Member since
09-12-2017
21
Posts
4
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2637 | 12-13-2017 07:16 AM |
12-21-2017
05:48 AM
1 Kudo
Hi Timothy, Am sorry for the delay, i have created a thread long back for the issue would you please look into it and help me to resolve the issue. Help is highly appreciated. https://community.hortonworks.com/questions/147666/facing-issues-with-date-and-timestamp-columns.html?childToView=155178#answer-155178
... View more
12-21-2017
05:43 AM
loadingdatafrom-hive-to-postgres.xml I have attached the XML for the reference , please check and let me know what am doing wrong here. please help me to resolve the issue
... View more
12-20-2017
06:50 AM
Can anybody please respond on my question, am new to Nifi the issue i find here is am using SelectHiveQl Processor to connect with Hive and get the data while getting the date it is trying to read the Date Columns as String ( {"name":"join_date","type":["null","string"]}) this the main issue i found. I have gone through few blogs regarding this they told me to use Update Atrribute processor to convert the string to Date as like below but no result. ${field.value:toDate('yyyy-mm-dd HH:mm:ss.SSS'):toNumber()} I have tried the same with QueryDatabaseTable Processor where we have an option of Boolean Property Use Avro Logical Types set to True but it is not worked it raised another issue. QueryDatabaseTable[id=590aae62-0160-1000-ffff-ffffdb58c844] Unable to execute SQL select query SELECT * FROM test.DatesTable due to org.apache.nifi.processor.exception.ProcessException: Error during database query or conversion of records to Avro.: org.apache.nifi.processor.exception.ProcessException: Error during database query or conversion of records to Avro. Am not sure how to resolve this issue. i found in one blog if the Avro format is like this ( {"name":"join_date","type":["null",{"type":"int","logicalType":"date"}]} ) it works but am not sure how to get this avro format with select HiveQL or QueryDatabaseTable processor. Help is highly appreciated.
... View more
12-15-2017
09:07 AM
Hi Matt, Am facing the same issue with QueryDatabaseTable Error during database query or conversion of records to Avro.: org.apache.nifi.processor.exception.ProcessException: Error during database query or conversion of records to Avro.) the comment which you provided i didnt understood, am new to nifi, can you please help me to resolve the issue, what need to be done
... View more
12-13-2017
07:16 AM
1 Kudo
yes, we have call it I have done it with PostHttp Processor.
... View more
12-07-2017
10:49 AM
1 Kudo
Hi Am new to Nifi is there any chance to run the Zeppelin Note Book play button from the Nifi processor, would you please help to give an example to acheive this.
... View more
Labels:
- Labels:
-
Apache NiFi
11-15-2017
09:28 AM
@Abdelkrim Hadjidj any inputs on this question..Thanks in advance.
... View more
11-14-2017
12:46 PM
Am working on one requirement , it is simple loading the data from Hive to Postgresql using apache nifi. My processors are SelectHiveQL--->SplitAvro--->PutDatabaseRecord. SelectHiveQL get the data from Hive, in hive we have many columns but facing issues with Date Column and Timestamp Coloumns. In putDatabaseRecord am getting error as ":"PutDatabaseRecord[id=cecd3d18-f1d2-1d39-9e48-d4be96170480]
Failed to process
StandardFlowFileRecord[uuid=1bb1f4cf-3b06-4c0a-aaea-4156a3953ce9,claim=StandardContentClaim
[resourceClaim=StandardResourceClaim[id=1510654697269-11, container=default,
section=11], offset=186544,
length=4932],offset=0,name=64863335688318.avro,size=4932] due to
java.sql.BatchUpdateException: Batch entry 0 INSERT
INTO some XXXX Columns was
aborted: ERROR: column \"XXXdate\" is of type date but
expression is of type character varying\nHint: You will need to rewrite or cast the expression.\nPosition: 932Call getNextException to see other errors in the batch.:
","timestamp":"06:14:09
EST"}}],"generated":"06:16:37 EST"}} Would you please guide me to resolve the issue, do i need add any processor in the flow, how to come out of this issue Thanks in advance.
... View more
Labels:
- Labels:
-
Apache NiFi