Member since
02-11-2021
31
Posts
5
Kudos Received
0
Solutions
06-15-2022
01:23 AM
I have used invokeHTTP in 1.12 version without SSL cert and works fine, however new version 1.16 doesn't. Any settings available to ignore?. Ex: I connect to SQL server with JDBCConnection with property trustServerCertificate=true; post which it works without certifcates.
... View more
06-08-2022
10:23 PM
While querying postgres database using ExecuteSQL Processor 1.16.1 converts the date into UTC format. However my target system requirement is to store data in local timezone. This happens only if you set the AVRO logical data type to True. If Avro logical types set to false then it returns the localtime. I have few 100 date fields and i cannot convert each of these from the source. How do i force the ExecuteSQL with AVRO type set to return the date as-is from the source. When Avro Type set to false : "install_date" : "2018-07-20 13:31:25.733" When Avro Type set to true: "install_date" : "2018-07-20T05:31:25.733Z",
... View more
Labels:
- Labels:
-
Apache NiFi
06-08-2022
12:51 AM
@acoast83 Even with 1.16 iam facing this issue. Any global workaround?.
... View more
06-07-2022
07:09 AM
@mburgess is there a way i can access the lineage duration from a update attribute processor. I like to store this in a database along with other meta information for analysis.
... View more
06-06-2022
07:47 AM
@geepark Iam also facing simillar issue. How you got this resolved?. PutHive3Streaming[id=38c56b98-0181-1000-0000-000077757de2] Failed to properly initialize Processor. If still scheduled to run, NiFi will attempt to initialize and run the Processor again after the 'Administrative Yield Duration' has elapsed. Failure is due to java.lang.NoClassDefFoundError: org/apache/hadoop/tracing/SpanReceiverHost java.lang.NoClassDefFoundError: org/apache/hadoop/tracing/SpanReceiverHost at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:634) at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:619) at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:149)
... View more
03-02-2021
08:55 AM
How to perform the same for the very first occurrence of [ and last occurrence of ].
... View more
02-26-2021
01:12 AM
@mburgess The challenge is that i dont want to handle specific columns as i have more than 100 tables and may be 500 Date fields. It has be to generic. The Execute SQL has the logical Data type which converts every datetime to Hive Datetime automatically which works good for SQL Database source. For JSON format and manually setting up each conversion is a tough option.
... View more
02-24-2021
08:58 AM
Hi Experts I need some help in handling ISO8601 data type. I get salesforce data in which all the date fields comes in the format as "2015-12-08T08:19:00.000+0000" which is not accepted by Hive3streaming where the target datatype is Timestamp or date. The hive streaming tries to convert to timestamp however throw errors as number format exception. How can I convert these data type fields automatically?. Each tables at least have 10-20 date fields in this format and i have more than 100 tables. I used InvokeHTTP to get the JSON data from Salesforce. Any help on this is really appreciated.
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache NiFi
02-24-2021
08:23 AM
How can i convert some of the fields based on this validation?. Can i perform validation based on a particular data type alone?. Thanks
... View more
02-18-2021
03:19 AM
NIFI Version : 1.12 Iam able to load the data using PutHive3Streaming processor for tables without timestamp datatype. However if the Hive table contains Timestamp field then the load fails with below error. WARN [Timer-Driven Process Thread-7] o.a.n.processors.hive.PutHive3Streaming PutHive3Streaming[id=01751042-d64d-1d24-cd20-5b2a9e1ea92b] Error [java.lang.NumberFormatException: For input string: "2018-10-20 21:30:03.493"] Any help here is highly appreciated.
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache NiFi
- « Previous
- Next »