Re: NiFi Replace Text: how t0 replace string " [{"...

Althotta · ‎03-02-2021

How to perform the same for the very first occurrence of [ and last occurrence of ].

Althotta · ‎02-26-2021

@ mburgess The challenge is that i dont want to handle specific columns as i have more than 100 tables and may be 500 Date fields. It has be to generic. The Execute SQL has the logical Data type which converts every datetime to Hive Datetime automatically which works good for SQL Database source. For JSON format and manually setting up each conversion is a tough option.

Althotta · ‎02-24-2021

Hi Experts I need some help in handling ISO8601 data type. I get salesforce data in which all the date fields comes in the format as "2015-12-08T08:19:00.000+0000" which is not accepted by Hive3streaming where the target datatype is Timestamp or date. The hive streaming tries to convert to timestamp however throw errors as number format exception. How can I convert these data type fields automatically?. Each tables at least have 10-20 date fields in this format and i have more than 100 tables. I used InvokeHTTP to get the JSON data from Salesforce. Any help on this is really appreciated.

Althotta · ‎02-24-2021

How can i convert some of the fields based on this validation?. Can i perform validation based on a particular data type alone?. Thanks

Althotta · ‎02-24-2021

Iam also having the same issue.I have multiple fields and multiple files coming with this format. Any generic way to handle this?. Are there any sample for the validate processor and conversion of these fields?. Thanks in advance.

Althotta · ‎02-18-2021

NIFI Version : 1.12 Iam able to load the data using PutHive3Streaming processor for tables without timestamp datatype. However if the Hive table contains Timestamp field then the load fails with below error. WARN [Timer-Driven Process Thread-7] o.a.n.processors.hive.PutHive3Streaming PutHive3Streaming[id=01751042-d64d-1d24-cd20-5b2a9e1ea92b] Error [java.lang.NumberFormatException: For input string: "2018-10-20 21:30:03.493"] Any help here is highly appreciated.

Online	Offline
Last Visited	‎03-17-2021 01:56 AM

Date Registered	‎02-11-2021 02:26 AM
Last Visited	‎03-17-2021 01:56 AM
Total Messages Posted	6

Re: NiFi Replace Text: how t0 replace string " [{"...

Re: NIFI Convert ISO 8601 Data type and HIVE Strea...

NIFI Convert ISO 8601 Data type and HIVE Streaming

Re: Using Apache NiFi to Validate that Records Adh...

Re: Nifi TImeStamp check for JSON record?

NIFI Puthive3streaming Timestamp Number format exc...