About naga_satish

naga_satish · ‎04-26-2021

I'm new to NiFi. How to run this command to clear state of a nifi processor. Do we need tokenid or some thing else to run this?

naga_satish · ‎12-01-2020

@stevenmatisonIn the link that you provided, they explained how to setup HWX schema registry. But I don't have access for HWX schema registry. So I wanted to go ahead with AvroSchemaRegistry controller service. Could you please show how to add schemas to AvroSchemaRegistry and use them dynamically according to filename. Thanks.

naga_satish · ‎11-30-2020

@stevenmatison That's precisely what I did. Every column in processed file is empty. just header name and delimiters are present.

naga_satish · ‎11-30-2020

I have 20 CSV files and I need to convert these files into parquet format before loading them to S3. I prepared schemas for 20 files(different schema for each file). For this to work I need to route all these files using route on attribute and process. This works but it create flow with 20 convert record processors. I want to know is there a way that I can store all these 20 schemas and I can use them according to filename with single convert record processor. Thanks.

naga_satish · ‎11-30-2020

@stevenmatison I already tried using convert record processor with the configurations that you mentioned. I use InferSchema as schema strategy. this configuration throughs an error. It says index for header "Created_Date__c" is 1 but csv record have only one value. Not sure what is this error. When I set schema strategy as "use string fields from header" entire data is messed up. When I set schema strategy as schema text everything is empty, just delimiters and header is present.

naga_satish · ‎11-27-2020

I have some pipe delimited files. Each field is bounded by quotes like this. "Created_Date__c"|"CreatedById"|"CreatedDate"|"Guid_c" "2020-03-02 00:00:00"|"0053i000002XCpAAG"|"2020-03-02 16:01:34"|"94bf83ccf9daf610VgnVCM100000307882a2RCRD" "2020-03-03 00:00:00"|"0053i000002XCpAAG"|"2020-03-03 09:15:56"|"1a4bb238cdedd610VgnVCM100000307882a2RCRD" "2020-03-03 00:00:00"|"0053i000002XCpAAG"|"2020-03-03 09:52:33"|"22408baca6fee610VgnVCM100000307882a2RCRD" I need to cleanse this data and the needs to look like this. Created_Date__c|CreatedById|CreatedDate|Guid_c 2020-03-02 00:00:00|0053i000002XCpAAG|2020-03-02 16:01:34|94bf83ccf9daf610VgnVCM100000307882a2RCRD 2020-03-03 00:00:00|0053i000002XCpAAG|2020-03-03 09:15:56|1a4bb238cdedd610VgnVCM100000307882a2RCRD 2020-03-03 00:00:00|0053i000002XCpAAG|2020-03-03 09:52:33|22408baca6fee610VgnVCM100000307882a2RCRD I tried using ReplaceText with these configurations. search value - ^"(.*)"$ and Replacement Value - $1. But these configurations is not working and the file is routing to failure. not sure what might be the issue. open to other suggestions. Thanks in advance.

Online	Offline
Last Visited	‎04-27-2021 10:09 AM

Member Since	‎11-20-2020 09:49 AM
Last Visited	‎04-27-2021 10:09 AM
Posts	9

Cloudera Community

Re: How do I clear state automatically on ListS3 P...

Re: Storing schemas in NiFi

Re: How to extract fields enveloped in quotes in N...

Storing schemas in NiFi

Re: How to extract fields enveloped in quotes in N...

How to extract fields enveloped in quotes in NiFi?