About amittal6_

amittal6_ · ‎07-24-2018

It works .. Thanks you

amittal6_ · ‎07-24-2018

@Matt Clarke above command gives the following error . The specified resource could not be found.curl: (6) Could not resolve host: Content-Type; Name or service not known

amittal6_ · ‎07-18-2018

Is there any way where we can provide nifi processor group variables when executing the process group from rest api as parameter

amittal6_ · ‎06-11-2018

You can try removing your .m2 directory and then retry the build .. Or manually copy the jar to the directory and then try.

amittal6_ · ‎06-07-2018

Appreciate your response ! I did the same using the Advanced property section of UpdateAttribute to create rules and actions as i have to append leading 0's since I need the fragment index appended in three digit like 001,020,100 ... I have created three rules to check if the fragment index is less than 10 then make fragment.index = 00${fragment.index} if it is more than 9 and less than 100 then fragment.index = 0${fragment.index} else fragment.index = ${fragment.index}

amittal6_ · ‎06-07-2018

Thanks ! I also did manage to do by the same way ! But there is one thing which needs to be tweaked . Since I am using selectHiveQl Processor for fetching the data from hive and then routing the files to split processor if file size is greater than 2 GB . For all the unmatched files i.e files with size less than 2 GB will not have fragment.index attribute associated with them as they are passed through split text processor . So You need to add the suffix tableName_001 using the update attribute processor to the table name attribute as it will not take the ${fragment.index} as it is null .

amittal6_ · ‎06-06-2018

I am doing the following stuff in nifi : Fetching data from tables in hive and then routing the flow files based on size : If flowfile size is gt 2GB then split the flow file to multiple flow files of 2Gb each. I want to use update attribute to name those splits like TableName_001_001,Tablename_001_002,Tablename_001_003 for a particular flow file or table . When next flow file comes in the split it should also be named like above . Is there any way we can do with the existing processor ?

amittal6_ · ‎05-25-2018

@Matt Clarke @Matt Burgess @Shu I have created a process group with following requirements in Nifi : Fetch data from hive table >> Encrypt content >> upload to azure blob storage . Now I have 3000 tables for which the above flow needs to be scheduled . Is there any way to use only single flow for all the tables instead of creating 3000 flows for each table . Also I want to execute the azure storage for some of the tables not for all . Is there any way to give instruction in the flow based on any condition that Table 1 should go to only gcloud and not on Azure . Similarly I want Table 2 to go to both azure and gcloud. Thanks In Advance

amittal6_ · ‎05-15-2018

@Matt Burgess Thank you for clarification ! Cheers

amittal6_ · ‎05-14-2018

Can anybody explain the Fetch Size,Maximum Number of Fragments properties with examples .

Online	Offline
Last Visited	‎01-08-2020 07:19 AM

Member Since	‎04-19-2018 06:43 AM
Last Visited	‎01-08-2020 07:19 AM
Posts	32
Kudos received	4

Cloudera Community

Re: Provide nifi variable from nifi rest API

Re: Provide nifi variable from nifi rest API

Provide nifi variable from nifi rest API

Re: How to create a custom processor in nifi 1.5.0...

Re: Naming splitted files incrementally in nifi fo...

Re: Naming splitted files incrementally in nifi fo...

Naming splitted files incrementally in nifi for a ...

Schedule a single nifi process group for multiple ...

Re: SelectHiveQl properties(Fetch Size,Maximum Num...

SelectHiveQl properties(Fetch Size,Maximum Number ...