@Nera Majer I tried on my local instance and everything works as expected. - If you have .gz file in local FS then try to fetch the file ListFile+FetchFile from your local FS(instead of HDFS) and check are you able to fetch the whole file without any issues?. - Move Local file to HDFS using the below command. hadoop fs -put <local_File_path> <hdfs_path> then check are u able to get the file size as 371kb in hdfs? - If yes then try to run ListHDFS+FetchHDFS processors to fetch the newly moved file into HDFS directory. - Some threads related to similar issue. https://community.hortonworks.com/questions/106925/error-when-sending-data-to-api-from-nifi.html https://issues.apache.org/jira/browse/NIFI-5879 ... View more

if possible please share processor configuration sreen-shot ... View more

@PP Include over() clause in your select query . Try with below query: select row_number() over(),* from testDB.testTable; Example: select row_number() over() as rn,* from ( select stack(2,1,"foo",2,"bar") as (id,name) )t; +-----+-------+---------+--+ | rn | t.id | t.name | +-----+-------+---------+--+ | 1 | 1 | foo | | 2 | 2 | bar | +-----+-------+---------+--+ "rn" is the row number column that we have added in the above result. ... View more

@Julio Gazeta Weird, i'm able to get the state value if i keep store state locally. Regards to GetMongo processor the flowfile attributes issue got resolved in NiFi-1.8 NIFI-5334 addressing this issue. As a word around to get required attribute refer to this link. ... View more

Thank you very much for the explanation regarding the work around to delete the row. ... View more

@Hemanth Vakacharla i think for this case we need to split the records one line each by using SplitRecord/SplitText processor. Then Using MergeContent processor we can do 500 MB splits by using this way we are not going to have splitting records in between. Flow: 1.SplitRecord/SplitText //split the flowfile 1 line each 2.MergeRecord/MergeContent //to get 500MB filesize To force merge flowfiles use MaxBigAge property like 30 mins..etc. In case if you are using Record oriented processors we need to define Record Writer/Reader with avro schema to read/write the flowfile. Refer to this link for more details regards to merge content processor. ... View more

NO! if you are trying to escape input to generate a sql query you should never roll your own sanitization unless you fully trust the input. THIS IS VULNERABLE TO SQL INJECTION! You should be using the '?' parameter substitution in your putsql stage. ... View more

@Shu I am sorry that i didnt mention this earlier, i actually use correlation attribute "filename" and i would be having 500 filenames/second. Thanks for the links. ... View more

Thanks @Shu ! It worked, I was using 'Return type' as auto instead of json in EvaluateJsonPath. Thanks for the reply 🙂 ... View more