Member since
07-03-2018
5
Posts
0
Kudos Received
0
Solutions
08-01-2018
02:06 PM
Hello Bryan, Thanks for the quick answer. I have no problem about the datatype, in my case every field of JSON is going to be long type. Im stuck on finding a reader that can manage dynamic JSON keys. For example 1st flow file: ... { "id_4344" : "1532102971, "id_4544" : 1532102972 } ... 2nd flow file: ... { "id_7177" : "1532102972, "id_8154" : 1532102972 } ... I need to find out how to read those ids that change in everyflowfile. Meanwhile i'll try your suggestion. Thanks.
... View more
08-01-2018
10:49 AM
Hello guys, I want to transform JSON to Parquet, i followed a tutorial and my current flow is functionally. My problem is that i need to create parquet schema's dynamically. Every schema needs to get generated reading attributes/content of the incoming flowfile. Putparquet processor uses a RecordReader. I found this processor called ScriptedReader but i have no idea about how i can generate a schema and use it for PutParquet processor. Does anyone now how to use it? Or, are there any alternatives about creating a schema dynamically for Putparquet processor? Thanks in advice.
... View more
Labels:
- Labels:
-
Apache NiFi
07-03-2018
01:09 PM
Hello, i would like to pass to ListSFTP processor some variables from DB but as far i know, this processor does not accept any flowfile as input. Is there a way to override processor group variables? Other solutions are accepted aswell. Thanks
... View more
07-03-2018
08:02 AM
Hello guys, i recently started using NiFi 1.5.0, i want to transfer some files from sftp to S3. I want to get the variables necessary for ListSFTP ( like ssh_key, username, ecc) from a DB fetching with executeSQL processor. I want to override the processor group variables with executeScript, do you have any ideas? Or is there a way to pass variables to ListSFTP dynamically? Thanks in advice
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache NiFi