Member since
07-08-2016
260
Posts
44
Kudos Received
10
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2439 | 05-02-2018 06:03 PM | |
4917 | 10-18-2017 04:02 PM | |
1587 | 08-25-2017 08:59 PM | |
2161 | 07-21-2017 08:13 PM | |
8659 | 04-06-2017 09:54 PM |
08-18-2016
09:41 PM
i think thats where its failing. the remote port on the input port is 9091. in the local NiFi i didn't set any remote port. so you are suggesting to set up a tunnel . what would be my local port for tunnel .?? i tried with local 9091 and to destination nifi remote 9091. but was getting the same error. i think its because its not using 9091 on local correct.?
... View more
08-18-2016
06:50 PM
We have a NiFi instance running on a remote server where we can only access ports thru SSH Tunneling from another server. So we setup a tunnel for nifi port 9090 and was able to successfully access it from a citrix server using http://localhost:10090/Nifi where port 10090 is tunneling to http://nifiserver:9090/Nifi. This scenario is working. i created input port and a putHDFS on the remote NiFi server and trying to access it from the NiFi instance on the citrix server , i am getting connection timeouts. The dataflow was able to recognise the fact that there is a remote port on the other machine. Also what is the reason behind the calling NiFi needing connectivity to remote port.? it would have been better if that is handled on the remote instance , because it can connect to the web port.(9090 here) . any ideas on what to do.?? 2016-08-18 13:03:40,919 ERROR [Timer-Driven Process Thread-8] o.a.nifi.remote.StandardRemoteGroupPort RemoteGroupPort[name=POV-HDFSInput,target=http://localhost:10090/nifi] failed to communicate with http://localhost:10090/nifi due to java.net.ConnectException: Connection timed out: no further information
... View more
Labels:
- Labels:
-
Apache NiFi
08-11-2016
04:29 PM
looks like by just doing correlation.id instead of {correlation.id} in the MergeProcess is doing the trick .
... View more
08-11-2016
04:14 PM
2 Kudos
Hi @Bryan Bende , @emaxwell something seems to be not correct..I am doing the same thing . but it is still mergeing all in to one file. here are some screen shots for your reference. I was testing this with 4 files in source folder 2 per each date. expecting the mergecontent to output 2 files. but its merging all in 1 file. here is my update attribute process after Fetch. and when I use data provenance I could correctly see the value like below..2 different correlation.Ids on 4 files as expected.(2 ids for 20121021 and 2 for 20121020) and here is how mergeprocess looks data provenance on the Mergeprocess JOIN type..
... View more
08-10-2016
08:44 PM
1 Kudo
Hi , where are you trying to load the files from ..?? i got the same error when i tried to upload files from my local HDF on to my VM. i solved that issue by doing these below . added below property to hdfs-site.xml <property><name>dfs.client.use.datanode.hostname</name><value>true</value></property> added a port forwarding rule in my VM to 50010 added 127.0.0.1 localhost sandbox.hortonworks.com to my local hosts file.
... View more
08-10-2016
07:57 PM
1 Kudo
Hi ,I have 1000 files in a folder , file names have date(yyyymmdd) in it. for ex data_20160810.csv...i have 200 files per each day (so 5 days files). I want merge those files by date . so if successful, i my output folder will contain 5 merged files one for each day. i am trying to do this by "Correlation Attribute Name" property..but still it is not merging in groups. what am i doing wrong.?
... View more
Labels:
- Labels:
-
Apache NiFi
08-09-2016
08:41 PM
Awesome ,thanks. that worked.
... View more
08-09-2016
07:41 PM
I am using MergeContent processor to Merge 20 small .csv files in to one file. All of them are similar with same header. The files are getting merged successfully but when i opened the destination file i am seeing 20 headers (one header for each file). is there some setting that i can do where i can have header only once in the Merged file.?
... View more
Labels:
- Labels:
-
Apache NiFi
08-09-2016
07:32 PM
i think changing the run schedule worked. thank you.
... View more
08-05-2016
04:37 PM
Hi, I have 74 files in a directory , and i am Merging those with max 20 files and min 4 files defined as in my process below. If you look at the dataflow , MergeContent only processed 73 out of 74 and left 1 file in the queue. when i looked at data province and it showed 4 merged files 3 with merge count 20 and 1 with merge count 13. i was expecting 4 files 3 with merge count 20 and 1 with merge count 14. any idea why it is doing it and what can we do to correct it.?
... View more
Labels:
- Labels:
-
Apache NiFi
- « Previous
- Next »