Member since
04-27-2016
218
Posts
133
Kudos Received
25
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3151 | 08-31-2017 03:34 PM | |
6490 | 02-08-2017 03:17 AM | |
2712 | 01-24-2017 03:37 AM | |
9609 | 01-19-2017 03:57 AM | |
5200 | 01-17-2017 09:51 PM |
06-27-2016
06:27 PM
1 Kudo
You can use PutHDFS or FetchHDFS depending on your using. You need to set the properties Hadoop Configuration Resources in the processor which you can point to the location where you have core-site and hdfs-site configuration files. Make sure network connections are OK between NiFi and HDP. Also didnt understand your usecase fully, "Why you would like to use NiFI to copy files between HDFS directories?"
... View more
06-23-2016
10:18 PM
Got it resolved the issue is firewall on remote machine. I had to disable the firewall to make it work.( service iptables stop).
... View more
06-23-2016
09:30 PM
2016-06-23 17:00:36,333 ERROR [Timer-Driven Process Thread-3] o.a.nifi.remote.StandardRemoteGroupPort RemoteGroupPort[name=Remote Connection,target=http://host:7090/nifi] failed to communicate with http://host:7090/nifi due to java.net.SocketTimeoutException. I can access the target nifi instance with no issues.
... View more
Labels:
- Labels:
-
Apache NiFi
-
Cloudera DataFlow (CDF)
06-23-2016
03:42 PM
Thanks Sunile, the scenario is HDP in cloud and HDF on prem. Let me give a try.
... View more
06-23-2016
02:54 PM
I had to disable the processor and then I was able to delete the connection.
... View more
06-23-2016
02:41 PM
Labels:
- Labels:
-
Apache NiFi
-
Cloudera DataFlow (CDF)
06-22-2016
05:44 PM
Thank you Andrew, it helped me resolving my issue.
... View more
06-22-2016
04:45 PM
Just added relevant lines here. public static final Relationship SUCCESS = new Relationship.Builder().name("SUCCESS") .description("Success relationship").build(); if (msgText != null) { FlowFile flowFile = session.create(); flowFile = session.write(flowFile, new OutputStreamCallback() { public void process(final OutputStream out) throws IOException { try { out.write(msgText.getText().getBytes()); } catch (Exception e) { e.printStackTrace(); } } }); session.getProvenanceReporter().receive(flowFile, context.getProperty("MyProp").getValue()); session.transfer(flowFile, REL_SUCCESS); } queueConn.close(); session.commit();
... View more
06-22-2016
03:42 PM
Its a custom processor.
... View more