Member since
05-10-2016
303
Posts
35
Kudos Received
0
Solutions
11-25-2016
11:57 AM
Hi @mayki wogno The first error message was also written by the same error with the second error message. The processor reported the error twice, because it logged an error message when the ListHDFS processor caught the exception, then re-throw it, and NiFi framework caught the exception and logged another error message. When NiFi framework catches an exception thrown by a processor, it yields the processor for the amount of time specified by 'Yield Duration'. Once the processor successfully accesses core-site.xml and hdfs-site.xml, both error messages will be cleared.
... View more
11-15-2016
02:05 PM
dont do the SCP part. the files will get downloaded from the NCM when the node connects to it.
... View more
11-14-2016
05:16 PM
This issue is fixed in Apache. https://issues.apache.org/jira/browse/HDFS-9184 . However this might be in a future apache release as this has been fixed very recently.
... View more
07-20-2017
01:07 PM
I post the data using following curl command: curl -H "hdfsdir:/Sandbox_Zone/Test/Landing_Zone/TestDir" -H "year:2017" -H "month:07" --data-binary "@client_mandate.csv" http://test:7000/hdfs_push In the ListHttp processor I have specified the following as regex to read headers: hdfsdir|year|month Then I correctly get the attribtues as hdfsdir, year and month
... View more
10-24-2016
09:23 AM
@mclark Thanks !
... View more
10-20-2016
02:18 PM
@Timothy : I got this flow I'm use for testing this curl curl -i -v -F file=@/var/opt/hosting/log/flume/flume-a1.log http://nifi011:10000/contentListener
RouteOnAttribute has properties (abc ==> ${filename:contains('flume')} Why flume log not send tu HDFS ?
... View more
10-31-2016
10:52 PM
1 Kudo
@Ayub Khan you can grep "ExternalStatu" or "Status" in the log with workflow id.
... View more
10-10-2016
09:22 AM
2 Kudos
@mayki wogno There is a chance that the master might be went down while creating the znode or system catalog table data might be deleted from hdfs You can connect to zookeeper and remove the znode from zookeeper and create connection. The znode path is {zookeeper.znode.parent}/table/SYSTEM.CATALOG. Connect to zookeeper with this command ./hbase zkcli Remove znode from zk client: rmr /hbase-unsecure/table/SYSTEM.CATLOG
... View more