You can pull data from JMS using either queues or topics by using these processors: https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi.processors.standard.GetJMSTopic/index.html https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi.processors.standard.GetJMSQueue/index.html Those processors presently support ActiveMQ out of the box. It is pretty easy to add other vendors as well but we're going to make it even easier in an upcoming release. Once you pull data from JMS then you connect that processor's output to PutHDFS as explained here: https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi.processors.hadoop.PutHDFS/index.html You might find these templates useful to help get you started: https://github.com/hortonworks-gallery/nifi-templates/tree/master/templates Thanks Joe ... View more

Hello You've run into a bug. https://issues.apache.org/jira/browse/NIFI-1396, https://issues.apache.org/jira/browse/NIFI-21 Has been around for quite a while but someone else ran into recently. Should be sorted soon but if you're interested in contributing a fix please let us know. Thanks Joe ... View more

Thanks for reporting it and for providing the stack traces. Very helpful. I've filed an Apache NiFi JIRA for it https://issues.apache.org/jira/browse/NIFI-1417 ... View more

Hello. In looking at the API/products facebook offers that URL api.facebook.com/restserver.php was not something I could find. Can you point to the Facebook API documentation of the particular endpoint you wish to access? Also, the programmableweb entry you provided shows that authentication in the form of oauth, apikey, username/password is required. But, it sounds like those weren't set. Might be better to just implement a process to listen to/interact with the Facebook API. Thanks Joe ... View more

Hello @Sunile Manjee. As Andrew mentions the http://nifi.apache.org/quickstart.html does outline how to alter the settings to ensure the NiFi process is able to have sufficient open files. One common gotcha is that the setting is tied to a different user than your NiFi process is executed as and in making sure that the session NiFi starts with does indeed have that new open files setting reflected. Are you running 'bin/nifi.sh start' in the same terminal that you run 'ulimit -a' to see if the setting has taken effect? Another good technique you can use is to run 'lsof -p 12345' assuming the pid of NiFi is 12345 and it will show you all the open file handles that NiFi process has. Thanks Joe ... View more

Absolutely. Don't have a good timeline to offer at the moment but it is on the roadmap. Happy to talk it over further with you. Thanks! ... View more

Hello What the NiFi server exposes/provides is a RESTFul API. If you attach your web browser to it you'll get a visually friendly UI. You can lock down access via 2-Way SSL in HDF 1.0 and in the upcoming HDF 1.1 you can also do username/password with active directory or directory server via LDAP. Thanks Joe ... View more