Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

stream data from web site using nifi

avatar
Rising Star

this is the first time that i use nifi ,so how i can stream data from web site to hdfs using nifi ; there is template for this ?? if not how i can do it ,which processor i can used it ? thx

1 ACCEPTED SOLUTION

avatar
Master Mentor
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login
6 REPLIES 6

avatar
Master Mentor

avatar
Master Mentor
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login

avatar
Rising Star

@Neeraj Sabharwal

thx for your help , now i use template twitter to stream data but i get this error

Permission denied: user=root, access=WRITE, inode="/nifi/tweets/.668434832146110.json":hdfs:hdfs:drwxr-xr-x

how i can change permission to make user root can write to hdfs ,also whene i try to manage my     files  or change permission (i connect as admin  in ambari ) i get the same error for the user 
admin

avatar
Master Mentor

@nejm hadj That's good progress!!!

Now, Please do this

login as user root in your machine

su - hdfs

hdfs dfs -chown -R root:hdfs /nifi

exit

This should fix permission issue.

avatar
Master Mentor

@nejm hadj For admin user

http://docs.hortonworks.com/HDPDocuments/Ambari-2.2.0.0/bk_ambari_views_guide/content/_setup_HDFS_us...

  1. Connect to a host in the cluster that includes the HDFS client.
  2. Switch to the hdfs system account user.
    su - hdfs
  3. Using the HDFS client, make an HDFS directory for the user. For example, if your username is admin, you would create the following directory.
    hadoop fs -mkdir /user/admin
  4. Set the ownership on the newly created directory. For example, if your username is admin, you would make that user the directory owner.
    hadoop fs -chown admin:hadoop /user/admin

avatar
Rising Star

Thx it is work