stream data from web site using nifi

[#1]

this is the first time that i use nifi ,so how i can stream data from web site to hdfs using nifi ; there is template for this ?? if not how i can do it ,which processor i can used it ? thx

[#2]

@nejm hadj here are all templates https://cwiki.apache.org/confluence/display/NIFI/Example+Dataflow+Templates

Take a look at GetHTTP processor for your task https://nifi.apache.org/docs.html

[#3 · Accepted solution]

@nejm hadj

See this

https://community.hortonworks.com/repos/6119/apache-nifi-template-rpo.html or

https://github.com/hortonworks-gallery/nifi-templates

Now , let's take twitter example

https://community.hortonworks.com/repos/8587/storm-demo-to-monitor-tweets.html

https://community.hortonworks.com/repos/10062/single-view-demo.html

[#4]

@Neeraj Sabharwal

thx for your help , now i use template twitter to stream data but i get this error

Permission denied: user=root, access=WRITE, inode="/nifi/tweets/.668434832146110.json":hdfs:hdfs:drwxr-xr-x

how i can change permission to make user root can write to hdfs ,also whene i try to manage my     files  or change permission (i connect as admin  in ambari ) i get the same error for the user 
admin

[#5]

@nejm hadj That's good progress!!!

Now, Please do this

login as user root in your machine

su - hdfs

hdfs dfs -chown -R root:hdfs /nifi

exit

This should fix permission issue.

[#6]

@nejm hadj For admin user

http://docs.hortonworks.com/HDPDocuments/Ambari-2.2.0.0/bk_ambari_views_guide/content/_setup_HDFS_us...

1. Connect to a host in the cluster that includes the HDFS client.
2. Switch to the hdfs system account user.

   su - hdfs

3. Using the HDFS client, make an HDFS directory for the user. For example, if your username is admin, you would create the following directory.

   hadoop fs -mkdir /user/admin

4. Set the ownership on the newly created directory. For example, if your username is admin, you would make that user the directory owner.

   hadoop fs -chown admin:hadoop /user/admin

[#7]

Thx it is work