Hi @vinay kumar, I think your partitioning is wrong you are not using "/" for hdfs directory. If you want use full disk capacity, you can create any folder name under "/" example /data/1 on every data node using command "#mkdir -p /data/1" and add to it dfs.datanode.data.dir. restart the hdfs service. You should get the desired output. ... View more

@Jeremy Salazar you mean HDFS Ambari view? That won't work, it's too big of a file to upload via Ambari view. Consider using CLI. ... View more

@ali hadi additionally http://hortonworks.com/hadoop-tutorial/nlp-sentiment-analysis-retailers-using-hdp-itc-infotech-radar/ http://hortonworks.com/hadoop-tutorial/how-to-refine-and-visualize-sentiment-data/ and a video http://hortonworks.com/use-cases/sentiment-analysis-hadoop-example/ ... View more

I think I have now understood the calculation displayed on the Ambari Dashboard and NN Web UI. What confused me is the information displayed under the 'hosts' link, which displays all nodes with their hard disk consumption. The figure shown for each node (on placing the mouse over the bar), does not match with the DFS consumption. The hdfs dfsadmin -report command displays the consumption of the node on which I executed the command, which is fine. I understood this calculation after you posted the information from your cluster, so thanks again! ... View more

Can someone please help me with the below error while moving a file from local drive to hdp? [root@sandbox-hdp ~]# ssh root@127.0.0.1 -p 22 The authenticity of host '127.0.0.1 (127.0.0.1)' can't be established. RSA key fingerprint is 9c:3a:83:80:2c:d5:1f:a9:41:48:68:96:4d:0f:bb:ed. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added '127.0.0.1' (RSA) to the list of known hosts. root@127.0.0.1's password: Last login: Fri Dec 15 17:45:44 2017 from 127.0.0.1 [root@sandbox-hdp ~]# scp -P 22 /Users/me/test/Input/movies_initial.csv.gz root@sandbox-hdp.hortonworks.com:root/Input root@sandbox-hdp.hortonworks.com's password: /Users/me/test/Input/movies_initial.csv.gz: No such file or directory , I am facing the below error while moving a file from local directory(Mac) to Hortonworks. Can someone please help? [root@sandbox-hdp ~]# ssh root@127.0.0.1 -p 22 The authenticity of host '127.0.0.1 (127.0.0.1)' can't be established. RSA key fingerprint is 9c:3a:83:80:2c:d5:1f:a9:41:48:68:96:4d:0f:bb:ed. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added '127.0.0.1' (RSA) to the list of known hosts. root@127.0.0.1's password: Last login: Fri Dec 15 17:45:44 2017 from 127.0.0.1 [root@sandbox-hdp ~]# scp -P 22 /Users/me/Hadoop/Input/movies_initial.csv.gz root@sandbox-hdp.hortonworks.com:root/Input root@sandbox-hdp.hortonworks.com's password: /Users/me/Hadoop/Input/movies_initial.csv.gz: No such file or directory ... View more

@Michael DURIEUX please accept the best answer. ... View more

@Alan McShane Thanks for sharing this information. Did you get any information on Bug number? ... View more

@Swapnil Prabhu please run HDFS service check and report results. ... View more

@Neeraj Sabharwal @Artem Ervits Thank you so much guys.. ... View more

https://community.hortonworks.com/articles/149910/handling-hl7-records-part-1-hl7-ingest.html https://community.hortonworks.com/articles/149891/handling-hl7-records-and-storing-in-apache-hive-fo.html https://community.hortonworks.com/articles/149982/hl7-ingest-part-4-streaming-analytics-manager-and.html https://community.hortonworks.com/articles/150026/hl7-processing-part-3-apache-zeppelin-sql-bi-and-a.html Attribute Name Cleaner (Needed for messy C-CDA and HL7 attribute names) https://github.com/tspannhw/nifi-attributecleaner-processor ... View more