I am roughly following this tutorial. I am using ambari cluster, but I am using it locally. https://www.tutorialspoint.com/apache_pig/apache_pig_storing_data.htm The student_data.txt file is on the above page. In pig -x mapreduce I get: 1. student = LOAD 'user/admin/Pig_Data/student_data.txt'
USING PigStorage(',')
as ( id:int, firstname:chararray, lastname:chararray, phone:chararray,
city:chararray );
2. STORE student INTO '/Pig_Output/' USING PigStorage (','); I get: Input(s):
Failed to read data from "hdfs://c7001.ambari.apache.org:8020/user/vagrant/user/admin/Pig_Data/student_data.txt"
Output(s):
Failed to produce result in "file:///Pig_Output" Why is the store command trying to read data from "hdfs://c7001.ambari.apache.org:8020/user/vagrant/user/admin/Pig_Data/student_data.txt" Where is this coming from??? I put the file in HDFS as hdfs dfs -put student_data.txt 'user/admin/Pig_Data/student_data.txt' I am assuming that the cluster is saving my files on the ambari-server node c7001.ambari.apache.org is the amber-server node/namenode, port 8020 ???? I am logged on one pig clients as vagrant, but where does the /user/vagrant come from??
... View more
