Member since
07-31-2016
30
Posts
0
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1883 | 05-11-2017 11:38 PM |
06-26-2017
07:54 PM
Above is a local terminal where I have ssh'd into the VM??? Below is the VirtualBox VM???? There are not the same machine and where does Docker fit into all of this? Thanks for any clarification John
... View more
Labels:
- Labels:
-
Docker
06-26-2017
07:36 PM
Sorry tutorial below. The traffic pattern hdf tutorial https://hortonworks.com/tutorial/analyze-traffic-patterns-with-apache-nifi/section/3/
... View more
06-26-2017
07:35 PM
I am following the instructions here. Below is the screenshot: What does this mean as I am using VirtualBox?
... View more
06-07-2017
08:08 AM
Thanks, I added that / and it did get rid of the user/vagrant but still no mapreduce. I am going to start a new topic, because this one is essentially answered, but my real underlying problem has not been resolved.
... View more
06-07-2017
07:05 AM
The above is from grunt. Specifically pig -x mapreduce. The output is: Input(s): Failed to read data from "hdfs://c7001.ambari.apache.org:8020/user/vagrant/user/admin/Pig_Data/student_data.txt" Output(s): Failed to produce result in "file:///Pig_Output" see above posting I will post the entire output in a few minutes ... it is rather long.
... View more
06-06-2017
10:39 PM
I am roughly following this tutorial. I am using ambari cluster, but I am using it locally. https://www.tutorialspoint.com/apache_pig/apache_pig_storing_data.htm The student_data.txt file is on the above page. In pig -x mapreduce I get: 1. student = LOAD 'user/admin/Pig_Data/student_data.txt'
USING PigStorage(',')
as ( id:int, firstname:chararray, lastname:chararray, phone:chararray,
city:chararray );
2. STORE student INTO '/Pig_Output/' USING PigStorage (','); I get: Input(s):
Failed to read data from "hdfs://c7001.ambari.apache.org:8020/user/vagrant/user/admin/Pig_Data/student_data.txt"
Output(s):
Failed to produce result in "file:///Pig_Output" Why is the store command trying to read data from "hdfs://c7001.ambari.apache.org:8020/user/vagrant/user/admin/Pig_Data/student_data.txt" Where is this coming from??? I put the file in HDFS as hdfs dfs -put student_data.txt 'user/admin/Pig_Data/student_data.txt' I am assuming that the cluster is saving my files on the ambari-server node c7001.ambari.apache.org is the amber-server node/namenode, port 8020 ???? I am logged on one pig clients as vagrant, but where does the /user/vagrant come from??
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Pig
06-01-2017
03:39 AM
For some reason hadoop.proxyuser.root.hosts=c7001.ambari.apache.org??? I changed it to * and I can now upload files.
... View more
06-01-2017
02:56 AM
My proxy users for both root and admin are *. 1. What does the * mean? 2. I have noticed that I get 192.168.70.104/5 in the error message ... these are my data nodes. So I will change the * to a comma separated list of the datanodes (for the proxy hosts) and see what happens thanks
... View more
05-31-2017
11:36 PM
1. I am using HDP 2.6 and ambari 2.5. on a 5 node cluster. The cluster was setup with vagrant following these instructions https://cwiki.apache.org/confluence/display/AMBARI/Quick+Start+for+New+VM+Users . The base box is Centos 7.0 2. I am trying to use File View and I cannot upload a file. I get: Unauthorized connection for super-user: root from IP 192.168.70.104 3. In Ambari Web. I logged in admin/admin. I have followed the instructions https://docs.hortonworks.com/HDPDocuments/Ambari-2.1.0.0/bk_ambari_views_guide/content/_configuring_your_cluster_for_files_view.html and created a proxy for admin, I changed the settings to 777. I also added admin as a user of this File View instance. 4. I have the sandbox setup and I can upload files on the sandbox. 5. If I vagrant ssh c7001.ambari.apache.org (node with ambari-server running) I can put a file into the hdfs and it shows up in the file view under /user/admin (The default directory that I set up see (3). ) However, I cannot upload anything from my local filesystem with File View.
... View more
Labels:
- Labels:
-
Apache Ambari