Member since
02-08-2016
36
Posts
18
Kudos Received
4
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1434 | 12-14-2017 03:09 PM | |
2386 | 08-03-2016 02:49 PM | |
4413 | 07-26-2016 10:52 AM | |
3777 | 03-07-2016 12:47 PM |
03-01-2016
01:01 AM
When testing the example I got this error 😕 : 16/03/01 01:57:29 INFO mapreduce.Job: Task Id : attempt_1456773989186_0006_r_000001_2, Status : FAILED
Error: java.lang.RuntimeException: PipeMapRed.waitOutputThreads(): subprocess failed with code 1
at org.apache.hadoop.streaming.PipeMapRed.waitOutputThreads(PipeMapRed.java:322)
at org.apache.hadoop.streaming.PipeMapRed.mapRedFinished(PipeMapRed.java:535)
at org.apache.hadoop.streaming.PipeReducer.close(PipeReducer.java:134)
at org.apache.hadoop.io.IOUtils.cleanup(IOUtils.java:244)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:459)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:392)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
... View more
03-01-2016
12:59 AM
1 Kudo
@Neeraj Sabharwal Thank u for your answer
... View more
03-01-2016
12:57 AM
@Artem Ervits thanks 🙂
... View more
02-29-2016
10:18 PM
3 Kudos
Hi all, I was following this tutorial: http://hortonworks.com/blog/using-r-and-other-non-java-languages-in-mapreduce-and-hive/ and I couldn't find hadoop-streamingxxxx.jar. I'm using a cluster with hdp-2.3.4.0-3485. Does any know where to find it or how to add it ? Thanks 🙂
... View more
Labels:
- Labels:
-
Apache Hadoop
02-29-2016
08:26 AM
1 Kudo
Thanks all, I used this method to setup the hostname and it worked ! My cluster is running now 🙂
... View more
02-24-2016
12:24 PM
1 Kudo
I added this lines to /etc/hosts in every VM
10.10.10.1 VM1.local VM1
10.10.10.2 VM2.local VM2
10.10.10.3 VM3.local VM3
10.10.10.4 VM4.local VM4
Now i'm able to use "ping VMx" from every VM and ssh user@VMx works too. hostname -f returns VMx.local is this fine ?
... View more
02-24-2016
11:55 AM
1 Kudo
Hi all, I've 4 VMs on a vps with internet access through a rebond but not visible from the internet. My problem is that i couldn't set the FQDN for each VM. I added this line to /etc/hosts for every VM: "10.10.10.x VMx.local VMx" where x is the number of the VM Any one have an idea about how to set the FQDN ? and if not is it possible to use IP instead of FQDN ? i've this config: Public repond: IP : 151.xx.xx.xx from the rebond with ssh: VM | eth0 | | eth1 |
VM1 : 192.168.1.10 10.10.10.1
VM2 : 192.168.1.11 10.10.10.2
VM3 : 192.168.1.12 10.10.10.3
VM4 : 192.168.1.13 10.10.10.4 Thanks.
... View more
Labels:
- Labels:
-
Apache Ambari
02-14-2016
09:19 PM
1 Kudo
@Neeraj Sabharwal Do you recommend using Ambari or manual installation ? in the case of using Ambari, i went through documentation and didn’t find where I can allocate space for logs. Thanks.
... View more
02-13-2016
02:33 PM
1 Kudo
@Neeraj Sabharwal Thank you for your answer. This is a development and test environment 🙂
... View more
02-13-2016
02:07 PM
2 Kudos
Hi all, I'm new to Hadoop and i'm currently working on a project using HDP. I've an OVH server with the following config: - 4 CPUs x Intel(R) Xeon(R) CPU E3-1231 v3 @ 3.40GHz
- RAM : 32 GB
- Storage : 2 TB with ESXi installed. My question is about the best partitioning schema and the number of Nodes. I'm not sure if 4 nodes with 1 cpu, 8 GB of RAM and 500 GB HDD is good, at least for development (1 Namenode and 3 Datanodes)? I'm working with Data from a middle sized retail. Thanks.
... View more
Labels:
- « Previous
- Next »