28804
DISCUSSIONS
102191
MEMBERS
3161
ARTICLES
Created on 03-21-2018 11:30 AM - edited 09-16-2022 06:00 AM
Hello Guys!
I'm having some trouble in running cloudera's example job, as below:
hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar pi 10 100
It's stucking in map, as it's output:
[root@cpsmaaeip04 data]# hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar pi 10 100
Number of Maps = 10
Samples per Map = 100
Wrote input for Map #0
Wrote input for Map #1
Wrote input for Map #2
Wrote input for Map #3
Wrote input for Map #4
Wrote input for Map #5
Wrote input for Map #6
Wrote input for Map #7
Wrote input for Map #8
Wrote input for Map #9
Starting Job
18/03/21 15:08:56 INFO client.RMProxy: Connecting to ResourceManager at cpsmaaeip04.cpfl.com.br/10.50.152.51:8032
18/03/21 15:08:56 INFO hdfs.DFSClient: Created HDFS_DELEGATION_TOKEN token 32 for hdfs on 10.50.152.51:8020
18/03/21 15:08:56 INFO security.TokenCache: Got dt for hdfs://cpsmaaeip04.cpfl.com.br:8020; Kind: HDFS_DELEGATION_TOKEN, Service: 10.50.152.51:8020, Ident: (HDFS_DELEGATION_TOKEN token 32 for hdfs)
18/03/21 15:08:56 INFO input.FileInputFormat: Total input paths to process : 10
18/03/21 15:08:57 INFO mapreduce.JobSubmitter: number of splits:10
18/03/21 15:08:57 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1521655578677_0001
18/03/21 15:08:57 INFO mapreduce.JobSubmitter: Kind: HDFS_DELEGATION_TOKEN, Service: 10.50.152.51:8020, Ident: (HDFS_DELEGATION_TOKEN token 32 for hdfs)
18/03/21 15:08:58 INFO impl.YarnClientImpl: Submitted application application_1521655578677_0001
18/03/21 15:08:58 INFO mapreduce.Job: The url to track the job: http://cpsmaaeip04.cpfl.com.br:8088/proxy/application_1521655578677_0001/
18/03/21 15:08:58 INFO mapreduce.Job: Running job: job_1521655578677_0001
18/03/21 15:09:10 INFO mapreduce.Job: Job job_1521655578677_0001 running in uber mode : false
18/03/21 15:09:10 INFO mapreduce.Job: map 0% reduce 0%
I have already set for dynamic resource pool 8 VCores and 8GB of memory for the pool root.users.
Do you guys have some clue to solve this issue?