Reply
New Contributor
Posts: 3
Registered: ‎06-24-2014

YARN unable to start the Job and FinalStatus is undefined

 

Team,

I have a new Cloudera setup with Cluster setup ( Had single node initially) i.e Cloudera 5.4.1. This brand new installation on EC2 do have any specific changes to YARN.

 

I had a couple of jobs started in Sqoop, Sqoop2 and sample WordCount example. And all job struct at final status UNDEFINED and not getting and clue where is the problem.

 

This looks like below.

 

application_1433292017070_0001ubuntugrep-searchMAPREDUCEroot.ubuntuTue Jun 2 17:48:11 -0700 2015N/AACCEPTEDUNDEFINED UNASSIGNED

Please let me know if you need any information.

 

-Shankar

 

 

 

New Contributor
Posts: 2
Registered: ‎01-02-2015

Re: YARN unable to start the Job and FinalStatus is undefined

Your job is waiting for the scheduler to assign a container.

 

Check at the top what are the resources available. Maybe you don't have any nodemanagers providing resources or all the resources are tied up.

New Contributor
Posts: 3
Registered: ‎01-14-2016

Re: YARN unable to start the Job and FinalStatus is undefined

[ Edited ]

I have setup CDH 5.5.1 cluster(3 nodes) with all components(may be overkill) for POC. SQOOP job is accepta but unassigned state. 

 

VM Servers : 8GB RAM

CPUs : 2

 

NodeManager :

Container Memory : 2.2 GB

Virtual CPU Cores : 4

 

Any help will be appreciated.

 

Thanks 

Arun

Highlighted
New Contributor
Posts: 3
Registered: ‎01-14-2016

Re: YARN unable to start the Job and FinalStatus is undefined

Resolved it:

 

My setup had 2 nodemanager, was missing YARN service on node1. Jobs completed after adding node1 as NodeManager.

 

added it from CM via CM -> YARN -> Instances -> Add Role Instances -> Gateway 

restarted it.

New Contributor
Posts: 3
Registered: ‎05-23-2016

Re: YARN unable to start the Job and FinalStatus is undefined

 Hi - I'm new to cloudera, I installed a single node cluster... 

 

Now I'm trying to import simple table with just two rows, the job is accepted and doesn't get assinged. 

Could you please help me ?

 

chetan@VM-DB-TESTM1 ~]$ sqoop import --connect jdbc:oracle:thin:@xxxxx:1521:testdb1 --table HADOOP --username dbo --password xxx --target-dir /user/chetan/s qoopimport_hadoop -m 1
Warning: /opt/cloudera/parcels/CDH-5.7.0-1.cdh5.7.0.p0.45/bin/../lib/sqoop/../accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
16/05/23 18:59:07 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6-cdh5.7.0
16/05/23 18:59:07 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
16/05/23 18:59:07 INFO oracle.OraOopManagerFactory: Data Connector for Oracle and Hadoop is disabled.
16/05/23 18:59:07 INFO manager.SqlManager: Using default fetchSize of 1000
16/05/23 18:59:07 INFO tool.CodeGenTool: Beginning code generation
16/05/23 18:59:08 INFO manager.OracleManager: Time zone has been set to GMT
16/05/23 18:59:08 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM HADOOP t WHERE 1=0
16/05/23 18:59:08 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce
Note: /tmp/sqoop-chetan/compile/3c2eef1b0c3dfa6014003af2614804cf/HADOOP.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
16/05/23 18:59:09 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-chetan/compile/3c2eef1b0c3dfa6014003af2614804cf/HADOOP.jar
16/05/23 18:59:09 INFO manager.OracleManager: Time zone has been set to GMT
16/05/23 18:59:09 INFO manager.OracleManager: Time zone has been set to GMT
16/05/23 18:59:09 INFO mapreduce.ImportJobBase: Beginning import of HADOOP
16/05/23 18:59:09 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
16/05/23 18:59:09 INFO manager.OracleManager: Time zone has been set to GMT
16/05/23 18:59:10 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
16/05/23 18:59:10 INFO client.RMProxy: Connecting to ResourceManager at VM-DB-TESTM1.VITECH.COM/10.xxxx:8032
16/05/23 18:59:11 INFO db.DBInputFormat: Using read commited transaction isolation
16/05/23 18:59:11 INFO mapreduce.JobSubmitter: number of splits:1
16/05/23 18:59:11 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1464044309422_0001
16/05/23 18:59:12 INFO impl.YarnClientImpl: Submitted application application_1464044309422_0001
16/05/23 18:59:12 INFO mapreduce.Job: The url to track the job: http://VM-DB-TESTM1.VITECH.COM:8088/proxy/application_1464044309422_0001/
16/05/23 18:59:12 INFO mapreduce.Job: Running job: job_1464044309422_0001

Announcements