YARN unable to start the Job and FinalStatus is undefined

[#1]

Team,

I have a new Cloudera setup with Cluster setup ( Had single node initially) i.e Cloudera 5.4.1. This brand new installation on EC2 do have any specific changes to YARN.

I had a couple of jobs started in Sqoop, Sqoop2 and sample WordCount example. And all job struct at final status UNDEFINED and not getting and clue where is the problem.

This looks like below.

application_1433292017070_0001

ubuntu

grep-search

MAPREDUCE

root.ubuntu

Tue Jun 2 17:48:11 -0700 2015

N/A

ACCEPTED

UNDEFINED

UNASSIGNED

Please let me know if you need any information.

-Shankar

[#2]

Your job is waiting for the scheduler to assign a container.

Check at the top what are the resources available. Maybe you don't have any nodemanagers providing resources or all the resources are tied up.

[#3]

I have setup CDH 5.5.1 cluster(3 nodes) with all components(may be overkill) for POC. SQOOP job is accepta but unassigned state. 

VM Servers : 8GB RAM

CPUs : 2

NodeManager :

Container Memory : 2.2 GB

Virtual CPU Cores : 4

Any help will be appreciated.

Thanks 

Arun

[#4]

Resolved it:

My setup had 2 nodemanager, was missing YARN service on node1. Jobs completed after adding node1 as NodeManager.

added it from CM via CM -> YARN -> Instances -> Add Role Instances -> Gateway 

restarted it.

[#5]

 Hi - I'm new to cloudera, I installed a single node cluster... 

Now I'm trying to import simple table with just two rows, the job is accepted and doesn't get assinged. 

Could you please help me ?

chetan@VM-DB-TESTM1 ~]$ sqoop import --connect jdbc:oracle:thin:@xxxxx:1521:testdb1 --table HADOOP --username dbo --password xxx --target-dir /user/chetan/s qoopimport_hadoop -m 1
Warning: /opt/cloudera/parcels/CDH-5.7.0-1.cdh5.7.0.p0.45/bin/../lib/sqoop/../accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
16/05/23 18:59:07 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6-cdh5.7.0
16/05/23 18:59:07 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
16/05/23 18:59:07 INFO oracle.OraOopManagerFactory: Data Connector for Oracle and Hadoop is disabled.
16/05/23 18:59:07 INFO manager.SqlManager: Using default fetchSize of 1000
16/05/23 18:59:07 INFO tool.CodeGenTool: Beginning code generation
16/05/23 18:59:08 INFO manager.OracleManager: Time zone has been set to GMT
16/05/23 18:59:08 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM HADOOP t WHERE 1=0
16/05/23 18:59:08 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce
Note: /tmp/sqoop-chetan/compile/3c2eef1b0c3dfa6014003af2614804cf/HADOOP.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
16/05/23 18:59:09 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-chetan/compile/3c2eef1b0c3dfa6014003af2614804cf/HADOOP.jar
16/05/23 18:59:09 INFO manager.OracleManager: Time zone has been set to GMT
16/05/23 18:59:09 INFO manager.OracleManager: Time zone has been set to GMT
16/05/23 18:59:09 INFO mapreduce.ImportJobBase: Beginning import of HADOOP
16/05/23 18:59:09 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
16/05/23 18:59:09 INFO manager.OracleManager: Time zone has been set to GMT
16/05/23 18:59:10 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
16/05/23 18:59:10 INFO client.RMProxy: Connecting to ResourceManager at VM-DB-TESTM1.VITECH.COM/10.xxxx:8032
16/05/23 18:59:11 INFO db.DBInputFormat: Using read commited transaction isolation
16/05/23 18:59:11 INFO mapreduce.JobSubmitter: number of splits:1
16/05/23 18:59:11 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1464044309422_0001
16/05/23 18:59:12 INFO impl.YarnClientImpl: Submitted application application_1464044309422_0001
16/05/23 18:59:12 INFO mapreduce.Job: The url to track the job: http://VM-DB-TESTM1.VITECH.COM:8088/proxy/application_1464044309422_0001/
16/05/23 18:59:12 INFO mapreduce.Job: Running job: job_1464044309422_0001