Cloudera Community
MSharma
user rank
Expert Contributor
My Accepted Solutions
Show All

Re: YARN JobHistory Logs (http:<server>:19888/jobh...

by Expert Contributor in Support Questions
‎02-16-2017 06:47 PM
‎02-16-2017 06:47 PM
this is resolved now , there was a permission issue .after setting the right permission issue resolved  ... View more

java.lang.IllegalArgumentException: Illegal princi...

by Expert Contributor in Support Questions
‎02-16-2017 06:45 PM
‎02-16-2017 06:45 PM
Hi , I am running into a problem . i have  CDH cluster(kerberized cluster )  on unix and ETL client on windows . so to authenticate i have installed kerberos client on on window and generate the ticket for my user . but while running a job i am getting        Starting job testjob at 18:40 16/02/2017. [statistics] connecting to socket on port 3487 [statistics] connected [WARN ]: org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Exception in component tHDFSOutput_1 java.io.IOException: failure to login at org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:823) at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:760) at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:633) at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2859) at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2851) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2714) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:382) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:181) at local_project.testjob_0_1.testjob.tFixedFlowInput_1Process(testjob.java:709) at local_project.testjob_0_1.testjob.tHDFSConnection_1Process(testjob.java:419) at local_project.testjob_0_1.testjob.runJobInTOS(testjob.java:1156) at local_project.testjob_0_1.testjob.main(testjob.java:990) Caused by: javax.security.auth.login.LoginException: java.lang.IllegalArgumentException: Illegal principal name 25761081@PROD.GLOBAL.COM: org.apache.hadoop.security.authentication.util.KerberosName$NoMatchingRule: No rules applied to 25761081@PROD.GLOBAL.COM [FATAL]: local_project.testjob_0_1.testjob - tHDFSOutput_1 failure to login at org.apache.hadoop.security.UserGroupInformation$HadoopLoginModule.commit(UserGroupInformation.java:199) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) at java.lang.reflect.Method.invoke(Unknown Source) at javax.security.auth.login.LoginContext.invoke(Unknown Source) at javax.security.auth.login.LoginContext.access$000(Unknown Source) at javax.security.auth.login.LoginContext$4.run(Unknown Source) at javax.security.auth.login.LoginContext$4.run(Unknown Source) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.login.LoginContext.invokePriv(Unknown Source) at javax.security.auth.login.LoginContext.login(Unknown Source) at org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:798) ... 11 more Caused by: java.lang.IllegalArgumentException: Illegal principal name 25761081@PROD.GLOBAL.COM: org.apache.hadoop.security.authentication.util.KerberosName$NoMatchingRule: No rules applied to 25761081@PROD.GLOBAL.COM at org.apache.hadoop.security.User.<init>(User.java:50) at org.apache.hadoop.security.User.<init>(User.java:43) at org.apache.hadoop.security.UserGroupInformation$HadoopLoginModule.commit(UserGroupInformation.java:197) ... 23 more Caused by: org.apache.hadoop.security.authentication.util.KerberosName$NoMatchingRule: No rules applied to 25761081@PROD.GLOBAL.COM at org.apache.hadoop.security.authentication.util.KerberosName.getShortName(KerberosName.java:389) at org.apache.hadoop.security.User.<init>(User.java:48) ... 25 more [statistics] disconnected Job testjob ended at 18:40 16/02/2017. [exit code=1]   ************************ this is windows klist    C:\Program Files\MIT\Kerberos\bin>klist Ticket cache: FILE:C:\temp\krb5cache Default principal: 25761081@PROD.GLOBAL.COM Valid starting Expires Service principal 02/16/17 18:53:18 02/17/17 04:53:18 krbtgt/PROD.GLOBAL.COM@PROD.GLOBAL.COM renew until 02/23/17 18:53:13   **********************   this is the krb5.ini   [realms] CDH.PROD.GLOBAL.COM = { kdc = XXXXXXXXXXXXXX admin_server = XXXXXXXXXXXX } PROD.GLOBAL.COM = { kdc = XXXXXXXXXXXXXXX:88 admin_server = XXXXXXXXXXXX:749 default_domain = PROD.GLOBAL.COM }   Please suggest ... View more
Labels:

Re: Job application has expired Cannot be found on...

by Expert Contributor in Support Questions
‎02-08-2017 02:15 PM
‎02-08-2017 02:15 PM
this is resolved my setting proper permission . Thanks ... View more

Re: YARN JobHistory Logs (http:<server>:19888/jobh...

by Expert Contributor in Support Questions
‎02-07-2017 10:38 AM
‎02-07-2017 10:38 AM
if this get fail because of permission issue Counter information (.jhist file) and job_conf.xml files are written to /user/history/do ne_intermediate/<user>/job_xxxxxxxxxx_xxxx* can we create .jhist and .xml file again ? ... View more

Job application has expired Cannot be found on the...

by Expert Contributor in Support Questions
‎02-07-2017 08:54 AM
‎02-07-2017 08:54 AM
Hi , I am not able to see log in hue job browser . job completed successfully   \   but when click on log it gives      2017-02-07 11:46:59,592 ERROR org.apache.hadoop.mapreduce.v2.hs.CachedHistoryStorage: Unable to find job job_1485978333557_0001 ... View more
Labels:

Re: CM not detecting cdh 5.5 parcel

by Expert Contributor in Support Questions
‎08-11-2016 09:52 AM
‎08-11-2016 09:52 AM
it works now .Thanks  ... View more

CM not detecting cdh 5.5 parcel

by Expert Contributor in Support Questions
‎08-10-2016 09:20 PM
‎08-10-2016 09:20 PM
Hi , I am running into a problem .   our cluster is running on cdh5.3 and CM just upgraded to 5.8.1 now i added https://archive.cloudera.com/cdh5/parcels/ in parcel repository but still gettinng old cdh 5.3.10   what is wrong here?         ... View more

Re: spark.streaming.kafka.KafkaUtils error

by Expert Contributor in Support Questions
‎08-10-2016 09:09 PM
‎08-10-2016 09:09 PM
Thanks i will move to latest version then. ... View more

Re: spark.streaming.kafka.KafkaUtils error

by Expert Contributor in Support Questions
‎08-10-2016 08:38 AM
‎08-10-2016 08:38 AM
i have created a depndancy jar file and used that in spark shell with --jars option , it added fine but while importing its gicing this error.   is this is aversion issue . spark-kafka streaming will work after CDH5.5 only ? ... View more

spark.streaming.kafka.KafkaUtils error

by Expert Contributor in Support Questions
‎08-09-2016 02:36 PM
‎08-09-2016 02:36 PM
Hi , I am getting error while importing KafkaUtils class    scala> import org.apache.spark.streaming.kafka.KafkaUtils <console>:13: error: object kafka is not a member of package org.apache.spark.streaming import org.apache.spark.streaming.kafka.KafkaUtils   pom.xml    <project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"> <modelVersion>4.0.0</modelVersion> <groupId>spark</groupId> <artifactId>spark-kafka</artifactId> <version>1.0-SNAPSHOT</version> <packaging>jar</packaging> <name>spark-kafka</name> <url>http://maven.apache.org</url> <properties> <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding> </properties> <dependencies> <dependency> <groupId>junit</groupId> <artifactId>junit</artifactId> <version>3.8.1</version> <scope>test</scope> </dependency> <dependency> <groupId>org.apache.spark</groupId> <artifactId>spark-streaming-kafka_2.10</artifactId> <version>1.1.0</version> </dependency> </dependencies> </project>     can anyne help.what is wrong in this  ... View more
Labels:
Contact Me
Online
Offline
Last Visited
‎08-31-2018 11:15 AM
Community Statistics
Member Since ‎02-15-2016 01:41 PM
Last Visited ‎08-31-2018 11:15 AM
Posts 113
Kudos received 7