RajbMandal
Rising Star
My Accepted Solutions
Show All

Re: Insert overwrite query failing with Execution ...

by Rising Star in Support Questions
‎02-13-2019 08:21 AM
‎02-13-2019 08:21 AM
I am facing same issue. java.sql.SQLException: Error while processing statement: FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MoveTask SQL Exception Occured Any pointer is appreciated. ... View more

Install Hadoop Clients

by Rising Star in Support Questions
‎12-06-2018 07:20 AM
‎12-06-2018 07:20 AM
hi, We want to install Hadoop client (2.7.3) in a RHEL 6.9 server. Can you please let me know steps to be followed and configuration changes required in the client system? Please note that client system is not part of the Hadoop cluster. Regards, Rajib ... View more

Hadoop 2.7.3 client

by Rising Star in Support Questions
‎12-06-2018 05:46 AM
‎12-06-2018 05:46 AM
Hi, I want into install Hadoop 2.7.3 ,sqoop client,hive client in a RHEL 6.9 system. Can you please help us how will get all the client from HDP repository? Regards, Rajib ... View more

Re: hive-webhcat

by Rising Star in Support Questions
‎11-14-2017 04:54 AM
‎11-14-2017 04:54 AM
I am getting same error " The 'hive-webhcat' component did not advertise a version. This may indicate a problem with the component packaging. However, the stack-select tool was able to report a single version installed (2.6.3.0-235). This is the version that will be reported". Please let me know how to resolve the issue. ... View more

Re: Install HIVE 2.1

by Rising Star in Support Questions
‎11-10-2017 08:59 AM
‎11-10-2017 08:59 AM
Please refer atatched image for your refernce ... View more

Install HIVE 2.1

by Rising Star in Support Questions
‎11-10-2017 08:57 AM
‎11-10-2017 08:57 AM
We are trying to install HDP 2.6.3 .But we have not found HIVE 2 .1 while configuring cluster. Please let me know if we are missing anythin here. ... View more

Re: Ambari Server java process died with exitcode ...

by Rising Star in Support Questions
‎12-05-2016 02:05 PM
‎12-05-2016 02:05 PM
@jss We found below error in the log 05 Dec 2016 19:25:54,977 ERROR [main] AmbariServer:844 - Failed to run the Ambari Server org.apache.ambari.server.AmbariException: Ambari Server Kerberos credentials check failed. Check KDC availability and JAAS configuration in /etc/ambari-server/conf/krb5JAASLogin.conf at org.apache.ambari.server.controller.utilities.KerberosChecker.checkJaasConfiguration(KerberosChecker.java:116) at org.apache.ambari.server.controller.AmbariServer.main(AmbariServer.java:839) 05 Dec 2016 19:25:55,623 INFO [Stack Version Loading Thread] LatestRepoCallable:93 - Could not load the URI for stack HDP-2.1 from http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json (Connection refused). Using default repository values. ... View more

Re: Ambari Server java process died with exitcode ...

by Rising Star in Support Questions
‎12-05-2016 01:58 PM
‎12-05-2016 01:58 PM
@jss Thanks for your reply. Please find below the log root@c00675971901:~# tail -10f /var/log/ambari-server/ambari-server.log 05 Dec 2016 19:25:55,658 INFO [Stack Version Loading Thread] LatestRepoCallable:93 - Could not load the URI for stack HDP-2.3.ECS from http://s3.amazonaws.com/dev.hortonworks.com/HDP/hdp_urlinfo.json (Connection refused). Using default repository values. 05 Dec 2016 19:25:55,658 INFO [Stack Version Loading Thread] LatestRepoCallable:74 - Loading latest URL info for stack HDP-2.1.GlusterFS from http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json 05 Dec 2016 19:25:55,658 DEBUG [Stack Version Loading Thread] URLStreamProvider:169 - readFrom spec:http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json 05 Dec 2016 19:25:55,659 INFO [Stack Version Loading Thread] LatestRepoCallable:93 - Could not load the URI for stack HDP-2.1.GlusterFS from http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json (Connection refused). Using default repository values. 05 Dec 2016 19:25:55,659 INFO [Stack Version Loading Thread] LatestRepoCallable:74 - Loading latest URL info for stack HDP-2.3.GlusterFS from http://s3.amazonaws.com/dev.hortonworks.com/HDP/hdp_urlinfo.json 05 Dec 2016 19:25:55,659 DEBUG [Stack Version Loading Thread] URLStreamProvider:169 - readFrom spec:http://s3.amazonaws.com/dev.hortonworks.com/HDP/hdp_urlinfo.json 05 Dec 2016 19:25:55,660 INFO [Stack Version Loading Thread] LatestRepoCallable:93 - Could not load the URI for stack HDP-2.3.GlusterFS from http://s3.amazonaws.com/dev.hortonworks.com/HDP/hdp_urlinfo.json (Connection refused). Using default repository values. 05 Dec 2016 19:25:55,661 INFO [Stack Version Loading Thread] LatestRepoCallable:74 - Loading latest URL info for stack HDP-2.0 from http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json 05 Dec 2016 19:25:55,661 DEBUG [Stack Version Loading Thread] URLStreamProvider:169 - readFrom spec:http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json 05 Dec 2016 19:25:55,662 INFO [Stack Version Loading Thread] LatestRepoCallable:93 - Could not load the URI for stack HDP-2.0 from http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json (Connection refused). Using default repository values. ... View more

Ambari Server java process died with exitcode -1.

by Rising Star in Support Questions
‎12-05-2016 01:31 PM
‎12-05-2016 01:31 PM
We are getting following error (Os:ubuntu 14.04) while starting ambari i server. Using python /usr/bin/python Starting ambari-server Ambari Server running with administrator privileges. About to start PostgreSQL Organizing resource files at /var/lib/ambari-server/resources... Server PID at: /var/run/ambari-server/ambari-server.pid Server out at: /var/log/ambari-server/ambari-server.out Server log at: /var/log/ambari-server/ambari-server.log Waiting for server start.................... ERROR: Exiting with exit code -1. REASON: Ambari Server java process died with exitcode 1. Check /var/log/ambari-server/ambari-server.out for more information. The output of root@ctsc00675971901:~# vi /var/log/ambari-server/ambari-server.out Exception in thread "main" org.apache.ambari.server.AmbariException: Error stopping the server at org.apache.ambari.server.controller.AmbariServer.stop(AmbariServer.java:737) at org.apache.ambari.server.controller.AmbariServer.main(AmbariServer.java:846) ... View more
Labels:

Load data in azure data lake using Apache Nifi

by Rising Star in Support Questions
‎09-14-2016 09:53 AM
‎09-14-2016 09:53 AM
There are some requirement in our project. We want to store data in azure data lake using Apache Nifi. Is it possible to load data in azure data lake using Apache Nifi? ... View more
Labels:

Re: Unable to import data to Hbase using nifi thro...

by Rising Star in Support Questions
‎09-14-2016 04:11 AM
‎09-14-2016 04:11 AM
Bryan Bende -Yes ,we did configure the HBase Client Service in NiFi to use the Kerberos principal and keytab.Please find attached .nifi-error-1.png ... View more

Re: Unable to import data to Hbase using nifi thro...

by Rising Star in Support Questions
‎09-13-2016 12:19 PM
‎09-13-2016 12:19 PM
@Artem Ervits We have given READ,WRITE,CREATE,EXE to user on the table employee_1 in hbase shell.Still we are getting same error. ... View more

Unable to import data to Hbase using nifi through ...

by Rising Star in Support Questions
‎09-13-2016 11:18 AM
1 Kudo
‎09-13-2016 11:18 AM
1 Kudo
Unable to import data to Hbase using nifi through puthbaseshell.. geting the following issue "Habse due to org.apache.hadoop.hbase.client.RetriesExhaustedWithDetailsException: Failed 1 action org.apache.hadoop.hbase.security.AccessDeniedException org.apache.hadoop.hbase.security.access.AccessController.prePut(AccessController java:1642)" we already checked in hbase shell that particular user(nifi/HDF@XXX.COM) have complete authority hbase(main):009:0> user_permission 'employee_1' User Namespace,Table,Family,Qualifier:Permission nifi/HDF@XXX.COM default,employee_1,personalInfo,: [Permission: actions=READ,WRITE,CREATE,EXEC,ADMIN] Please find the attached Ni-fi_issue screen shot for reference. Please suggest, ... View more
Labels:

Re: Yarn Distributed Shell

by Rising Star in Support Questions
‎09-08-2016 01:16 PM
1 Kudo
‎09-08-2016 01:16 PM
1 Kudo
@Constantin Stanca : Thanks for your clarifications. We are getting list of shell scripts from an upstream application. These shell scripts contains shell command and Sqoop command as well which needs to run on multiple nodes in a Hadoop cluster. ... View more

Re: Yarn Distributed Shell

by Rising Star in Support Questions
‎09-07-2016 09:00 AM
‎09-07-2016 09:00 AM
@Constantin Stanca Thanks for your suggestions. Is it possible to execute sqoop command using Yarn distributed shell? ... View more

Yarn Distributed Shell

by Rising Star in Support Questions
‎09-06-2016 12:00 PM
1 Kudo
‎09-06-2016 12:00 PM
1 Kudo
We are trying to run sqoop command using Yarn distributed shell. All the command is written within shell script. The sqoop client is not installed in NameNode.But Sqoop is installed all the data node. While running the script ,we are getting "ExecScript.sh: line 5: sqoop: command not found" error. P.S-The sqoop command running fine in the individual data node. Am I missing anything here? ... View more

User Specific ticket lifetime.

by Rising Star in Support Questions
‎08-25-2016 06:58 AM
1 Kudo
‎08-25-2016 06:58 AM
1 Kudo
Can we specify ticket lifetime for a particular user in kerberos? If yes , what are the steps to specify ticket lifetime for the particular user? ... View more

Re: OOzie : Authentication failed, status: 403, me...

by Rising Star in Support Questions
‎08-19-2016 01:51 PM
‎08-19-2016 01:51 PM
@Murali Ramasami Added below two line in job.properties.But I am getting same error. mapreduce.jobtracker.kerberos.principal=rm/xxx.abc.com@hp.COM dfs.namenode.kerberos.principal=nn/xxx.abc.com@hp.COM ... View more

Re: OOzie : Authentication failed, status: 403, me...

by Rising Star in Support Questions
‎08-18-2016 04:23 AM
‎08-18-2016 04:23 AM
@mliem Here is the property file. nameNode=hdfs://xxx91239901.cts.abc:8020 jobTracker=xxx91239901.cts.abc:8050 queueName=default examplesRoot=examples ozie.use.system.libpath=true mapreduce.jobtracker.kerberos.principal=biguser dfs.namenode.kerberos.principal=biguser oozie.libpath=${nameNode}/usr/hdp/2.4.2.0-258/oozie/share/lib oozie.wf.application.path=${nameNode}/user/${user.name}/${examplesRoot}/apps/map-reduce/workflow.xml outputDir=map-reduce ... View more

Re: OOzie : Authentication failed, status: 403, me...

by Rising Star in Support Questions
‎08-18-2016 04:11 AM
‎08-18-2016 04:11 AM
@mliem Here is the workflow xml @mliem <workflow-app xmlns="uri:oozie:workflow:0.2" name="map-reduce-wf"> <start to="mr-node"/> <action name="mr-node"> <map-reduce> <job-tracker>${jobTracker}</job-tracker> <name-node>${nameNode}</name-node> <prepare> <delete path="${nameNode}/user/${wf:user()}/${examplesRoot}/output-data/${outputDir}"/> </prepare> <configuration> <property> <name>mapred.job.queue.name</name> <value>${queueName}</value> </property> <property> <name>mapred.mapper.class</name> <value>org.apache.oozie.example.SampleMapper</value> </property> <property> <name>mapred.reducer.class</name> <value>org.apache.oozie.example.SampleReducer</value> </property> <property> <name>mapred.map.tasks</name> <value>1</value> </property> <property> <name>mapred.input.dir</name> <value>/user/${wf:user()}/${examplesRoot}/input-data/text</value> </property> <property> <name>mapred.output.dir</name> <value>/user/${wf:user()}/${examplesRoot}/output-data/${outputDir}</value> </property> </configuration> </map-reduce> <ok to="end"/> <error to="fail"/> </action> <kill name="fail"> <message>Map/Reduce failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message> </kill> <end name="end"/> </workflow-app> ... View more

OOzie : Authentication failed, status: 403, messag...

by Rising Star in Support Questions
‎08-17-2016 09:43 AM
‎08-17-2016 09:43 AM
We are getting below error while running mapreduce job througoozie in a Kerborized cluster. Please find below the log. 2016-08-17 13:16:40,702 WARN ActionStartXCommand:523 - SERVER[xxx00675971901.yyy.com] USER[bigframe] GROUP[-] TOKEN[] APP[map-reduce-wf] JOB[0000012-160816141521057-oozie-oozi-W] ACTION[0000012-160816141521057-oozie-oozi-W@mr-node] Error starting action [mr-node]. ErrorType [TRANSIENT], ErrorCode [JA009], Message [JA009: java.lang.reflect.UndeclaredThrowableException] org.apache.oozie.action.ActionExecutorException: JA009: java.lang.reflect.UndeclaredThrowableException at org.apache.oozie.action.ActionExecutor.convertExceptionHelper(ActionExecutor.java:456) at org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:440) at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1139) at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1293) at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:250) at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:64) at org.apache.oozie.command.XCommand.call(XCommand.java:286) at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: java.io.IOException: java.lang.reflect.UndeclaredThrowableException at org.apache.hadoop.crypto.key.kms.KMSClientProvider.addDelegationTokens(KMSClientProvider.java:892) at org.apache.hadoop.crypto.key.KeyProviderDelegationTokenExtension.addDelegationTokens(KeyProviderDelegationTokenExtension.java:86) at org.apache.hadoop.hdfs.DistributedFileSystem.addDelegationTokens(DistributedFileSystem.java:2291) at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:121) at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:100) at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodes(TokenCache.java:80) at org.apache.hadoop.mapred.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:126) at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:268) at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:139) at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290) at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1709) at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287) at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:575) at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:570) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1709) at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:570) at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:561) at org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:1124) ... 8 more Caused by: java.lang.reflect.UndeclaredThrowableException at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1727) at org.apache.hadoop.crypto.key.kms.KMSClientProvider.addDelegationTokens(KMSClientProvider.java:874) ... 30 more Caused by: org.apache.hadoop.security.authentication.client.AuthenticationException: Authentication failed, status: 403, message: Forbidden at org.apache.hadoop.security.authentication.client.AuthenticatedURL.extractToken(AuthenticatedURL.java:274) at org.apache.hadoop.security.authentication.client.PseudoAuthenticator.authenticate(PseudoAuthenticator.java:77) at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticator.authenticate(DelegationTokenAuthenticator.java:128) at org.apache.hadoop.security.authentication.client.KerberosAuthenticator.authenticate(KerberosAuthenticator.java:214) at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticator.authenticate(DelegationTokenAuthenticator.java:128) at org.apache.hadoop.security.authentication.client.AuthenticatedURL.openConnection(AuthenticatedURL.java:215) at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticator.doDelegationTokenOperation(DelegationTokenAuthenticator.java:285) at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticator.getDelegationToken(DelegationTokenAuthenticator.java:166) at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticatedURL.getDelegationToken(DelegationTokenAuthenticatedURL.java:371) at org.apache.hadoop.crypto.key.kms.KMSClientProvider$2.run(KMSClientProvider.java:879) at org.apache.hadoop.crypto.key.kms.KMSClientProvider$2.run(KMSClientProvider.java:874) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1709) ... View more
Labels:

oozie failing with libpath under the workflow dire...

by Rising Star in Support Questions
‎08-06-2016 06:16 AM
‎08-06-2016 06:16 AM
I am trying to run oozie workflowsin the cluster and keep running into this missing libpath error: 2016-08-05 12:49:50,403 WARN LiteWorkflowAppService:523 - SERVER[xxxx00691239901.aaa.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] libpath [hdfs://xxxx00691239901.aaa.com:8020/user/bigframe/generic/oozie_dir/lib] does not exist Not sure where/how lib directory is created and what is it expected to contain? Please let me know if I'm missing any step.Thanks! ... View more
Labels:

Re: OOzie webconsole error

by Rising Star in Support Questions
‎08-05-2016 09:05 AM
‎08-05-2016 09:05 AM
@Kuldeep Kulkarni and @Sunile Manjee I tried all the steps .But not able to access oozie webconsole in IE11,CHROME AND FIREFOX. ... View more

oozie failing with libpath under the workflow dire...

by Rising Star in Support Questions
‎08-05-2016 08:03 AM
‎08-05-2016 08:03 AM
I am trying to run oozie workflowsin the cluster and keep running into this missing libpath error: 2016-08-05 12:49:50,403 WARN LiteWorkflowAppService:523 - SERVER[xxxx00691239901.aaa.com] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[-] ACTION[-] libpath [hdfs://xxxx00691239901.aaa.com:8020/user/bigframe/generic/oozie_dir/lib] does not exist Not sure where/how lib directory is created and what is it expected to contain? Please let me know if I'm missing any step.Thanks! ... View more
Labels:

Re: java.lang.IllegalArgumentException: Oozie URL ...

by Rising Star in Support Questions
‎08-05-2016 07:34 AM
‎08-05-2016 07:34 AM
@ Kuldeep Kulkarni : Issue got resolved by uncommenting export OOZIE_CONFIG_FILE=oozie-site.xml in /etc/oozie/conf/oozie-env.sh ... View more

Re: java.lang.IllegalArgumentException: Oozie URL ...

by Rising Star in Support Questions
‎08-05-2016 06:11 AM
1 Kudo
‎08-05-2016 06:11 AM
1 Kudo
@ Kuldeep Kulkarni Also tried to change the /etc/oozie/conf/oozie-env.sh file.After doing the necessary changes ,I restarted the service . I found all the changes reverted. Can you please let me know what went wrong here? ... View more

Re: java.lang.IllegalArgumentException: Oozie URL ...

by Rising Star in Support Questions
‎08-05-2016 05:47 AM
‎08-05-2016 05:47 AM
@ Kuldeep Kulkarni After running the command, I am getting below error Connection exception has occurred [ java.net.ConnectException Connection refused ]. Trying after 1 sec. Retry count = 1 Connection exception has occurred [ java.net.ConnectException Connection refused ]. Trying after 2 sec. Retry count = 2 Connection exception has occurred [ java.net.ConnectException Connection refused ]. Trying after 4 sec. Retry count = 3 Connection exception has occurred [ java.net.ConnectException Connection refused ]. Trying after 8 sec. Retry count = 4 Error: IO_ERROR : java.io.IOException: Error while connecting Oozie server. No of retries = 4. Exception = Connection refused ... View more

java.lang.IllegalArgumentException: Oozie URL is n...

by Rising Star in Support Questions
‎08-05-2016 05:10 AM
‎08-05-2016 05:10 AM
While running oozie jobs command from CLI I am getting below error.Can any one tell me the issue? ava.lang.IllegalArgumentException: Oozie URL is not available neither in command option or in the environment at org.apache.oozie.cli.OozieCLI.getOozieUrl(OozieCLI.java:711) at org.apache.oozie.cli.OozieCLI.createXOozieClient(OozieCLI.java:911) at org.apache.oozie.cli.OozieCLI.jobsCommand(OozieCLI.java:1544) at org.apache.oozie.cli.OozieCLI.processCommand(OozieCLI.java:676) at org.apache.oozie.cli.OozieCLI.run(OozieCLI.java:626) at org.apache.oozie.cli.OozieCLI.main(OozieCLI.java:225) Oozie URL is not available neither in command option or in the environment ... View more
Labels:

Re: OOzie webconsole error

by Rising Star in Support Questions
‎08-04-2016 03:02 PM
‎08-04-2016 03:02 PM
@Sunile Manjee Yes, the cluster is kerberized. I am trying to open console from windows system.Also copied krb5.ini into c:\windows . ... View more

Re: Accessing HDP web UI from Windows PC causes "G...

by Rising Star in Support Questions
‎08-04-2016 02:21 PM
‎08-04-2016 02:21 PM
@Jonas Straub I use JDK "1.8.0_91".But still getting same error. ... View more
Contact Me
Online
Offline
Last Visited
‎02-27-2017 04:30 AM
Public Statistics
Date Registered ‎06-03-2016 03:09 AM
Last Visited ‎02-27-2017 04:30 AM
Total Messages Posted 77
Total Kudos Received 7