Member since
05-08-2017
11
Posts
0
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
578 | 05-10-2017 06:14 PM | |
537 | 05-09-2017 04:31 PM |
09-10-2020
08:00 PM
Its Worked for me .
... View more
12-11-2017
08:36 PM
One of our Sqoop import jobs throwing below error, Please help me to fix this issu. 2017-12-11 06:40:15,203 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1507175565630_261578_m_000000_0 TaskAttempt Transitioned from RUNNING to SUCCESS_CONTAINER_CLEANUP
2017-12-11 06:40:15,203 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: Processing the event EventType: CONTAINER_REMOTE_CLEANUP for container container_e106_1507175565630_261578_01_000002 taskAttempt attempt_1507175565630_261578_m_000000_0
2017-12-11 06:40:15,204 INFO [ContainerLauncher #1] org.apache.hadoop.mapreduce.v2.app.launcher.ContainerLauncherImpl: KILLING attempt_1507175565630_261578_m_000000_0
2017-12-11 06:40:15,204 INFO [ContainerLauncher #1] org.apache.hadoop.yarn.client.api.impl.ContainerManagementProtocolProxy: Opening proxy : clpd863:45454
2017-12-11 06:40:15,216 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: attempt_1507175565630_261578_m_000000_0 TaskAttempt Transitioned from SUCCESS_CONTAINER_CLEANUP to SUCCEEDED
2017-12-11 06:40:15,220 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: Task succeeded with attempt attempt_1507175565630_261578_m_000000_0
2017-12-11 06:40:15,221 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskImpl: task_1507175565630_261578_m_000000 Task Transitioned from RUNNING to SUCCEEDED
2017-12-11 06:40:15,222 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: Num completed Tasks: 1
2017-12-11 06:40:15,223 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl: job_1507175565630_261578Job Transitioned from RUNNING to COMMITTING
2017-12-11 06:40:15,223 INFO [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Processing the event EventType: JOB_COMMIT
2017-12-11 06:40:15,235 ERROR [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Could not commit job
java.io.FileNotFoundException: File hdfs://Intra1cluster/intraday/stage/lte/vertica/rops/fdd5/_temporary/1 does not exist.
at org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(DistributedFileSystem.java:904)
at org.apache.hadoop.hdfs.DistributedFileSystem.access$600(DistributedFileSystem.java:113)
at org.apache.hadoop.hdfs.DistributedFileSystem$21.doCall(DistributedFileSystem.java:966)
at org.apache.hadoop.hdfs.DistributedFileSystem$21.doCall(DistributedFileSystem.java:962)
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:962)
at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1534)
at org.apache.hadoop.fs.FileSystem.listStatus(FileSystem.java:1574)
at org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter.getAllCommittedTaskPaths(FileOutputCommitter.java:321)
at org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter.commitJobInternal(FileOutputCommitter.java:391)
at org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter.commitJob(FileOutputCommitter.java:364)
at org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler$EventProcessor.handleJobCommit(CommitterEventHandler.java:285)
at org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler$EventProcessor.run(CommitterEventHandler.java:237)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
... View more
Labels:
- Labels:
-
Apache Sqoop
05-17-2017
11:04 PM
Equivalent lookup for ambari.properties file. http://<ambari_server>:8080/api/v1/services/AMBARI/components/AMBARI_SERVER?fields=RootServiceComponents/properties
... View more
05-10-2017
06:14 PM
HI Jay, I Fond the issue with given two URLS and get request_id and stage_id values for "status" : "PENDING" then fixed the issue. - Connected ambari DB and issued the below command then continued the Upgrade. update host_role_command set status='COMPLETED' where request_id='523' and stage_id='107';
... View more
05-10-2017
02:47 AM
HI Jay, I have deleted Falcon since I am not using this component 3 hours back, but I delete falcon while doing upgrade now it not allowing me to moving forward or backward. And It showing below message from last 3 hours. Upgrade in Progress
96%
Waiting to execute the next task...
... View more
05-09-2017
06:58 PM
While upgrade to 2.5.3.40 I am getting Failed on:Service Check Falcon error with below error log File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 294, in _call
raise Fail(err_msg)
resource_management.core.exceptions.Fail: Execution of '/usr/hdp/current/falcon-client/bin/falcon admin -version' returned 255. ERROR: Unable to initialize Falcon Client object. Cause : Could not authenticate, Authentication failed, URL: http://zld00736.vci.att.com:15000/api/options?user.name=ambariqa&user.name=ambariqa, status: 503, message: Service Unavailable
... View more
05-09-2017
05:05 PM
I am using Ambari 2.4 and getting below error when I run hive service check . It looks like a bug File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 294, in _call
raise Fail(err_msg)
resource_management.core.exceptions.Fail: Execution of '/var/lib/ambari-agent/tmp/templetonSmoke.sh zld00736.vci.att.com ambariqa 50111 idtest.ambariqa.1494348478.61.pig no_keytab false kinit no_principal /var/lib/ambari-agent/tmp' returned 1. Templeton Smoke Test (pig cmd): Failed. : {"error":"File /usr/hdp/2.5.3.40-1/hive/lib/hive-common.jar/zookeeper.jar does not exist."}http_code <500> Please provide solution for this.
... View more
05-09-2017
04:31 PM
It Works! Thank you so much Jay.
... View more
05-08-2017
08:15 PM
I am upgrading HDP 2.3.4 to 2.5.3.40.. but upgrade failed with "Failed on: Restarting History Server on zld00735" Std err log message File "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py", line 192, in run_command
raise Fail(err_msg)
resource_management.core.exceptions.Fail: Execution of 'curl -sS -L -w '%{http_code}' -X PUT --data-binary @/usr/hdp/2.5.3.40-1/hadoop/mapreduce.tar.gz 'http://zld00733.vci.att.com:50070/webhdfs/v1/hdp/apps/2.5.3.40-1/mapreduce/mapreduce.tar.gz?op=CREATE&user.name=hdfs&overwrite=True&permission=444'' returned status_code=500. Below one is Name node log 2017-05-08 14:42:24,970 ERROR mortbay.log (Slf4jLog.java:warn(87)) - /webhdfs/v1/hdp/apps/2.5.3.40-1/mapreduce/mapreduce.tar.gz
java.lang.IllegalStateException: Form too large206534214>200000
at org.mortbay.jetty.Request.extractParameters(Request.java:1561)
at org.mortbay.jetty.Request.getParameterMap(Request.java:870)
at org.apache.hadoop.http.HttpServer2$QuotingInputFilter$RequestQuoter.getParameterMap(HttpServer2.java:1227)
at org.apache.hadoop.hdfs.web.AuthFilter.toLowerCase(AuthFilter.java:95)
at org.apache.hadoop.hdfs.web.AuthFilter.doFilter(AuthFilter.java:82)
at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at org.apache.hadoop.http.HttpServer2$QuotingInputFilter.doFilter(HttpServer2.java:1294)
at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at org.apache.hadoop.http.NoCacheFilter.doFilter(NoCacheFilter.java:45)
at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at org.apache.hadoop.http.NoCacheFilter.doFilter(NoCacheFilter.java:45)
at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
... View more