Re: spark yarn-client mode failed due to OutOfMemo...

trupti · ‎01-05-2018

What error do you see in the logs for hiveserver2/metastore? From Ambari you can go to Hive-> Configs and you should be able to see the DB that is set and credentials as well.

trupti · ‎01-02-2018

You can refer to https://community.hortonworks.com/articles/81353/popular-ambari-rest-api-commands.html for commands relating to listing of various services etc. It also has link to other ambari API documentation

trupti · ‎12-21-2017

Are you using Oozie shell action for your workflow? You can invoke a shell script from oozie shell action. Refer https://community.hortonworks.com/content/supportkb/48985/how-to-setup-oozie-shell-action.html for details

trupti · ‎12-21-2017

Can you get application logs for the failed application using yarn logs -applicationId application_1513775507967_0002 and see what error is seen int he failed application?

trupti · ‎09-13-2017

From error message, it looks like you dont have any healthy datanodes. Can you check your HDFS service and see if Datanodes and Namenode is up and healthy? message":"Failed to find datanode, suggest to check cluster health. excludeDatanodes=null"

trupti · ‎09-11-2017

Can you post the complete stack trace?

trupti · ‎09-08-2017

You can refer to following guide to setup HA using Ambari https://docs.hortonworks.com/HDPDocuments/Ambari-2.5.1.0/bk_ambari-operations/content/hbase_high_availability.html

trupti · ‎09-07-2017

Can you look at the region server logs and post what you see in them? Are other services healthy like HDFS, hbase master?

trupti · ‎04-12-2017

Can you post your commands that you are typing?

trupti · ‎04-12-2017

@Sai Deepthi Do you have an additional newline character after the last query ending in semi-colon? If you do can you remove that and run again and see if that helps?

trupti · ‎04-05-2017

What command are you trying to run ? Is it throwing any error/response that you can post?

trupti · ‎04-03-2017

What Oozie DB are you using? Also what is the status that you see when you run -info command on one of the workflow that you are trying to kill? e.g - 0000006-170324203356317-oozie-oozi-W If that is also shown as RUNNING. Have you tried killing just one of the workflow by giving specific workflow ID instead of running using filter? What output does that give?

trupti · ‎03-29-2017

@Chris Mata can you try this link which is in the tutorial (that worked for me) - https://raw.githubusercontent.com/hortonworks/data-tutorials/d0468e45ad38b7405570e250a39cf998def5af0f/tutorials/hdp/hdp-2.5/introduction-to-apache-hbase-concepts-apache-phoenix-and-new-backup-restore-utility-in-hbase/assets/data.csv

trupti · ‎03-22-2017

Can you add following in your code and see whether that helps? conf.addResource(<path to hbase site.xml>+"/hbase-site.xml");

trupti · ‎02-17-2017

You can try to give --driver-memory to 2g in spark-submit command and see if it helps

trupti · ‎02-07-2017

I think 1 coordinator can only have one workflow as per the xsd for coordinator- https://oozie.apache.org/docs/4.3.0/CoordinatorFunctionalSpec.html#Oozie_Coordinator_Schema_0.5 <xs:element name="action" type="coordinator:ACTION" minOccurs="1" maxOccurs="1"/> ... ... <xs:complexType name="ACTION"> <xs:sequence minOccurs="1" maxOccurs="1"> <xs:element name="workflow" type="coordinator:WORKFLOW" minOccurs="1" maxOccurs="1"/ <xs:any namespace="uri:oozie:sla:0.1" minOccurs="0" maxOccurs="1"/> </xs:sequence> </xs:complexType> So in description can you clarify what you mean by 1 coordinator with 2 workflows Bundle jobs take multiple coordinators each with one workflow and you can specify properties for start time/end time for those. Probably you can use those to accomplish the requirement.

trupti · ‎01-31-2017

Can you check what is running on 8080 using netstat command and stop it? It looks like the port is still occupied even though you have uninstalled postgres. Also you can check status of Ambari using following command to see if it is started. If port is in use it may not have started. service ambari-server status

trupti · ‎01-30-2017

Can you try http://127.0.0.1:8888 on the browser?

trupti · ‎06-24-2016

@Vijay Kumar J Before copying the spark assembly jar into share lib have you cleared other contents of the sharelib? If not, can you backup the current sharelib and then do following- Backup current sharelib - hdfs dfs -mv /user/oozie/share/lib/lib_<timestamp>/spark /user/oozie/share/lib/lib_<timestamp>/spark_old Create spark folder - hdfs dfs -mkdir /user/oozie/share/lib/lib_<timestamp>/spark Copy and Update all the required libraries ,files to the spark folder Example: hdfs dfs -put /hdp/2.4.0.0-169/spark/lib/spark-assembly-1.6.0.2.4.0.0-169-hadoop2.7.1.2.4.0.0-169.jar /user/oozie/share/lib/lib_<timestamp>/spark hdfs dfs -put /hdp/2.4.0.0-169/oozie/libserver/oozie-sharelib-spark-4.2.0.2.4.0.0-169.jar /user/oozie/share/lib/lib_<timestamp>/spark hdfs dfs -put /etc/hadoop/conf/hdfs-site.xml /user/oozie/share/lib/lib_<timestamp>/spark hdfs dfs -put /etc/hadoop/conf/core-site.xml /user/oozie/share/lib/lib_<timestamp>/spark hdfs dfs -put /etc/hadoop/conf/mapred-site.xml /user/oozie/share/lib/lib_<timestamp>/spark hdfs dfs -put /etc/hadoop/conf/yarn-site.xml /user/oozie/share/lib/lib_<timestamp>/spark oozie admin -oozie http://<oozie_server>:11000/oozie -sharelibupdate

trupti · ‎10-28-2015

The error code suggests that the oozie sharelib may not be set correctly. Was this an upgraded cluster? Also you can try following command to see if you get more info/error message /usr/hdp/current/oozie-client/bin/oozie -Doozie.auth.token.cache=false job -oozie http://hdpmaster3.bigdataprod1.wh.xxxxcorp.com:11000/oozie -info 0000005-151024200514443-oozie-oozi-W@mr-node

Online	Offline
Last Visited	‎03-27-2018 08:33 PM

Date Registered	‎09-11-2015 05:37 PM
Last Visited	‎03-27-2018 08:33 PM
Total Messages Posted	20
Total Kudos Received	26

Re: spark yarn-client mode failed due to OutOfMemo...

Re: OOzie smoke tests failed in Ambari UI

Re: hiveserver2 and hive metastore fail to start (...

Re: how to capture all ambari services/components ...

Re: Oozie Job failing when it tried to call anothe...

Re: Why does my Oozie job change from RUNNING to K...

Re: History Server startup error after installing...

Re: Oozie sqoop Hcatlog import job throwing error...

Re: I need help with hbase high availability for a...

Re: RegionServer Down

Re: org.apache.hive.service.cli.HiveSQLException: ...

Re: org.apache.hive.service.cli.HiveSQLException: ...

Re: I can not run yarn commands on the cluster

Re: Cant kill an oozie workflow

Re: Hbase tutorial - 404 not found when trying to ...

Re: Unable to use Hbase from Java API

Re: spark yarn-client mode failed due to OutOfMemo...

Re: delay specific workflow action of oozie coordi...

Re: I have installed hortonworks sandbox but when ...

Re: I have installed hortonworks sandbox but when ...

Re: Oozie Spark Integration giving FAILED for SLA ...

Re: OOzie smoke tests failed in Ambari UI