About rkottaru

rkottaru · ‎03-10-2020

Spark jobs which were not getting into the RUNNING state from ACCEPTED State,this is happening when submiting jobs with driver-memory greater that 3G. Example: spark-submit --master yarn --deploy-mode cluster --driver-memory 4G --class org.apache.spark.examples.SparkPi /usr/hdp/3.1.5.0-152/spark2/examples/jars/spark-examples_2.11-2.3.2.3.1.5.0-152.jar 10000 Error: Mon Mar 02 11:33:41 -0500 2020] Application is added to the scheduler and is not yet activated. User's AM resource limit exceeded. Details : AM Partition = <DEFAULT_PARTITION>; AM Resource Request = <memory:6144, vCores:1>; Queue Resource Limit for AM = <memory:71680, vCores:1>; User AM Resource Limit of the queue = <memory:10240, vCores:1>; Queue AM Resource Usage = <memory:6144, vCores:1>;

rkottaru · ‎12-10-2019

Thanks for the response, i tried to use below curl command to turn on/off maintenance mode but failed. curl -u user -H "X-Requested-By:ambari" -i -X PUT -d '{"RequestInfo":{"context:"Turn Off Maintenance Mode for host","query":"Hosts/host_name.in(host1,host2)"},"Body":{"Hosts":{"maintenance_state":"OFF"}}}' http://ambari_host:8080/api/v1/clusters/comcastdrcluster/hosts can someone please advise if we have anyother commands that we can use to turn on/off maintenance mode. Thanks Reshma

rkottaru · ‎12-02-2019

Hello everyone, As recently hortonworks support portal was changed , can someone help me understand how to upload smartsense budle and where to view the recommendations. Thanks Reshma

rkottaru · ‎11-06-2019

Hi, We are trying to automate the patching process. we are trying to create a script with start/stop/validate commands. can anyone help if there is any steps for this.

rkottaru · ‎10-07-2019

Hi All, Smartsense HST Server and Agents are down with connection refused error and unable to start via Ambari.

rkottaru · ‎09-26-2019

@lwang Thanks for the Info my question is , our current log directory paths are set as var/log/service so to change this to /hadoop/var/log/servce should we create any directories or move the current directories under /var/log or just change the Hadoop Log Dir Prefix to /hadoop/var/log in Ambari fix the issue.

rkottaru · ‎09-26-2019

Hi Can someone help me how to change the log directory paths from /var/log to /hadoop/var/log. we have HDFS, YARN, MapReduce2, Hive, Spark2, Zookeeper, Ambari Metrics and smartsense services running in our Dev Env.

Online	Offline
Last Visited	‎05-11-2021 01:15 PM

Date Registered	‎08-02-2019 07:03 PM
Last Visited	‎05-11-2021 01:15 PM
Total Messages Posted	9

Spark jobs which were not getting into the RUNNING...

Re: is there any way to start/stop/validate hadoop...

How to get the smartsense recommendations from new...

is there any way to start/stop/validate hadoop clu...

SmartSense HST Server connection failed: [Errno 11...

Re: Change default log directory path

Change default log directory path