About mravipati

mravipati · ‎08-24-2017

Hi Jay, It is resolving to the new repo. I can install the packages manually. If you see in the attached image, I wonder how the latest version info not having in the "New versions:" field. Other machines have resolved toerror1.jpg the latest version. If you can see the attached image other machines have resolved the New version. hdp-select is working good.

mravipati · ‎08-24-2017

Hi, While installing packages for hdp upgrade on one of the nodes, we see the attached error. In the New versions, I don't see the version I am going to install. Here the old and New versions are both same. I checked hdp-select command, it is working good and pointing to the correct old version. error.jpg

mravipati · ‎08-22-2017

Hi, We have a requirement to add few datanodes to existing hdp 2.4 cluster. The existing cluster has datanodes running on Redhat 6.6 and new datanodes are running with Redhat 6.8 version. Can I add them to the cluster

mravipati · ‎08-22-2017

Hi, We have a requirement to add few datanodes to existing hdp cluster. The existing cluster has datanodes running on Redhat 6.6 version. The new datanodes that are to be added are running on Redhat 6.8 version. Can I add them to the existing cluster as datanodes.

mravipati · ‎08-22-2017

Hi, We have a requirement to add few datanodes to existing hdp cluster. The existing cluster has datanodes running on Redhat 6.6 version. The new datanodes that are to be added are running on Redhat 6.8 version. Can I add them to the existing cluster as datanodes.

mravipati · ‎08-04-2017

Hi Jay, The cluster is kerberoized. Our custom "ambari-qa" account is part of proxyusers groups and hosts. yarn.acl.enable = true tez.am.view-acls=<empty> yarn.admin.acl = yarn, dr.who, <our-custom-yarn-user> Please suggest me do I need to modify anything

mravipati · ‎08-04-2017

tez-issue.jpgHi, TEZ view not showing any jobs. Please see the attached screen shot. TEZ has integrated with Timeline DB and timeline server is running good. Could anyone help me on this asap.

mravipati · ‎07-31-2017

Hi, dynamic allocation is enabled and the value of max dynamic allocation executors is set to 10. My yarn container min. size is 4GB, executor size is 10 GB, overhead memory is 384MB, so the containers are launching with 12GB. We are ok with 12 GB container size and also we are clear on the memory utilization. But, we failed to understand how spark is launching more containers than the no. of executors. I think for driver also it uses AM container rather than launching separate container for the driver process.

mravipati · ‎07-29-2017

Hi, Please correct me if I am wrong. As per my understanding Spark can run equal no. of containers to that of Executors. When we run a job with 600 executors, the spark trying to run more containers roughly around 700 causing the job fail as my queue allow ro run upto 620 containers. Please help me in this issue. As per my understanding all tasks are executed in spark executor containers. Then, how come these extra containers got launched

mravipati · ‎07-20-2017

Hi, My cluster is kerbeorized with KMS. When I execute the following command I am getting the below error. Could anyone help me on this asap. curl --negotiate -u : -X GET http://<clustername>:9292/kms/v1/keyversion/<keyname@0/_eek?ee_op=decrypt { "RemoteException" : { "message" : null, "exception" : "WebApplicationException", "javaClassName" : "javax.ws.rs.WebApplicationException" } In the kms-audit.log I see the following error "ErrorMsg:'Authentication required' saying that Authentication required. I specified --negotiate option and -u option as well. But the below command is working curl --negotiate -u : -X GET http://<clustername>:9292/kms/v1/keyversion/<keyname@0 { "name" : "<keyname", "versionName" : "<keyname>@0", "material" : "<some value>" } The user with which the command is being executed has the valid Kerberos ticket and decrypt permissions also set with Ranger kms web ui

mravipati · ‎07-20-2017

Hi, My cluster is kerbeorized with KMS. When I execute the following command I am getting the below error. Could anyone help me on this asap. curl --negotiate -u : -X GET http://<clustername>:9292/kms/v1/keyversion/<keyname@0/_eek?ee_op=decrypt { "RemoteException" : { "message" : null, "exception" : "WebApplicationException", "javaClassName" : "javax.ws.rs.WebApplicationException" } In the kms-audit.log I see the following error "ErrorMsg:'Authentication required' saying that Authentication required. I specified --negotiate option and -u option as well. But the below command is working curl --negotiate -u : -X GET http://<clustername>:9292/kms/v1/keyversion/<keyname@0 { "name" : "<keyname", "versionName" : "<keyname>@0", "material" : "<some value>" } The user with which the command is being executed has the valid Kerberos ticket and decrypt permissions also set with Ranger kms web ui

mravipati · ‎07-18-2017

Hi Vineet, It is ambari 2.2.2 version. It is a fresh install.

mravipati · ‎07-17-2017

Hi Jay, In ambari server logs, I didn't see any error or warning. The log also stopped at "INFO [qtp-ambari-client-255] StackAdvisorRunner:71 - advisor script stderr: I also checked in the corresponding stack recommendations folder in ambari server pid folder, There are no entries. I observe this scenario only for HAWQ service, rest of the services are being installed or moving forward from that stuck page.

mravipati · ‎07-17-2017

Hi, I could see hawq installation is stuck forever at "Customize services" page in ambari 2.2 while installation. stack is hdp 2.4. Could any one please help on this issue. hawq-error.jpg

mravipati · ‎07-17-2017

@Jay Thanks for your immediate reply. The above commands resolved the issue.

mravipati · ‎07-17-2017

Hi, I am using hdp 2.4 with ambari 2.2. I am continuously seeing the following message in ambari server logs. Unable to run the ambari_server_stale_alerts alert: java.lang.NullPointerException WARN [qtp-ambari-client-62] servletHandler:563 - /api/v1/clusters/<ournameofCluster>/alerts The curl command to ambari alerts received status 500 server error. curl -u <user>:<password> -X GET http://<host>:8080/api/v1/clusters/<nameofourcluster>/alerts the same curl command is working for alert_definitions. Please help me on this asap. Thanks

Online	Offline
Last Visited	‎09-18-2017 06:36 PM

Date Registered	‎07-05-2017 08:09 AM
Last Visited	‎09-18-2017 06:36 PM
Total Messages Posted	19

Re: Install packages for HDP upgrade

Install packages for HDP upgrade

datanodes comission having different Linux version

datanodes running on different linux versions

Datanodes on different linux versions

Re: TEZ View not showing any jobs

TEZ View not showing any jobs

Re: Spark is running more containers than no. of e...

Spark is running more containers than no. of execu...

Ranger KMS throws exception

KMS throws exceptions

Re: Hawq 2.0.1 stucks forever at "Customize servic...

Re: Hawq 2.0.1 stucks forever at "Customize servic...

Hawq 2.0.1 stucks forever at "Customize services" ...

Re: Unable to run the ambari_server_stale_alerts a...

Unable to run the ambari_server_stale_alerts alert...