Member since
07-05-2017
19
Posts
0
Kudos Received
0
Solutions
08-24-2017
03:16 PM
Hi Jay, It is resolving to the new repo. I can install the packages manually. If you see in the attached image, I wonder how the latest version info not having in the "New versions:" field. Other machines have resolved toerror1.jpg the latest version. If you can see the attached image other machines have resolved the New version. hdp-select is working good.
... View more
08-24-2017
02:38 PM
Hi, While installing packages for hdp upgrade on one of the nodes, we see the attached error. In the New versions, I don't see the version I am going to install. Here the old and New versions are both same. I checked hdp-select command, it is working good and pointing to the correct old version. error.jpg
... View more
Labels:
- Labels:
-
Hortonworks Data Platform (HDP)
08-22-2017
04:43 AM
Hi, We have a requirement to add few datanodes to existing hdp 2.4 cluster. The existing cluster has datanodes running on Redhat 6.6 and new datanodes are running with Redhat 6.8 version. Can I add them to the cluster
... View more
Labels:
- Labels:
-
Apache Hadoop
08-22-2017
04:38 AM
Hi, We have a requirement to add few datanodes to existing hdp cluster. The existing cluster has datanodes running on Redhat 6.6 version. The new datanodes that are to be added are running on Redhat 6.8 version. Can I add them to the existing cluster as datanodes.
... View more
Labels:
08-22-2017
04:37 AM
Hi, We have a requirement to add few datanodes to existing hdp cluster. The existing cluster has datanodes running on Redhat 6.6 version. The new datanodes that are to be added are running on Redhat 6.8 version. Can I add them to the existing cluster as datanodes.
... View more
Labels:
08-04-2017
06:43 AM
Hi Jay, The cluster is kerberoized. Our custom "ambari-qa" account is part of proxyusers groups and hosts. yarn.acl.enable = true tez.am.view-acls=<empty> yarn.admin.acl = yarn, dr.who, <our-custom-yarn-user> Please suggest me do I need to modify anything
... View more
08-04-2017
05:54 AM
tez-issue.jpgHi, TEZ view not showing any jobs. Please see the attached screen shot. TEZ has integrated with Timeline DB and timeline server is running good. Could anyone help me on this asap.
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Tez
07-31-2017
07:06 AM
Hi, dynamic allocation is enabled and the value of max dynamic allocation executors is set to 10. My yarn container min. size is 4GB, executor size is 10 GB, overhead memory is 384MB, so the containers are launching with 12GB. We are ok with 12 GB container size and also we are clear on the memory utilization. But, we failed to understand how spark is launching more containers than the no. of executors. I think for driver also it uses AM container rather than launching separate container for the driver process.
... View more
07-29-2017
05:28 PM
Hi, Please correct me if I am wrong. As per my understanding Spark can run equal no. of containers to that of Executors. When we run a job with 600 executors, the spark trying to run more containers roughly around 700 causing the job fail as my queue allow ro run upto 620 containers. Please help me in this issue. As per my understanding all tasks are executed in spark executor containers. Then, how come these extra containers got launched
... View more
Labels:
- Labels:
-
Apache Spark
-
Apache YARN
07-20-2017
08:37 AM
Hi, My cluster is kerbeorized with KMS. When I execute the following command I am getting the below error. Could anyone help me on this asap. curl --negotiate -u : -X GET http://<clustername>:9292/kms/v1/keyversion/<keyname@0/_eek?ee_op=decrypt { "RemoteException" : { "message" : null, "exception" : "WebApplicationException", "javaClassName" : "javax.ws.rs.WebApplicationException" } In the kms-audit.log I see the following error "ErrorMsg:'Authentication required' saying that Authentication required. I specified --negotiate option and -u option as well. But the below command is working curl --negotiate -u : -X GET http://<clustername>:9292/kms/v1/keyversion/<keyname@0 { "name" : "<keyname", "versionName" : "<keyname>@0", "material" : "<some value>" } The user with which the command is being executed has the valid Kerberos ticket and decrypt permissions also set with Ranger kms web ui
... View more
Labels:
- Labels:
-
Apache Hadoop
-
Apache Ranger
07-20-2017
07:13 AM
Hi, My cluster is kerbeorized with KMS. When I execute the following command I am getting the below error. Could anyone help me on this asap. curl --negotiate -u : -X GET http://<clustername>:9292/kms/v1/keyversion/<keyname@0/_eek?ee_op=decrypt {
"RemoteException" : {
"message" : null,
"exception" : "WebApplicationException",
"javaClassName" : "javax.ws.rs.WebApplicationException"
} In the kms-audit.log I see the following error "ErrorMsg:'Authentication required' saying that Authentication required. I specified --negotiate option and -u option as well. But the below command is working curl --negotiate -u : -X GET http://<clustername>:9292/kms/v1/keyversion/<keyname@0 {
"name" : "<keyname",
"versionName" : "<keyname>@0",
"material" : "<some value>"
} The user with which the command is being executed has the valid Kerberos ticket and decrypt permissions also set with Ranger kms web ui
... View more
Labels:
- Labels:
-
Apache Ranger
-
Kerberos
07-18-2017
05:34 AM
Hi Vineet, It is ambari 2.2.2 version. It is a fresh install.
... View more
07-17-2017
01:52 PM
Hi Jay, In ambari server logs, I didn't see any error or warning. The log also stopped at "INFO [qtp-ambari-client-255] StackAdvisorRunner:71 - advisor script stderr: I also checked in the corresponding stack recommendations folder in ambari server pid folder, There are no entries. I observe this scenario only for HAWQ service, rest of the services are being installed or moving forward from that stuck page.
... View more
07-17-2017
01:37 PM
Hi, I could see hawq installation is stuck forever at "Customize services" page in ambari 2.2 while installation. stack is hdp 2.4. Could any one please help on this issue. hawq-error.jpg
... View more
- Tags:
- hawq
Labels:
07-17-2017
01:23 PM
@Jay Thanks for your immediate reply. The above commands resolved the issue.
... View more
07-17-2017
01:09 PM
Hi, I am using hdp 2.4 with ambari 2.2. I am continuously seeing the following message in ambari server logs. Unable to run the ambari_server_stale_alerts alert: java.lang.NullPointerException WARN [qtp-ambari-client-62] servletHandler:563 - /api/v1/clusters/<ournameofCluster>/alerts The curl command to ambari alerts received status 500 server error. curl -u <user>:<password> -X GET http://<host>:8080/api/v1/clusters/<nameofourcluster>/alerts the same curl command is working for alert_definitions. Please help me on this asap. Thanks
... View more
Labels:
- Labels:
-
Apache Ambari