Member since
10-01-2020
19
Posts
0
Kudos Received
0
Solutions
01-24-2023
03:34 AM
Hey @joao_ascenso! After formatting the namenode, I am not able to see my file structure as you mentioned in your answer. How can I recover the namenode metadata. The blocks are present on the datanodes, but can you help me recover them so that I can see them in hdfs using hdfs dfs -ls command like before?
... View more
03-07-2021
09:23 PM
@Scharan thanks a lot for replying. The solution you suggested worked! But I just wanted to know whether modifying those two properties as you mentioned will cause any decrease in the security of my HDFS or cluster anyway?
... View more
03-02-2021
11:48 PM
HTTP ERROR 401 Problem accessing /ui2/. Reason: Unauthorized access
... View more
03-02-2021
10:55 PM
Ambari : 2.7.4 HDP : 3.1.4.0-315 Hi everyone, Recently after kerberizing my cluster, I am unable to access my Resource Manager UI. Whenever I hit on the resource manager link on Ambari, it shows up the following error : Please help me out to resolve this issue as soon as possible. @KuldeepK @Shelton @jsensharma
... View more
Labels:
- Labels:
-
Kerberos
01-04-2021
12:23 AM
Thanks @Shelton I found that the issue was popping up because of wrong entries in my local DNS (/etc/hosts) file which I have now resolved.
... View more
12-31-2020
02:38 AM
Hi everyone, Ambari :- 2.7.4 HDP :- 3.1.4.0 I was facing some issue with the mysql server on the host where my ambari server was running. So, I removed mysql completely with some purge commands and now after setting up the mysql server back and creating required database, users and sourcing Ambari-DDL-MySQL-CREATE.sqlas mentioned in the Ambari docs : https://docs.cloudera.com/HDPDocuments/Ambari-2.7.5.0/administering-ambari/content/amb_using_ambari_with_mysql_or_mariadb.html Now, when I opened the my ambari web Ui I was asked again to setup my cluster using Ambari Installation Wizard. All agents are up and running on datanodes and namenode still but my server is not able to recognize them back ( I guess all because I reinstalled MySQL and all the ambari server data was wiped out ). Its i now asking me back to setup cluster again but I cant do that even as on the step of setting up the agents it shows that multiple java processes are running there on the agents. So my question is how to either make the server realize its previous cluster state or if I need to setup the cluser again, then how do I go about removing the installed services on the master node and the slave nodes and start the cluster setup from scratch. Thanks in advance, Please help guys! @KuldeepK @Shelton
... View more
Labels:
- Labels:
-
Apache Ambari
12-22-2020
11:18 PM
Hi eveyone, Ambari :- 2.7.4.0 HDP :- 3.1.4.0 I want to know whether postgresql in addition to MYSQL ( I will be using MYSQL in advanced database configuration while setting up Ambari server as my choice ) is needed for Ambari ( 2.7.4 ) installation or not. If it is needed should I install it on both Ambari Server host and also Ambari Agent hosts or only Ambari Server host. On which hosts is it required? Please help! @KuldeepK @jsensharma @MattWho @Shelton
... View more
Labels:
- Labels:
-
Apache Ambari
12-21-2020
12:03 AM
Hello everyone, I recently kerberized my cluster running Ambari 2.7.4 and HDP stack 3.1.4.0-315. Now I am unbale to access my Resource Manager UI `http://<IP_address>:8088/ui2/`. It shows up as follows: Please help me out and let me know if any more info is needed. @KuldeepK @mattw @Shelton
... View more
Labels:
- Labels:
-
Apache Ambari
12-14-2020
01:26 AM
@Shelton When I use root or sudo for kadmin then it enter as root/admin@EXAMPLE.AI not what (credentials) I enter in Ambari Kerberos Web Wizard : [ Entering as root ] # kadmin Authenticating as principal root/admin@EXAMPLE.AI with password. Password for root/admin@EXAMPLE.AI: error is still there as posted above. Please help!
... View more
12-14-2020
01:08 AM
Thanks @Shelton for the detailed reply. The previous got resolved but now I am facing a new error : [ Error ] 500 status code received on POST method for API: /api/v1/clusters/couture/requests Error message: An internal system exception occurred: Unexpected error condition executing the kadmin command. STDERR: kadmin: Matching credential not found while initializing kadmin interface When I hit [ $ kadmin ] command from CLI of client hosts, then I get the following output: $ kadmin Couldn't open log file /var/log/kadmind.log: Permission denied Authenticating as principal example/admin@EXAMPLE.AI with password. Password for example/admin@EXAMPLE.AI: and I am able to login with the password for the admin principal and I am using the same admin principal and the password for Ambari Kerberos Wizard. I found similar issue : https://community.cloudera.com/t5/Support-Questions/Unexpected-error-condition-executing-the-kadmin-command/td-p/242295 but the solution is quite unclear to me. Please throw some light on this! Please help me in resolving this issue. Thanks a lot. @Shelton @KuldeepK @jsensharma @MattWho
... View more
12-11-2020
05:51 AM
@Shelton Thanks for the reply. 1) Yes, I have entered the 'admin principal' in the same format example/admin@EXAMPLE.AI. in the pop-up window. 2) Also, I checked the krb5.conf and found a section for my realm (EXAMPLE.COM) inside the [realms] part of the file. Still the message remains the same and the error logs too as uploaded in the question above. Please help in resolving the issue.
... View more
12-11-2020
04:57 AM
Hello everyone, Ambari : 2.7.4 HDP : 3.1.4.0 While kerberizing my cluster using MIT-KDC and Ambari Kerberos Wizard. I am facing the following window popup at the time of Testing client after client installation saying : [ Invalid KDC administrator credentials. Please enter admin principal and password. ] Error logs in /var/log/ambari-server/ : We are using the right password and amin principal created while setting up MIT-KDC. Still, the window pops up with the same message again and again. Please help in resolving the issue. @jsensharma @Shelton @KuldeepK @nsabharwal Thanks in advance!
... View more
Labels:
- Labels:
-
Kerberos
12-04-2020
01:27 AM
@sshimpi I am getting this failure error when I do gradle clean build : The 'sonar-runner' plugin has been deprecated and is scheduled to be removed in Gradle 3.0. please use the official plugin from SonarQube ( http://docs.sonarqube.org/display/SONAR/Analyzing+with+Gradle ). :clean :buildInfo :compileJava FAILURE: Build failed with an exception. * What went wrong: Could not resolve all dependencies for configuration ':compile'. > Could not resolve com.sequenceiq:ambari-client20:2.0.1. Required by: com.sequenceiq:ambari-shell: 0.1.DEV > Could not resolve com.sequenceiq:ambari-client20:2.0.1. > Could not get resource ' http://maven.sequenceiq.com/snapshots/com/sequenceiq/ambari-client20/2.0.1/ambari-client20-2.0.1.pom '. > Could not GET ' http://maven.sequenceiq.com/snapshots/com/sequenceiq/ambari-client20/2.0.1/ambari-client20-2.0.1.pom '. > maven.sequenceiq.com : Name or service not known > Could not resolve com.sequenceiq:ambari-client20:2.0.1. > Could not get resource ' http://maven.sequenceiq.com/release/com/sequenceiq/ambari-client20/2.0.1/ambari-client20-2.0.1.pom '. > Could not GET ' http://maven.sequenceiq.com/release/com/sequenceiq/ambari-client20/2.0.1/ambari-client20-2.0.1.pom '. > maven.sequenceiq.com > Could not resolve com.sequenceiq:ambari-client20:2.0.1. > Could not get resource ' http://maven.sequenceiq.com/releases/com/sequenceiq/ambari-client20/2.0.1/ambari-client20-2.0.1.pom '. > Could not GET ' http://maven.sequenceiq.com/releases/com/sequenceiq/ambari-client20/2.0.1/ambari-client20-2.0.1.pom '. > maven.sequenceiq.com * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. BUILD FAILED Total time: 11.708 secs Please help!
... View more
12-02-2020
05:05 AM
Hello everyone,
Ambari = 2.7.4
HDP = 3.1.4.0
We need to install Ambari (HDP stack) on our Production Environment running on Ubuntu 16. But the production servers dont have internet access and no ports are open, hence Ambari Install Wizard (Web UI) is not accessible. We used local repository menthod to install ambari server and agents on our cluster. Now the cluster setup and service installation/start up is left which is done via Ambari Web UI installation Wizard.
Recently we came across, Ambari Blueprint that uses REST APIs for cluster deployment. However we are skeptical about the foloowing points:
1) How to specify proper custom configirations for various services ( Hive, Ranger, Kerberos, etc. ) in the json files for the blueprint approach as the propeties are not well documented over the internet.
2) Will we be able to manage the cluster like maintaining HA, Kerberos , Ranger security without their respective wizard.
3) As there wont be any alerts/ warnings as we got from Ambari WebUI, how will the proper monitoring of the production cluster be carried out at any point of time.
4) Maintaing cluster health, Log aggregation, Commission/Decommissioning of nodes, Service additon/ deletion be carried out properly.
5) Will the proper functioning as it is achieved through Ambari WebUI, be achieved through the REST APIs.
Also, is the Blueprint deployment approach recommended for Production environment ( No-Internet access, no port open )?
Please help and thanks in advance!
@jsensharma @Shelton @nsabharwal @KuldeepK
... View more
Labels:
11-29-2020
12:58 AM
Hi everyone, Ambari :- 2.7.4 HDP :- 3.1.4.0 I had done the ambari installation using local repositories with no Internet access for Ambari and HDP as mentioned in the official docs by creating directory structure /var/www/html and, untarred all the HDP and Ambari files into /var/www/html/hdp and /var/www/html respectively, as mentioned in the docs. :- [ Ref :- https://docs.cloudera.com/HDPDocuments/Ambari-2.7.5.0/bk_ambari-installation/content/getting_started_setting_up_a_local_repository.html https://docs.cloudera.com/HDPDocuments/Ambari-2.7.5.0/bk_ambari-installation/content/setting_up_a_local_repository_with_no_internet_access.html ] Then, I used python's Simple HTTP Server to host my local repository by running the command `python -m SimpleHTTPServer 2000` from inside /var/www/ instead of using Apache HTTP server as mentioned in the docs, to host my repositories in html directory on port 2000. Installation was done and services are running fine. But the problem that I am facing is the / (root) partition of my system is now at 98% and these files of ambari inside the /var/www/html are taking up 11 GBs. So my question is as the installation is done and the services have been running for few days, is it possible to move all the files inside the /var/www/html into some other directory on my system (lets says /app) and create a directory /app/html and put all those ambari and HDP files inside it and then create a new python SimpleHTTPServer from /app as I did for /var/www/ to host the newly created html directory containing the copied files? What effects will it have, if any and is it safe to do that as my cluster is up and running? Is there any other way is this is not possible? Thanks in advance. Please help! @jsensharma @Shelton @nsabharwal
... View more
Labels:
10-10-2020
10:29 AM
Hi everyone, I am new to Ambari and have just installed Ambar 2.7.4 with HDP stack 3.1.4 with a cluster having 1 node running the Ambari Server, one being the master node of all service components and there is one more. The installation completed with few warnings, all the services on the web UI are running with green light on. The problem is an alert that says.. SmartSense Bundle Capture Failure Last SamrtSense bundle was not successful. Bundle key.unspecified_xxxxxx_0_2020-10-04_02-00-01, status:failed Also, the Activity Analyzer stops again and again after restarting it. All other services are running. PS: I have just installed this and haven't loaded any data or anything or tested anything. Please provide help! Thankyou! @jsensharma @MattWho @Shelton @nsabharwal
... View more
Labels:
- Labels:
-
Apache Ambari
-
Hortonworks SmartSense