Member since
01-19-2017
3679
Posts
632
Kudos Received
372
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 844 | 06-04-2025 11:36 PM | |
| 1426 | 03-23-2025 05:23 AM | |
| 714 | 03-17-2025 10:18 AM | |
| 2555 | 03-05-2025 01:34 PM | |
| 1671 | 03-03-2025 01:09 PM |
11-16-2017
02:21 PM
@Rahul Narayanan Can you run the commands one after the other and proceed with your cluster creation # ambari-server stop
# ambari-server reset
# ambari-server start Hope that helps
... View more
11-16-2017
12:12 PM
1 Kudo
@Bala Vignesh N V hadoop fs has been deprecated, From hadoop 2.0 use hdfs dfs instead.Having said that hadoop fs -test -[defsz] URI is used to check the hdfs and it takes the below options: -d: f the path is a directory, return 0.
-e: if the path exists, return 0.
-f: if the path is a file, return 0.
-s: if the path is not empty, return 0.
-z: if the file is zero length, return 0. Example Check for valid directories in hdfs $ hdfs dfs -ls /
Found 7 items
drwxrwx--- - ambari-qa hdfs 0 2017-10-19 14:13 /user/ambari-qa
drwxr-xr-x - druid hdfs 0 2017-10-19 20:49 /user/druid
drwxr-xr-x - hbase hdfs 0 2017-10-19 13:43 /user/hbase
drwxr-xr-x - hcat hdfs 0 2017-10-19 13:53 /user/hcat
drwxr-xr-x - hive hdfs 0 2017-10-19 13:53 /user/hive
drwxrwxr-x - oozie hdfs 0 2017-10-19 13:57 /user/oozie
drwxr-xr-x - zeppelin hdfs 0 2017-10-19 19:25 /user/zeppelin Test whether path exists,the below returns 0 $ hdfs dfs -test -e /user/druid Hope that helps
... View more
11-16-2017
10:58 AM
@Rahul Narayanan Good news, you can now proceed using postgres doesn't cause any problems at all, but if you are a fan of MySQL then see link. if you intend to use the embedded postgres then choose option 1 when running ambari-server setup Using Postgres is straightforward and easy
... View more
11-16-2017
09:18 AM
@Rahul Narayanan When you hit the below URL's can you see the bits you downloaded and unzipped earlier? http://xxxxmaapl685.ad.infosys.com/Ambari-2.6.0.0/centos6
http://xxxxmaapl685.ad.infosys.com/hdp/HDP-UTILS-1.1.0.21/repos/centos6
http://xxxxmaapl685.ad.infosys.com/hdp/HDP/centos6/2.x/updates/2.6.3.0 Please see this 2 videos localrepo1 localrepo2 Ensure your setup matches this short demo
... View more
11-16-2017
08:34 AM
@Rahul Narayanan Can you share your ambari/hdp.repos in /etc/yum.repos.d/*, because the error just confirms that installation is pointing to an public repo Clean out all packages and metadata from cache yum clean all Ensure your ambari & hdp repos point to the internal repos above Check enabled repos yum repolist Retry the installation
... View more
11-15-2017
10:22 PM
1 Kudo
@Vijay Kumar Yadav A good starting point is to attach your ambari-server logs and also check your FW settings Also check if the port is free and listening $ netstat -an | grep 8080 | grep -i listen or curl http://ambari-server-ip:8080 This should give you some idea whether the port is reachable or not
... View more
11-15-2017
09:31 PM
@Rahul Narayanan It's very important to stick to the official documentation see link Defining a repository during the install step wont force Ambari to pick up that location it will always read from the /etc/yum.repos.d/* Yes you should create the /var/www/html/ directory and unzip as stated in the document. Remember to copy the repos to all the nodes in the cluster! Good luck
... View more
11-15-2017
03:49 PM
@Rahul Narayanan These are the 2 files (baseurl)you should update to point to the local repo /etc/yum.repos.d/ambari.repo
/etc/yum.repos.d/hdp.repo Hope that helps
... View more
11-15-2017
03:37 PM
@Daniel Müller I think your cluster is kerberized. The cause the nameNode is switching to safe mode is due to the communication time out in between the KDC server. The error should appear in the /var/log/hadoop-hdfs log You should find an error stack like below. Caused by: javax.security.auth.login.LoginException: Receive timed out at com.sun.security.auth.module.Krb5LoginModule.attemptAuthentication(Krb5LoginModule.java:808) at com.sun.security.auth.module.Krb5LoginModule.login(Krb5LoginModule.java:617) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at javax.security.auth.login.LoginContext.invoke(LoginContext.java:755) at javax.security.auth.login.LoginContext.access$000(LoginContext.java:195) at The solution on this problem will be adding a line to krb5.conf under the [libdefaults] section: udp_preference_limit = 1 You shouldn't edit the local /etc/krb5.conf but you have to use the Ambari UI go to Ambari > kerberos > Configs > Advanced krb5-conf to make the change. This ensures that the new setting available on all nodes within the cluster. See atached screenshot save and restart all required services Please let me know if that helped.
... View more
11-14-2017
03:18 PM
@raouia Let me quickly reproduce your environment, HDP cluster 2.6.3 Kerberized? Hue version and OS link you used for download and installation? Can you briefly describe your environment?
... View more