@Aman075  Instead of doing "#cd  forPig" and then checking the listing can you try specifying the fully qualified path of the dir like: (because there may be multiple "forPig" directories (like one may be in relative path and other on absolute path)   # pwd # ls -lart /forPig     If you still face any issue then please try the DEBUG logging to see if there is anything wrong?   # export HADOOP_ROOT_LOGGER=DEBUG,console # hdfs dfs -get -f /testing/pigData/drivers.csv /forPig/   . ... View more

@Aman075  Because the directory "/forPig" or may be its content already exist in your local file system hence the hdfs get command is not able to replace the local dir/file "/forPig" content with the HDFS file content  "/testing/pigData/drivers.csv"   So if you want to override the content inside the directory "/forPig" then you can use "-f" force option.   # hdfs dfs -get -f /testing/pigData/drivers.csv /forPig/drivers.csv (OR) # hdfs dfs -get -f /testing/pigData/drivers.csv /forPig/     Also in your case "/forData" seems to be a directory hence you can try to specify the filename there like above or the dir like above   ... View more

@prakashpunj  By default it uses sqllite as Database (no password). However, you can try checking the following files for more details on the Superset host.   # grep 'SUPERSET_DATABASE_PASSWORD' /etc/superset/conf/superset_config.py # grep 'SUPERSET_DATABASE_PASSWORD' /var/lib/ambari-agent/data/command-*   . Via ambari Ui you can check   Ambari UI --> Superset --> Configs --> 'SUPERSET META DATA STORAGE CONFIG' (tab)   Search for "Superset Database password" section in the above page and verify if it is empty or password is set. . ... View more

@Ham  Starting with the   Ambari 2.7.5   release, access to Ambari repositories requires authentication. To access the binaries, you must first have the required authentication credentials ( username   and   password ). Authentication credentials for new customers and partners are provided in an email sent from Cloudera to registered support contacts. Existing users can file a non-technical case within the support portal (https://my.cloudera.com) to obtain credentials. Reference:  https://docs.cloudera.com/HDPDocuments/Ambari-2.7.5.0/bk_ambari-installation/content/access_ambari_paywall.html https://www.cloudera.com/contact-sales.html ... View more

@san_t_o  In addition to my previous comment: Which path do you see when you run following on failing NodeManager node?   # source /etc/hadoop/conf/yarn-env.sh # echo $JAVA_LIBRARY_PATH :/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir (OR) # echo $HADOOP_OPTS -Dyarn.id.str= -Dyarn.policy.file=hadoop-policy.xml -Djava.io.tmpdir=/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir   If that path writable for the yarn user? Or if that user belongs to the correct group?   # id yarn   . ... View more

@san_t_o  Can you please check few things: 1). Please verify what is the value set for "" property in the NodeManager option? (If it starts even for few seconds) # ps -ef | grep NodeManager Things to look for: 2). If above does not start due to the "" error then please check the permissions set for this directory: Example: # ls -ld /var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir drwxrwxrwt. 8 hdfs hadoop 4096 Feb 25 07:23 /var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir # ls -ld /var/lib/ambari-agent/tmp/ drwxrwxrwt. 12 ambari hadoop 4096 Mar 4 01:48 /var/lib/ambari-agent/tmp/ Why we wanted to check permissions on "/var/lib/ambari-agent/tmp/" and "/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir" directory because the "" is usually set to this directory so the yarn user should have proper read/write access on the directory listed here. Example: # grep 'JAVA_LIBRARY_PATH' /etc/hadoop/conf/yarn-env.sh export JAVA_LIBRARY_PATH="${JAVA_LIBRARY_PATH}:/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir" 3). Also please check if you see any "" related files here. Ideally those should be owned by "yarn" user like "yarn:hadoop" (hadoop is group). This directory and it's content should be writable be yarn user. Example: # ls -lart /var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir/libleveldbjni* -rwxr-xr-x. 1 yarn hadoop 752803 Dec 2 06:33 /var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir/libleveldbjni-64-1-2529926063314066012.8     Possible Cause: So if by mistake if you would have ever restarted YARN NodeManager /RM with "root" user then the permissions on those directories/files might have changed and it might not be writable by Yarn user. So please check the directory permissions if they are writable or not?   ... View more

@stryjz  Most the API calls will remain same/similar in Ambari 2.7 and previous releases. Ambari 2.7 has a cool new feature where it is integrated with Swagger and you can try and explore all the REST APIs. Steps to use Swagger Login to Ambari Hit this url (   http://{ambari-host}:8080/api-docs) For more information on this please refer to : https://community.cloudera.com/t5/Community-Articles/How-To-Use-Swagger-with-Ambari-Explore-Ambari-REST/ta-p/248692   If your question is answered then, Please make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.   ... View more

@alepiedra  Are you really connecting to the MySQL db provided as part of Sandbox ? Or is it some other mysql? Can you try specifying the Hostname as well in the mysql command to see how it goes? Something like this   # mysql -u root -h sandbox.hortonworks.com     . ... View more

@Daria  Ideally a 4 node cluster is good enough to setup locally with VirtualBox in a local environment to test various features in a HDFS/Yarn HA Enabled cluster.  However, if you want to quickly test some features in a single host machine then you can also have a look at the HDP Sandbox.  https://www.cloudera.com/downloads/hortonworks-sandbox/hdp.html ... View more

@shyamshaw  Hive LLAP uses Hive 2.x, So please check if you have enabled the LLAP interactive query in order to get the statistics for the partition table. Also  can you please verify if you have "Interactive Mode" is enabled for the Hive View ?   Ambari UI --> Manage Ambari --> Views --> Hive > Hive View 2.0   Find the "Settings" section, and verify if the "Interactive Mode" is set to "true" or not? If not then can you try to set it to "true" and then hard refresh the browser and then try again. ... View more

@Sud  To reset of forgotten password to 'admin' https://community.cloudera.com/t5/Community-Articles/Ambari-2-7-0-How-to-Reset-Ambari-Admin-Password-from/ta-p/248891   Once you remember the old admin credential (or have already reset to 'admin'). https://docs.cloudera.com/HDPDocuments/Ambari-2.7.5.0/administering-ambari/content/amb_change_the_admin_password.html If your question is answered then, Please make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button. ... View more

@mike_bronson7  In addition to my previous comment: Ambari provides option to "Rolling Restart Kafka Brokers" (one by one). In the ambari UI when you click on Ambari UI --> Kafka --> Service Actions (drop down) --> "Restart Kafka Brokers" Then it basically shows the Rolling restart Settings like. You can decide how much time in your env one Kafka Broker full restart taks and then after how much time do you want other Kafka broker restart will be scheduled by Ambari.   It can also be achieved using the API call as following: # curl -iskH "X-Requested-By: ambari" -u admin:admin -X POST -d '[{"RequestSchedule":{"batch":[{"requests":[{"order_id":1,"type":"POST","uri":"/clusters/NewCluster/requests","RequestBodyInfo":{"RequestInfo":{"context":"_PARSE_.ROLLING-RESTART.KAFKA_BROKER.1.3","command":"RESTART"},"Requests/resource_filters":[{"service_name":"KAFKA","component_name":"KAFKA_BROKER","hosts":"testnode2.example.com"}]}},{"order_id":2,"type":"POST","uri":"/clusters/NewCluster/requests","RequestBodyInfo":{"RequestInfo":{"context":"_PARSE_.ROLLING-RESTART.KAFKA_BROKER.2.3","command":"RESTART"},"Requests/resource_filters":[{"service_name":"KAFKA","component_name":"KAFKA_BROKER","hosts":"testnode3.example.com"}]}},{"order_id":3,"type":"POST","uri":"/clusters/NewCluster/requests","RequestBodyInfo":{"RequestInfo":{"context":"_PARSE_.ROLLING-RESTART.KAFKA_BROKER.3.3","command":"RESTART"},"Requests/resource_filters":[{"service_name":"KAFKA","component_name":"KAFKA_BROKER","hosts":"testnode5.example.com"}]}}]},{"batch_settings":{"batch_separation_in_seconds":"121","task_failure_tolerance":1}}]}}]' ttp://testnode1.example.com:8080/api/v1/clusters/NewCluster/request_schedules   . ... View more

@mike_bronson7  Looks like you have asked a very similar query on the other thread : https://community.cloudera.com/t5/Support-Questions/amari-rest-API-how-to-stop-service-on-specific-host/m-p/290651 ... View more

@Sud  Ambari will not allow any user creation without having a valid ambari crdentials.   However, I have responded to a very similar query of yours in the other thread which you have opened here:  https://community.cloudera.com/t5/Support-Questions/Create-new-Ambari-user-without-Ambari-admin-credential/m-p/290601   Please take a look at that thread , to reset  the password of any ambari local user to 'admin' and then later it can be changed to any desired password. ... View more

@Sud  You can try resetting the ambari 'admin' user's password to default 'admin' by running the following queries in the Ambari DB. Then you should be able to login to Ambari UI as user: "admin" and password: "admin". Then you can change the password to your desired one. 1). Stop Ambari Server # ambari-server stop 2). Take a Backup of Ambari DB (just for a safe copy) 3). Login to your Database like using psql/mysql/sqlplus utility and connect to Ambari DB then run any of the below quwery based on your Ambari Version. If you are using Ambari 2.6 Or previous Ambari versions then you can run the following SQL Query in your Ambari DB UPDATE users SET user_password='538916f8943ec225d97a9a86a2c6ec0818c1cd400e09e03b660fdaaec4af29ddbb6f2b1033b81b00' WHERE user_name='admin' For Ambari 2.7.x you can run the following query in Ambari DB UPDATE user_authentication SET authentication_key='538916f8943ec225d97a9a86a2c6ec0818c1cd400e09e03b660fdaaec4af29ddbb6f2b1033b81b00' WHERE user_id IN (SELECT user_id FROM users WHERE user_name='admin'); 4). Restart Ambari Server and then login to ambari UI with admin/admin credential. # ambari-server start   . Using above approach you can change any users password to 'admin' and then later from ambari UI the password can be changed. ... View more

@stryjz  In order to turn ON maintenance mode for Host "abcd.example.com" # curl -iLvk -u admin:admin -H "X-Requested-By: ambari" -X PUT -d '{"RequestInfo":{"context":"Turn On Maintenance Mode for host","query":"Hosts/host_name.in(abcd.example.com)"},"Body":{"Hosts":{"maintenance_state":"ON"}}}' ttp://ambariserver.example.com:8080/api/v1/clusters/DemoCluster/hosts In order to turn OFF maintenance mode for Host "abcd.example.com" # curl -iLvk -u admin:admin -H "X-Requested-By: ambari" -X PUT -d '{"RequestInfo":{"context":"Turn On Maintenance Mode for host","query":"Hosts/host_name.in(abcd.example.com)"},"Body":{"Hosts":{"maintenance_state":"OFF"}}}' ttp://ambariserver.example.com:8080/api/v1/clusters/DemoCluster/hosts   . Please change the Cluster Name "DemoCluster" and hostnames of ambari server and intended host , credentials in the above above example API calls. ... View more

@Prabhu_Muppala  As we see that the netstat command shows no oracle port 1521 opened.     (no output means Oracle is not running on default listerer port  1521. [cloudera@quickstart ~]$ sudo netstat -tnlpa | grep 1521 . Also the following error indicates that your Oracle Database is not successfully running on "localhost:1521" Caused by: oracle.net.ns.NetException: The Network Adapter could not establish the connection at oracle.net.nt.ConnStrategy.execute(ConnStrategy.java:470) So please verify why the oracle DB is not running and configured to use 1521 listener port? Please try to restart Oracle and then recheck if the port 1521 is opened? Or if you have configured to run Oracle on some other port? # netstat -tnlpa | grep $ORACLE_PROCESS_ID   .   ... View more

@pauljoshiva  Can you please check what is the port for the "RegistryDNS Bind Port" ? Is it free of being used by some other process ?  I am assuming that port is 53 (please change the port in the following command to verify if that port is free os being used)?    # netstat -tnlpa | grep 53   If possible then can you try changing the port to something else and then see if that works? And check for "RegistryDNS Bind Port" Ambari UI --> Yarn --> Configs --> Advanced (tab) --> Registry Example: RegistryDNS Bind Port = 1553 Reference Threads: https://community.cloudera.com/t5/Support-Questions/YARN-Registry-DNS-Start-failed-Hortonworks-3/m-p/218794 https://community.cloudera.com/t5/Community-Articles/YARN-REGISTRY-DNS-Port-Conflict-Issue/ta-p/249117 ... View more

@mike_bronson7  As you are running AMS in distributed mode hence it will be good to see any error appearing in the AMS-Hbase-Master logs first, because of the AMS HMaster process will not run successfully then AMS collector will definitely go down.   So we should see all these logs for any errors: /var/log/ambari-metrics-collector/hbase-ams-master-*.log /var/log/ambari-metrics-collector/hbase-ams-region-*.log /var/log/ambari-metrics-collector/ambari-metrics-collector.log .  After freshly restarting AMS service what is the first error that you see in the  "hbase-ams-master-xxx.log"  and in "ambari-metrics-collector.log"?     ... View more

@Prabhu_Muppala  Can you please try to specify the the "--driver" param in your Sqoop as following: --driver oracle.jdbc.driver.OracleDriver Also can you pleas everify if the DB credentials are correctly being entered and DB is accessbile on localhost 1521? # netstat -tnlpa | grep 1521 Also this user "hr" has enough privileges to list tables in Oracle DB? ... View more

@Ravirakunapu  Can you check the "/etc/krb5.conf"  file present on the host which is showing the error  " kdc host is not reachable on port 88" ?   Checks from Client machine: Then verify what is the hostname for KDC mentioned in this file? suppose kdc hostname is "kdc.example.com" then check if you are able to access that hhostname & port from the problematic machine? # telnet kdc.example.com 88 (OR) # nc -v kdc.example.com 88 . Also please verify if the "/etc/hosts" file is mapped to correct hostname& port for the kdc.example.com?   # cat /etc/hosts .   On the KDC host Check on the KDC side is the port 88 is listening  and iptables/firewall is disabled? # netstat -tnlpa | grep $PID_Of_KDC # service iptables status # systemctl status firewalld   ... View more