@Eon kitex This is a case usually when one believes he is answering the prompt correctly !!!!! Please read carefully Example the assumption is the root password is hadoop sandbox login :root root@sandbox.hortonworks.com password: hadoop You are required ..............(root enforced) Changing your password for root ...NOTE the current (current) UNIX password : hadoop In the above prompt if you type something else it will immediate close connect ... View more

@Takefumi Oide This is the hive parameter that you should toggle valid values are true/ false,please use the filter to get the values. You should restart the all stale configs thereafter hive.server2.enable.doAs Tells HiveServer2 to execute Hive operations as the user submitting the query. Must be set to true for the storage based model. ... View more

@Ravin Reddy What is the output of this command $ cat /var/lib/pgsql/data/postgresql.conf | grep -e listen -e standard_conforming_strings ... View more

@Sujitha Subbiah Is virtualisation enabled in your host BIOS? ... View more

@pk reddy The error below shows there is a problem with Solr, Command failed, tries again (tries: 1) No live SolrServers available to handle this request org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request Can you stop and kill any Solr related process on the sandbox # ps -ef | grep solr If there any processes the # kill -9 PID Restart Solr it should reload/recreate the collections in zookeeper Check the Atlas table Log into hbase which is the default backend DB for Atlas as the hbase user $ hbase shell List the tables, make sure you have a similar output hbase(main):003:0> list TABLE ATLAS_ENTITY_AUDIT_EVENTS atlas_titan 2 row(s) in 0.0690 seconds => ["ATLAS_ENTITY_AUDIT_EVENTS", "atlas_titan"] The restart Atlas All should be okay Please revert ... View more

@vivekananda chagam That's definitely a networking issue.You are using the internal Private IP .. ip-172-31-9-148 which is can't access the internet you should try the Public DNS Public IP and if not download from your laptop and use WinSCP to transfer it to one of the nodes. You could give and restrict access to ONLY one node in the cluster to access the internet then SCP the mysql-connector-java.jar to the desired hosts. Hope that helps. ... View more

@Anurag Mishra You can create a new database fro ranger follow these steps, log on to MySQL as the root user, below I am assuming: The root password is guessit The ranger user and password is ranger The FQDN of the MySQL server is hdptest.com # mysql -u root -pguessit One you have the prompt mysql> CREATE USER 'ranger'@'localhost' IDENTIFIED BY 'ranger'; mysql> GRANT ALL PRIVILEGES ON *.* TO 'ranger'@'localhost'; mysql> GRANT ALL PRIVILEGES ON *.* TO 'ranger'@'hdptest.com'; mysql> GRANT ALL PRIVILEGES ON *.* TO 'ranger'@'%'; mysql> GRANT ALL PRIVILEGES ON *.* TO 'ranger'@'localhost' WITH GRANT OPTION; mysql> GRANT ALL PRIVILEGES ON *.* TO 'ranger'@'hdptest.com' IDENTIFIED BY 'ranger' WITH GRANT OPTION; mysql> GRANT ALL PRIVILEGES ON *.* TO 'ranger'@'localhost' IDENTIFIED BY 'ranger' WITH GRANT OPTION; mysql> GRANT ALL PRIVILEGES ON *.* TO 'ranger'@'%' WITH GRANT OPTION; mysql> FLUSH PRIVILEGES; quit; Switch to user ranger and create the databases rangerdb $ mysql -u ranger -pranger mysql> CREATE DATABASE rangerdb; quit; Use the above credentials when setting up ranger in the Ambari UI. Please revert ... View more

@Sujitha Subbiah Can you ensure that hardware virtualization support is turned on in the BIOS settings of your host machine? Save the BIOS settings and boot up the machine normally and as you have plenty of memory shoot it up to 10GB See attached screenshot ... View more

@Amol Haval Can you be precise with what you were doing ,the action that triggered that error. This exception is mainly due to unavailability of the mysql-connector jar file which contains the required class which is missing. What you need to do is, just add the mysql-connector-java jar file in the build path of your program and then run the program again ... View more

@rutuja jagtap Here is how to change the MySQL root password # mysql_secure_connection Answer the questions as shown below: Change the root password? [Y/n] <-- y New password: <-- Enter a new MySQL root password Re-enter new password: <-- Repeat the MySQL root password Remove anonymous users? [Y/n] <-- y Disallow root login remotely? [Y/n] <-- y Remove test database and access to it? [Y/n] <-- y Reload privilege tables now? [Y/n] <-- y Hope that helps ... View more

@Erkan ŞİRİN Great to know all is working for you. I don't think it started working without your touch 🙂 Try to recall all that you did. I am certain you did clean the directories but MAYBE didn't kill the AMS process so when the process died.you somehow restarted the AMS et voila !!! ... View more

@rutuja jagtap Its an authorization problem could you run the below steps as root against the MySQL where FQDN is the hostname of in this case the sandbox # Hive user setup # mysql -u root -p GRANT ALL PRIVILEGES ON *.* TO 'hive'@'localhost'; GRANT ALL PRIVILEGES ON *.* TO 'hive'@'%'; GRANT ALL PRIVILEGES ON *.* TO 'hive'@'{FQDN}'; GRANT ALL PRIVILEGES ON hive.* TO 'hive'@'localhost' IDENTIFIED BY 'hive' WITH GRANT OPTION; GRANT ALL PRIVILEGES ON hive.* TO 'hive'@'{FQDN}' IDENTIFIED BY 'hive' WITH GRANT OPTION; FLUSH PRIVILEGES; quit; Please revert ... View more

@ Erkan ŞİRİN Backup hbase.tmp.dir/zookeeper and then remove hbase.tmp.dir/zookeeper/* files and retry. Can you follow this procedure Cleaning up AMS data ... View more

@Saravana V Can you be more explicit? When you make changes to the cluster using Ambari UI the only recommended way, you will see next the service an Orange circular arrow, which recommends a restart of that service so as to update the config files cluster wide once you have restart all the required services. The changes should reflect in the servers(nodes) ... View more

@Manmeet Kaur Because you are using LDAPS (SSL) you will need to import the certificate. Setup LDAPS Currently Ambari can use only 1 custom truststore at a time, therefore it is needed to merge the certificates into 1 truststore. Get the LDAPS certificate, if you do not have the certificate locally e.g. for self signed, you can download it: $ openssl s_client -connect myurl.com:636 -showcerts </dev/null 2>/dev/null | openssl x509 -outform PEM > ldapserver.pem Create a JKS keystore from the https.keystore.p12 keystore: (in the end, HTTPS/LDAPS will use https.keystore.jks) $ keytool -importkeystore -srckeystore https.keystore.p12 -srcstoretype pkcs12 -destkeystore https.keystore.jks -deststoretype jks -deststorepass changeit Convert LDAPS certificate to DER format and Import LDAPS certificate to the truststore: $ openssl x509 -outform der -in ldapserver.pem -out ldapserver.der $ keytool -import -alias ldap -keystore https.keystore.jks -file ldapserver.der Run 'ambari-server setup-ldap' command, e.g.: Setting up LDAP properties... Primary URL* {host:port} : my.domain.com:636 Secondary URL : Use SSL* [true/false] (true): User object class* (person): User name attribute* (uid): Group object class* (posixGroup): Group name attribute* (cn): Group member attribute* (memberUid): Base DN* : dc=apache,dc=org Bind anonymously* [true/false] (false): Manager DN* : uid=hdfs,ou=people,ou=dev,dc=apache,dc=org Enter Manager Password* : xxxxx Re-enter password: xxxxx Do you want to provide custom TrustStore for Ambari [y/n] (n)? y TrustStore type [jks/jceks/pkcs12] (jks): Path to TrustStore file :/var/lib/ambari-server/keys/https.keystore.jks Password for TrustStore: Re-enter password: Save settings [y/n] (y)? y Add these properties to ambari.properties file: client.api.ssl.keystore_name=https.keystore.jks client.api.ssl.keystore_type=jks client.api.ssl.truststore_name=https.keystore.jks client.api.ssl.truststore_type=jks (Optional) instead of the steps above, JDK default keystore can be used here as a truststore: (same for https certificate) $ openssl x509 -in ldapserver.pem -out ldapserver.crt /usr/jdk64/jdk1.7.0_45/bin/keytool -import -trustcacerts -file ldapserver.crt -keystore /usr/jdk64/jdk1.7.0_45/jre/lib/security/cacerts Finally, run: $ ambari-server restart Hope that helps ... View more

@Bright Lee Seems the job runs fine but encounters this issue "Caused by: org.apache.hadoop.fs.s3a.AWSClientIOException: saving output on data-sources-reports/media_mix_model/test/.distcp.tmp.attempt_1521586586857_0006_m_000000_0: com.amazonaws.AmazonClientException: Unable to verify integrity of data upload. Client calculated content hash (contentMD5: pkYbRKamqFtjgaN8gTsaCw== in base 64) didn't match hash (etag: dd9f32656c595bd40176556bd2f65a68 in hex)" 18/03/21 14:24:27 INFO tools.DistCp: DistCp job-id: job_1521586586857_0006 18/03/21 14:24:27 INFO mapreduce.Job: Running job: job_1521586586857_0006 18/03/21 14:24:33 INFO mapreduce.Job: Job job_1521586586857_0006 running in uber mode : false 18/03/21 14:24:33 INFO mapreduce.Job: map 0% reduce 0% 18/03/21 14:24:43 INFO mapreduce.Job: map 100% reduce 0% 18/03/21 14:24:45 INFO mapreduce.Job: Task Id : attempt_1521586586857_0006_m_000000_0, Status : FAILED Error: java.io.IOException: File copy failed: hdfs://ip-10-0-0-75.us-east-2.compute.internal:8020/user/mli/temp/testfile.txt --> s3a://encryption-bucket/test/testfile.txt at org.apache.hadoop.tools.mapred.CopyMapper.copyFileWithRetry(CopyMapper.java:299) at org.apache.hadoop.tools.mapred.CopyMapper.map(CopyMapper.java:266) at org.apache.hadoop.tools.mapred.CopyMapper.map(CopyMapper.java:52) at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:170) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866) It seems like S3 server side data at rest encryption please try too enable it add the following property in core-site.xml: <property> <name>fs.s3n.server-side-encryption-algorithm</name> <value> AES256 </value> <description> Specify a server-side encryption algorithm for S3. The default is NULL, and the only other currently allowable value is AES256. </description> </property> Please revert ... View more

@Erkan ŞİRİN The error "transientZooKeeper" please make sure the zookeepers are all up and running. AMS uses hbase as backend databases In general, AMS operates in 2 modes. embedded : Single AMS HBase daemon writing to local disk. distributed : Separate AMS HBase master and RS daemons by default writing to HDFS. I assume the value of your config in ams-site : "timeline.metrics.service.operation.mode" is embedded. Please verify the config ams-hbase-site : hbase.cluster.distributed = false for embedded true for distributed ... View more

@Bright Lee Have you tried DISTCP? hadoop distcp /source-folder s3a://destination-bucket To access DistCp utility, SSH to any node in your cluster. By default, DistCp is invoked against the cluster's default file system, which is defined in the configuration property fs.defaultFS in core-site.xml ... View more

@Artur Bukowski Did you set this in the oozie user's .profile or bashrc HADOOP_CLASSPATH=$(hcat -classpath) export HADOOP_CLASSPATH Can you attach the new error stack. ... View more

@Vinit Mahiwal Are you running an HDP cluster not managed by Ambari? I don't think its simply toggling a property from OFF to ON in the hive-site.xml or any related file because in the background it enables many other properties. You will really need to do a deep analysis to achieve your goal. ... View more

@Daniel Müller Apart from the link above, the best way is to become a partner, though the conditions have become stringent. It used to be 4 certified consultants for a company and it gives access to client-facing presentations and lots more. I was lucky as an early bird to grab a golden chance and obtained a consultant logo. Current program level is below. - Silver - Gold - Platinum The above framework gives greater benefits to partners that make deeper commitments to Hortonworks and the Hortonworks Data Platform. Hope that helps ... View more

@Michael Napoleon The problem seems to be around the default temporary table (at least, it is failing here before anything else). The query you make with the "VALUES" part work like this : - it creates a temporary hive table with the line to be inserted - it then queries that temporary table for inserting the data into the target table From the output I see, the temporary table is created [default/values__tmp__table__1]. But the user does not have "select" permission on it. I guess that a workaround would be to grant "SELECT" on the database "default" but this could bring some security issues for you (since the user will have read permission on all the tables inside "default"). ... View more

@Arvind Ramugade Normally it should be transparent to the end user in milliseconds. But you should test it to fine tune your Business continuity plans (BCP) Zookeeper maintains an active connection with all its clients using a heartbeat mechanism. Furthermore, Zookeeper keeps a session for each active client that is connected to it. When a client is disconnected from Zookeeper for more than a specified timeout the session expires. This means that Zookeeper has a pretty good picture of all the {animals} in its zoo. ... View more