@Spandan Mohanty YARN Registry DNS is a new component introduced in HDP 3.0 and usually runs on port 53. The most probable issue is the port is already in use by another process to check that follow the below steps Verify if the port 53 is available on the YARN host. # nc -l `hostname -f` 53 Ncat: bind to x.x.x.x:53: Address already in use. QUITTING. Else change the value of hadoop.registry.dns.bind-port and restart th registrydns Start the DNS Server yarn --daemon start registrydns Please revert ... View more

@sundeep dande Can you be more precise? Are you dropping a Mysql; oracle, hive or hbase table? And please under which user were you executing the command,? Have you checked whether you have the correct privileges on the object(table) ie like drop,delete , update etc? ... View more

@Mighty Mike Normally you don't need to remember the passwords for these service users if you have root access or you are included in the sudoers files then you can switch to a user (su) using the below methods su - {username} sets up the shell environment as if it were a clean login as the specified user, it accesses and uses specified users environment variables, su {username} just starts a shell with current environment settings for the specified user. If the username is not specified with su and su -, the root account is implied as default. To check the usernames you run cat /etc/passwd Sample output livy:x:1013:1007::/home/livy:/bin/bash spark:x:1014:1007::/home/spark:/bin/bash ambari-qa:x:1015:1007::/home/ambari-qa:/bin/bash kafka:x:1016:1007::/home/kafka:/bin/bash hdfs:x:1017:1007::/home/hdfs:/bin/bash sqoop:x:1018:1007::/home/sqoop:/bin/bash yarn:x:1019:1007::/home/yarn:/bin/bash The encrypted passwords and other information such as password expiry information (the password aging information) are stored in /etc/shadow file. All fields are separated by a colon (:) symbol. It contains one entry per line for each user listed in /etc/passwd Sample output livy:!!:17900:0:99999:7::: spark:!!:17900:0:99999:7::: ambari-qa:!!:17900:0:99999:7::: kafka:!!:17900:0:99999:7::: hdfs:!!:17900:0:99999:7::: sqoop:!!:17900:0:99999:7::: yarn:!!:17900:0:99999:7::: mapred:!!:17900:0:99999:7::: hbase:!!:17900:0:99999:7::: knox:!!:17900:0:99999:7::: Hope that helps ... View more

@Michael Bronson Whenever you change the parameter this config the cluster needs to be aware of the changes. When you start Ambari the underlying components don't get started unless you explicitly start those components! So you can start Ambari without stating YARN or HDFS ... View more

@Michael Bronson Parameter dfs.namenode.fs-limits.max-directory-items determines the maximum number of folders or files (not recursive) in one directory. The value range of this parameter is 1 to 6400000, and the default value is 1048576. Increase the value of parameter dfs.namenode.fs-limits.max-directory-items, and then restart the Ambari so that the new value takes effect. Workaround Go to Ambari -> HDFS -> Configs -> Advanced -> Custom hdfs-site and add the key (dfs.namenode.fs-limits.max-directory-items) to i.e double 1048576 to 2097152 you cannot set dfs.namenode.fs-limits.max-directory-items to a value less than 1 or greater than 6400000 After an Ambari restart the config should be pushed to the whole cluster this will allow you to work HTH ... View more

@choppadandi vamshi krishna With Hive 3.0 you have hive and druid storage options too and the orc is the most common. I haven't tested and can't confirm whether it's possible to create an MV over Avro and refresh it a regular interval would work You can also use the rebuild option to refresh the MV when scripting run the rebuild which will overwrite the previous mv before querying it so you have an updated ALTER MATERIALIZED VIEW mv REBUILD; You also have the Druid storage org .apache.hadoop.hive.druid.DruidStorageHandler or you can rebuild an MV like every 5 minutes but you should take into account that every rebuild will take longer than the previous due to the addition of data in the source table. HTH ... View more

@Michael Bronson Is all good? ... View more