@Lakshmi Prathyusha, You can download the hadoop aws jar and put it in /usr/hdp/{hdp-version}/hadoop folder and pass it while running the spark shell command ./spark-shell --master yarn --jars /usr/hdp/{hdp-version}/hadoop/hadoop-aws.jar ... You can also try passing --packages param to download the package in run time without downloading the jar before. Example shown below ./spark-shell --packages org.apache.hadoop:hadoop-aws:2.7.3 Note: Make sure to download all the dependent packages as well. . https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-aws/2.7.3. . Please "Accept" the answer if this helps ... View more

@Saravana V, Check the folders inside /usr/hdp folder. If you have folder with name "2.6.1.0-129", try moving it to some other directory and retry the operation. . Please "Accept" the answer if this helps 🙂 ... View more

@subhash parise, In HDP 3.0, yarn has a new implementation of Timeline server called Timeline server v2 (previouly timeline 1.5 was used). TS v2 uses HBase for storing the information of all the applications. TS v2 will be started either as a system service (which is a yarn application) or in embedded mode ( runs a standalone hbase server) based on the resources. If the cluster has enough resources it will be started as a system service or yarn application which is true in your case. You can check the config ( is_hbase_system_service ) to check if is running as a yarn application or in standalone mode. . You can read more about timeline server 2.0 here https://docs.hortonworks.com/HDPDocuments/HDP3/HDP-3.0.0/data-operating-system/content/yarn_timeline_service_2.0_overview.html . Please "Accept" if this helps 🙂 ... View more

@Amit Samanta, Looks like your hbase got into some inconsistent state somehow. The namespace creation is failed. You can check the logs under /var/log/hbase/hbase-master-xxx.log You can try doing the below steps and see if this works. For non kerberized environment, # su hbase # zookeeper-client -server {some-zookeeper-hostname}:2181 ## rmr /hbase-unsecure ----> This should be run inside zookeeper shell ## quit . For kerberized environment, # kinit -kt /etc/security/keytabs/hbase.headless.keytab hbase # zookeeper-client -server {some-zookeeper-hostname}:2181 ## rmr /hbase-secure ## quit . Restart HBase after performing above steps. . Please "Accept" the answer if this helps ... View more