@Michael Martinez By default, Ambari pushes all service configuration (identified as default configuration group) to any newly added node. If you want to make changes for a particular node then you need to go create a different config group for that node. But, if you still want to compare then the best way to compare is: to download config for the new node and for an old node from Ambari UI and compare them using linux (diff command) or any third party comparison tool/editor. ... View more

@Rajesh K First move forward by ignoring the error and clicking next. Oce you are at Ambari Dashboard please add the following values to the HDFS custom core-site (Services -> HDFS -> Config -> Custom core-site ) configuration: hadoop.proxyuser.hcat.groups=* hadoop.proxyuser.hcat.hosts=* Save your changes and restart all impacted services. Now, rerun the service check. It should work this time. PS: If this solution work for you, then please accept my answer as a best answer ... View more

@Florin Miron Please try to start one service at at time. Start with: Ambari-metrices Zookeeper HDFS If anything fails. Then get the logs from Ambari itself and let us know. ... View more

Hi @Vijay Gorania There is an error is hive creation command. totmiles must be double instead of bigint. Please use following steps and try to run the pig script again. drop table riskfactor; CREATE TABLE riskfactor (driverid string,events bigint,totmiles double,riskfactor float) STORED AS ORC; Please check this post for further detail: https://community.hortonworks.com/questions/58614/i-need-help-with-the-riskfactor-pig-script-from-th.html ... View more

@Pradheep Shan both are 2 independent products. You can use CloudBreak without subscribing to Hortonworks Data Cloud AWS Marketplace product. Cloudbreak: https://hortonworks.com/open-source/cloudbreak/#section_1 ... View more

@Lakhman Pervatoju The simple answer is Yes. But, if you are using LLAP(im memory processing) then you may not see a new job in RM because it uses already running LLAP jobs, which keeps running in memory. If you are using Ambari View 2 then it runs a job first time and 2nd time it gets data from cache. ... View more

@kotesh banoth the problem is the single quotes, you are using in the command. You are having a pair of single quotes inside single quote. The first single quote which starts@ 'select, actually is ending at DateViewed >=' You need to escape inside pair of single qoute using this example: https://stackoverflow.com/questions/8254120/how-to-escape-a-single-quote-in-single-quote-string-in-bash ... View more

@eric valoschin the solution in the above link is not storing the output on local FS. It is streaming the output from HDFS to HDFS: ============================ A command line scriptlet to do this could be as follows: hadoop fs -text *_fileName.txt | hadoop fs -put - targetFilename.txt This will cat all files that match the glob to standard output, then you'll pipe that stream to the put command and output the stream to an HDFS file named targetFilename.txt ============================= ... View more

@eric valoschin how about this: https://stackoverflow.com/questions/14831117/merging-hdfs-files ... View more

@Pradheep Shan 1. is it any different in creating a cluster through cloudbreak than using cloud controller ui. Manish: What is cloud controller UI? Are you talking about AWS UI? If yes, AWS UI will provide you only RAW OS images or marketplace customize images, But, you need to install/config the cluster yourself. CloudBreak creates/configs HDP cluster with default settings for you using few clicks. 2. can a long running cluster be created using cloudbreak with HA.. Manish: Yes 3. can the cluster be created with master and worker unlike(master, slave and compute) Manish: Yes, you can have different set of machines for master and workers nodes. But, make sure they have the same OS. 4. do we need cloud subscriptions to create cluster with cloudbreak. Manish: You must have AWS account to use cloudbreak. ... View more

@Prasant Soni Please see this: https://stackoverflow.com/questions/10624511/upgrade-python-without-breaking-yum ... View more

@Prasant Soni It seems OS is dependent on the default python version OR there is some dependency on previous version, which stops working when you upgrade. ... View more

@Prasant Soni If you are using Hortonworks Sandbox on Virtualbox then you should not run yum update (to update all the installed packages). The VM is based on Docker and it works with specific packages only. Once you run yum update it breaks its integrity. It is better to update individual packages as needed basis. ... View more

@kotesh banoth can you run the select statement only using the same command but, remove the insert statement and check whether it returns some data or not. It is a possibility that the select statement is not returning any data. ... View more

@kotesh banoth What is the error? ... View more

Where are steps to configure R-server for Kerberos? Does it not need any kerberos related settings? No kinit etc..? I noticed that the connect string has kerberos related variables though. Is it really good enough? Please confirm. rhive.connect(host="node1.hortonworks.com:10000/default;principal=hive/node1.hortonworks.com@HDP.COM;AuthMech=1;KrbHostFQDN=service.hortonworks.com;KrbServiceName=hive;KrbRealm=HDP.COM", defaultFS="hdfs://node1.hortonworks.com/rhive", hiveServer2=TRUE,updateJar=FALSE)) ... View more

Interesting! These steps are talking about: Download R server Use R to install Rserver Download rhive library Set the appropriate path for HIVE_HOME and HADOOP_HOME Change directory to RHive Use ant to build Use R to build RHive, this will build a file within the same directory Where are steps to configure R-server for Kerberos? Does it not need any kerberos related settings? No kinit etc..? I noticed that the connect string has kerberos related variables though. Is it really good enough? rhive.connect(host="node1.hortonworks.com:10000/default;principal=hive/node1.hortonworks.com@HDP.COM;AuthMech=1;KrbHostFQDN=service.hortonworks.com;KrbServiceName=hive;KrbRealm=HDP.COM", defaultFS="hdfs://node1.hortonworks.com/rhive", hiveServer2=TRUE,updateJar=FALSE)) ... View more

Thanks for providing a complete list. ... View more

Awesome. Thanks for sharing. ... View more

@Avinash Reddy I assume, you are using /data for HDP datafiles. If you are using a cloud environment then please follow their guideline on "adding additional disk-space in an existing volume" You can also add additional volumes on your machine and mount them to /data1, /data2 etc.. directories. Now, you can add them in HDP through Ambari using following steps: 1. Login to Ambari 2. Click on HDFS -> Settings 3. Search for "dir" keyword 4. Add new volumes under Namenode data dir and DataNode data dir 5. Save your changes and restart all impacted services. NOTE: As usual, if you think this answer satisfies your need then please accept it as a best answer. ... View more