Member since
09-18-2015
100
Posts
98
Kudos Received
11
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1450 | 03-22-2016 02:05 AM | |
1009 | 03-17-2016 06:16 AM | |
1802 | 03-17-2016 06:13 AM | |
1296 | 03-12-2016 04:48 AM | |
4674 | 03-10-2016 08:04 PM |
03-12-2016
04:48 AM
2 Kudos
@Madhu V You can add custom Metadata. I had written a CLI that uses the Atlas API to do this. The best code sample is with QuickStart.java which is part of the Atlas Code base. Take a look at that. There is also support for REST Calls
... View more
03-10-2016
11:09 PM
2 Kudos
@Sunile Manjee We ran into a similar issue with a customer. To clean up you need to do the followin Stop all services and run the cleanup script https://cwiki.apache.org/confluence/display/AMBARI/Host+Cleanup+for+Ambari+and+Stack python /usr/lib/python2. 6 /site-packages/ambari_agent/HostCleanup.py
You have elected to remove all users as well. If it is not intended then use option --skip "users" . Do you want to continue [y/n] (n) Run the above on each hosts. Next you would want to do a ambari reset and follow the steps that Scott mentioned.
... View more
03-10-2016
08:04 PM
2 Kudos
@Ram D Did you take a look at this. https://slider.incubator.apache.org/docs/manpage.html Commands for testing These operations are here primarily for testing. kill-container <name> --id container-id Kill a YARN container belong to the application. This is useful primarily for testing the resilience to failures. Container IDs can be determined from the application instance status JSON document.
... View more
03-10-2016
07:51 PM
1 Kudo
java.net.ConnectException:Connection refused This is connection error, it is unclear as why you are getting the error. You may look at hiveserver2 logs. It may have also happened that the hiveserver2 may have tripped. If it is not obvious take a tcpdump on the traffic and see where it is failing. I hope you do not have to go this far.
... View more
03-10-2016
03:26 PM
1 Kudo
@Andrew Watson - The ACID properties have been taken back by the community. It is not recommended for customer use currently.
... View more
03-03-2016
06:42 AM
1 Kudo
http://hortonworks.com/hadoop/cloudbreak/ - Check this video out. If you use S3 you should be fine, except you will not get stellar performance. It will be slower than HDFS on local storage. If you like the answer, you should hit "Accept" and give a vote :).
... View more
03-03-2016
05:02 AM
1 Kudo
@shahab nasir Best is to use the ambari-qa user. This is special user with super powers 🙂 su ambari-qa Overall, please understand the Hadoop security model. Spend some time to understand the user permissions. This is mostly like unix. The service accounts hdfs, yarn etc are service accounts that are part of hadoop group. Spend some time on the Hadoop HDFS section. This will help your understanding better.
... View more
03-03-2016
04:59 AM
The tutorial needs to be fixed.
... View more
03-03-2016
04:52 AM
3 Kudos
@ARUNKUMAR RAMASAMY In hortonworks platform we have Cloudbreak. It is open source http://sequenceiq.com/cloudbreak-docs/latest/ You can use it to launch Clusters on Amazon, Azure Google Cloud. It needs a host to install the Cloudbreak software and then it will spin up the nodes for you. One thing you have ti understand that if you have data in HDFS, it is not easy to bring down nodes. HDFS will kick off HDFS rebalance which will take time. An elastic cluster will work well when you use a detached storage like Blob storage behind it. Note scaling up is not an issue, it is scaling down that you will experience some rough time :).
... View more