About sdutta

sdutta · ‎06-24-2016

We are interested in querying and exporting the Yarn AppTimelIine Server content for external reporting. Is there any documentation or method to query and export the data. What is the best way to do this? I found this on apache's website http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/TimelineServer.html#Accessing_generic-data_via_command-line

sdutta · ‎05-04-2016

This is the hortonworks docs that gives reference to it. https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_hadoop-ha/content/deploy-hue-rm-ha-cluster.html

sdutta · ‎03-22-2016

@Richard Xu Can you please remove the hostname :). It is a security risk and customer may not like it.

sdutta · ‎03-22-2016

@rcicak Yes you are right, it does not make sense to have a 3x replication. It is a default so it is set to 3. I have thoughts about it. But the other way of looking at replication is if you are going after the same table and a node is busy, which does not apply in this case exactly, you can run the same query on another node where the replication is available. I would leave it to 3, incase someone add more nodes to the VMs, the data gets replicated correctly.

sdutta · ‎03-17-2016

@Mohammed Ibrahim a) I would go with the Hortonworks Sandbox, if you are doing standalone. b) Here is a lab for setting up HDP on a single node HDP https://github.com/shivajid/HortonworksOperationsWorkshop/blob/master/Lab1.md This will use HDP 2.3, you can make modifications to do HDP 2.4

sdutta · ‎03-17-2016

@ARUNKUMAR RAMASAMY Please provide the documentation link that you are using. Also why are you managing the kerberos keytabs manually? I would let the wizard create it irrespective of if you do it on AD or MIT KDC. This is a much cleaner process.

sdutta · ‎03-15-2016

@Sunile Manjee Why not reuse the same Zookeeper? What is the advantage of a separate Zookeeper. I have deployed Solr Cloud with the same zookeeper as HDP, did not see any issues.

sdutta · ‎03-14-2016

@S Srinivasa Try and run the hostcleanup to clean away your host. This cleans up any old versions etc. https://cwiki.apache.org/confluence/display/AMBARI/Host+Cleanup+for+Ambari+and+Stack See if this helps. This has come to my rescue in the past.

sdutta · ‎03-14-2016

@Teng Geok Keh You are getting the following exception. The 4040 is having a Bind Exception. You already have a spark context running on your local machine. I would say a simple restart of spark should solve it for now. Probably you have the spark-shell running under another user. 16/03/13 14:07:53 INFO SparkEnv: Registering OutputCommitCoordinator 16/03/13 14:07:53 INFO Server: jetty-8.y.z-SNAPSHOT 16/03/13 14:07:54 WARN AbstractLifeCycle: FAILED SelectChannelConnector@0.0.0.0:4040: java.net.BindException: Address already in use java.net.BindException: Address already in use at sun.nio.ch.Net.bind0(Native Method) at sun.nio.ch.Net.bind(Net.java:463) at sun.nio.ch.Net.bind(Net.java:455)

sdutta · ‎03-14-2016

@Teng Geok Keh You are getting the following exception. The 4040 is having a Bind Exception. You already have a spark context running on your local machine. I would say a simple restart of spark should solve it for now. Probably you have the spark-shell running under another user. 16/03/13 14:07:53 INFO SparkEnv: Registering OutputCommitCoordinator 16/03/13 14:07:53 INFO Server: jetty-8.y.z-SNAPSHOT 16/03/13 14:07:54 WARN AbstractLifeCycle: FAILED SelectChannelConnector@0.0.0.0:4040: java.net.BindException: Address already in use java.net.BindException: Address already in use at sun.nio.ch.Net.bind0(Native Method) at sun.nio.ch.Net.bind(Net.java:463) at sun.nio.ch.Net.bind(Net.java:455)

Online	Offline
Last Visited	‎12-21-2017 03:09 AM

Member Since	‎09-18-2015 03:08 PM
Last Visited	‎12-21-2017 03:09 AM
Posts	100
Kudos received	96

Cloudera Community

Cloudera Community

Re: Sandbox HDFS Replication Set to 3 - Why?

Re: What are all the best possible ways to install...

Re: Manual KDC and kerberos option in ambari

Re: Atlas metadata hooks

Re: Can we able to kill particular container in th...

Exporting/Querying Yarn LEVELDB Content

Re: Oozie job: What value should I use for jobTrac...

Re: Ranger admin install fails with "007-updateBla...

Re: Sandbox HDFS Replication Set to 3 - Why?

Re: What are all the best possible ways to install...

Re: Manual KDC and kerberos option in ambari

Re: Does ambari allow multipule instances of zooke...

Re: Oozie conflicts with existing Tomcat installat...

Re: Unable to complete Spark Pi example tutorial

Re: Unable to complete Spark Pi example tutorial