About ScipioTheElder

ScipioTheElder · ‎10-27-2016

Is there any better way to pull HDFS data into Kafka? I could use a flume exec source and kafka sink, but any alternative?

ScipioTheElder · ‎10-17-2016

Sunile. For daemons such as NM and RM, I can hard-code JMS port number. However, how to set different JMX port number on a number of JVM containers running on the same slave node? For example, I can configure 18 container per node, how could I set the port number to 8001-8018? Maybe I can use ZK, or some kind of script.

ScipioTheElder · ‎10-17-2016

My problem is how to set different JMX ports on the containers running on the same slave node.

ScipioTheElder · ‎10-14-2016

@Timothy Spann Tim, Thanks for the info. I can pull daemon JMX for sure since they are running all the time. However, I am more interested on per job based container. How to query YARN restful api to get a list of container for a job?

ScipioTheElder · ‎10-14-2016

@mhendricks I have the exact same interest on monitoring all the containers of the job via JMX. However, my question is how to get the list of containers for a job assuming we can turn ON JMX for yarn containers?

ScipioTheElder · ‎10-14-2016

Great article. Is there any way to pull individual yarn container JMX? It would be great for me to see what is going on when I start a job and monitor the job containers at real time.

ScipioTheElder · ‎09-07-2016

The more, the better, to some extent.

ScipioTheElder · ‎09-06-2016

Should 3 be sufficient for a 3 rack cluster with one ZK per rack? Does increasing ZK nodes to 5 make sense? My understanding is that for fault tolerant 3 ZKs are good enough. Having 2 ZK nodes on the same rack doesn't increase HA.

ScipioTheElder · ‎08-29-2016

This is NOT about HiveServer2, but only on Hive metastore. Do we have only two choices on Hive metastore property hive.security.metastore.authorization.manager? StorageBasedAuthorizationProvider DefaultHiveMetastoreAuthorizationProvider

ScipioTheElder · ‎07-28-2016

# H2 Settings nifi.database.directory=./database_repository nifi.h2.url.append=;LOCK_TIMEOUT=25000;WRITE_DELAY=0;AUTO_SERVER=FALSE Is something to be added here?

Online	Offline
Last Visited	‎08-22-2019 12:57 PM

Member Since	‎05-16-2016 12:18 PM
Last Visited	‎08-22-2019 12:57 PM
Posts	76
Kudos received	44

Cloudera Community

Re: Sanbox 2.3.2 hive beeline error

How to ingest HDFS data into Kafka

Re: Enable JMX metrics on hadoop using jmxterm

Re: Access Running Job Metrics via JMX

Re: Access Running Job Metrics via JMX

Re: Access Running Job Metrics via JMX

Re: Enable JMX metrics on hadoop using jmxterm

Re: Number of Zookeepers in a 3 rack cluster with ...

Number of Zookeepers in a 3 rack cluster with data...

Hive metastore authorization

Re: Why multiple nifi instances on the same host s...