About pdvorak

pdvorak · ‎07-28-2015

MirrorMaker is only needed if you are syncing topics from one kafka cluster to another. If you only have one kafka installation, you won't be using the MirrorMaker role.

pdvorak · ‎07-27-2015

Can you confirm what version of Cloudera Manager and CDH you are running? Within the Kafka service configuration, if you search for "Java Heap Size of Broker in Megabytes" is there anything set for this value? If not, try to set it to 256 MB (at least) and attempt to restart. -PD

pdvorak · ‎06-11-2015

The latest kafka parcels can be found here: http://archive-primary.cloudera.com/kafka/parcels/latest/ And adding that URL to your parcel repository list will make them available to download in Cloudera Manager.

pdvorak · ‎05-01-2015

It should definitely show up in netstat as a LISTENING port. You could also use 'lsof -iTCP:8989' to confirm if it is listening.

pdvorak · ‎04-30-2015

If there was some changes to the MapReduce or Yarn service, you can see those configuration changes by hitting the "History and Rollback" button on the configuration page for the service. That will display the most recent changes, and you can review those and rollback if needed.

pdvorak · ‎04-23-2015

It appears as though there is some problems in your custom source instantiating the class. You can verify that the jar file is being loaded by running this: lsof -u flume |grep MyFlumeSource.jar If it is then you need to review your code to determine what is causing that exception, here are a few pointers: http://craftingjava.blogspot.com/2012/06/javalanginstantiationexception.html

pdvorak · ‎04-23-2015

If you have a Cloudera Enterprise license, you can also configure alerts via snmp traps: http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/cm_ag_snmp.html

pdvorak · ‎03-17-2015

If you are wanting to add more shards (to better distribute the updates), then yes, I would suggest planning in advance and oversharding. If you are more concerned about query performance, and want to keep the same number of shards but just add more replicas per shard, then just creating replicas on the new nodes will be sufficient.

pdvorak · ‎03-17-2015

Khaled, If you'd like to add more replicas to existing shards, you can use this method with the CREATE action on the new nodes that you want to add replicas to. If you need to add more shards, you'll want to recreate the collection with a larger number of shards after you've added solr to the new nodes.

pdvorak · ‎02-09-2015

It looks like you may be using an old Twitter Source which is now included standard in the apache flume distribution. You'll need to update your source class to reflect the new location: If your original source looks like: TwitterAgent.sources.TwitterSource.type = com.cloudera.flume.source.TwitterSource Please change it to: TwitterAgent.sources.TwitterSource.type=org.apache.flume.source.twitter.TwitterSource

Online	Offline
Last Visited	‎01-08-2020 04:37 PM

Member Since	‎01-09-2014 08:15 AM
Last Visited	‎01-08-2020 04:37 PM
Posts	283
Kudos received	70

Cloudera Community

Re: spooldir channel error - too many files. - how...

Re: How to configure Flume with Kafka channel with...

Re: How to configure Flume with Kafka channel with...

Re: Solrcloud Replica Names

Re: flume kafkasource, hdfs sink remove avro field

Re: Cannot add service Kafka: JVM BROKER_HEAP_SIZE...

Re: Cannot add service Kafka: JVM BROKER_HEAP_SIZE...

Re: Kafka service Failed to start in CDH 5.4.1.. S...

Re: Flume Agents - do they appear as a port in NET...

Re: Server error after someone change config

Re: Error in Configuring Custom Flume Source

Re: Is it possible to use the other notify way whe...

Re: Move Solr server from one host to another usin...

Re: Move Solr server from one host to another usin...

Re: Flume - The Cloudera Manager Agent is not able...