Hi , It seems, problem comes from dependent libraries, basically you will get the problem when your trying to put the data into hbase table. initially I had used <dependency> <groupId>org.apache.hbase</groupId> <artifactId>hbase-client</artifactId> <version>1.1.2</version> </dependency> i got the similar problem and later I changed to <dependency> <groupId>org.apache.hbase</groupId> <artifactId>hbase-shaded-client</artifactId> <version>1.1.2</version> </dependency> now the problem has been resolved. Regards, Ram. ... View more

Guys, I would prefer Kafka only when data is pushing from an external system. and another place where I use Kafka, pulled data will be used by multiple parties .so that each consumer connects to kafka topic. when you have control to pull the data then you can go for custom receivers in Spark. pull what you can consume. which avoids the extra overhead of maintaining Kafka cluster for balancing the load. Regards, @Ram. ... View more