@Rainer Geissendoerfer Try this ./kafka-console-producer.sh --broker-list sandbox.hortonworks.com:6667 --topic test ./kafka-console-consumer.sh --zookeeper localhost:2181 --topic test --from-beginning ... View more

@Jan J I wont start with 2 node cluster ..Minimum 3 to 5 nodes --> This is just a lab env 2 master, 3 DN You need to deploy a cluster - Link Use ambari to deploy HDP https://github.com/cartershanklin/hive-testbench - You can generate hive data using testbench then you can test sparksql and https://github.com/databricks/spark-perf Yes, you should start with Hadoop and take advantage of distributed computing framework. ... View more