Hi,  can I instead add the following line to spark-defaults.conf file: spark.ui.port   4041 Will that have the same effect ? Thanks   ... View more

@hoda moradi http://spark.apache.org/docs/latest/streaming-kafka-integration.html It has java code ... View more

Additionally, if you want to change number of partitions (and then parallelism) of an existing RDD, you can use rdd.repartition(8) See the comments and tests from here: https://community.hortonworks.com/questions/5825/best-way-to-select-distinct-values-from-multiple-c.html ... View more