we backported Kafka sink into 1.5.2, just make sure you are using HDP 2.3, I see you're on 2.2.4 which is quite old. Alternatively, try HDF powered by Apache nifi https://community.hortonworks.com/questions/9425/is-flume-to-kafka-sink-supported-in-hdp-232.html ... View more

You need to add jars with -libjars not -libjar you can also add your connector jar as dependency to your project as I am not able to find a maven pom you can include. You also need to make sure if you do put the jar in lib of hadoop ditectories, you need to place it on every node. You can also get familiar with DistributedCache API to upload jars in hdfs for access. https://hadoop.apache.org/docs/current/api/org/apache/hadoop/filecache/DistributedCache.html ... View more

replace derby database with sql server, there are multiple questions with same issue on HCC and all stem from using Derby with Oozie on Windows. ... View more

We are not ready to publish release information yet, expect to see Storm 1.0 sometime in the next few months. There will be a patch release of Storm 1.0.1 in the new few days. ... View more

Here's all info on Flume sinks and sample hdfs sink configuration https://flume.apache.org/FlumeUserGuide.html#hdfs-sink a1.channels = c1 a1.sinks = k1 a1.sinks.k1.type = hdfs a1.sinks.k1.channel = c1 a1.sinks.k1.hdfs.path = /flume/events/%y-%m-%d/%H%M/%S a1.sinks.k1.hdfs.filePrefix = events- a1.sinks.k1.hdfs.round = true a1.sinks.k1.hdfs.roundValue = 10 a1.sinks.k1.hdfs.roundUnit = minute ... View more