Hi team, I want to configuration "yarn-user/hdp01-node.lab.contoso.com@LAB.CONTOSO.COM" to "yarn-user" "yarn-user/hdp02-node.lab.contoso.com@LAB.CONTOSO.COM" to "yarn-user" "yarn-user/hdp03-node.lab.contoso.com@LAB.CONTOSO.COM" to "yarn-user" Please given a rule advidor. Thanks ... View more

We have updated this article to remove links to videos that are no longer available.  ... View more

I agree This flow shows workflow for log collection, aggregation, store and display. Ingest logs from folders. Listen for syslogs on UDP port. Merge syslogs and drop-in logs and persist merged logs to Solr for historical search. Dashboard: stream real-time log events to dashboard and enable cross-filter search on historical logs data https://community.hortonworks.com/articles/961/a-collection-of-nifi-examples.html ... View more

I just tried this with HDP 2.5.3 + Ambari 2.4.2, for the SASL_SSL example, I had to make a couple of changes to get it to work. For producer, When I tried the example able, I got "new-producer is not a recognized option" I had to create a ssl properties file (I called mine /tmp/kakfka.ssl.properties) then run producer as: /usr/hdp/current/kafka-broker/bin/kafka-console-producer.sh --broker-list kafka-node1.domain:6668,kafka-node2.domain:6668 -topic test --producer.config /tmp/kakfka.ssl.properties --security-protocol SASL_SSL Similarly for consumer, I had to add a reference to the ssl.properties file: I used this: /usr/hdp/current/kafka-broker/bin/kafka-console-consumer.sh --consumer.config /tmp/kakfka.ssl.properties -bootstrap-server kafka-node1.domain:6668,kafka-node2.domain:6668 --topic test --from-beginning --security-protocol SASL_SSL --new-consumer ... View more

Awesome! Exactly what I was looking for at the moment 🙂 ... View more

@Alberto Romero Useful,thank you ! Ambari 2.* enable kerberos, and can't rmr /ams-hbase-secure ,solve my problem ! ... View more

I know this is and old thread but can you also include instructions on how to change the log aggregation for Spark2? ... View more

Very nice! A good way to do ETL and create SOLR indexes. ... View more

@kishore sanchina I'm this example I started Spark thrift server on port 10010 and connected using beeline to same port. You can use default port 10015 instead. ... View more

@Shihab That worked for me. Thanks so much. I also had to delete /system/diskbalancer.id to run it successfully. But for some reason I have to do this for every rebalancer I run. ... View more