Member since
11-22-2016
9
Posts
12
Kudos Received
0
Solutions
05-21-2020
10:59 PM
@GreenMonster, the thread you've posted your question to was marked 'Solved' quite a while ago and hasn't had any activity recently. While we welcome your question and a member of the Cloudera Community might well be able to answer it, I believe you would be much more likely to obtain a timely solution if you posted it to the Ubuntu Community.
... View more
03-03-2018
12:51 AM
1 Kudo
@Connor O'Neal This would be somehow operationally challenging to achieve since Superset seems to be included with HDP. If you use HDP 2.6.1 and HDF 3.0 you should be able to use a single Ambari instance for both as such you could collocate those services in a single node.
... View more
05-10-2017
06:58 AM
@amankumbare thanks for the detailed explanation
... View more
02-22-2017
12:39 AM
3 Kudos
@Connor O'Neal The import offset tool is the opposite of exporting. See my answer to your other question to understand the exporting step: https://community.hortonworks.com/questions/84827/is-there-a-tool-to-export-offsets.html#answer-84846 To import the offsets for the consumer group named “testconsumergroup” from a file named “offsets”: kafka-run-class.sh kafka.tools.ImportZkOffsets --zkconnect mykafka.abc.com:2181/kafka-cluster --input-file offsets +++ If this helped, please vote/accept as the best answer.
... View more
02-22-2017
12:33 AM
3 Kudos
@Connor O'Neal There is no named script to export offsets, but we are able to use the kafka-run-class.sh
script to execute the underlying Java class for the tool in the proper environment.
Exporting offsets will produce a file that contains each topic partition for the group
and it’s offsets in a defined format that the import tool can read. The file that is
created will have one topic partition per line, with the
following format: /consumers/GROUPNAME/offsets/topic/TOPICNAME/PARTITIONID-0:OFFSET Let's assume export the offsets for the consumer group named “testconsumergroup” to a file named
“offsets”: # kafka-run-class.sh kafka.tools.ExportZkOffsets --zkconnect mykafka.abc.com:2181/kafka-cluster --group testconsumergroup --output-file offsets # cat offsets /consumers/testconsumergroup/offsets/my-topic/0:8905
/consumers/testconsumergroup/offsets/my-topic/1:8915
/consumers/testconsumergroup/offsets/my-topic/2:9845
/consumers/testconsumergroup/offsets/my-topic/3:8072
/consumers/testconsumergroup/offsets/my-topic/4:8008
/consumers/testconsumergroup/offsets/my-topic/5:8319
/consumers/testconsumergroup/offsets/my-topic/6:8102
/consumers/testconsumergroup/offsets/my-topic/7:12739 +++ If this helped, please vote/accept response.
... View more
12-05-2017
11:41 AM
It may be an old thread. But I added a tool for the same which may be useful here Check: https://github.com/nipuntalukdar/kafka_consumer_tool
... View more