Re: Associate schema with Kafka topic

alexandre_m_car · ‎07-13-2018

Hi @Varun Nemmani, Which usersync did you have to run? Thanks

alexandre_m_car · ‎04-24-2018

The idea is to use HBase as a state store which we pick up data from, in order to enrich the event stream. Example: HBase has a table called user where key = user_id and details (family cols) have the user's name; Event stream has: event, tstamp, user_id. The idea would be enrich the event stream with the user name (by joining to HBase using the user_id) and sink into HDFS a "denormalized" version of the event stream. Thanks.

alexandre_m_car · ‎04-24-2018

Found the solution to this. Just in case you run into the same problem, both schema and Kafka topic should have the exact same name.

alexandre_m_car · ‎04-23-2018

Hi everyone, I'm using HDF and have: successfully created a schema (page_view) through the Schema Registry UI; created a Kafka topic named page_views. I'd like to understand how do I now associate this schema to the topic. The intention is to now create a SAM application with that Kafka topic as the source. When setting up the Kafka source component on the SAM application, the UI isn't able to get the associated schema from Schema Registry (screenshot attached). This is how the topic was created: /usr/hdf/current/kafka-broker/bin/kafka-topics.sh --create --zookeeper sandbox-hdf.hortonworks.com:2181 --replication-factor 1 --partitions 3 --topic page_views I've also set the registry.url parameter under SAM's section on Ambari to http://sandbox-hdf.hortonworks.com:7788/api/v1 Any help would greatly appreciated!

Online	Offline
Last Visited	‎07-13-2018 03:35 PM

Date Registered	‎04-23-2018 03:27 PM
Last Visited	‎07-13-2018 03:35 PM
Total Messages Posted	5
Total Kudos Received	2

Re: Associate schema with Kafka topic

Re: How to set the authority/right of Atlas Web UI...

Is it possible to have HBase as a source in SAM?

Re: Associate schema with Kafka topic

Associate schema with Kafka topic