Member since
08-15-2016
189
Posts
63
Kudos Received
22
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
5661 | 01-02-2018 09:11 AM | |
2995 | 12-04-2017 11:37 AM | |
2144 | 10-03-2017 11:52 AM | |
21559 | 09-20-2017 09:35 PM | |
1601 | 09-12-2017 06:50 PM |
08-31-2017
09:37 PM
It should be like this, in case only the brokers need to authenticate (one-way server side SSL auth) to the clients: You need: 1. Client side: 1 keystore (client.truststore.jks) containing just the ca_cert you created and was used to sign the broker / server certificates 2. Server side: On each broker 1 keystore (server.keystore.jks) containing both the server specific certificate generated before, ( which should now be signed by the CA) and the certificate of the CA itself. What is misleading in the Kafka documentation is the first step, where a keystore 'server.keystore.jks' is created in the very first step, only to export the unsigned cert from to actually sign it. This is not the same 'server.keystore.jks' as in 2. above as the it should not contain the unsigned broker cert anymore ! You don't necessarily need a keystore to create a certificate to sign, you can also just create a cert + key, have it signed and then import it into a new keystore. Also, it makes more sense to me to copy the CA cert onto the brokers then moving it back-and-forth from server -> CA node (to sign) -> back to server (to import into final 'server.keystore.jks') Hope it makes sense
... View more
08-30-2017
09:44 AM
@Shailendra Lohia And yes, you could use the same group ID for many different topics, if you want. For Kafka that would be transparent, as it would just be totally different 'keys' (topic:consumer_group_id) to Kafka
... View more
08-30-2017
09:38 AM
Hi Shailendra, Having 2 Kafka consumers with the same group ID will be just fine. This is by design actually. Kafka internals will try to load balance the topic consumption between any consumers registering on the group ID. The number of consumers per group ID is not bound to anything, you can have as many as you want. Usually the consuming application (like Storm) sets/decides this. For optimal performance you would typically have as many consumers registering for a group ID as there are topic partitions. That way, a consumer would not have to switch between multiple assigned partitions, but would just stick to consuming from the same partition during its life span, which is most efficient.
... View more
08-16-2017
08:11 AM
@msumbul Please mark the question as answered if sufficiently answered
... View more
08-16-2017
07:10 AM
@msumbul Please mark the question as answered if sufficiently answered
... View more
08-10-2017
11:40 AM
@msumbul Frankly, there is no clean way to do it, at least not before HCP-1.2.1.0. Before that you have to run the 'services' in your shell somehow or daemonize them yourself. Consequently, you can just kill or Ctrl-C the cmd line Rest and Mgt. UI 'services'. I never had any issues afterwards doing that. HCP-1.2.1.0 release will install Rest and Mgt. UI as proper OS level services for you ...
... View more
08-10-2017
11:35 AM
@asubramanian This is not possible since Rest and Mgt. UI are both not installed as OS level services before HCP1.2.1.0.
... View more
08-10-2017
11:27 AM
@Frank Kam (Maybe you can create a separate topic for your problem as I think it is quite different from the original question.) Did you create the USERS and AUTHORITIES table on your chosen SQL platform? Did you insert the designated user data in those tables for the user you expect to log on with?
... View more
08-10-2017
11:24 AM
@msumbul Rest and Mgt. UI should be run as user metron. It would work with other users but then you can expect ACL issues on folders like you mention. Don't be afraid to change a few -rwx- ACL's along the way. Metron Rest and Metron Mgt. UI can only be managed from Ambari as of the new HCP1.2.1.0 release which is now available: HCP-1.2.1.0 In that release you'll also get proper OS level services for both. Those are then triggered from the Ambari UI. Everything prior to that; you can daemonize the Rest and Mgt. UI with nohup, screen or even create your own services for it, but it is not supported out-of-the-box, that is just the state of the project right now. I have created both as services myself for HCP-1.1.0.0 so it can be done.
... View more
06-13-2017
10:37 PM
@Vedant Jain Very interesting article. And usefull I am looking for a way though to do to same for NewConsumers that store their offset in the topic __consumer_offsets. Do you know how to manage that offset?
... View more