Hum... It seems that I have to use the new publisher and consumer API, and not the old one. Now it works but I still have warnings in kafka.out... With 6 lines of warning every second, I will quickly have a problem. ... View more

Hi Neeraj I am trying to do exactly the same thing, ie using ranger with a non kerberized Kafka. Unfortunately I have following error : [root@mykafka kafka]# tail -f kafka.out [2016-06-15 15:45:34,002] WARN got exception trying to get groups for user ANONYMOUS: id: ANONYMOUS: no such user (org.apache.hadoop.security.ShellBasedUnixGroupsMapping) [2016-06-15 15:45:34,002] WARN No groups available for user ANONYMOUS (org.apache.hadoop.security.UserGroupInformation) The public group should be mapped to an ANONYMOUS user. https://cwiki.apache.org/confluence/display/RANGER/Kafka+Plugin#KafkaPlugin-WhydowehavetospecifypublicusergrouponallpoliciesitemscreatedforauthorizingKafkaaccessovernon-securechannel? Did you do something special to declare it manually within ranger ? Can you share the list of declared users within ranger ? Thx in advance. Regards ... View more

Of course you're right. I was thinking that this property was inherited from the server but it is a consumer feature. It worked as wished now... I still have an issue when I want to personalize the offset topic : [2016-06-08 05:20:02,664] WARN Property offset.storage.topic is not valid (kafka.utils.VerifiableProperties) I will investigate, but if I ignore this property and use the default topic __consumer_offsets it works fine. Thk a lot for your clarification. ... View more

Yes I set it to true. I made a mistake... It seems that it is offsets.storage (with S) and offset.storage.topic (w/o S)... See :http://kafka.apache.org/documentation.html But even after having fixed this, it doesn't work. Did you achieve to us offset management within kafka ? Regards ... View more