The default queue's AM limit is 6144 MB -> the default queue's capacity must be 7 GB (for 6 the limit would be 5 and for 8 it would be 7 with the maximum-am-resource-percent of 0.9). Since default.capacity = 60 the whole cluster's capacity equals to ~ 100 / 60 * 7, which could indicate 12 or 13 GBs in total, but the latter would be very unusual. Did you manage to overcome your issue with any of my suggestions? ... View more

@mqureshi, @Daniel Kozlowski - looping you in, any ideas ? ... View more

@Karan Alang Re-implement the SSL by following up exactly the steps described in here: http://docs.confluent.io/2.0.0/kafka/ssl.html ... View more

@Aditya Pathak - thnx, i was able to remove - /var/lib/smartsense/hst-server/updates/upload/patch & start the hst-server & agents. ... View more

Cool, I remember I had faced similar problems when I first tried to add a new node. I guess you are using a lower version of ambari/sandbox just like me. Higher versions automatically install ambari-agents when adding a new node into the cluster. ... View more

@Karan Alang It's probably because -javaagent config was loaded twice or more in env loading. It happens when a variable is set like this in env config : KAFKA_OPT="$KAFKA_OPTS -java-agent:..." or JAVA_OPT="$JAVA_OPTS -java-agent:..." And variable is loaded twice during startup. ... View more

@mqureshi, @Sriharsha Chintalapani , @Artem Ervits -- any ideas on this ? ... View more

@Karan Alang What you are doing is right. "--new-consumer" should make it work if you are using the new consumer. Can you please try again the following. kafka-run-class.sh kafka.admin.ConsumerGroupCommand --new-consumer --describe --group myGroup --zookeeper localhost:2181 But if this doesn't help, check your zookeeper. Run zookeeper cli. do an ls on /consumers/myGroup/offsets/<topicname> You should get some thing like [0]. Then run a get command on this offset. Something like: get /consumers/myGroup/offsets/<topicname>/0 Then you'll see the first thing is your offset. If it's there, then paste the result and we'll go from there. ... View more