Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

When using storm-kafka version 1.1.0.2.6.0.3-8 it has a dependency on kafka-clients version 0.10.0.2.5.2.0-70 which doesn't even exist

avatar
New Member

Why it even uses a different version of HDP? I found this jar in a nexus-private repository, but I assume this is an error, isn't it?

What version do I need to include to deploy a topology to a 2.6.0.3-8 HDP cluster and have the Kafka Spout Lag in the UI?

1 ACCEPTED SOLUTION

avatar

@Lester Martin

Work around is to add the following in your pom.xml

<dependency>
                <groupId>org.apache.storm</groupId>
                <artifactId>storm-kafka-clients</artifactId>
                <version>1.1.0.2.6.0.3-8</version>
                <exclusions>
                    <exclusion>
                        <groupId>org.apache.kafka</groupId>
                        <artifactId>kafka-clients</artifactId>
                    </exclusion>
                </exclusions>
            </dependency>
            <dependency>
                <groupId>org.apache.kafka</groupId>
                <artifactId>kafka-clients</groupId>
                <version>0.10.0.2.6.0.0-598</version>
             </dependency>

View solution in original post

4 REPLIES 4

avatar

I surely don't have an answer for this one, but you could ~play~ with it by hand-jamming what you think is the appropriate jar into the worker nodes as I did with another jar issue as described in https://martin.atlassian.net/wiki/x/JbXqBQ. Then you'd have an easy case to submit which the support team could easily reproduce (and get fixed!). Good luck and happy Hadooping/Storming.

avatar

Ahhh.... for my sins it looks like I ran into the same problem as you did, @Joan Viladrosa (shown below). Did you get anywhere with this? Do you have a workaround while I try to see if anyone knows what's up?

15977-jarissue.jpg

avatar

@Lester Martin

Work around is to add the following in your pom.xml

<dependency>
                <groupId>org.apache.storm</groupId>
                <artifactId>storm-kafka-clients</artifactId>
                <version>1.1.0.2.6.0.3-8</version>
                <exclusions>
                    <exclusion>
                        <groupId>org.apache.kafka</groupId>
                        <artifactId>kafka-clients</artifactId>
                    </exclusion>
                </exclusions>
            </dependency>
            <dependency>
                <groupId>org.apache.kafka</groupId>
                <artifactId>kafka-clients</groupId>
                <version>0.10.0.2.6.0.0-598</version>
             </dependency>

avatar

It did the trick for me. I sure hope it helps out @Joan Viladrosa, too! Thanks, Sriharsha!