Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

How to read specific jar from classpath (having multiple version of common-codec in classpath)

avatar
Super Collaborator

My application need common-codec1.10 version but on cluster i have 1.4, when i launch yarn application using hadoop_classpath=/home/*/common-codec-1.10.jar:o yarn jar <*.jar> yarn picks up 1.4 first then after it has 1.10. so i am getting exception on method not found. How can tell yarn application to read through full classpath instead to read till 1.4 and stop.

1 ACCEPTED SOLUTION

avatar
Super Guru
@Saumil Mayani

Please try setting below parameters and see if that fix the issue.

export HADOOP_USER_CLASSPATH_FIRST=true

export HADOOP_CLASSPATH= /full-jar-path/xyz.jar

View solution in original post

1 REPLY 1

avatar
Super Guru
@Saumil Mayani

Please try setting below parameters and see if that fix the issue.

export HADOOP_USER_CLASSPATH_FIRST=true

export HADOOP_CLASSPATH= /full-jar-path/xyz.jar