Support Questions

Find answers, ask questions, and share your expertise

How to read specific jar from classpath (having multiple version of common-codec in classpath)

avatar
Super Collaborator

My application need common-codec1.10 version but on cluster i have 1.4, when i launch yarn application using hadoop_classpath=/home/*/common-codec-1.10.jar:o yarn jar <*.jar> yarn picks up 1.4 first then after it has 1.10. so i am getting exception on method not found. How can tell yarn application to read through full classpath instead to read till 1.4 and stop.

1 ACCEPTED SOLUTION

avatar
Super Guru
@Saumil Mayani

Please try setting below parameters and see if that fix the issue.

export HADOOP_USER_CLASSPATH_FIRST=true

export HADOOP_CLASSPATH= /full-jar-path/xyz.jar

View solution in original post

1 REPLY 1

avatar
Super Guru
@Saumil Mayani

Please try setting below parameters and see if that fix the issue.

export HADOOP_USER_CLASSPATH_FIRST=true

export HADOOP_CLASSPATH= /full-jar-path/xyz.jar