Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

How to read specific jar from classpath (having multiple version of common-codec in classpath)

avatar
Super Collaborator

My application need common-codec1.10 version but on cluster i have 1.4, when i launch yarn application using hadoop_classpath=/home/*/common-codec-1.10.jar:o yarn jar <*.jar> yarn picks up 1.4 first then after it has 1.10. so i am getting exception on method not found. How can tell yarn application to read through full classpath instead to read till 1.4 and stop.

1 ACCEPTED SOLUTION

avatar
Super Guru
@Saumil Mayani

Please try setting below parameters and see if that fix the issue.

export HADOOP_USER_CLASSPATH_FIRST=true

export HADOOP_CLASSPATH= /full-jar-path/xyz.jar

View solution in original post

1 REPLY 1

avatar
Super Guru
@Saumil Mayani

Please try setting below parameters and see if that fix the issue.

export HADOOP_USER_CLASSPATH_FIRST=true

export HADOOP_CLASSPATH= /full-jar-path/xyz.jar