<?xml version="1.0" encoding="UTF-8"?>
<rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:taxo="http://purl.org/rss/1.0/modules/taxonomy/" version="2.0">
  <channel>
    <title>question Guava library conflict in Support Questions</title>
    <link>https://community.cloudera.com/t5/Support-Questions/Guava-library-conflict/m-p/54610#M37283</link>
    <description>&lt;P&gt;Hi&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;We are using CDH 5.11, yarn and spark2.&lt;/P&gt;&lt;P&gt;In our application we are using guava 19 dependency, we shaded it in to our jar.&lt;/P&gt;&lt;P&gt;But when we submit the job, we are seeing&amp;nbsp;&lt;/P&gt;&lt;P&gt;java.lang.NoSuchMethodError: com.google.common.base.Splitter.splitToList(Ljava/lang/CharSequence;)Ljava/util/List;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;when i check the environment for he job.. we see&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;/opt/cloudera/parcels/CDH-5.11.0-1.cdh5.11.0.p0.34/lib/hadoop/../../../CDH-5.11.0-1.cdh5.11.0.p0.34/jars/guava-11.0.2.jar&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;What are the options we have to use different version of gauva.&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;I tried&amp;nbsp;&lt;SPAN&gt;spark.executor.userClassPathFirst=true and&amp;nbsp;spark.driver.userClassPathFirst=true&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;but ran into job start issues it self.&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;What worked for us when we run a job in local mode is setting &amp;nbsp;spark distribution classpath in cludera manager&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;SPARK_DIST_CLASSPATH=/home/dep/test-lib/guava-19.0.jar:$SPARK_DIST_CLASSPATH&lt;BR /&gt;export SPARK_DIST_CLASSPATH&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;When we run with yarn with above spark setting it still failed.&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;Tried setting tarn.application.classpath to have &amp;nbsp;/home/dep/test-lib/* as first entry but it still failed&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&lt;SPAN&gt;Can you suggest us.. whats the recommended approach for this conflict.&lt;/SPAN&gt;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;&lt;P&gt;&amp;nbsp;&lt;/P&gt;</description>
    <pubDate>Fri, 16 Sep 2022 11:35:13 GMT</pubDate>
    <dc:creator>iboppana</dc:creator>
    <dc:date>2022-09-16T11:35:13Z</dc:date>
  </channel>
</rss>

