Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Spark-LLap not working

Highlighted

Spark-LLap not working

New Contributor

Hello,

I submitted job with the follow parameter, but it not success with the error.


I followed this guide https://github.com/hortonworks-spark/spark-llap


# Parameter

./bin/spark-submit --class com.at.audience.spark.TestLLAPApp \
    --master yarn \
    --queue llap \
    --deploy-mode client \
    --num-executors 3 \
    --driver-memory 512m \
    --executor-memory 512m \
    --executor-cores 3 \
    --jars /usr/hdp/current/hive_warehouse_connector/hive-warehouse-connector-assembly-1.0.0.3.0.1.0-187.jar \
    --conf spark.executor.extraClassPath=/usr/hdp/current/phoenix-client/phoenix-5.0.0.3.0.1.0-187-client.jar:/usr/hdp/current/phoenix-client/lib/phoenix-spark-5.0.0.3.0.1.0-187.jar \
    --conf spark.driver.extraClassPath=/usr/hdp/current/phoenix-client/phoenix-5.0.0.3.0.1.0-187-client.jar:/usr/hdp/current/phoenix-client/lib/phoenix-spark-5.0.0.3.0.1.0-187.jar \
    --conf spark.security.credentials.hiveserver2.enabled=false \
    --conf spark.hadoop.hive.llap.daemon.service.hosts=@llap0 \
    --conf spark.sql.hive.hiveserver2.jdbc.url='jdbc:hive2://ants-pro-leaseweb-adsweb04:2181,ants-pro-leaseweb-adsweb05:2181,ants-pro-leaseweb-adsweb06:2181/;serviceDiscoveryMode=zooKeeperHA;zooKeeperNamespace=hs2ActivePassiveHA' \
    --files "/usr/hdp/current/hbase-client/conf/hbase-site.xml,/usr/hdp/current/hive-client/conf/hive-site.xml" \
    /data/be-jobs-1.0.jar ""


# Error

19/07/19 12:35:43 INFO ZkRegistryBase$InstanceStateChangeListener: CHILD_ADDED for zknode /instances/instance-0000000082
19/07/19 12:35:43 ERROR PathChildrenCache:
java.lang.NullPointerException
        at shadehive.org.apache.hive.service.server.HiveServer2Instance.<init>(HiveServer2Instance.java:48)
        at shadehive.org.apache.hive.service.server.HS2ActivePassiveHARegistry.createServiceInstance(HS2ActivePassiveHARegistry.java:187)
        at shadehive.org.apache.hive.service.server.HS2ActivePassiveHARegistry.createServiceInstance(HS2ActivePassiveHARegistry.java:53)
        at org.apache.hadoop.hive.registry.impl.ZkRegistryBase.extractServiceInstance(ZkRegistryBase.java:567)
        at org.apache.hadoop.hive.registry.impl.ZkRegistryBase.access$500(ZkRegistryBase.java:80)
        at org.apache.hadoop.hive.registry.impl.ZkRegistryBase$InstanceStateChangeListener.childEvent(ZkRegistryBase.java:499)
        at shadecurator.org.apache.curator.framework.recipes.cache.PathChildrenCache$5.apply(PathChildrenCache.java:522)
        at shadecurator.org.apache.curator.framework.recipes.cache.PathChildrenCache$5.apply(PathChildrenCache.java:516)
        at shadecurator.org.apache.curator.framework.listen.ListenerContainer$1.run(ListenerContainer.java:93)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)


Thanks.