28730
DISCUSSIONS
101732
MEMBERS
3157
ARTICLES
Created on 11-25-2015 07:25 AM - edited 11-25-2015 07:35 AM
Hello,
After upgrading a centos VM ( single node) from CDH 5.4.x to CDH 5.5, pyspark fails to start
with the error
java.lang.NoClassDefFoundError: org/apache/hadoop/fs/FSDataInputStream
HADOOP_HOME is pointing to correct path in /etc/spark/conf/set-env.sh
Any pointers on debugging this issue ? I dont want to download newer VM from cloudera since i have too much invested in the current VM
I used parcels to upgrade CDH5.4.x to CDH 5.5 via cloudera manager.
Completed all the tasks specided to deploy new jars etc..