Created 06-22-2022 01:40 AM
Hi ,
im unable to connect impala shell ( kerberised cluster ) with below: command on Edge node
impala-shell -i hostname.abc.com -d default -k
case scenario : we have two Edge node A and B , able to connect on edgenode A and unable to connect on edgenode B with same credentials. checked with different user is it also same as working on Edge node A and edgenode B .
observed that both have different python version A has 2.7.5 as default and B has 3.7.0 is this the cause of connection , if yes how to rectify.
ERROR screenshot shared.
Created 07-14-2022 07:33 AM
Hi Vidya ,
Issue has been resolved by setting path :
export PATH=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin:/usr/bin/python2:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/anaconda3/bin:/opt/anaconda3/condabin
Created 06-22-2022 07:31 AM
Hello Syed,
Yes, the impala is compatible with Python version 2.7.5.
Created 06-22-2022 07:34 AM
You can try the below steps in edge node B
virtualenv venv -p python2
cd venv
source bin/activate
(venv) impala-shell
Created 06-22-2022 07:43 AM
Thanks for the solution , every time i have to come in venv and run impala shell ? or it will work without venv !!
Created 06-22-2022 07:51 AM
Yes, you need to switch to venv everytime or you need to reinstall python with the 2.7.5 version.
Created 06-22-2022 08:11 AM
How to fix it permanently that default to python2.7.5 and impala shell to be work ?
Created 06-23-2022 03:56 AM
For a permanent fix, you need to install the python version 2.7.5.
Created 06-23-2022 09:08 AM
Python 2.7.5 is already installed and multiple version are available tried to set path but not working , any alternate solution.. .!!!
Created 06-28-2022 05:37 AM
Hi,
Me sharing below line from bashrc of a particular user
# .bashrc
export PYSPARK_DRIVER_PYTHON="jupyter"
export PYSPARK_DRIVER_PYTHON_OPTS="notebook"
export SPARK_HOME="/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/spark/"
export PATH="$PATH:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/"
# Source global definitions
if [ -f /etc/bashrc ]; then
. /etc/bashrc
fi
# >>> conda initialize >>>
# !! Contents within this block are managed by 'conda init' !!
__conda_setup="$('/opt/anaconda3/bin/conda' 'shell.bash' 'hook' 2> /dev/null)"
if [ $? -eq 0 ]; then
eval "$__conda_setup"
else
if [ -f "/opt/anaconda3/etc/profile.d/conda.sh" ]; then
. "/opt/anaconda3/etc/profile.d/conda.sh"
else
export PATH="/opt/anaconda3/bin:$PATH"
export PATH="/opt/anaconda3/condabin:$PATH"
fi
fi
unset __conda_setup
# Uncomment the following line if you don't like systemctl's auto-paging feature:
# export SYSTEMD_PAGER=
# User specific aliases and functions
alias python=/usr/bin/python2
export PYSPARK_PYTHON=/usr/src/Python-3.7.0/python
but still im getting same error
Thanks,
Syed
Created 07-06-2022 07:44 AM
Hello Syed,
Can you try the alternatives command to change the python version? Check the below link.
https://medium.com/coderlist/how-to-change-default-python-version-on-linux-fedora-28-c22da18bdd6
Regards,
Chethan YM
Created 07-10-2022 10:42 PM
@syedshakir, Have any of the replies helped resolve your issue? If so, kindly mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future.
Regards,
Vidya Sargur,Created 07-14-2022 07:33 AM
Hi Vidya ,
Issue has been resolved by setting path :
export PATH=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin:/usr/bin/python2:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/opt/anaconda3/bin:/opt/anaconda3/condabin