Created on 03-09-2015 07:21 AM - edited 09-16-2022 02:23 AM
i am trying to deploy client configuration on hbase , and it always fails , i am having 1 master , and 2 workers , and here are the logs:
Generate client configuration.
Successfully generated client configuration.
Run 3 steps in parallel
Completed 2/3 steps successfully
Cleanup client configs that failed to deploy.
Successfully cleaned up client configs that failed to deploy.
Can't open /var/run/cloudera-scm-agent/process/740-deploy-client-config/hbase-conf/hive-env.sh: No such file or directory. + '[' '!' -e /etc/hbase ']' + cd /etc/hbase + for SPECIAL_FILE in '$DEST_PATH/{taskcontroller.cfg,container-executor.cfg,topology.py,topology.map}' + '[' -e /etc/hbase/conf.cloudera.hbase/taskcontroller.cfg ']' + for SPECIAL_FILE in '$DEST_PATH/{taskcontroller.cfg,container-executor.cfg,topology.py,topology.map}' + '[' -e /etc/hbase/conf.cloudera.hbase/container-executor.cfg ']' + for SPECIAL_FILE in '$DEST_PATH/{taskcontroller.cfg,container-executor.cfg,topology.py,topology.map}' + '[' -e /etc/hbase/conf.cloudera.hbase/topology.py ']' + for SPECIAL_FILE in '$DEST_PATH/{taskcontroller.cfg,container-executor.cfg,topology.py,topology.map}' + '[' -e /etc/hbase/conf.cloudera.hbase/topology.map ']' + '[' -d conf -a '!' -L conf ']' + '[' -n '' ']' + rm -rf conf.cloudera.hbase + cp -a /var/run/cloudera-scm-agent/process/740-deploy-client-config/hbase-conf conf.cloudera.hbase + chmod -R ugo+r conf.cloudera.hbase + [[ HBASE == HIVE ]] + /usr/sbin/update-alternatives --install /etc/hbase/conf hbase-conf /etc/hbase/conf.cloudera.hbase 90 + /usr/sbin/update-alternatives --auto hbase-conf
2nd log :
Can't open /var/run/cloudera-scm-agent/process/739-deploy-client-config/hbase-conf/hive-env.sh: No such file or directory. + '[' '!' -e /etc/hbase ']' + cd /etc/hbase + for SPECIAL_FILE in '$DEST_PATH/{taskcontroller.cfg,container-executor.cfg,topology.py,topology.map}' + '[' -e /etc/hbase/conf.cloudera.hbase/taskcontroller.cfg ']' + for SPECIAL_FILE in '$DEST_PATH/{taskcontroller.cfg,container-executor.cfg,topology.py,topology.map}' + '[' -e /etc/hbase/conf.cloudera.hbase/container-executor.cfg ']' + for SPECIAL_FILE in '$DEST_PATH/{taskcontroller.cfg,container-executor.cfg,topology.py,topology.map}' + '[' -e /etc/hbase/conf.cloudera.hbase/topology.py ']' + for SPECIAL_FILE in '$DEST_PATH/{taskcontroller.cfg,container-executor.cfg,topology.py,topology.map}' + '[' -e /etc/hbase/conf.cloudera.hbase/topology.map ']' + '[' -d conf -a '!' -L conf ']' + '[' -n '' ']' + rm -rf conf.cloudera.hbase + cp -a /var/run/cloudera-scm-agent/process/739-deploy-client-config/hbase-conf conf.cloudera.hbase + chmod -R ugo+r conf.cloudera.hbase + [[ HBASE == HIVE ]] + /usr/sbin/update-alternatives --install /etc/hbase/conf hbase-conf /etc/hbase/conf.cloudera.hbase 90 /var/lib/alternatives/hbase-conf empty!
3rd log :
Can't open /var/run/cloudera-scm-agent/process/738-deploy-client-config/hbase-conf/hive-env.sh: No such file or directory. + '[' '!' -e /etc/hbase ']' + cd /etc/hbase + for SPECIAL_FILE in '$DEST_PATH/{taskcontroller.cfg,container-executor.cfg,topology.py,topology.map}' + '[' -e /etc/hbase/conf.cloudera.hbase/taskcontroller.cfg ']' + for SPECIAL_FILE in '$DEST_PATH/{taskcontroller.cfg,container-executor.cfg,topology.py,topology.map}' + '[' -e /etc/hbase/conf.cloudera.hbase/container-executor.cfg ']' + for SPECIAL_FILE in '$DEST_PATH/{taskcontroller.cfg,container-executor.cfg,topology.py,topology.map}' + '[' -e /etc/hbase/conf.cloudera.hbase/topology.py ']' + for SPECIAL_FILE in '$DEST_PATH/{taskcontroller.cfg,container-executor.cfg,topology.py,topology.map}' + '[' -e /etc/hbase/conf.cloudera.hbase/topology.map ']' + '[' -d conf -a '!' -L conf ']' + '[' -n '' ']' + rm -rf conf.cloudera.hbase + cp -a /var/run/cloudera-scm-agent/process/738-deploy-client-config/hbase-conf conf.cloudera.hbase + chmod -R ugo+r conf.cloudera.hbase + [[ HBASE == HIVE ]] + /usr/sbin/update-alternatives --install /etc/hbase/conf hbase-conf /etc/hbase/conf.cloudera.hbase 90 + /usr/sbin/update-alternatives --auto hbase-conf
so the problem is that hive-env.sh is not created , also having same problem on deploying client configuration for spark ,
and in the log it shows same error "hive-env.sh: No such file or directory."
,,Please help me with this issue
Created 09-18-2016 07:31 AM
This issue can occur if there are problems with alternatives.
Try this on your nodes:
/usr/sbin/alternatives --display hadoop-conf
If that command does not return valid alternatives, you may be missing the following file:
/var/lib/alternatives/hadoop-conf
If you can find a host with the file, copy it from that host to the host or hosts where it is missing.
Regards,
Ben
Created 12-19-2018 03:59 PM
Hi Ben,
But if we cannot find that file, what should we do? Why these files are missing?
Thanks,
Mo