Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here. Want to know more about what has changed? Check out the Community News blog.

impala:Can't open /run/cloudera-scm-agent/process/.../config.zip: Permission denied.

impala:Can't open /run/cloudera-scm-agent/process/.../config.zip: Permission denied.

New Contributor

Impala after adding  Kerberos,I found that many commands will fail with the following permission denied error with Cloudera Manager 5.12.I use CDH-5.12,jdk1.8.0_91

 

+ FLAG_FILE=/opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER/impala-conf/catalogserver_flags
+ USE_DEBUG_BUILD=false
+ replace_conf_dir
+ echo CONF_DIR=/opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER
+ echo CMF_CONF_DIR=/opt/cm-5.12.2/etc/cloudera-scm-agent
+ EXCLUDE_CMF_FILES=('cloudera-config.sh' 'httpfs.sh' 'hue.sh' 'impala.sh' 'sqoop.sh' 'supervisor.conf' '*.log' '*.keytab' '*jceks')
++ printf '! -name %s ' cloudera-config.sh httpfs.sh hue.sh impala.sh sqoop.sh supervisor.conf '*.log' impala.keytab '*jceks'
+ find /opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER -type f '!' -path '/opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER/logs/*' '!' -name cloudera-config.sh '!' -name httpfs.sh '!' -name hue.sh '!' -name impala.sh '!' -name sqoop.sh '!' -name supervisor.conf '!' -name '*.log' '!' -name impala.keytab '!' -name '*jceks' -exec perl -pi -e 's#{{CMF_CONF_DIR}}#/opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER#g' '{}' ';'
Can't open /opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER/config.zip: Permission denied.
Can't open /opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER/proc.json: Permission denied.
+ make_scripts_executable
+ find /opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER -regex '.*\.\(py\|sh\)$' -exec chmod u+x '{}' ';'
+ perl -pi -e 's#{{CMF_CONF_DIR}}#/opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER#g' /opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER/impala-conf/catalogserver_flags
+ perl -pi -e 's#{{CGROUP_ROOT_CPU}}#/sys/fs/cgroup/cpu,cpuacct#g' /opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER/impala-conf/catalogserver_flags
+ '[' -f /opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER/impala-conf/.htpasswd ']'
+ chmod 600 /opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER/impala-conf/.htpasswd
+ false
+ export IMPALA_BIN=/opt/cloudera/parcels/CDH-5.12.2-1.cdh5.12.2.p0.4/lib/impala/sbin-retail
+ IMPALA_BIN=/opt/cloudera/parcels/CDH-5.12.2-1.cdh5.12.2.p0.4/lib/impala/sbin-retail
+ [[ true = '' ]]
+ '[' impalad = catalogd ']'
+ '[' statestore = catalogd ']'
+ '[' catalogd = catalogd ']'
+ exec /opt/cloudera/parcels/CDH-5.12.2-1.cdh5.12.2.p0.4/lib/impala/../../bin/catalogd --flagfile=/opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER/impala-conf/catalogserver_flags
Redirecting stderr to /var/log/catalogd/catalogd.ERROR

 when Shutting down Kerberos,Impala normally works;

 

I did two steps:

Step 1 :

Impala Daemon properties:

Impala Daemon Environment Advanced Configuration Snippet (Safety Valve)

apply the JAVA_TOOL_OPTIONS=-Xss2m

Steo 2 :

Apply the same for Impala Catalog -

"Impala Catalog Server Environment Advanced Configuration Snippet (Safety Valve)"

before you restart the catalog daemon.

JAVA_TOOL_OPTIONS=-Xss2m

but I didn't solved this problem.

 

Thanks for your help!!

 

5 REPLIES 5

Re: impala:Can't open /run/cloudera-scm-agent/process/.../config.zip: Permission denied.

Guru
Hi,

Can you please share the permission of all the files under directory:

/opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER

Also, what's the error you get from catalog server log as well as what error you get when running Impala queries?

Re: impala:Can't open /run/cloudera-scm-agent/process/.../config.zip: Permission denied.

New Contributor

All file directories for impala

-rw-r----- 1 impala impala  281 Oct 26 09:47 cloudera-monitor.properties
-rw-r----- 1 impala impala  297 Oct 26 09:47 cloudera-stack-monitor.properties
-rw------- 1 root   root   8974 Oct 26 09:47 config.zip
drwxr-x--x 2 impala impala  100 Oct 26 09:47 hadoop-conf
drwxr-x--x 2 impala impala  180 Oct 26 09:47 hbase-conf
drwxr-x--x 2 impala impala   60 Oct 26 09:47 hive-conf
drwxr-x--x 2 impala impala  100 Oct 26 09:47 impala-conf
-rw------- 1 impala impala  610 Oct 25 14:17 impala.keytab
drwxr-x--x 2 impala impala  120 Oct 26 05:05 logs
-rw-r----- 1 impala impala   17 Oct 26 09:47 log-whitelist.json
-rw-r--r-- 1 root   root     13 Oct 26 09:50 process_timestamp
-rw------- 1 root   root   4181 Oct 26 09:47 proc.json
-rw-r----- 1 impala impala    0 Oct 26 09:47 redaction-rules.json
-rw-r----- 1 impala impala 1108 Oct 26 09:47 service-metrics.properties
-rw------- 1 root   root   3637 Oct 25 14:17 supervisor.conf
Highlighted

Re: impala:Can't open /run/cloudera-scm-agent/process/.../config.zip: Permission denied.

New Contributor

All file directories for impala Catalog Server 

-rw-r----- 1 impala impala  281 Oct 26 09:47 cloudera-monitor.properties
-rw-r----- 1 impala impala  297 Oct 26 09:47 cloudera-stack-monitor.properties
-rw------- 1 root   root   8974 Oct 26 09:47 config.zip
drwxr-x--x 2 impala impala  100 Oct 26 09:47 hadoop-conf
drwxr-x--x 2 impala impala  180 Oct 26 09:47 hbase-conf
drwxr-x--x 2 impala impala   60 Oct 26 09:47 hive-conf
drwxr-x--x 2 impala impala  100 Oct 26 09:47 impala-conf
-rw------- 1 impala impala  610 Oct 25 14:17 impala.keytab
drwxr-x--x 2 impala impala  120 Oct 26 05:05 logs
-rw-r----- 1 impala impala   17 Oct 26 09:47 log-whitelist.json
-rw-r--r-- 1 root   root     13 Oct 26 09:50 process_timestamp
-rw------- 1 root   root   4181 Oct 26 09:47 proc.json
-rw-r----- 1 impala impala    0 Oct 26 09:47 redaction-rules.json
-rw-r----- 1 impala impala 1108 Oct 26 09:47 service-metrics.properties
-rw------- 1 root   root   3637 Oct 25 14:17 supervisor.conf  

All file directories for impala daemon

 

-rw-r----- 1 impala impala   345 Oct 29 11:16 cloudera-monitor.properties
-rw------- 1 root   root   10150 Oct 26 09:50 config.zip
drwxr-x--x 2 impala impala   100 Oct 29 11:16 hadoop-conf
drwxr-x--x 2 impala impala   180 Oct 29 11:16 hbase-conf
drwxr-x--x 2 impala impala    60 Oct 29 11:16 hive-conf
drwxr-x--x 2 impala impala   160 Oct 29 11:16 impala-conf
-rw------- 1 impala impala   602 Oct 26 09:50 impala.keytab
drwxr-x--x 2 impala impala   240 Oct 29 04:10 logs
-rw-r----- 1 impala impala    17 Oct 29 11:16 log-whitelist.json
-rw-r----- 1 impala impala     0 Oct 29 11:16 navigator.client.properties
-rw-r----- 1 impala impala     0 Oct 29 11:16 navigator.lineage.client.properties
-rw------- 1 root   root    6744 Oct 26 09:50 proc.json
-rw-r----- 1 impala impala     0 Oct 29 11:16 redaction-rules.json
-rw-r----- 1 impala impala  1108 Oct 29 11:16 service-metrics.properties
-rw------- 1 root   root    3324 Oct 26 09:50 supervisor.conf

 

 

All file directories for impala StateStore

 

-rw-r----- 1 impala impala  249 Oct 26 09:50 cloudera-monitor.properties
-rw------- 1 root   root   1939 Oct 26 09:50 config.zip
drwxr-x--x 2 impala impala   80 Oct 26 09:50 impala-conf
-rw------- 1 impala impala  610 Oct 26 09:50 impala.keytab
drwxr-x--x 2 impala impala   80 Oct 26 09:50 logs
-rw-r----- 1 impala impala   17 Oct 26 09:50 log-whitelist.json
-rw------- 1 root   root   3391 Oct 26 09:50 proc.json
-rw-r----- 1 impala impala    0 Oct 26 09:50 redaction-rules.json
-rw-r----- 1 impala impala 1108 Oct 26 09:50 service-metrics.properties
-rw------- 1 root   root   3321 Oct 26 09:50 supervisor.conf

now ,only Impala StateStore role works,Impala Catalog Server and impala daemon are error.

 

 

 

 All file directories for Hbase,All of hbase's roles normally work;

-rw-r----- 1 hbase hbase  274 Oct 26 09:49 cloudera-monitor.properties
-rw-r----- 1 hbase hbase  327 Oct 26 09:49 cloudera-stack-monitor.properties
-rw------- 1 root  root  7447 Oct 26 09:49 config.zip
-rw-r----- 1 hbase hbase 3625 Oct 26 09:49 core-site.xml
-rw-r----- 1 hbase hbase 6840 Oct 26 09:49 event-filter-rules.json
-rw-r----- 1 hbase hbase    0 Oct 26 09:49 hadoop-metrics2.properties
-rw------- 1 hbase hbase  602 Oct 26 09:49 hbase.keytab
-rw-r----- 1 hbase hbase 8021 Oct 26 09:49 hbase-site.xml
-rw-r----- 1 hbase hbase 4059 Oct 26 09:49 hdfs-site.xml
-rw-r----- 1 hbase hbase  176 Oct 26 09:49 jaas.conf
-rw-r----- 1 hbase hbase 1729 Oct 26 09:49 log4j.properties
drwxr-x--x 2 hbase hbase   80 Oct 26 09:49 logs
-rw-r----- 1 hbase hbase    0 Oct 26 09:49 navigator.client.properties
-rw------- 1 root  root  3401 Oct 26 09:49 proc.json
-rw-r----- 1 hbase hbase    0 Oct 26 09:49 redaction-rules.json
-rw-r----- 1 hbase hbase  315 Oct 26 09:49 ssl-client.xml
-rw-r----- 1 hbase hbase   98 Oct 26 09:49 ssl-server.xml
-rw------- 1 root  root  3743 Oct 26 09:49 supervisor.conf
-rw-r--r-- 1 hbase hbase   42 Oct 26 09:49 znode2292

 

@EricL  thank you !

Re: impala:Can't open /run/cloudera-scm-agent/process/.../config.zip: Permission denied.

Guru
I am not sure whether that would cause any issues, what is the error reported in Catalog and Impala daemon logs?

Also, if you run Impala queries through impala-shell, what error do you get?

Re: impala:Can't open /run/cloudera-scm-agent/process/.../config.zip: Permission denied.

New Contributor

I find Impala Catalog Server log error

    

I1030 15:30:29.345330 11989 CatalogServiceCatalog.java:770] Invalidated all metadata.
I1030 15:30:29.362368 11989 statestore-subscriber.cc:186] Starting statestore subscriber
I1030 15:30:29.364665 11989 thrift-server.cc:448] ThriftServer 'StatestoreSubscriber' started on port: 23020
I1030 15:30:29.364682 11989 statestore-subscriber.cc:204] Registering with statestore
E1030 15:30:29.365150 11989 authentication.cc:159] SASL message (Kerberos (internal)): No worthy mechs found
I1030 15:30:29.373036 11989 status.cc:122] Couldn't open transport for cdhmaster01:24000 (SASL(-4): no mechanism available: No worthy mechs found)
    @           0x83d599  impala::Status::Status()
    @           0xdd8fc6  impala::ThriftClientImpl::Open()
    @           0xdd9300  impala::ThriftClientImpl::OpenWithRetry()
    @           0xa53daa  impala::ClientCacheHelper::CreateClient()
    @           0xa5437b  impala::ClientCacheHelper::GetClient()
    @           0xb553e4  impala::StatestoreSubscriber::Register()
    @           0xb56aae  impala::StatestoreSubscriber::Start()
    @           0x8138f4  impala::CatalogServer::Start()
    @           0x80c9d7  CatalogdMain()
    @           0x7d8e96  main
    @     0x7ff90619dc05  __libc_start_main
    @           0x80be3d  (unknown)
I1030 15:30:29.373055 11989 thrift-client.cc:67] Unable to connect to cdhmaster01:24000
I1030 15:30:29.373061 11989 thrift-client.cc:73] (Attempt 1 of 10)

  @EricL