Reply
New Contributor
Posts: 4
Registered: ‎10-25-2018

impala:Can't open /run/cloudera-scm-agent/process/.../config.zip: Permission denied.

Impala after adding  Kerberos,I found that many commands will fail with the following permission denied error with Cloudera Manager 5.12.I use CDH-5.12,jdk1.8.0_91

 

+ FLAG_FILE=/opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER/impala-conf/catalogserver_flags
+ USE_DEBUG_BUILD=false
+ replace_conf_dir
+ echo CONF_DIR=/opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER
+ echo CMF_CONF_DIR=/opt/cm-5.12.2/etc/cloudera-scm-agent
+ EXCLUDE_CMF_FILES=('cloudera-config.sh' 'httpfs.sh' 'hue.sh' 'impala.sh' 'sqoop.sh' 'supervisor.conf' '*.log' '*.keytab' '*jceks')
++ printf '! -name %s ' cloudera-config.sh httpfs.sh hue.sh impala.sh sqoop.sh supervisor.conf '*.log' impala.keytab '*jceks'
+ find /opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER -type f '!' -path '/opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER/logs/*' '!' -name cloudera-config.sh '!' -name httpfs.sh '!' -name hue.sh '!' -name impala.sh '!' -name sqoop.sh '!' -name supervisor.conf '!' -name '*.log' '!' -name impala.keytab '!' -name '*jceks' -exec perl -pi -e 's#{{CMF_CONF_DIR}}#/opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER#g' '{}' ';'
Can't open /opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER/config.zip: Permission denied.
Can't open /opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER/proc.json: Permission denied.
+ make_scripts_executable
+ find /opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER -regex '.*\.\(py\|sh\)$' -exec chmod u+x '{}' ';'
+ perl -pi -e 's#{{CMF_CONF_DIR}}#/opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER#g' /opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER/impala-conf/catalogserver_flags
+ perl -pi -e 's#{{CGROUP_ROOT_CPU}}#/sys/fs/cgroup/cpu,cpuacct#g' /opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER/impala-conf/catalogserver_flags
+ '[' -f /opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER/impala-conf/.htpasswd ']'
+ chmod 600 /opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER/impala-conf/.htpasswd
+ false
+ export IMPALA_BIN=/opt/cloudera/parcels/CDH-5.12.2-1.cdh5.12.2.p0.4/lib/impala/sbin-retail
+ IMPALA_BIN=/opt/cloudera/parcels/CDH-5.12.2-1.cdh5.12.2.p0.4/lib/impala/sbin-retail
+ [[ true = '' ]]
+ '[' impalad = catalogd ']'
+ '[' statestore = catalogd ']'
+ '[' catalogd = catalogd ']'
+ exec /opt/cloudera/parcels/CDH-5.12.2-1.cdh5.12.2.p0.4/lib/impala/../../bin/catalogd --flagfile=/opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER/impala-conf/catalogserver_flags
Redirecting stderr to /var/log/catalogd/catalogd.ERROR

 when Shutting down Kerberos,Impala normally works;

 

I did two steps:

Step 1 :

Impala Daemon properties:

Impala Daemon Environment Advanced Configuration Snippet (Safety Valve)

apply the JAVA_TOOL_OPTIONS=-Xss2m

Steo 2 :

Apply the same for Impala Catalog -

"Impala Catalog Server Environment Advanced Configuration Snippet (Safety Valve)"

before you restart the catalog daemon.

JAVA_TOOL_OPTIONS=-Xss2m

but I didn't solved this problem.

 

Thanks for your help!!

 

Cloudera Employee
Posts: 417
Registered: ‎03-23-2015

Re: impala:Can't open /run/cloudera-scm-agent/process/.../config.zip: Permission denied.

Hi,

Can you please share the permission of all the files under directory:

/opt/cm-5.12.2/run/cloudera-scm-agent/process/3231-impala-CATALOGSERVER

Also, what's the error you get from catalog server log as well as what error you get when running Impala queries?
New Contributor
Posts: 4
Registered: ‎10-25-2018

Re: impala:Can't open /run/cloudera-scm-agent/process/.../config.zip: Permission denied.

All file directories for impala

-rw-r----- 1 impala impala  281 Oct 26 09:47 cloudera-monitor.properties
-rw-r----- 1 impala impala  297 Oct 26 09:47 cloudera-stack-monitor.properties
-rw------- 1 root   root   8974 Oct 26 09:47 config.zip
drwxr-x--x 2 impala impala  100 Oct 26 09:47 hadoop-conf
drwxr-x--x 2 impala impala  180 Oct 26 09:47 hbase-conf
drwxr-x--x 2 impala impala   60 Oct 26 09:47 hive-conf
drwxr-x--x 2 impala impala  100 Oct 26 09:47 impala-conf
-rw------- 1 impala impala  610 Oct 25 14:17 impala.keytab
drwxr-x--x 2 impala impala  120 Oct 26 05:05 logs
-rw-r----- 1 impala impala   17 Oct 26 09:47 log-whitelist.json
-rw-r--r-- 1 root   root     13 Oct 26 09:50 process_timestamp
-rw------- 1 root   root   4181 Oct 26 09:47 proc.json
-rw-r----- 1 impala impala    0 Oct 26 09:47 redaction-rules.json
-rw-r----- 1 impala impala 1108 Oct 26 09:47 service-metrics.properties
-rw------- 1 root   root   3637 Oct 25 14:17 supervisor.conf
New Contributor
Posts: 4
Registered: ‎10-25-2018

Re: impala:Can't open /run/cloudera-scm-agent/process/.../config.zip: Permission denied.

All file directories for impala Catalog Server 

-rw-r----- 1 impala impala  281 Oct 26 09:47 cloudera-monitor.properties
-rw-r----- 1 impala impala  297 Oct 26 09:47 cloudera-stack-monitor.properties
-rw------- 1 root   root   8974 Oct 26 09:47 config.zip
drwxr-x--x 2 impala impala  100 Oct 26 09:47 hadoop-conf
drwxr-x--x 2 impala impala  180 Oct 26 09:47 hbase-conf
drwxr-x--x 2 impala impala   60 Oct 26 09:47 hive-conf
drwxr-x--x 2 impala impala  100 Oct 26 09:47 impala-conf
-rw------- 1 impala impala  610 Oct 25 14:17 impala.keytab
drwxr-x--x 2 impala impala  120 Oct 26 05:05 logs
-rw-r----- 1 impala impala   17 Oct 26 09:47 log-whitelist.json
-rw-r--r-- 1 root   root     13 Oct 26 09:50 process_timestamp
-rw------- 1 root   root   4181 Oct 26 09:47 proc.json
-rw-r----- 1 impala impala    0 Oct 26 09:47 redaction-rules.json
-rw-r----- 1 impala impala 1108 Oct 26 09:47 service-metrics.properties
-rw------- 1 root   root   3637 Oct 25 14:17 supervisor.conf  

All file directories for impala daemon

 

-rw-r----- 1 impala impala   345 Oct 29 11:16 cloudera-monitor.properties
-rw------- 1 root   root   10150 Oct 26 09:50 config.zip
drwxr-x--x 2 impala impala   100 Oct 29 11:16 hadoop-conf
drwxr-x--x 2 impala impala   180 Oct 29 11:16 hbase-conf
drwxr-x--x 2 impala impala    60 Oct 29 11:16 hive-conf
drwxr-x--x 2 impala impala   160 Oct 29 11:16 impala-conf
-rw------- 1 impala impala   602 Oct 26 09:50 impala.keytab
drwxr-x--x 2 impala impala   240 Oct 29 04:10 logs
-rw-r----- 1 impala impala    17 Oct 29 11:16 log-whitelist.json
-rw-r----- 1 impala impala     0 Oct 29 11:16 navigator.client.properties
-rw-r----- 1 impala impala     0 Oct 29 11:16 navigator.lineage.client.properties
-rw------- 1 root   root    6744 Oct 26 09:50 proc.json
-rw-r----- 1 impala impala     0 Oct 29 11:16 redaction-rules.json
-rw-r----- 1 impala impala  1108 Oct 29 11:16 service-metrics.properties
-rw------- 1 root   root    3324 Oct 26 09:50 supervisor.conf

 

 

All file directories for impala StateStore

 

-rw-r----- 1 impala impala  249 Oct 26 09:50 cloudera-monitor.properties
-rw------- 1 root   root   1939 Oct 26 09:50 config.zip
drwxr-x--x 2 impala impala   80 Oct 26 09:50 impala-conf
-rw------- 1 impala impala  610 Oct 26 09:50 impala.keytab
drwxr-x--x 2 impala impala   80 Oct 26 09:50 logs
-rw-r----- 1 impala impala   17 Oct 26 09:50 log-whitelist.json
-rw------- 1 root   root   3391 Oct 26 09:50 proc.json
-rw-r----- 1 impala impala    0 Oct 26 09:50 redaction-rules.json
-rw-r----- 1 impala impala 1108 Oct 26 09:50 service-metrics.properties
-rw------- 1 root   root   3321 Oct 26 09:50 supervisor.conf

now ,only Impala StateStore role works,Impala Catalog Server and impala daemon are error.

 

 

 

 All file directories for Hbase,All of hbase's roles normally work;

-rw-r----- 1 hbase hbase  274 Oct 26 09:49 cloudera-monitor.properties
-rw-r----- 1 hbase hbase  327 Oct 26 09:49 cloudera-stack-monitor.properties
-rw------- 1 root  root  7447 Oct 26 09:49 config.zip
-rw-r----- 1 hbase hbase 3625 Oct 26 09:49 core-site.xml
-rw-r----- 1 hbase hbase 6840 Oct 26 09:49 event-filter-rules.json
-rw-r----- 1 hbase hbase    0 Oct 26 09:49 hadoop-metrics2.properties
-rw------- 1 hbase hbase  602 Oct 26 09:49 hbase.keytab
-rw-r----- 1 hbase hbase 8021 Oct 26 09:49 hbase-site.xml
-rw-r----- 1 hbase hbase 4059 Oct 26 09:49 hdfs-site.xml
-rw-r----- 1 hbase hbase  176 Oct 26 09:49 jaas.conf
-rw-r----- 1 hbase hbase 1729 Oct 26 09:49 log4j.properties
drwxr-x--x 2 hbase hbase   80 Oct 26 09:49 logs
-rw-r----- 1 hbase hbase    0 Oct 26 09:49 navigator.client.properties
-rw------- 1 root  root  3401 Oct 26 09:49 proc.json
-rw-r----- 1 hbase hbase    0 Oct 26 09:49 redaction-rules.json
-rw-r----- 1 hbase hbase  315 Oct 26 09:49 ssl-client.xml
-rw-r----- 1 hbase hbase   98 Oct 26 09:49 ssl-server.xml
-rw------- 1 root  root  3743 Oct 26 09:49 supervisor.conf
-rw-r--r-- 1 hbase hbase   42 Oct 26 09:49 znode2292

 

@EricL  thank you !

Cloudera Employee
Posts: 417
Registered: ‎03-23-2015

Re: impala:Can't open /run/cloudera-scm-agent/process/.../config.zip: Permission denied.

I am not sure whether that would cause any issues, what is the error reported in Catalog and Impala daemon logs?

Also, if you run Impala queries through impala-shell, what error do you get?
Highlighted
New Contributor
Posts: 4
Registered: ‎10-25-2018

Re: impala:Can't open /run/cloudera-scm-agent/process/.../config.zip: Permission denied.

I find Impala Catalog Server log error

    

I1030 15:30:29.345330 11989 CatalogServiceCatalog.java:770] Invalidated all metadata.
I1030 15:30:29.362368 11989 statestore-subscriber.cc:186] Starting statestore subscriber
I1030 15:30:29.364665 11989 thrift-server.cc:448] ThriftServer 'StatestoreSubscriber' started on port: 23020
I1030 15:30:29.364682 11989 statestore-subscriber.cc:204] Registering with statestore
E1030 15:30:29.365150 11989 authentication.cc:159] SASL message (Kerberos (internal)): No worthy mechs found
I1030 15:30:29.373036 11989 status.cc:122] Couldn't open transport for cdhmaster01:24000 (SASL(-4): no mechanism available: No worthy mechs found)
    @           0x83d599  impala::Status::Status()
    @           0xdd8fc6  impala::ThriftClientImpl::Open()
    @           0xdd9300  impala::ThriftClientImpl::OpenWithRetry()
    @           0xa53daa  impala::ClientCacheHelper::CreateClient()
    @           0xa5437b  impala::ClientCacheHelper::GetClient()
    @           0xb553e4  impala::StatestoreSubscriber::Register()
    @           0xb56aae  impala::StatestoreSubscriber::Start()
    @           0x8138f4  impala::CatalogServer::Start()
    @           0x80c9d7  CatalogdMain()
    @           0x7d8e96  main
    @     0x7ff90619dc05  __libc_start_main
    @           0x80be3d  (unknown)
I1030 15:30:29.373055 11989 thrift-client.cc:67] Unable to connect to cdhmaster01:24000
I1030 15:30:29.373061 11989 thrift-client.cc:73] (Attempt 1 of 10)

  @EricL 

Announcements