Member since
07-31-2019
11
Posts
0
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
6044 | 03-11-2020 09:26 AM | |
6392 | 08-07-2019 03:11 AM |
03-11-2020
09:26 AM
@GangWar Thanks for your suggestion. All the parameters except the following one were already set in /etc/cloudera-scm-agent/config.ini verify_cert_file Apparently, the only reason why agent wasn't serving requests for logs was because the above flat wasn't set. The moment we configured the flag verify_cert_file and restarted agent, it started serving logs correctly.
... View more
10-29-2019
09:28 AM
@GangWar Indeed I'm using rhel 7.7.Same behavior is observed on rhel 7.6 as well. I have performed some tests and everything works smoothly when not enabled SSL on both OS releases (7.6 as well as 7.7). I would guess, setting Enable Kerberos Authentication for HTTP Web-Consoles would kick in only for web-console's like 'Name Node UI etc' and shouldn't have any impact on CM's ability to read service logs from their respective hosts. Regards Sandeep Singh
... View more
10-23-2019
05:49 AM
Hi @GangWar I tried the both of the following command; however result was exactly the same. /opt/cloudera/cm-agent/bin/supervisorctl -c /var/run/cloudera-scm-agent/supervisor/supervisord.conf restart status_server I have indeed Enable Kerberos Authentication for HTTP Web-Consoles option checked-in and I already tried configuring SPNEGO in the browsers (Mozilla Firefox as well Chrome) as stated in Cloudera documentation; no luck. Host Inspector also failed to complete on all hosts of the cluster. Error Details: IOException thrown while collecting data from host: Read timed out stdout "etcKrbConfMessages" : [ ],
"extantInitdErrors" : [ ],
"groupData" : "hdfs:x:11004:hive,impala\nmapred:x:11014:\nzookeeper:x:11022:\noozie:x:11015:\nhbase:x:11003:\nhue:x:11007:\ncloudera-scm:x:991:\nhadoop:x:11002:hdfs,hive,impala,mapred,yarn\nhive:x:11005:impala\nsqoop:x:11019:\nimpala:x:11008:\nyarn:x:11021:\nhttpfs:x:11006:\nsentry:x:11018:\nsolr:x:11016:\nspark:x:11017:\nkms:x:11010:\n",
"hostDnsErrors" : [ ],
"hostname" : "dwz-06.nonprod.lan",
"jceStrength" : 0,
"kdcConnectionMessages" : [ ],
"kernelVersion" : "3.10.0-1062.1.2.el7.x86_64",
"kernelVersionException" : null,
"localHostIpError" : null,
"localhostIp" : "127.0.0.1",
"nowMillis" : 1571833401403,
"psycopg2Version" : "2.7.5",
"psycopg2VersionException" : null,
"psycopg2VersionOk" : true,
"pythonVersionException" : null,
"pythonVersionOk" : true,
"pythonVersionString" : "2.7",
"rhelRelease" : "Red Hat Enterprise Linux Server release 7.7 (Maipo)",
"runExceptions" : [ ],
"swappiness" : "60",
"swappinessException" : null,
"timeZone" : "UTC+01:00",
"transparentHugePagesDefrag" : "[always] madvise never",
"transparentHugePagesEnabled" : "always madvise [never]",
"transparentHugePagesException" : null,
"transparentHugePagesPath" : "/sys/kernel/mm/transparent_hugepage",
"userData" : "hdfs:x:980:11004::/home/hdfs:/bin/bash\nmapred:x:977:11014::/home/mapred:/bin/bash\nzookeeper:x:981:11022::/home/zookeeper:/bin/bash\noozie:x:986:11015::/home/oozie:/bin/bash\nhbase:x:994:11003::/home/hbase:/bin/bash\nhue:x:992:11007::/home/hue:/bin/bash\ncloudera-scm:x:974:991:Cloudera Manager:/var/lib/cloudera-scm-server:/sbin/nologin\nsqoop:x:982:11019::/home/sqoop:/bin/bash\nsqoop2:x:976:11019::/home/sqoop2:/bin/bash\nimpala:x:978:11008::/home/impala:/bin/bash\nyarn:x:975:11021::/home/yarn:/bin/bash\nhttpfs:x:993:11006::/home/httpfs:/bin/bash\nsentry:x:983:11018::/home/sentry:/bin/bash\nsolr:x:985:11016::/home/solr:/bin/bash\nspark:x:984:11017::/home/spark:/bin/bash\nkms:x:990:11010::/home/kms:/bin/bash\n"
} stderr + [[ inspector == \f\i\r\e\h\o\s\e ]]
+ [[ inspector == \e\v\e\n\t\s\e\r\v\e\r ]]
+ [[ inspector == \a\l\e\r\t\p\u\b\l\i\s\h\e\r ]]
+ [[ inspector == \h\e\a\d\l\a\m\p ]]
+ [[ inspector == \t\e\l\e\m\e\t\r\y\p\u\b\l\i\s\h\e\r ]]
+ [[ inspector == \t\e\s\t\-\d\b\u\s\-\c\o\n\n\e\c\t\i\o\n ]]
+ [[ inspector == \i\n\s\p\e\c\t\o\r ]]
+ shift
++ pwd
+ MGMT_CLASSPATH='/run/cloudera-scm-agent/process/86-host-inspector:/usr/share/java/mysql-connector-java.jar:/opt/cloudera/cm/lib/postgresql-42.1.4.jre7.jar:/usr/share/java/oracle-connector-java.jar:/opt/cloudera/cm/lib/*:'
+ echo_and_exec /usr/java/jdk1.8.0_131/bin/java -server -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -Dmgmt.log.file= -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true -cp '/run/cloudera-scm-agent/process/86-host-inspector:/usr/share/java/mysql-connector-java.jar:/opt/cloudera/cm/lib/postgresql-42.1.4.jre7.jar:/usr/share/java/oracle-connector-java.jar:/opt/cloudera/cm/lib/*:' com.cloudera.cmf.inspector.Inspector input.json output.json DEFAULT
+ echo 'Executing: /usr/java/jdk1.8.0_131/bin/java' -server -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -Dmgmt.log.file= -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true -cp '/run/cloudera-scm-agent/process/86-host-inspector:/usr/share/java/mysql-connector-java.jar:/opt/cloudera/cm/lib/postgresql-42.1.4.jre7.jar:/usr/share/java/oracle-connector-java.jar:/opt/cloudera/cm/lib/*:' com.cloudera.cmf.inspector.Inspector input.json output.json DEFAULT
+ exec /usr/java/jdk1.8.0_131/bin/java -server -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -Dmgmt.log.file= -Djava.awt.headless=true -Djava.net.preferIPv4Stack=true -cp '/run/cloudera-scm-agent/process/86-host-inspector:/usr/share/java/mysql-connector-java.jar:/opt/cloudera/cm/lib/postgresql-42.1.4.jre7.jar:/usr/share/java/oracle-connector-java.jar:/opt/cloudera/cm/lib/*:' com.cloudera.cmf.inspector.Inspector input.json output.json DEFAULT Here is what CM shows on Host Inspection result page: Validations Inspector failed on the following hosts... View Details dwz-[01-07].nonprod.lan: IOException thrown while collecting data from host: Read timed out Inspector ran on 0 hosts. The inspector failed to run on all hosts. 0 hosts are running CDH 5 and 7 hosts are running CDH 6. All checked hosts in each cluster are running the same version of components. All managed hosts have consistent versions of Java. All checked Cloudera Management Daemons versions are consistent with the server. All checked Cloudera Management Agents versions are consistent with the server. Version Summary AfisPOCDataLake All HostsComponent Version Hosts Release CDH Version dwz-[01-07].nonprod.lan Supervisord 3.0 All Hosts Unavailable Not applicable Cloudera Manager Agent 6.2.0 All Hosts 968826.el7 Not applicable Cloudera Manager Management Daemons 6.2.0 All Hosts 968826.el7 Not applicable Flume NG 1.9.0+cdh6.2.0 All Hosts 967373 CDH 6 Hadoop 3.0.0+cdh6.2.0 All Hosts 967373 CDH 6 HDFS 3.0.0+cdh6.2.0 All Hosts 967373 CDH 6 HttpFS 3.0.0+cdh6.2.0 All Hosts 967373 CDH 6 hadoop-kms 3.0.0+cdh6.2.0 All Hosts 967373 CDH 6 MapReduce 2 3.0.0+cdh6.2.0 All Hosts 967373 CDH 6 YARN 3.0.0+cdh6.2.0 All Hosts 967373 CDH 6 HBase 2.1.0+cdh6.2.0 All Hosts 967373 CDH 6 Lily HBase Indexer 1.5+cdh6.2.0 All Hosts 967373 CDH 6 Hive 2.1.1+cdh6.2.0 All Hosts 967373 CDH 6 HCatalog 2.1.1+cdh6.2.0 All Hosts 967373 CDH 6 Hue 4.2.0+cdh6.2.0 All Hosts 967373 CDH 6 Impala 3.2.0+cdh6.2.0 All Hosts 967373 CDH 6 Java 8 1.8.0_131 All Hosts Unavailable Not applicable Kafka 2.1.0+cdh6.2.0 All Hosts 967373 CDH 6 Kite 1.0.0+cdh6.2.0 All Hosts 967373 CDH 6 kudu 1.9.0+cdh6.2.0 All Hosts 967373 CDH 6 Oozie 5.1.0+cdh6.2.0 All Hosts 967373 CDH 6 Parquet 1.9.0+cdh6.2.0 All Hosts 967373 CDH 6 Pig 0.17.0+cdh6.2.0 All Hosts 967373 CDH 6 sentry 2.1.0+cdh6.2.0 All Hosts 967373 CDH 6 Solr 7.4.0+cdh6.2.0 All Hosts 967373 CDH 6 spark 2.4.0+cdh6.2.0 All Hosts 967373 CDH 6 Sqoop 1.4.7+cdh6.2.0 All Hosts 967373 CDH 6 Zookeeper 3.4.5+cdh6.2.0 All Hosts 967373 CDH 6 Regards, Sandeep Singh
... View more
10-18-2019
09:00 AM
Hi @lwang CM version in this case is 6.2, so I suspect if I am hitting the bug you've mentioned; Unless this wasn't fixed in 6.2 too. Do you have an info? Regards Sandeep
... View more
10-16-2019
04:09 AM
Hi @Bhuv Here are the owner/permission details: drwxr-xr-x. 2 cloudera-scm cloudera-scm 40 Sep 24 12:05 cloudera-scm-server Regards, Sandeep
... View more
10-15-2019
07:04 AM
Hi All,
When Kerberos and TLS is enabled on the CDH cluster, role logs are not reported in Cloudera Manager under the respective services. CM reports 'No log messages at the specified URL' for each of the following:
Role Log File
Stdout
Stderr
Interestingly, the log files mentioned on the log pages (on CM) exist on the underlined host and contain all & correct log entries; They just don't get reported at CM service log pages. When tried downloading full log files, it throws error:
HTTP ERROR 403
Problem accessing /cmf/process/335/logs. Reason:
Unexpected end of file from server
The server declined access to the page or resource.
Powered by Jetty:// 9.4.14.v20181114
Same error is observed when attempted fetching logs using CM API.
Environment:
CDH
6.2
OS
Redhat 7.7
... View more
Labels:
- Labels:
-
Cloudera Manager
09-12-2019
01:45 AM
Hi @lwang, Thanks for your answer. Indeed I was able to do it using RoleConfigGroup API's. However, my concern is more with the fact that the recommended model schema provided by Cloudera lists the attribute that it doesn't support. Regards Sandeep
... View more
09-04-2019
08:32 AM
Hi All,
I've been using CM API V32 to update various service configuration and I noticed it works as long as we set service level attributes. However, while trying to update attributes at roleType level, the API responds with error code 400, stating "'Role type configuration is supported only up to API v2' in CM API V32.
Interestingly, the model schema provided by Cloudera recommends using the same attribute for the service config update.
I am using PUT `/clusters/{clusterName}/services/{serviceName}/config` API.
Anyone else facing a similar issue or knows how to deal with this issue?
Thanks.
... View more
Labels:
- Labels:
-
Cloudera Manager
08-07-2019
03:11 AM
Got it working myself. Apparently because of some grant issues, hue wasn't able to create other objects in DB, hence although the service was starting, hue portal itself won't work. What is strange although, is the fact that CM would report hue starting successfully. Not sure if this is the best behavior when CM is supposed to be monitoring and reporting correct health of each service it manages.
... View more
08-07-2019
12:27 AM
Hi @araujo , Thanks for your response. Following objects have been created in the database under hue schema (which implicates not all tables got created in the database correcty): OBJECT_NAME OBJECT_TYPE DJANGO_CO_APP_LABEL_76BD3D3B_U INDEX SYS_C0013948 INDEX SYS_C0013950 INDEX DJANGO_CONTENT_TYPE_SQ SEQUENCE DJANGO_MIGRATIONS_SQ SEQUENCE DJANGO_CONTENT_TYPE TABLE DJANGO_MIGRATIONS TABLE In hue logs, I have tons of errors regarding missing tables for users etc. Manual connections are working from hue host to the database using hue credentials. I however noticed this in the hue startup logs which seems rather problematic (for alerts related to cm-managed env) as well as incomplete (for the last part i.e. running migrations and nothing afterwards even after CM reports that hue is successfully started): CMF_CONF_DIR=
ALERT: This appears to be a CM Managed environment
ALERT: HUE_CONF_DIR must be set when running hue commands in CM Managed environment
ALERT: Please run 'hue <command> --cm-managed'
ALERT: This appears to be a CM Managed environment
ALERT: HUE_CONF_DIR must be set when running hue commands in CM Managed environment
ALERT: Please run 'hue <command> --cm-managed'
Operations to perform:
Apply all migrations: admin, auth, axes, beeswax, contenttypes, desktop, django_openid_auth, jobsub, oozie, pig, sessions, sites, useradmin
Running migrations: stderror tab on CM states following: [07/Aug/2019 09:08:57 +0000] 5081 MainThread redactor INFO Started launcher: /opt/cloudera/cm-agent/service/hue/hue.sh runcpserver
[07/Aug/2019 09:08:57 +0000] 5081 MainThread redactor INFO Re-exec watcher: /opt/cloudera/cm-agent/bin/cm proc_watcher 5099
[07/Aug/2019 09:08:57 +0000] 5100 MainThread redactor INFO Re-exec redactor: /opt/cloudera/cm-agent/bin/cm redactor --fds 3 5
[07/Aug/2019 09:08:57 +0000] 5100 MainThread redactor INFO Started redactor
+ date
+ date
Wed Aug 7 09:08:58 CEST 2019
++ dirname /opt/cloudera/cm-agent/service/hue/hue.sh
+ cloudera_config=/opt/cloudera/cm-agent/service/hue
++ cd /opt/cloudera/cm-agent/service/hue/../common
++ pwd
+ cloudera_config=/opt/cloudera/cm-agent/service/common
+ . /opt/cloudera/cm-agent/service/common/cloudera-config.sh
++ : /opt/cloudera/cm
++ export CLOUDERA_DIR
++ set -x
+ source_parcel_environment
+ '[' '!' -z /opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/meta/cdh_env.sh ']'
+ OLD_IFS='
'
+ IFS=:
+ SCRIPT_ARRAY=($SCM_DEFINES_SCRIPTS)
+ DIRNAME_ARRAY=($PARCEL_DIRNAMES)
+ IFS='
'
+ COUNT=1
++ seq 1 1
+ for i in '`seq 1 $COUNT`'
+ SCRIPT=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/meta/cdh_env.sh
+ PARCEL_DIRNAME=CDH-6.2.0-1.cdh6.2.0.p0.967373
+ . /opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/meta/cdh_env.sh
++ CDH_DIRNAME=CDH-6.2.0-1.cdh6.2.0.p0.967373
++ export CDH_HADOOP_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop
++ CDH_HADOOP_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop
++ export CDH_MR1_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop-0.20-mapreduce
++ CDH_MR1_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop-0.20-mapreduce
++ export CDH_HDFS_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop-hdfs
++ CDH_HDFS_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop-hdfs
++ export CDH_HTTPFS_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop-httpfs
++ CDH_HTTPFS_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop-httpfs
++ export CDH_MR2_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop-mapreduce
++ CDH_MR2_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop-mapreduce
++ export CDH_YARN_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop-yarn
++ CDH_YARN_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop-yarn
++ export CDH_HBASE_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hbase
++ CDH_HBASE_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hbase
++ export CDH_ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/zookeeper
++ CDH_ZOOKEEPER_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/zookeeper
++ export CDH_HIVE_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hive
++ CDH_HIVE_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hive
++ export CDH_HUE_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue
++ CDH_HUE_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue
++ export CDH_OOZIE_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/oozie
++ CDH_OOZIE_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/oozie
++ export CDH_HUE_PLUGINS_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop
++ CDH_HUE_PLUGINS_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop
++ export CDH_FLUME_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/flume-ng
++ CDH_FLUME_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/flume-ng
++ export CDH_PIG_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/pig
++ CDH_PIG_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/pig
++ export CDH_HCAT_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hive-hcatalog
++ CDH_HCAT_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hive-hcatalog
++ export CDH_SENTRY_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/sentry
++ CDH_SENTRY_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/sentry
++ export JSVC_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/bigtop-utils
++ JSVC_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/bigtop-utils
++ export CDH_HADOOP_BIN=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop/bin/hadoop
++ CDH_HADOOP_BIN=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop/bin/hadoop
++ export CDH_IMPALA_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/impala
++ CDH_IMPALA_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/impala
++ export CDH_SOLR_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/solr
++ CDH_SOLR_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/solr
++ export CDH_HBASE_INDEXER_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hbase-solr
++ CDH_HBASE_INDEXER_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hbase-solr
++ export SEARCH_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/search
++ SEARCH_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/search
++ export CDH_SPARK_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/spark
++ CDH_SPARK_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/spark
++ export WEBHCAT_DEFAULT_XML=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/etc/hive-webhcat/conf.dist/webhcat-default.xml
++ WEBHCAT_DEFAULT_XML=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/etc/hive-webhcat/conf.dist/webhcat-default.xml
++ export CDH_KMS_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop-kms
++ CDH_KMS_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop-kms
++ export CDH_PARQUET_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/parquet
++ CDH_PARQUET_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/parquet
++ export CDH_AVRO_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/avro
++ CDH_AVRO_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/avro
++ export CDH_KAFKA_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/kafka
++ CDH_KAFKA_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/kafka
++ export CDH_KUDU_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/kudu
++ CDH_KUDU_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/kudu
+ locate_cdh_java_home
+ '[' -z '' ']'
+ '[' -z /opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/bigtop-utils ']'
+ local BIGTOP_DETECT_JAVAHOME=
+ for candidate in '"${JSVC_HOME}"' '"${JSVC_HOME}/.."' '"/usr/lib/bigtop-utils"' '"/usr/libexec"'
+ '[' -e /opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/bigtop-utils/bigtop-detect-javahome ']'
+ BIGTOP_DETECT_JAVAHOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/bigtop-utils/bigtop-detect-javahome
+ break
+ '[' -z /opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/bigtop-utils/bigtop-detect-javahome ']'
+ . /opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/bigtop-utils/bigtop-detect-javahome
++ BIGTOP_DEFAULTS_DIR=/etc/default
++ '[' -n /etc/default -a -r /etc/default/bigtop-utils ']'
++ JAVA11_HOME_CANDIDATES=('/usr/java/jdk-11' '/usr/lib/jvm/jdk-11' '/usr/lib/jvm/java-11-oracle')
++ OPENJAVA11_HOME_CANDIDATES=('/usr/lib/jvm/jdk-11' '/usr/lib64/jvm/jdk-11')
++ JAVA8_HOME_CANDIDATES=('/usr/java/jdk1.8' '/usr/java/jre1.8' '/usr/lib/jvm/j2sdk1.8-oracle' '/usr/lib/jvm/j2sdk1.8-oracle/jre' '/usr/lib/jvm/java-8-oracle')
++ OPENJAVA8_HOME_CANDIDATES=('/usr/lib/jvm/java-1.8.0-openjdk' '/usr/lib/jvm/java-8-openjdk' '/usr/lib64/jvm/java-1.8.0-openjdk' '/usr/lib64/jvm/java-8-openjdk')
++ MISCJAVA_HOME_CANDIDATES=('/Library/Java/Home' '/usr/java/default' '/usr/lib/jvm/default-java' '/usr/lib/jvm/java-openjdk' '/usr/lib/jvm/jre-openjdk')
++ case ${BIGTOP_JAVA_MAJOR} in
++ JAVA_HOME_CANDIDATES=(${JAVA8_HOME_CANDIDATES[@]} ${MISCJAVA_HOME_CANDIDATES[@]} ${OPENJAVA8_HOME_CANDIDATES[@]} ${JAVA11_HOME_CANDIDATES[@]} ${OPENJAVA11_HOME_CANDIDATES[@]})
++ '[' -z '' ']'
++ for candidate_regex in '${JAVA_HOME_CANDIDATES[@]}'
+++ ls -rvd /usr/java/jdk1.8.0_131
++ for candidate in '`ls -rvd ${candidate_regex}* 2>/dev/null`'
++ '[' -e /usr/java/jdk1.8.0_131/bin/java ']'
++ export JAVA_HOME=/usr/java/jdk1.8.0_131
++ JAVA_HOME=/usr/java/jdk1.8.0_131
++ break 2
+ get_java_major_version JAVA_MAJOR
+ '[' -z /usr/java/jdk1.8.0_131/bin/java ']'
++ /usr/java/jdk1.8.0_131/bin/java -version
+ local 'VERSION_STRING=java version "1.8.0_131"
Java(TM) SE Runtime Environment (build 1.8.0_131-b11)
Java HotSpot(TM) 64-Bit Server VM (build 25.131-b11, mixed mode)'
+ local 'RE_JAVA=[java|openjdk][[:space:]]version[[:space:]]\"1\.([0-9][0-9]*)\.?+'
+ [[ java version "1.8.0_131"
Java(TM) SE Runtime Environment (build 1.8.0_131-b11)
Java HotSpot(TM) 64-Bit Server VM (build 25.131-b11, mixed mode) =~ [java|openjdk][[:space:]]version[[:space:]]\"1\.([0-9][0-9]*)\.?+ ]]
+ eval JAVA_MAJOR=8
++ JAVA_MAJOR=8
+ '[' 8 -lt 8 ']'
+ verify_java_home
+ '[' -z /usr/java/jdk1.8.0_131 ']'
+ echo JAVA_HOME=/usr/java/jdk1.8.0_131
+ export HUE_CONF_DIR=/var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER
+ HUE_CONF_DIR=/var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER
+ export HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hadoop-conf
+ HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hadoop-conf
+ '[' python27_version_check = runcpserver ']'
+ '[' -n 6 ']'
+ '[' 6 -ge 6 ']'
+ python27_version_check
+ python27_exists=0
+ python_vers=("/usr/bin" "/usr/local/python27/bin" "/opt/rh/python27/root/usr/bin")
+ for binpath in '${python_vers[@]}'
+ pybin=/usr/bin/python2.7
+ '[' '!' -e /usr/bin/python2.7 ']'
+ [[ /usr/bin == \/\o\p\t\/\r\h\/\p\y\t\h\o\n\2\7* ]]
++ run_python /usr/bin/python2.7
++ /usr/bin/python2.7 --version
++ '[' '!' 0 -eq 0 ']'
++ echo 0
+ out=0
+ '[' 0 -eq 0 ']'
+ export PATH=/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin
+ PATH=/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin
+ python27_exists=1
+ break
+ '[' 1 -eq 0 ']'
+ '[' -e /usr/share/oracle/instantclient/lib ']'
+ export LD_LIBRARY_PATH=/usr/share/oracle/instantclient/lib:
+ LD_LIBRARY_PATH=/usr/share/oracle/instantclient/lib:
+ add_postgres_to_pythonpath
+ grep -q '^\s*engine\s*=\s*postgres\+' hue.ini hue_safety_valve.ini hue_safety_valve_server.ini
+ '[' 6 -lt 6 ']'
+ return
+ [[ -d /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf ]]
+ export HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf
+ HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf
+ export HADOOP_MAPRED_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop-mapreduce
+ HADOOP_MAPRED_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop-mapreduce
+ [[ -d /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf ]]
+ chmod -R a+r /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf
+ export HIVE_CONF_DIR=/var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hive-conf
+ HIVE_CONF_DIR=/var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hive-conf
+ chmod -R a+r /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hive-conf
+ export HADOOP_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop
+ HADOOP_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop
+ export HIVE_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hive
+ HIVE_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hive
+ export HUE_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue
+ HUE_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue
+ export HBASE_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hbase
+ HBASE_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hbase
+ export PIG_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/pig
+ PIG_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/pig
+ export PIG_SCRIPT_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/pig/../..
+ PIG_SCRIPT_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/pig/../..
+ echo HUE_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue
+ echo HUE_CONF_DIR=/var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER
+ echo HADOOP_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop
+ echo HADOOP_CONF_DIR=/var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf
+ echo HIVE_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hive
+ echo HIVE_DEFAULT_XML=/etc/hive/conf.dist/hive-default.xml
+ echo HIVE_CONF_DIR=/var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hive-conf
+ echo HBASE_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hbase
+ echo PIG_HOME=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/pig
+ HBASE_CONF_DIR=/var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hbase-conf
+ [[ -d /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hbase-conf ]]
+ SQOOP2_CONF_DIR=/var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/sqoop2-conf
+ [[ -d /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/sqoop2-conf ]]
+ echo SQOOP2_CONF_DIR=/var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/sqoop2-conf
+ export PYTHON_EGG_CACHE=/var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/.python-eggs
+ PYTHON_EGG_CACHE=/var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/.python-eggs
+ perl -pi -e 's#\{\{JAVA_HOME}}#/usr/java/jdk1.8.0_131#g' /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue.ini /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue_safety_valve.ini /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue_safety_valve_server.ini
+ perl -pi -e 's#\{\{HBASE_HOME}}#/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hbase#g' /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue.ini /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue_safety_valve.ini /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue_safety_valve_server.ini
+ perl -pi -e 's#\{\{PIG_SCRIPT_HOME}}#/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/pig/../..#g' /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue.ini /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue_safety_valve.ini /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue_safety_valve_server.ini
+ perl -pi -e 's#\{\{HADOOP_CONF_DIR}}#/var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf#g' /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue.ini /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue_safety_valve.ini /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue_safety_valve_server.ini
+ perl -pi -e 's#\{\{HUE_CONF_DIR}}#/var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER#g' /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue.ini /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue_safety_valve.ini /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue_safety_valve_server.ini
+ [[ -d /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hbase-conf ]]
+ [[ -d /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/sqoop2-conf ]]
+ perl -pi -e 's#\{\{SQOOP2_CONF_DIR}}#/var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/sqoop2-conf#g' /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue.ini /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue_safety_valve.ini /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue_safety_valve_server.ini
+ perl -pi -e 's#\{\{SQOOP2_CONF_DIR}}#/var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/sqoop2-conf#g' /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/sqoop2-conf/sqoop.properties
+ '[' 6 -ge 4 ']'
+ perl -pi -e 's#\{\{HADOOP_HDFS_HOME}}#/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop-hdfs#g' /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue.ini /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue_safety_valve.ini /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue_safety_valve_server.ini
+ perl -pi -e 's#\{\{HADOOP_MR1_HOME}}#/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop-0.20-mapreduce#g' /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue.ini /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue_safety_valve.ini /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue_safety_valve_server.ini
+ perl -pi -e 's#\{\{HADOOP_MR2_HOME}}#/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop-mapreduce#g' /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue.ini /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue_safety_valve.ini /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue_safety_valve_server.ini
+ perl -pi -e 's#\{\{HADOOP_BIN}}#/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop/bin/hadoop#g' /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue.ini /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue_safety_valve.ini /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue_safety_valve_server.ini
+ SQOOP2_SCRIPT_HOME=/usr/lib/sqoop2/../..
+ perl -pi -e 's#\{\{SQOOP2_SCRIPT_HOME}}#/usr/lib/sqoop2/../..#g' /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue.ini /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue_safety_valve.ini /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/hue_safety_valve_server.ini
+ perl -pi -e 's#\{\{CDH_MR1_HOME}}#/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop-0.20-mapreduce#g' /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf/core-site.xml /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf/hadoop-env.sh /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf/hdfs-site.xml /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf/log4j.properties /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf/mapred-site.xml /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf/ssl-client.xml /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf/topology.map /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf/topology.py /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf/yarn-site.xml
+ perl -pi -e 's#\{\{CDH_MR2_HOME}}#/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop-mapreduce#g' /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf/core-site.xml /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf/hadoop-env.sh /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf/hdfs-site.xml /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf/log4j.properties /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf/mapred-site.xml /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf/ssl-client.xml /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf/topology.map /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf/topology.py /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf/yarn-site.xml
+ perl -pi -e 's#\{\{CDH_HADOOP_HOME}}#/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hadoop#g' /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf/core-site.xml /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf/hadoop-env.sh /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf/hdfs-site.xml /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf/log4j.properties /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf/mapred-site.xml /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf/ssl-client.xml /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf/topology.map /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf/topology.py /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/yarn-conf/yarn-site.xml
+ replace_conf_dir
+ echo CONF_DIR=/var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER
+ echo CMF_CONF_DIR=
+ EXCLUDE_CMF_FILES=('cloudera-config.sh' 'hue.sh' 'impala.sh' 'sqoop.sh' 'supervisor.conf' 'config.zip' 'proc.json' '*.log' '*.keytab' '*jceks')
++ printf '! -name %s ' cloudera-config.sh hue.sh impala.sh sqoop.sh supervisor.conf config.zip proc.json '*.log' hue.keytab creds.localjceks
+ find /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER -type f '!' -path '/var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER/logs/*' '!' -name cloudera-config.sh '!' -name hue.sh '!' -name impala.sh '!' -name sqoop.sh '!' -name supervisor.conf '!' -name config.zip '!' -name proc.json '!' -name '*.log' '!' -name hue.keytab '!' -name creds.localjceks -exec perl -pi -e 's#\{\{CMF_CONF_DIR}}#/var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER#g' '{}' ';'
+ make_scripts_executable
+ find /var/run/cloudera-scm-agent/process/79-hue-HUE_SERVER -regex '.*\.\(py\|sh\)$' -exec chmod u+x '{}' ';'
+ '[' runcpserver == beeswax_server ']'
+ set_classpath_in_var HADOOP_EXTRA_CLASSPATH_STRING
+ '[' -z HADOOP_EXTRA_CLASSPATH_STRING ']'
+ [[ -n /opt/cloudera/cm ]]
++ find /opt/cloudera/cm/lib/plugins -maxdepth 1 -name '*.jar'
++ tr '\n' :
+ ADD_TO_CP=/opt/cloudera/cm/lib/plugins/event-publish-6.2.0-shaded.jar:/opt/cloudera/cm/lib/plugins/tt-instrumentation-6.2.0.jar:
+ [[ -n '' ]]
+ eval 'OLD_VALUE=$HADOOP_EXTRA_CLASSPATH_STRING'
++ OLD_VALUE=
+ NEW_VALUE=/opt/cloudera/cm/lib/plugins/event-publish-6.2.0-shaded.jar:/opt/cloudera/cm/lib/plugins/tt-instrumentation-6.2.0.jar:
+ export HADOOP_EXTRA_CLASSPATH_STRING=/opt/cloudera/cm/lib/plugins/event-publish-6.2.0-shaded.jar:/opt/cloudera/cm/lib/plugins/tt-instrumentation-6.2.0.jar
+ HADOOP_EXTRA_CLASSPATH_STRING=/opt/cloudera/cm/lib/plugins/event-publish-6.2.0-shaded.jar:/opt/cloudera/cm/lib/plugins/tt-instrumentation-6.2.0.jar
+ HUE=/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/bin/hue
+ [[ runcpserver == runcpserver ]]
+ '[' 6 -lt 6 ']'
+ '[' '!' -z '' ']'
+ run_syncdb_and_migrate_subcommands
+ '[' 6 -ge 6 ']'
+ /opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/bin/hue makemigrations --noinput
Traceback (most recent call last):
File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/bin/hue", line 14, in <module>
load_entry_point('desktop', 'console_scripts', 'hue')()
File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/desktop/core/src/desktop/manage_entry.py", line 216, in entry
execute_from_command_line(sys.argv)
File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/lib/python2.7/site-packages/Django-1.11-py2.7.egg/django/core/management/__init__.py", line 363, in execute_from_command_line
utility.execute()
File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/lib/python2.7/site-packages/Django-1.11-py2.7.egg/django/core/management/__init__.py", line 355, in execute
self.fetch_command(subcommand).run_from_argv(self.argv)
File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/lib/python2.7/site-packages/Django-1.11-py2.7.egg/django/core/management/base.py", line 283, in run_from_argv
self.execute(*args, **cmd_options)
File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/lib/python2.7/site-packages/Django-1.11-py2.7.egg/django/core/management/base.py", line 330, in execute
output = self.handle(*args, **options)
File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/lib/python2.7/site-packages/Django-1.11-py2.7.egg/django/core/management/commands/makemigrations.py", line 110, in handle
loader.check_consistent_history(connection)
File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/lib/python2.7/site-packages/Django-1.11-py2.7.egg/django/db/migrations/loader.py", line 282, in check_consistent_history
applied = recorder.applied_migrations()
File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/lib/python2.7/site-packages/Django-1.11-py2.7.egg/django/db/migrations/recorder.py", line 65, in applied_migrations
self.ensure_schema()
File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/lib/python2.7/site-packages/Django-1.11-py2.7.egg/django/db/migrations/recorder.py", line 59, in ensure_schema
raise MigrationSchemaMissing("Unable to create the django_migrations table (%s)" % exc)
django.db.migrations.exceptions.MigrationSchemaMissing: Unable to create the django_migrations table (ORA-01031: insufficient privileges
)
+ /opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/bin/hue migrate --fake-initial
Traceback (most recent call last):
File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/bin/hue", line 14, in <module>
load_entry_point('desktop', 'console_scripts', 'hue')()
File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/desktop/core/src/desktop/manage_entry.py", line 216, in entry
execute_from_command_line(sys.argv)
File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/lib/python2.7/site-packages/Django-1.11-py2.7.egg/django/core/management/__init__.py", line 363, in execute_from_command_line
utility.execute()
File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/lib/python2.7/site-packages/Django-1.11-py2.7.egg/django/core/management/__init__.py", line 355, in execute
self.fetch_command(subcommand).run_from_argv(self.argv)
File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/lib/python2.7/site-packages/Django-1.11-py2.7.egg/django/core/management/base.py", line 283, in run_from_argv
self.execute(*args, **cmd_options)
File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/lib/python2.7/site-packages/Django-1.11-py2.7.egg/django/core/management/base.py", line 330, in execute
output = self.handle(*args, **options)
File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/lib/python2.7/site-packages/Django-1.11-py2.7.egg/django/core/management/commands/migrate.py", line 204, in handle
fake_initial=fake_initial,
File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/lib/python2.7/site-packages/Django-1.11-py2.7.egg/django/db/migrations/executor.py", line 115, in migrate
state = self._migrate_all_forwards(state, plan, full_plan, fake=fake, fake_initial=fake_initial)
File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/lib/python2.7/site-packages/Django-1.11-py2.7.egg/django/db/migrations/executor.py", line 145, in _migrate_all_forwards
state = self.apply_migration(state, migration, fake=fake, fake_initial=fake_initial)
File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/lib/python2.7/site-packages/Django-1.11-py2.7.egg/django/db/migrations/executor.py", line 244, in apply_migration
state = migration.apply(state, schema_editor)
File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/lib/python2.7/site-packages/Django-1.11-py2.7.egg/django/db/backends/base/schema.py", line 92, in __exit__
self.execute(sql)
File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/lib/python2.7/site-packages/Django-1.11-py2.7.egg/django/db/backends/base/schema.py", line 119, in execute
cursor.execute(sql, params)
File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/lib/python2.7/site-packages/Django-1.11-py2.7.egg/django/db/backends/utils.py", line 65, in execute
return self.cursor.execute(sql, params)
File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/lib/python2.7/site-packages/Django-1.11-py2.7.egg/django/db/utils.py", line 94, in __exit__
six.reraise(dj_exc_type, dj_exc_value, traceback)
File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/lib/python2.7/site-packages/Django-1.11-py2.7.egg/django/db/backends/utils.py", line 65, in execute
return self.cursor.execute(sql, params)
File "/opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/lib/python2.7/site-packages/Django-1.11-py2.7.egg/django/db/backends/oracle/base.py", line 480, in execute
return self.cursor.execute(query, self._param_generator(params))
django.db.utils.DatabaseError: ORA-01031: insufficient privileges
+ '[' dumpdata = runcpserver ']'
+ '[' syncdb = runcpserver ']'
+ '[' ldaptest = runcpserver ']'
+ exec /opt/cloudera/parcels/CDH-6.2.0-1.cdh6.2.0.p0.967373/lib/hue/build/env/bin/hue runcpserver This is weird because while there is an error in the stderr, service is reported to be started successfully and also while error here says, `Unable to create the django_migrations table (ORA-01031: insufficient privileges)`, this table is created successfully in the DB. Does this help pinning down the problem, in any way? @araujo wrote: Did you check if the Hue table have been created successfully in the database? Are you able to manuall connect to that database from the Hue host and with the credentials configured in Hue through JDBC and read from tables? Note that Oracle 19c hasn't been tested or certified to work with CDH6 yet: https://www.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_database_requirements.html#cdh_cm_supported_db
... View more