Member since
09-30-2019
12
Posts
0
Kudos Received
3
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1804 | 10-18-2019 01:43 AM | |
1340 | 10-15-2019 02:42 AM | |
2123 | 10-13-2019 11:29 PM |
10-20-2019
08:38 AM
Yes, I am using Cloudera Version 5.16.2.1
... View more
10-18-2019
01:51 AM
I am Trying running command in impala shell. And i am get error. I am trying Creating a New kudu table from impala CREATE TABLE my_first_table
(
id BIGINT,
name STRING,
PRIMARY KEY(id)
)
PARTITION BY HASH PARTITIONS 16
STORED AS KUDU; here log output [root@cloudera-master ~]# impala-shell
Starting Impala Shell without Kerberos authentication
Opened TCP connection to master.cloudera-testing.io:21000
Connected to master.cloudera-testing.io:21000
Server version: impalad version 2.12.0-cdh5.16.2 RELEASE (build e73cce22064ef4972312d895bed2cdb8787a4215)
***********************************************************************************
Welcome to the Impala shell.
(Impala Shell v2.12.0-cdh5.16.2 (e73cce2) built on Mon Jun 3 03:32:01 PDT 2019)
Every command must be terminated by a ';'.
***********************************************************************************
[master.cloudera-testing.io:21000] > CREATE TABLE my_first_table
> (
> id BIGINT,
> name STRING,
> PRIMARY KEY(id)
> )
> PARTITION BY HASH PARTITIONS 16
> STORED AS KUDU;
Query: CREATE TABLE my_first_table
(
id BIGINT,
name STRING,
PRIMARY KEY(id)
)
PARTITION BY HASH PARTITIONS 16
STORED AS KUDU
ERROR: AnalysisException: Table property 'kudu.master_addresses' is required when the impalad startup flag -kudu_master_hosts is not used.
[master.cloudera-testing.io:21000] >
... View more
Labels:
- Labels:
-
Apache Impala
-
Apache Kudu
-
Cloudera Manager
10-18-2019
01:43 AM
Fixed after re-installing cloudera and restart host
... View more
10-15-2019
02:47 AM
I am trying search my host for CDH cluster installation. I search using IP and hostname. I can not found cloudera host. Here log from
/var/log/cloudera-scm-server/cloudera-scm-server.log
2019-10-15 16:46:54,028 INFO 1759898621@scm-web-9:com.cloudera.server.cmf.node.NodeScannerService: Request 2 returning 0/1 scans
2019-10-15 16:46:56,027 INFO 1759898621@scm-web-9:com.cloudera.server.cmf.node.NodeScannerService: Request 2 returning 0/1 scans
2019-10-15 16:46:58,042 INFO 1759898621@scm-web-9:com.cloudera.server.cmf.node.NodeScannerService: Request 2 returning 0/1 scans
2019-10-15 16:47:00,037 INFO 1759898621@scm-web-9:com.cloudera.server.cmf.node.NodeScannerService: Request 2 returning 0/1 scans
2019-10-15 16:47:02,040 INFO 1759898621@scm-web-9:com.cloudera.server.cmf.node.NodeScannerService: Request 2 returning 0/1 scans
2019-10-15 16:47:04,040 INFO 1759898621@scm-web-9:com.cloudera.server.cmf.node.NodeScannerService: Request 2 returning 0/1 scans
2019-10-15 16:47:04,745 WARN avro-servlet-hb-processor-3:com.cloudera.server.cmf.AgentProtocolImpl: Received an optimized heartbeat for a host with ID '798f1ee7-be79-475c-bc30-28573451693e' that is not recognized
2019-10-15 16:47:06,047 INFO 1759898621@scm-web-9:com.cloudera.server.cmf.node.NodeScannerService: Request 2 returning 0/1 scans
2019-10-15 16:47:08,048 INFO 1759898621@scm-web-9:com.cloudera.server.cmf.node.NodeScannerService: Request 2 returning 0/1 scans
2019-10-15 16:47:10,057 INFO 1759898621@scm-web-9:com.cloudera.server.cmf.node.NodeScannerService: Request 2 returning 0/1 scans
2019-10-15 16:47:12,058 INFO 1759898621@scm-web-9:com.cloudera.server.cmf.node.NodeScannerService: Request 2 returning 0/1 scans
2019-10-15 16:47:14,055 INFO 1759898621@scm-web-9:com.cloudera.server.cmf.node.NodeScannerService: Request 2 returning 0/1 scans
2019-10-15 16:47:16,060 INFO 1759898621@scm-web-9:com.cloudera.server.cmf.node.NodeScannerService: Request 2 returning 0/1 scans
2019-10-15 16:47:18,063 INFO 1759898621@scm-web-9:com.cloudera.server.cmf.node.NodeScannerService: Request 2 returning 0/1 scans
... View more
Labels:
- Labels:
-
Cloudera Manager
10-15-2019
02:42 AM
Solved,After Set $JAVA_HOME to OpenJDK1.8.0.222(i use open jdk)
... View more
10-15-2019
12:04 AM
i am trying connected mysql java connector to my mariadb using this docs https://docs.cloudera.com/documentation/enterprise/5-16-x/topics/prepare_cm_database.html. I am getting this error messege
[root@cloudera java-1.6.0]# /usr/share/cmf/schema/scm_prepare_database.sh mysql scm scm my_password
JAVA_HOME=/usr/java/jdk1.6.0_31
Verifying that we can write to /etc/cloudera-scm-server
Creating SCM configuration file in /etc/cloudera-scm-server
Executing: /usr/java/jdk1.6.0_31/bin/java -cp /usr/share/java/mysql-connector-java.jar:/usr/share/java/oracle-connector-java.jar:/usr/share/java/postgresql-connector-java.jar:/usr/share/cmf/schema/../lib/* com.cloudera.enterprise.dbutil.DbCommandExecutor /etc/cloudera-scm-server/db.properties com.cloudera.cmf.db.
Exception in thread "main" java.lang.UnsupportedClassVersionError: org/postgresql/util/PSQLException : Unsupported major.minor version 51.0
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631)
at java.lang.ClassLoader.defineClass(ClassLoader.java:615)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:283)
at java.net.URLClassLoader.access$000(URLClassLoader.java:58)
at java.net.URLClassLoader$1.run(URLClassLoader.java:197)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
Could not find the main class: com.cloudera.enterprise.dbutil.DbCommandExecutor. Program will exit.
--> Error 1, giving up (use --force if you wish to ignore the error)
Check java version using "java --version" on terminal
[root@cloudera java-1.6.0]# java -version
openjdk version "1.8.0_222"
OpenJDK Runtime Environment (build 1.8.0_222-b10)
OpenJDK 64-Bit Server VM (build 25.222-b10, mixed mode)
... View more
Labels:
- Labels:
-
Cloudera Manager
10-13-2019
09:03 PM
I am trying install cloudera 5.16.2(single mode). In cluster instalasion i am get this error.
/tmp/scm_prepare_node.ZzLnmqNE using SSH_CLIENT to get the SCM hostname: 10.0.0.4 34302 22 opening logging file descriptor Starting installation script... Acquiring installation lock... BEGIN flock 4 END (0) Detecting root privileges... effective UID is 0 Detecting distribution... BEGIN grep Tikanga /etc/redhat-release END (1) BEGIN grep 'CentOS release 5' /etc/redhat-release END (1) BEGIN grep 'Scientific Linux release 5' /etc/redhat-release END (1) BEGIN grep Santiago /etc/redhat-release END (1) BEGIN grep 'CentOS Linux release 6' /etc/redhat-release END (1) BEGIN grep 'CentOS release 6' /etc/redhat-release END (1) BEGIN grep 'Scientific Linux release 6' /etc/redhat-release END (1) BEGIN grep Maipo /etc/redhat-release END (1) BEGIN grep 'CentOS Linux release 7' /etc/redhat-release CentOS Linux release 7.5.1804 (Core) END (0) /etc/redhat-release ==> CentOS 7 Detecting Cloudera Manager Server... BEGIN host -t PTR 10.0.0.4 Host 4.0.0.10.in-addr.arpa. not found: 3(NXDOMAIN) END (1) BEGIN which python /usr/bin/python END (0) BEGIN python -c 'import socket; import sys; s = socket.socket(socket.AF_INET); s.settimeout(5.0); s.connect((sys.argv[1], int(sys.argv[2]))); s.close();' 10.0.0.4 7182 END (0) BEGIN which wget /usr/bin/wget END (0) BEGIN wget -qO- -T 1 -t 1 http://169.254.169.254/latest/meta-data/public-hostname && /bin/echo END (8) Installing package repositories... validating format of repository file /tmp/scm_prepare_node.ZzLnmqNE/repos/rhel7/cloudera-manager.repo installing repository file /tmp/scm_prepare_node.ZzLnmqNE/repos/rhel7/cloudera-manager.repo repository file /tmp/scm_prepare_node.ZzLnmqNE/repos/rhel7/cloudera-manager.repo installed Refreshing package metadata... BEGIN yum --disablerepo=* --enablerepo=cloudera* clean all Loaded plugins: fastestmirror, langpacks Cleaning repos: cloudera-manager Cleaning up everything Maybe you want: rm -rf /var/cache/yum, to also free up space taken by orphaned data from disabled or removed repos END (0) BEGIN rm -Rf /var/cache/yum/x86_64 END (0) BEGIN yum --disablerepo=* --enablerepo=cloudera* makecache Loaded plugins: fastestmirror, langpacks Determining fastest mirrors Metadata Cache Created END (0) Installing cloudera-manager-agent package... BEGIN yum --disablerepo=* --enablerepo=cloudera* list installed cloudera-manager-agent Loaded plugins: fastestmirror, langpacks Installed Packages cloudera-manager-agent.x86_64 5.16.2-1.cm5162.p0.7.el7 @Cloudera-manager END (0) BEGIN echo oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep cloudera-manager-agent oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons END (0) BEGIN yum --disablerepo=* --enablerepo=cloudera* info cloudera-manager-agent Loaded plugins: fastestmirror, langpacks Loading mirror speeds from cached hostfile Installed Packages Name : cloudera-manager-agent Arch : x86_64 Version : 5.16.2 Release : 1.cm5162.p0.7.el7 Size : 76 M Repo : installed From repo : cloudera-manager Summary : The Cloudera Manager Agent URL : http://www.cloudera.com License : Proprietary Description : The Cloudera Manager Agent. : : The Agent is deployed to machines running services managed by : Cloudera Manager.
END (0) Version : 5.16.2 Release : 1.cm5162.p0.7.el7 BEGIN yum -y install cloudera-manager-agent Loaded plugins: fastestmirror, langpacks Loading mirror speeds from cached hostfile * epel: mirror.umd.edu http://csc.mcs.sdsmt.edu/epel/7/x86_64/repodata/2315a785ec9b893a28d85b3782ba8a1bb742b8d07449f7040b22305b6aaa9019-updateinfo.xml.bz2: [Errno 12] Timeout on http://csc.mcs.sdsmt.edu/epel/7/x86_64/repodata/2315a785ec9b893a28d85b3782ba8a1bb742b8d07449f7040b22305b6aaa9019-updateinfo.xml.bz2: (28, 'Operation too slow. Less than 1000 bytes/sec transferred the last 30 seconds') Trying other mirror. Package cloudera-manager-agent-5.16.2-1.cm5162.p0.7.el7.x86_64 already installed and latest version Nothing to do END (0) remote package cloudera-manager-agent installed Installing cloudera-manager-daemons package... BEGIN yum --disablerepo=* --enablerepo=cloudera* list installed cloudera-manager-daemons Loaded plugins: fastestmirror, langpacks Installed Packages cloudera-manager-daemons.x86_64 5.16.2-1.cm5162.p0.7.el7 @Cloudera-manager END (0) BEGIN echo oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons | grep cloudera-manager-daemons oracle-j2sdk1.7 cloudera-manager-agent cloudera-manager-daemons END (0) BEGIN yum --disablerepo=* --enablerepo=cloudera* info cloudera-manager-daemons Loaded plugins: fastestmirror, langpacks Loading mirror speeds from cached hostfile Installed Packages Name : cloudera-manager-daemons Arch : x86_64 Version : 5.16.2 Release : 1.cm5162.p0.7.el7 Size : 931 M Repo : installed From repo : cloudera-manager Summary : Provides daemons for monitoring Hadoop and related tools. URL : http://www.cloudera.com License : Proprietary Description : This package includes daemons for monitoring and managing Hadoop.
END (0) Version : 5.16.2 Release : 1.cm5162.p0.7.el7 BEGIN yum -y install cloudera-manager-daemons Loaded plugins: fastestmirror, langpacks Loading mirror speeds from cached hostfile * epel: iad.mirror.rackspace.com Package cloudera-manager-daemons-5.16.2-1.cm5162.p0.7.el7.x86_64 already installed and latest version Nothing to do END (0) remote package cloudera-manager-daemons installed Installing Unlimited Strength Encryption policy files. Installation not requested. Step will be skipped. Configuring Cloudera Manager Agent... BEGIN grep server_host=10.0.0.4 /etc/cloudera-scm-agent/config.ini END (1) BEGIN cp /etc/cloudera-scm-agent/config.ini /etc/cloudera-scm-agent/config.ini.orig END (0) BEGIN sed -e 's/\(server_host=\).*/\110.0.0.4/' -i /etc/cloudera-scm-agent/config.ini END (0) scm agent configured BEGIN sed -e 's/#\(USER=.*\)/\1/' -i /etc/default/cloudera-scm-agent END (0) Starting Cloudera Manager Agent... BEGIN /sbin/service cloudera-scm-agent status ● cloudera-scm-agent.service - LSB: Cloudera SCM Agent Loaded: loaded (/etc/rc.d/init.d/cloudera-scm-agent; bad; vendor preset: disabled) Active: failed (Result: exit-code) since Mon 2019-10-14 01:18:43 WIB; 9h ago Docs: man:systemd-sysv-generator(8) Process: 32808 ExecStart=/etc/rc.d/init.d/cloudera-scm-agent start (code=exited, status=1/FAILURE)
Oct 14 01:18:43 xxx.xxx.xxx.xxxsystemd[1]: Starting LSB: Cloudera SCM Agent... Oct 14 01:18:43 xxx.xxx.xxx.xxx su[32826]: (to cloudera-scm) root on none Oct 14 01:18:43 xxx.xxx.xxx.xxx cloudera-scm-agent[32808]: Starting cloudera-scm-agent: bash: /var/log/cloudera-scm-agent/cloudera-scm-agent.out: Permission denied Oct 14 01:18:43 xxx.xxx.xxx.xxx cloudera-scm-agent[32808]: [FAILED] Oct 14 01:18:43 xxx.xxx.xxx.xxx systemd[1]: cloudera-scm-agent.service: control process exited, code=exited status=1 Oct 14 01:18:43 xxx.xxx.xxx.xxx systemd[1]: Failed to start LSB: Cloudera SCM Agent. Oct 14 01:18:43 xxx.xxx.xxx.xxx systemd[1]: Unit cloudera-scm-agent.service entered failed state. Oct 14 01:18:43 xxx.xxx.xxx.xxx systemd[1]: cloudera-scm-agent.service failed. END (3) BEGIN /sbin/service cloudera-scm-agent start Starting cloudera-scm-agent (via systemctl): Job for cloudera-scm-agent.service failed because the control process exited with error code. See "systemctl status cloudera-scm-agent.service" and "journalctl -xe" for details. [FAILED] END (1) agent logs: BEGIN tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.out | sed 's/^/>>/' >>[14/Oct/2019 00:14:10 +0000] 26295 MainThread agent INFO SCM Agent Version: 5.16.2 >>[14/Oct/2019 00:14:10 +0000] 26295 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[14/Oct/2019 00:14:10 +0000] 26295 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent >>[14/Oct/2019 00:14:10 +0000] 26295 MainThread agent INFO SCM Agent Version: 5.16.2 >>[14/Oct/2019 00:14:10 +0000] 26295 MainThread agent WARNING Expected mode 0751 for /run/cloudera-scm-agent but was 0755 >>[14/Oct/2019 00:14:10 +0000] 26295 MainThread agent INFO Re-using pre-existing directory: /run/cloudera-scm-agent END (0) BEGIN tail -n 50 /var/log/cloudera-scm-agent//cloudera-scm-agent.log | sed 's/^/>>/' >> verbose=self.__verbose >> File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/xmlrpc.py", line 470, in request >> '' ) >>ProtocolError: <ProtocolError for 127.0.0.1/RPC2: 401 Unauthorized> >>[14/Oct/2019 00:14:14 +0000] 26309 MainThread agent INFO Trying to connect to newly launched supervisor (Attempt 3) >>[14/Oct/2019 00:14:14 +0000] 26309 MainThread agent ERROR Failed! trying again in 1 second(s) >>Traceback (most recent call last): >> File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.16.2-py2.7.egg/cmf/agent.py", line 2271, in connect_to_new_supervisor >> self.get_supervisor_process_info() >> File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.16.2-py2.7.egg/cmf/agent.py", line 2291, in get_supervisor_process_info >> self.identifier = self.supervisor_client.supervisor.getIdentification() >> File "/usr/lib64/python2.7/xmlrpclib.py", line 1233, in __call__ >> return self.__send(self.__name, args) >> File "/usr/lib64/python2.7/xmlrpclib.py", line 1591, in __request >> verbose=self.__verbose >> File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/xmlrpc.py", line 470, in request >> '' ) >>ProtocolError: <ProtocolError for 127.0.0.1/RPC2: 401 Unauthorized> >>[14/Oct/2019 00:14:15 +0000] 26309 MainThread agent INFO Trying to connect to newly launched supervisor (Attempt 4) >>[14/Oct/2019 00:14:15 +0000] 26309 MainThread agent ERROR Failed! trying again in 1 second(s) >>Traceback (most recent call last): >> File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.16.2-py2.7.egg/cmf/agent.py", line 2271, in connect_to_new_supervisor >> self.get_supervisor_process_info() >> File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.16.2-py2.7.egg/cmf/agent.py", line 2291, in get_supervisor_process_info >> self.identifier = self.supervisor_client.supervisor.getIdentification() >> File "/usr/lib64/python2.7/xmlrpclib.py", line 1233, in __call__ >> return self.__send(self.__name, args) >> File "/usr/lib64/python2.7/xmlrpclib.py", line 1591, in __request >> verbose=self.__verbose >> File "/usr/lib64/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/xmlrpc.py", line 470, in request >> '' )
... View more
Labels:
- Labels:
-
Cloudera Manager