Cloudera Community
flowerbirds
user rank
Explorer

cloudera-scm-agent start error: AttributeError: _d...

by Explorer in Support Questions
‎07-14-2021 02:13 AM
‎07-14-2021 02:13 AM
There has 3 agent, 2 agent start up normal, the other one failed to start.    CDH 5.11.1       /u01/cm-5.11.1/etc/init.d/cloudera-scm-agent start Traceback (most recent call last): File "/u01/cm-5.11.1/lib64/cmf/agent/build/env/bin/cmf-agent", line 8, in <module> from pkg_resources import load_entry_point File "/u01/cm-5.11.1/lib64/cmf/agent/build/env/lib/python2.7/site-packages/pkg_resources.py", line 3007, in <module> working_set.require(__requires__) File "/u01/cm-5.11.1/lib64/cmf/agent/build/env/lib/python2.7/site-packages/pkg_resources.py", line 728, in require needed = self.resolve(parse_requirements(requirements)) File "/u01/cm-5.11.1/lib64/cmf/agent/build/env/lib/python2.7/site-packages/pkg_resources.py", line 631, in resolve requirements.extend(dist.requires(req.extras)[::-1]) File "/u01/cm-5.11.1/lib64/cmf/agent/build/env/lib/python2.7/site-packages/pkg_resources.py", line 2489, in requires dm = self._dep_map File "/u01/cm-5.11.1/lib64/cmf/agent/build/env/lib/python2.7/site-packages/pkg_resources.py", line 2543, in __getattr__ raise AttributeError(attr) AttributeError: _dep_map       other agent:   ... View more

Re: Spark: Read from remote HA-enabled HDFS using ...

by Explorer in Support Questions
‎07-13-2021 02:15 AM
‎07-13-2021 02:15 AM
Same problem: 21/07/13 15:56:34 ERROR ExecutionImpl: Couldn't create proxy provider class org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider java.io.IOException: Couldn't create proxy provider class org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider at org.apache.hadoop.hdfs.NameNodeProxies.createFailoverProxyProvider(NameNodeProxies.java:530) at org.apache.hadoop.hdfs.NameNodeProxies.createProxy(NameNodeProxies.java:172) at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:662) at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:606) at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:148) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2596) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91) at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2630) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2612) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370) at org.apache.hadoop.fs.Path.getFileSystem(Path.java:296) at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:97) at org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodes(TokenCache.java:80) at org.apache.hadoop.mapred.FileInputFormat.listStatus(FileInputFormat.java:205) at org.apache.hadoop.mapred.FileInputFormat.getSplits(FileInputFormat.java:313) at org.apache.spark.rdd.HadoopRDD.getPartitions(HadoopRDD.scala:202) at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:252) at org.apache.spark.rdd.RDD$$anonfun$partitions$2.apply(RDD.scala:250) at scala.Option.getOrElse(Option.scala:121) at org.apache.spark.rdd.RDD.partitions(RDD.scala:250) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:637) Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hdfs.NameNodeProxies.createFailoverProxyProvider(NameNodeProxies.java:513) ... 84 more Caused by: java.lang.RuntimeException: Could not find any configured addresses for URI hdfs://nameservice1/user/hive/warehouse/test.db/test/year_month=20187 at org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider.<init>(ConfiguredFailoverProxyProvider.java:93) ... 89 more ... View more

Re: ACID table transactions fails

by Explorer in Support Questions
‎07-12-2021 07:52 PM
‎07-12-2021 07:52 PM
It works on impala shell or hive beeline? ... View more

Re: Error while running Insert overwrite query on ...

by Explorer in Support Questions
‎07-12-2021 07:45 PM
‎07-12-2021 07:45 PM
I think you should check yarn logs for more details info. ... View more

CM 5.16.2 scm prepare database error with mysql 5....

by Explorer in Support Questions
‎07-12-2021 03:20 AM
‎07-12-2021 03:20 AM
use script ：     /opt/module/cm/cm-5.16.2/share/cmf/schema/scm_prepare_database.sh     Error：     Mon Jul 12 17:30:10 CST 2021 WARN: Establishing SSL connection without server's identity verification is not recommended. According to MySQL 5.5.45+, 5.6.26+ and 5.7.6+ requirements SSL connection must be established by default if explicit option isn't set. For compliance with existing applications not using SSL the verifyServerCertificate property is set to 'false'. You need either to explicitly disable SSL by setting useSSL=false, or set useSSL=true and provide truststore for server certificate verification. [ main] DbProvisioner ERROR Exception when creating/dropping database with user 'temp' and jdbc url 'jdbc:mysql://localhost/?useUnicode=true&characterEncoding=UTF-8' com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure The last packet successfully received from the server was 287 milliseconds ago. The last packet sent successfully to the server was 277 milliseconds ago. at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)[:1.8.0_291] at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)[:1.8.0_291] at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)[:1.8.0_291] at java.lang.reflect.Constructor.newInstance(Constructor.java:423)[:1.8.0_291] at com.mysql.jdbc.Util.handleNewInstance(Util.java:425)[mysql-connector-java.jar:5.1.40] at com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:989)[mysql-connector-java.jar:5.1.40] at com.mysql.jdbc.ExportControlled.transformSocketToSSLSocket(ExportControlled.java:164)[mysql-connector-java.jar:5.1.40] at com.mysql.jdbc.MysqlIO.negotiateSSLConnection(MysqlIO.java:4898)[mysql-connector-java.jar:5.1.40] at com.mysql.jdbc.MysqlIO.proceedHandshakeWithPluggableAuthentication(MysqlIO.java:1659)[mysql-connector-java.jar:5.1.40] at com.mysql.jdbc.MysqlIO.doHandshake(MysqlIO.java:1226)[m      I guess the reason is mysql use ssl but jdbc url not set  useSSL=false，so I disabled mysql ssl option， then it works. Has another way to solve this problem, like modify options in db.properties? ... View more
Labels:
Contact Me
Online
Offline
Last Visited
‎07-28-2021 10:02 PM
Community Statistics
Member Since ‎05-22-2021 08:56 AM
Last Visited ‎07-28-2021 10:02 PM
Posts 6