Cloudera Community
satvaddi
user rank
Explorer
My Accepted Solutions
Show All

Re: ozone FS datanodes disk space full

by Explorer in Support Questions
‎07-09-2025 09:50 PM
‎07-09-2025 09:50 PM
do not find such folders in /tmp 405 GB /tmp/24c9e15e52afc47c225b757e7bee1f9d/ 134 GB /tmp/5af6b2617513b81608501adea4166625/ 21 GB /tmp/bc3dcd485adfa1c339eab38f1516c6c5/     ... View more

Re: ozone FS datanodes disk space full

by Explorer in Support Questions
‎06-30-2025 08:43 AM
‎06-30-2025 08:43 AM
/tmp is occupied more space, please share command to cleanup /tmp [root@invcdp91dei01 ~]# ozone admin namespace du ofs://ozoneid/tmp Connecting to Recon: http://invcdp91dei04.informatica.com:9888/api/v1/namespace/du?path=/tmp ... Path : /tmp Total Size : 562 GB DU Size Path Name 405 GB /tmp/24c9e15e52afc47c225b757e7bee1f9d/ 134 GB /tmp/5af6b2617513b81608501adea4166625/ 459 MB /tmp/8a4ac216fb230da3834de641b3e5d0f7/ 0 bytes /tmp/adpqa/ 0 bytes /tmp/bb3462b62cd8db3f9ba007d86f8d1c6d/ 21 GB /tmp/bc3dcd485adfa1c339eab38f1516c6c5/ 0 bytes /tmp/d58da82289939d8c4ec4f40689c2847e/ 0 bytes /tmp/tmp/   ... View more

Re: ozone FS datanodes disk space full

by Explorer in Support Questions
‎06-30-2025 08:39 AM
‎06-30-2025 08:39 AM
cdp version used - cdh7.1.9.p1000  tmp volume is showing as disk space occupied.  [root@invcdp91dei01 ~]# hadoop fs -du -h ofs://ozoneid/tmp 0 0 ofs://ozoneid/tmp/.cloudera_health_monitoring_canary_files 0 0 ofs://ozoneid/tmp/hive             ... View more

Re: ozone FS datanodes disk space full

by Explorer in Support Questions
‎06-30-2025 12:07 AM
‎06-30-2025 12:07 AM
even container balancer is not helping to distributed the data in nodes [root@invcdp91dei01 ~]# ozone admin containerbalancer start Container Balancer started successfully.     ... View more

ozone FS datanodes disk space full

by Explorer in Support Questions
‎06-29-2025 11:25 PM
‎06-29-2025 11:25 PM
ozone FS datanodes disk space is getting occupied immediately even after extend the disk space without any operations performed. ... View more
Labels:

Spark job in cdp 7.2.18 RangerRaz not generating l...

by Explorer in Support Questions
‎03-31-2025 10:08 PM
‎03-31-2025 10:08 PM
in CDP Public Cloud 7218 RangerRaz Cluster.Below spark job is not generating logs though it Run Successfully. [cloudbreak@ajay7218razdh-master0 ~]$ spark3-submit \ > --master yarn \ > --deploy-mode cluster \ > --conf "spark.hadoop.hadoop.security.authentication=KERBEROS" \ > --conf "spark.hadoop.hadoop.security.authorization=true" \ > --conf "spark.hadoop.fs.s3a.delegation.token.binding=org.apache.knox.gateway.cloud.idbroker.s3a.IDBDelegationTokenBinding" \ > --conf "spark.hadoop.fs.s3a.idb.auth.token.enabled=true" \ > --conf "spark.hadoop.fs.s3a.aws.credentials.provider=org.apache.hadoop.fs.s3a.auth.IAMInstanceCredentialsProvider" \ > --conf "spark.hadoop.fs.s3a.security.credential.provider.path=jceks://hdfs/user/infa/knox_credentials.jceks" \ > --conf "spark.hadoop.fs.s3a.endpoint=s3.amazonaws.com" \ > --conf "spark.hadoop.fs.s3a.impl=org.apache.hadoop.fs.s3a.S3AFileSystem" \ > --conf "spark.driver.extraJavaOptions=-Djavax.net.debug=ssl:handshake" \ > --conf "spark.executor.extraJavaOptions=-Djavax.net.debug=ssl:handshake" \ > --class org.apache.spark.examples.SparkPi \ > /opt/cloudera/parcels/CDH-7.2.18-1.cdh7.2.18.p0.51297892/jars/spark-examples_2.12-3.4.1.7.2.18.0-641.jar 100           ... View more
Labels:

Re: Hive beeline with knox gateway is failing

by Explorer in Support Questions
‎03-19-2025 07:14 PM
‎03-19-2025 07:14 PM
TLS Certificate Alias - gateway-identity1 has been already set. beeline string is working beeline -u "jdbc:hive2://invgcscdp71901.informatica.com:8443/default;ssl=true;sslTrustStore=/var/lib/knox/gateway/data/security/gateway-client-trust.jks;trustStorePassword=changeit;transportMode=http;httpPath=gateway/cdp-proxy-api/hive;user=admin;password=admin" ... View more

Hive beeline with knox gateway is failing

by Explorer in Support Questions
‎03-19-2025 12:55 AM
‎03-19-2025 12:55 AM
knox service after enabling ssl is failing to start and hive beeline string used   oot@invgcscdp71901 jks]# beeline -u "jdbc:hive2://invgcscdp71901.informatica.com:8443/;ssl=true;sslTrustStore=/opt/cloudera/security/jks/truststore.jks;trustStorePassword=hadoop;transportMode=http;httpPath=gateway/cdp-proxy-api/hive" SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-7.1.9-1.cdh7.1.9.p1000.55406660/jars/log4j-slf4j-impl-2.18.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-7.1.9-1.cdh7.1.9.p1000.55406660/jars/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] WARNING: Use "yarn jar" to launch YARN applications. SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-7.1.9-1.cdh7.1.9.p1000.55406660/jars/log4j-slf4j-impl-2.18.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/opt/cloudera/parcels/CDH-7.1.9-1.cdh7.1.9.p1000.55406660/jars/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] Connecting to jdbc:hive2://invgcscdp71901.informatica.com:8443/;ssl=true;sslTrustStore=/opt/cloudera/security/jks/truststore.jks;trustStorePassword=hadoop;transportMode=http;httpPath=gateway/cdp-proxy-api/hive 25/03/19 13:17:34 [main]: ERROR jdbc.HiveConnection: Error opening session org.apache.thrift.transport.TTransportException: HTTP Response code: 404 at org.apache.thrift.transport.THttpClient.flushUsingHttpClient(THttpClient.java:291) ~[hive-exec-3.1.3000.7.1.9.1000-103.jar:3.1.3000.7.1.9.1000-103] at org.apache.thrift.transport.THttpClient.flush(THttpClient.java:346) ~[hive-exec-3.1.3000.7.1.9.1000-103.jar:3.1.3000.7.1.9.1000-103] at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:73) ~[hive-exec-3.1.3000.7.1.9.1000-103.jar:3.1.3000.7.1.9.1000-103] at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:62) ~[hive-exec-3.1.3000.7.1.9.1000-103.jar:3.1.3000.7.1.9.1000-103] at org.apache.hive.service.rpc.thrift.TCLIService$Client.send_OpenSession(TCLIService.java:143) ~[hive-service-rpc-3.1.3000.7.1.9.1000-103.jar:3.1.3000.7.1.9.1000-103] at org.apache.hive.service.rpc.thrift.TCLIService$Client.OpenSession(TCLIService.java:135) ~[hive-service-rpc-3.1.3000.7.1.9.1000-103.jar:3.1.3000.7.1.9.1000-103] at org.apache.hive.jdbc.HiveConnection.openSession(HiveConnection.java:1018) ~[hive-jdbc-3.1.3000.7.1.9.1000-103.jar:3.1.3000.7.1.9.1000-103] at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:349) ~[hive-jdbc-3.1.3000.7.1.9.1000-103.jar:3.1.3000.7.1.9.1000-103] at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:107) ~[hive-jdbc-3.1.3000.7.1.9.1000-103.jar:3.1.3000.7.1.9.1000-103] at java.sql.DriverManager.getConnection(DriverManager.java:664) ~[?:1.8.0_442] at java.sql.DriverManager.getConnection(DriverManager.java:208) ~[?:1.8.0_442] at org.apache.hive.beeline.DatabaseConnection.connect(DatabaseConnection.java:145) ~[hive-beeline-3.1.3000.7.1.9.1000-103.jar:3.1.3000.7.1.9.1000-103] at org.apache.hive.beeline.DatabaseConnection.getConnection(DatabaseConnection.java:209) ~[hive-beeline-3.1.3000.7.1.9.1000-103.jar:3.1.3000.7.1.9.1000-103] at org.apache.hive.beeline.Commands.connect(Commands.java:1679) ~[hive-beeline-3.1.3000.7.1.9.1000-103.jar:3.1.3000.7.1.9.1000-103] at org.apache.hive.beeline.Commands.connect(Commands.java:1574) ~[hive-beeline-3.1.3000.7.1.9.1000-103.jar:3.1.3000.7.1.9.1000-103] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_442] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_442] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_442] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_442] at org.apache.hive.beeline.ReflectiveCommandHandler.execute(ReflectiveCommandHandler.java:56) ~[hive-beeline-3.1.3000.7.1.9.1000-103.jar:3.1.3000.7.1.9.1000-103] at org.apache.hive.beeline.BeeLine.execCommandWithPrefix(BeeLine.java:1463) ~[hive-beeline-3.1.3000.7.1.9.1000-103.jar:3.1.3000.7.1.9.1000-103] at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:1502) ~[hive-beeline-3.1.3000.7.1.9.1000-103.jar:3.1.3000.7.1.9.1000-103] at org.apache.hive.beeline.BeeLine.connectUsingArgs(BeeLine.java:922) ~[hive-beeline-3.1.3000.7.1.9.1000-103.jar:3.1.3000.7.1.9.1000-103] at org.apache.hive.beeline.BeeLine.initArgs(BeeLine.java:804) ~[hive-beeline-3.1.3000.7.1.9.1000-103.jar:3.1.3000.7.1.9.1000-103] at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:1115) ~[hive-beeline-3.1.3000.7.1.9.1000-103.jar:3.1.3000.7.1.9.1000-103] at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:1089) ~[hive-beeline-3.1.3000.7.1.9.1000-103.jar:3.1.3000.7.1.9.1000-103] at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:547) ~[hive-beeline-3.1.3000.7.1.9.1000-103.jar:3.1.3000.7.1.9.1000-103] at org.apache.hive.beeline.BeeLine.main(BeeLine.java:529) ~[hive-beeline-3.1.3000.7.1.9.1000-103.jar:3.1.3000.7.1.9.1000-103] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_442] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_442] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_442] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_442] at org.apache.hadoop.util.RunJar.run(RunJar.java:318) ~[hadoop-common-3.1.1.7.1.9.1000-103.jar:?] at org.apache.hadoop.util.RunJar.main(RunJar.java:232) ~[hadoop-common-3.1.1.7.1.9.1000-103.jar:?] 25/03/19 13:17:34 [main]: WARN jdbc.HiveConnection: Failed to connect to invgcscdp71901.informatica.com:8443 Error: Could not open client transport with JDBC Uri: jdbc:hive2://invgcscdp71901.informatica.com:8443/;ssl=true;sslTrustStore=/opt/cloudera/security/jks/truststore.jks;trustStorePassword=hadoop;transportMode=http;httpPath=gateway/cdp-proxy-api/hive: Could not establish connection to jdbc:hive2://invgcscdp71901.informatica.com:8443/;ssl=true;sslTrustStore=/opt/cloudera/security/jks/truststore.jks;trustStorePassword=hadoop;transportMode=http;httpPath=gateway/cdp-proxy-api/hive: HTTP Response code: 404 (state=08S01,code=0) ... View more
Labels:
Contact Me
Online
Offline
Last Visited
‎07-09-2025 09:46 PM
Community Statistics
Member Since ‎07-05-2022 08:13 AM
Last Visited ‎07-09-2025 09:46 PM
Posts 8