Member since
02-07-2022
45
Posts
2
Kudos Received
2
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1336 | 07-13-2023 05:25 AM | |
4208 | 07-13-2023 05:23 AM |
01-10-2023
06:03 AM
Hi All, I am also facing this WARN messages in one of my spark job and output not getting generating and job status shows succeeded. any suggestions please???
... View more
12-28-2022
03:51 AM
Hi @AsimShaikh , We are observing on specific nodes
... View more
12-22-2022
10:51 PM
Hi team, How to troubleshoot always particular nodemanagers nodes memory reaches >95% when job is running Regards, Hanu
... View more
Labels:
- Labels:
-
Cloudera Enterprise Data Hub
12-22-2022
08:44 PM
Hi Team, While running spark job we are getting below error.. any one please guide me on this.. ERROR yarn.ApplicationMaster: User class threw exception: java.lang.IllegalArgumentException: Unable to instantiate SparkSession with Hive support because Hive classes are not found. java.lang.IllegalArgumentException: Unable to instantiate SparkSession with Hive support because Hive classes are not found. Regards, Hanu
... View more
Labels:
- Labels:
-
Cloudera Enterprise Data Hub
12-06-2022
12:26 AM
Hi All, As CDH version was 5.16.1 out of support , i am unable to contact support. please help here.
... View more
12-05-2022
07:11 AM
Hi Team,
Please suggest any guide or recommendations of tuning the memory parameters for spark jobs.
Eg: To process 500GB input data by spark job how much executors and memory required for each executor etc...
... View more
Labels:
12-05-2022
07:04 AM
Hi Team, Spark job is hang or struck due to below error. can any one please help here.. 22/12/05 22:29:55 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=localhost:2181 sessionTimeout=90000 watcher=hconnection-0x5e29988e0x0, quorum=localhost:2181, baseZNode=/hbase 22/12/05 22:29:55 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error) 22/12/05 22:29:55 WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1126) .... 22/12/05 22:30:12 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error) 22/12/05 22:30:12 ERROR zookeeper.RecoverableZooKeeper: ZooKeeper exists failed after 4 attempts 22/12/05 22:30:12 WARN zookeeper.ZKUtil: hconnection-0x5e29988e0x0, quorum=localhost:2181, baseZNode=/hbase Unable to set watcher on znode (/hbase/hbaseid) org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
... View more
Labels:
11-14-2022
08:10 PM
Hi Team, We have 1 table which has more than 1 lakh partitions. Support team moved data from HDFS to other path and try to do MSCK but it is not working even drop table also. Getting below errors.. FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask While drooping partitions also getting same error after 10min can one help me on this..
... View more
Labels:
- Labels:
-
Apache Hive
11-14-2022
07:35 PM
@ask_bill_brooks not only for NIFI ,this vulnerability has been raised for below path also.. /opt/hadoop/yarn/nm/filecache /opt/hadoop/yarn/nm/usercache
... View more