Member since
08-10-2019
5
Posts
0
Kudos Received
0
Solutions
08-28-2019
12:06 AM
Zookeeper heap configured to 1GB and snapshot size suddenly reached to 1GB(950M ) and Zookeeper service got stopped. Once we increase heap to 4GB, ZK is working fine. The snapshot size is now back to few MBs once we restart the Cluster.
How to get the cause for this problem? What is stored as part of zookeeper snapshot? Why there is a sudden increase in snapshot size?
... View more
Labels:
- Labels:
-
Apache Zookeeper
08-12-2019
07:40 AM
I have the same case where the queries are running as hive user. Is there anyway to detect which user run the query from Hue? We have created a generic user which is shared among a group of analysts, but not able to detect who run the query. Is there any way to identify from Hue Sessions or IP address of the client who runs the query.
... View more
08-10-2019
10:55 AM
Community,
Any best practices for the maintenance for production clusters. When we should restart the services generally? - weekly once or monthly once.
Cleaning up log files.
And, also found that yarr logs in HDFS not get deleted according to the retention period. Ref: YARN logs under /tmp/logs/{user.name}/logs not cleared properly
Note: Mainly looking for a cluster in Bank, with regular ingestion using Sqoop and analytics using spark and impala.
... View more
Labels: