Member since
05-03-2017
29
Posts
0
Kudos Received
0
Solutions
12-18-2019
06:59 PM
I wonder if there is a way to ensure that all the files have finished being written to /tmp/log (The location at my site of yarn.nodemanager.remote-app-log-dir) before I copy them ?
... View more
12-15-2019
07:08 PM
Hi,
If I try and get the logs for an application like this:
yarn logs -applicationId application_1575531060741_10424
The command fails because I am not running it as the application owner. I need to run it like this:
yarn logs -applicationId application_1575531060741_10424 -appOwner hive
The problem is I want to write out all the yarn logs to the os so I can ingest them into splunk. If I try and figure out the appOwner for each application then this is awkward and time consuming even in a script.
Is there a better way to dump all the yarn logs to the os ?
Thanks
... View more
Labels:
- Labels:
-
Apache YARN
07-14-2019
03:01 PM
Do table statistics get replicated as part of hive BDR replication ?
... View more
Labels:
- Labels:
-
Apache Hive
-
Cloudera Manager
02-20-2019
04:41 PM
Hi, We have HA enabled for the metastore and have 2 instances running. Is it possible to configre a load balancer in front of these ? and if so is this normal practice ? Thanks
... View more
Labels:
- Labels:
-
Apache Hive
01-17-2019
04:30 PM
Hi, I can find this kind of message in the Impala daemon logs:
impalad.pxlbig04.nz.thenational.com.impala.log.INFO.20190117-104024.29754:I0117 10:42:17.900411 9206 admission-controller.cc:515] Stats: agg_num_running=7, agg_num_queued=0, agg_mem_reserved=525.00 GB, local_host(local_mem_admitted=0, num_admitted_running=0, num_queued=0, backend_mem_reserved=75.00 GB)
Which shows agg_num_running=7
Why is this same kind of metric not available in the CM graphs ?
I want to know how close to the max running queries of 25 that I set in the default queue on Impala Admission Control.
... View more
Labels:
- Labels:
-
Apache Impala
-
Cloudera Manager