Member since
07-06-2018
59
Posts
1
Kudos Received
4
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2585 | 03-05-2019 07:20 AM | |
2755 | 01-16-2019 09:15 AM | |
1490 | 10-25-2018 01:46 PM | |
1675 | 08-02-2018 12:34 PM |
07-14-2020
11:52 AM
Is there a way to poll parcel distribution progress/completion using cm api ?
... View more
Labels:
- Labels:
-
Cloudera Essentials
-
Cloudera Manager
08-21-2019
11:48 AM
Hi network, Can anyone list scenarios where in Impala queries goes in "query waiting to be closed stage". i was checking one of IDs webUI and found bunch of queries listed under that section. 1. Why queries end up in that category, i guess timeout controls it(yet to do a bit of reading on that ). 2. Is it safe to close them or does that lead to any problems? Regards
... View more
Labels:
- Labels:
-
Apache Impala
08-21-2019
11:28 AM
Thanks that does show more information. Though what i find weird is the same query has run with a large load earlier (with same config params) and now has failed (from the logs: java.lang.OutOfMemoryError: Java heap space). Regards
... View more
08-20-2019
01:35 PM
Hi ,
Has anyone come across, below error and can share a common cause since the error message looks very generic:
ERROR Lost executor 12 on host123: Container marked as failed: container_e218_1564435356568_349499_01_000013 on host: host123. Exit status: 143. Diagnostics: Container killed on request. Exit code is 143
Container exited with a non-zero exit code 143
... View more
Labels:
- Labels:
-
Apache Spark
08-09-2019
08:45 AM
Thanks for confirming that. We'll enable for Impala as well but after a week or so, but wanted to know if in the meantime it'd still work or not.
... View more
08-09-2019
07:52 AM
Hi Team, We are in process on enabling TLS on HS2, I wanted to know/clarify if that happens will Impala be affected? Impala is dependent on HMS and TLS is only limited to hive server 2, given that having TLS enabled on Hive and running Impala without it should be ok or do you see a scenario where this combination may not work? Regards
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Impala
08-02-2019
09:05 AM
Thanks, to be on the same page taking help of below scenario: hdfs snapshottable location /a/b/ has a file c which is snapshotted. Consider a scenario where c is deleted from hdfs using cli hdfs -rm -r -skipTrash (NN transaction happened and hdfs cli command doesn't show up the file anymore) and then a new file is created with same content/size and name. - What gets stored in hdfs? whats the delta that snapshot add in hdfs in this case? --> is it just that snapshot still holds c as block in hdfs in addition to the same file that was created in hdfs --> NN resource used to maintain both of their metadata in heap? is this all or there is more to it . Regards
... View more
08-01-2019
09:56 AM
Thanks Arpit, To clarify what is the magnitude of the size we are talking about here when you mention - " directory will need to be tracked as deltas and that can result in both higher disk space and NameNode heap usage". I'm assuming you mean just to store the metadata of the changed snapshot and which isn't significant given the actual size of data held(in reference to my example above) , if not please clarify Regards
... View more
08-01-2019
08:59 AM
HI,
Can someone confirm if snapshot enabled on a location occupy space in HDFS ?
For ex: HDFS location: /a/b/c is the only location in HDFS and occupies 9 TB post replication(3x).
it looks like:
3.0 9.0T /a/b/c
Question: If after enabling snapshot on this location will total HDFS utilization at cluster level increase to 18.0 TB?
Regards
... View more
Labels:
- Labels:
-
Apache Hadoop
07-30-2019
01:59 PM
Hi everyone, I'm using command in subject to fetch all yarn applications and use grep on the output to filter out a specific application . I wanted to find out what is the limit of this command, as in how far in the history does it go to get these states. Is this limited by the job history server limit or does it return something below that like last 1000 jobs etc? Regards
... View more
Labels:
- Labels:
-
Apache YARN