Cloudera Community
ABaaya
user rank
Contributor
My Accepted Solutions
Show All

Re: Spark job fails in cluster mode.

by Community Manager Community Manager in Support Questions
‎03-29-2021 12:36 AM
‎03-29-2021 12:36 AM
@ishika as this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post. ... View more

Re: CDH5.0 VM: Error getting logs for job_14046579...

by Explorer in Support Questions
‎09-03-2019 08:39 AM
‎09-03-2019 08:39 AM
Hi,   For me it's happening while finding YARN logs using yarn logs command. The /tmp/logs directory is having below permissions.   drwxrwxrwt - yarn yarn   But inside logs directory, the directories are having permission as below. drwxrwxrwt - user/owner_of_directory yarn   Your guidance will be helpful.     Thanks, ... View more

Re: Jar files created when invalidate metadata is ...

by Guru Guru in Support Questions
‎11-26-2018 05:29 PM
‎11-26-2018 05:29 PM
CDH5.10.2 should have the fix for that specific issue.   ... View more

Re: Open File Descriptors warning in Cloudera Mana...

by Contributor Contributor in Support Questions
‎10-23-2018 02:08 AM
‎10-23-2018 02:08 AM
Resurrecting this topic with some clarity on the issue and it's remedy.   If RegionServers would be keeping dead connections to the Datanodes, the same symnptoms would be seen, many connection in CLOSE_WAIT, and file descriptor number increasing. In extreme cases the limit could be reached, whioch would case the host node to fail with no more open file descriptors to use issue.   There wasa bug in HBase prior to CDH5.13 which is described in this upstream JIRA in more detail[1]: HBASE-9393 Hbase does not closing a closed socket resulting in many CLOSE_WAIT]   This issue was patched in the following CDH releases: CDH5.13.0, CDH5.13.1, CDH5.13.2, CDH5.13.3, CDH5.14.0,  CDH5.14.2, CDH5.14.4, CDH5.15.0,  CDH5.15.1, CDH6.0.0.   [1] - upstream HBase JIRA - https://issues.apache.org/jira/browse/HBASE-9393?attachmentOrder=asc ... View more

Re: HDFS ACL Inheritance doesn't work

by Former Member in Support Questions
‎12-22-2017 08:39 AM
‎12-22-2017 08:39 AM
Hi Folks, if we change umask mode to 002 from 022 will fix this? is there any version dependency? currently, we are in 5.9.0.   My question is for the directory, seems we are forcing to give write permissions to group by changing to 002?    directory: 022 - rwxr-xr-x  002 - rwxrwxr-w   File: 022- rw-r--r-- 002 - rw-rw-r--     This is how much ACL on directory looks like, i have few groups that need only r-x, if we keep 002 will it get changed to rwx for group?    hdfs dfs -getfacl /test/ky/val/claim/version=xx/ # file: /test/ky/val/claim/version=xx # owner: svc_ingest_t # group: supergroup user::rwx user:hive:rwx group::rwx group:g_ingt_ba:r-x group:g_ingt_bu:rwx group:g_ingt_du:r-x group:hive:rwx mask::rwx other::--- default:user::rwx default:user:hive:rwx default:group::rwx default:group:g_ingt_ba:r-x default:group:g_ingt_bu:rwx default:group:g_du:r-x default:group:hive:rwx default:mask::rwx default:other::--- ... View more

Re: Errors while running alter table and compute s...

by Contributor in Support Questions
‎11-07-2017 02:37 PM
‎11-07-2017 02:37 PM
  Below is the error message i received .   1137 2017-11-07 03:55:11,536  [INFO ] There are no more tasks to run at this time 1138 Starting Impala Shell without Kerberos authentication 1140 Server version: impalad version 2.6.0-cdh5.8.4 RELEASE (build 207450616f75adbe082a4c2e1145a2384da83fa6) 1141 Invalidating Metadata 1142 Query: invalidate metadata 1143 1144 Fetched 0 row(s) in 4.11s 1145 Query: use `DBNAME` 1146 Query: insert overwrite table Table partition(recordtype) select adid,seg,profile,livecount, 1147 count(distinct mc) as nofs,stbnt,1 from table1 where livecount<>0 group by adid,seg,profile,livecount,stbnt 1148 WARNINGS: 1149 CatalogException: Table 'dbname.table' was modified while operation was in progress, aborting execution. 1150 1151 ... View more

Re: Get actual query details of all HIVE jobs in l...

by Contributor in Support Questions
‎08-24-2017 07:32 AM
‎08-24-2017 07:32 AM
The below link connects and filter results from API to get last 30 days of jobs and limit is increased to 10000 jobs at a time. Note: All times "endTime=1503438687495" are EPOC time, so filter your times based on requirement. Also set limit to what ever number of jobs you want to be displayed.   http://cloudera-manager-host-ip/cmf/yarn/completedApplications?startTime=1500758462000&endTime=1503438687495&offset=0&limit=10000&serviceName=yarn&histogramAttributes=allocated_memory_seconds%2Callocated_vcore_seconds%2Ccpu_milliseconds%2Capplication_duration%2Chdfs_bytes_read%2Chdfs_bytes_written ... View more

Re: Permission denied: user=mapred, access=WRITE, ...

by Rising Star in Support Questions
‎04-04-2017 01:50 AM
‎04-04-2017 01:50 AM
How did u solved it ??? Which things one has to check ? ... View more
Contact Me
Online
Offline
Last Visited
‎11-22-2017 09:08 AM
Community Statistics
Member Since ‎10-25-2016 01:36 PM
Last Visited ‎11-22-2017 09:08 AM
Posts 18
Kudos received 2