About AsimShaikh

AsimShaikh · ‎04-20-2023

Hi @skasireddy Can you please share spark-submit command used to trigger this application? Also you can try specifying --files for hbase dependant files and share its outcome?

AsimShaikh · ‎04-20-2023

Hi @as30 Could be data related issue here, can you please share DDL for table? Also do you have partitions created before hand if you are trying to write data under partitioned table?

AsimShaikh · ‎04-13-2023

Hi @Scout Can you share acl for /var/lib/ranger/yarn/policy-cache/yarn_cm_yarn_tag.json

AsimShaikh · ‎04-13-2023

Hi @rdhau Can you share spark-submit command used to trigger this application? Also as a quick test can you make this property as true and share its outcome? spark.dynamicAllocation.enabled

AsimShaikh · ‎02-21-2023

Can you please help with full stack trace for queue manager?

AsimShaikh · ‎01-03-2023

@aval Can you please confirm on which version of Cloudera you are currently on ? Basically HWC is required when you want to access Managed tables via Spark. Also use of spark.sql.hive.hwc.execution.mode is deprecated as per CDP 7.1.7 https://docs.cloudera.com/cdp-private-cloud-base/7.1.7/integrating-hive-and-bi/topics/hive-hwc-reader-mode.html

AsimShaikh · ‎01-02-2023

yarn.nodemanager.disk-health-checker.enable is only to Enable or disable the disk health checker service and will not fix this issue. Please share NM logs snippet for review.

AsimShaikh · ‎01-02-2023

Hi @rudi101101 Can you please confirm if you are using any timeout settings from PowerBI end?

AsimShaikh · ‎01-02-2023

@hanumanth Can you please share top command output from NM's, need to check which processes are consuming resources on NM

AsimShaikh · ‎01-02-2023

Hi @SantoshB You can see such messages when you have reached user factor limit/resource limit on queue level. You can check tune user-limit factor or check queue utilization to schedule applications accordingly. Also seems application has failed with exit-code 13, can you please share YARN trace to identify reason for failure?

Online	Offline
Last Visited	‎06-30-2023 07:16 AM

Member Since	‎04-04-2022 04:39 AM
Last Visited	‎06-30-2023 07:16 AM
Posts	79
Kudos received	5

Cloudera Community

Re: write is slow in hdfs using pyspark

Re: particular nodemanagers nodes memory reaches >...

Re: Queue Manager best practices

Re: Version mapping between CDH and Apache communi...

Re: Version mapping between CDH and Apache communi...

Re: Unable to connect remote Hadoop cluster using ...

Re: HELP PLEASE!!!, Failed to write at least 1000 ...

Re: CDP 7 placement rules dont work

Re: write is slow in hdfs using pyspark

Re: cluster configuration Failed to execute comman...

Re: HWC execution in spark no spark ui

Re: Map Reduce job on YARN hangs in ACCEPTED state

Re: ERROR [HY000] [Cloudera][ImpalaODBC] (120) Err...

Re: particular nodemanagers nodes memory reaches >...

Re: WARN cluster.YarnScheduler: Initial job has no...