About EricL

EricL · ‎01-20-2020

@IsmailKeskin , --conf spark.hadoop.fs.hdfs.impl.disable.cache=true should help, if not, please also try to add --conf mapreduce.job.complete.cancel.delegation.tokens=false See if it helps. Cheers Eric

EricL · ‎01-16-2020

@DPez, Yeah, please share the result with your research. Cheers Eric

EricL · ‎01-15-2020

@DPez, I know that split.by.partition does require CREATE VIEW privilege, see table below: I believe that fastexport is new, and it might have the same requirement. However, I can't find official documentation to support it. Maybe other community members can validate. Cheers Eric

EricL · ‎01-14-2020

@Seaport, Please refer to documentation here: https://hadoop.apache.org/docs/r2.4.1/hadoop-project-dist/hadoop-common/FileSystemShell.html#setfacl Maybe try: sudo -u hdfs hadoop fs -setfacl -m group:hadoop:r-x /warehouse/tablespace/managed/hive/test1

EricL · ‎01-14-2020

@Seaport Great, thanks for sharing! So try to use "hdfs dfs -setfacl" to update it and see how it goes.

EricL · ‎01-14-2020

@Nekkanti, The whole {application_id} is the placeholder, so you should run below instead: sudo -u yarn yarn logs -applicationId application_1578980062850_0002

EricL · ‎01-13-2020

@Nekkanti , You need to locate the failed YARN application job and its associated logs to understand why it is failing. Find the application ID and run: If kerberized: yarn logs -applicationId {application_id} -appOwner {username} If unsecured: sudo -u yarn yarn logs -applicationId {application_id} Cheers Eric

EricL · ‎01-13-2020

@Seaport , Can you try: hdfs groups zeppelin Or run "id zeppelin" on the active NN host?

EricL · ‎01-09-2020

Have you tried @lyubomirangelo 's suggestion? He noticed that you have 0vcore configured, not sure if that has any negative impacts. And you only have 2 nodes in the cluster, meaning only one NodeManager? One master one worker node?

EricL · ‎01-09-2020

@kvinod , Can you try to run the same command from RM host and see if you also get the local mode or not? This can confirm if your edgenode is not setup correctly. Also, is it possible to share the yarn-site.xml and mapred-site.xml files? You can redact any host related information. Thanks Eric

Online	Offline
Last Visited	‎08-12-2020 03:17 AM

Member Since	‎03-23-2015 01:24 PM
Last Visited	‎08-12-2020 03:17 AM
Posts	1,288
Kudos received	113

Cloudera Community

Re: max() function generating an error in sqoop

Re: Add a dynamic variable to a Hive view

Re: Hive Server 2 failing to start CDP ,Cloudera M...

Re: Sqoop export from hive to teradata - > issue ...

Re: Cloudera Hadoop internal workings

Re: Actions of long running Spark streaming job fa...

Re: Sqoop import from teradata using fast export m...

Re: Sqoop import from teradata using fast export m...

Re: HDFS folder permission denied, but the user is...

Re: HDFS folder permission denied, but the user is...

Re: Hive Query is not running in cloudera HUE

Re: Hive Query is not running in cloudera HUE

Re: HDFS folder permission denied, but the user is...

Re: Spark jobs are stuck under YARN Fair Scheduler

Re: Yarn is not stable and getting SIGTERM 15 and ...