Member since
03-23-2015
1288
Posts
114
Kudos Received
98
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3318 | 06-11-2020 02:45 PM | |
5030 | 05-01-2020 12:23 AM | |
2829 | 04-21-2020 03:38 PM | |
3549 | 04-14-2020 12:26 AM | |
2330 | 02-27-2020 05:51 PM |
01-20-2020
03:13 PM
@IsmailKeskin , --conf spark.hadoop.fs.hdfs.impl.disable.cache=true should help, if not, please also try to add --conf mapreduce.job.complete.cancel.delegation.tokens=false See if it helps. Cheers Eric
... View more
01-16-2020
03:00 PM
@DPez, Yeah, please share the result with your research. Cheers Eric
... View more
01-15-2020
03:44 PM
@DPez, I know that split.by.partition does require CREATE VIEW privilege, see table below: I believe that fastexport is new, and it might have the same requirement. However, I can't find official documentation to support it. Maybe other community members can validate. Cheers Eric
... View more
01-14-2020
07:14 PM
@Seaport, Please refer to documentation here: https://hadoop.apache.org/docs/r2.4.1/hadoop-project-dist/hadoop-common/FileSystemShell.html#setfacl Maybe try: sudo -u hdfs hadoop fs -setfacl -m group:hadoop:r-x /warehouse/tablespace/managed/hive/test1
... View more
01-14-2020
02:06 PM
@Seaport Great, thanks for sharing! So try to use "hdfs dfs -setfacl" to update it and see how it goes.
... View more
01-14-2020
02:05 PM
@Nekkanti, The whole {application_id} is the placeholder, so you should run below instead: sudo -u yarn yarn logs -applicationId application_1578980062850_0002
... View more
01-13-2020
10:19 PM
@Nekkanti , You need to locate the failed YARN application job and its associated logs to understand why it is failing. Find the application ID and run: If kerberized: yarn logs -applicationId {application_id} -appOwner {username} If unsecured: sudo -u yarn yarn logs -applicationId {application_id} Cheers Eric
... View more
01-13-2020
10:17 PM
@Seaport , Can you try: hdfs groups zeppelin Or run "id zeppelin" on the active NN host?
... View more
01-09-2020
08:56 PM
Have you tried @lyubomirangelo 's suggestion? He noticed that you have 0vcore configured, not sure if that has any negative impacts. And you only have 2 nodes in the cluster, meaning only one NodeManager? One master one worker node?
... View more
01-09-2020
07:47 PM
@kvinod , Can you try to run the same command from RM host and see if you also get the local mode or not? This can confirm if your edgenode is not setup correctly. Also, is it possible to share the yarn-site.xml and mapred-site.xml files? You can redact any host related information. Thanks Eric
... View more