Member since
09-18-2015
3274
Posts
1159
Kudos Received
426
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2691 | 11-01-2016 05:43 PM | |
| 9131 | 11-01-2016 05:36 PM | |
| 5027 | 07-01-2016 03:20 PM | |
| 8438 | 05-25-2016 11:36 AM | |
| 4609 | 05-24-2016 05:27 PM |
02-17-2016
12:38 PM
@Phoncy Joseph This is from AWS forums "I tried to rerun my job again and this time it is finished successfully. So I guess it may be related with s3 service unstable in rent two days at least from error message. I hope this issue not happen again." link
... View more
02-17-2016
12:35 PM
@marko I see that other people are hitting the same issue. I guess you did the manual install of spark now..Correct? Can you try to do this in some other node?
... View more
02-17-2016
12:27 PM
@Deepak Girdher Now , answering your original question: You never point a table to a location like /tmp or /user or / anything ...You want to point table location to particular directory structure not landing/root of mounts
... View more
02-17-2016
12:26 PM
@Deepak Girdher That's correct...Data will show up in HDFS after loading into Hive table.
... View more
02-17-2016
12:20 PM
@Roberto Sancho It's part of HDP and for supported customers. http://hortonworks.com/blog/introducing-hortonworks-smartsense/
... View more
02-17-2016
12:19 PM
1 Kudo
@cokorda putra susila rpm -qa | grep -i spark -> whats the output? Did you run yum install spark_2_3_4_1_10-master -y ?
... View more
02-17-2016
12:07 PM
1 Kudo
@Saurabh Kumar No , neeraj and group is in AD You can see the output Also, you need to look into syncing up your server with ad Use nslcd or sssd
... View more
02-17-2016
12:01 PM
@Roberto Sancho Do you have support contract ? Please install smartsense for better utilization of your cluster .
... View more
02-17-2016
11:59 AM
@Roberto Sancho See this thread http://stackoverflow.com/questions/16836770/last-reducer-tasks-are-taking-long-time-to-finish
... View more
02-17-2016
11:30 AM
@Rushikesh Deshmukh See this https://dzone.com/articles/how-tame-java-gc-pauses
... View more