Member since
09-25-2015
101
Posts
51
Kudos Received
25
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1122 | 08-25-2017 01:06 PM | |
1519 | 05-16-2017 12:53 PM | |
1168 | 05-15-2017 05:07 PM | |
1201 | 05-11-2017 04:19 PM | |
881 | 05-05-2017 12:29 AM |
04-28-2016
01:17 PM
Thanks Guys. Both answers helped. I had the wrong DNS name in Database URL config value on Hive service. Hive is NOT being used in this cluster, so I did not think to check that value. Thanks to both. WG
... View more
12-17-2015
02:42 PM
@William Gonzalez Maybe a cast can be a workaround, like this: --query "select col1 as col1, col2 as col2, cast('' as varchar(10)) as col3, col4 as col4 from input_table" \
... View more
02-03-2016
03:46 PM
1 Kudo
@John Smith are you still having issues with this? Can you accept best answer or provide your own solution?
... View more
11-16-2015
07:10 PM
Thank you, Deepesh. I will do that.
... View more
10-26-2015
04:55 PM
2 Kudos
This will depend on how fast they wish to have this information...You can get historical info, so you could do this once a day, or once an hour, or once every 5 minutes depending on your use for it. Its possible to pass parameters to the REST call your making that specific a time range, so you could for example get all the logs from the last hour. So you could do something like... http://RMHOST:8088/ws/v1/cluster/apps?startedTimeBegin=1445351681496&startedTimeEnd=1445878421 https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html#Cluster_Applications_API
... View more
10-19-2015
06:24 PM
IMO, this doesn't look bad at all. While you could tune the young generation size a bit higher to lessen these, the amount of time spent in GC is pretty low, so it's unlikely to have any impact on long term performance. We'd also need to see entries for the Perm Gen and Old Gen to determine what impact increasing the young gen would have. Let's break it down: This is a Young Generation collection, also known as a minor collection. The total heap used by the young generation hovers around 135mb, which aligns with your setting. The size of the young gen before GC is hovering around 130mb (some times less, as heap needs for objects will determine when the GC is needed). After GC, the heap is 1mb, meaning clean up went very well and most objects are short lived for this application. Ultimately, these collections took on average 5ms each (.005 seconds) each 8 seconds or so (8000 ms), under .0001% of the total run time of the application, which is perfectly fine.
... View more
01-31-2016
03:41 PM
Thanks @Paul Codding for taking care of this...very helpful to have in official docs.
... View more
10-08-2015
03:37 PM
Yes and it gave more insight into what was wrong: FAILED: SemanticException [Error 10007]: Ambiguous column reference visit_num in features_and_label Customer had a duped column. Thank you for the tip.
... View more
06-14-2016
10:47 AM
Hi, we are facing same issue. the issue in intermittent. Has anybody found the issue here? Once we rerun the same job after some time it gets executed successfully.
... View more
09-30-2015
05:06 PM
Good find. Thanks
... View more
- « Previous
- Next »