Member since
12-30-2015
68
Posts
16
Kudos Received
3
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1977 | 06-14-2016 08:56 AM | |
1737 | 04-25-2016 11:59 PM | |
2173 | 03-25-2016 06:50 PM |
01-18-2017
01:03 AM
- Not sure why dynamic partition pruning is not being chosen .. you might want to try running with DEBUG level logging and run the EXPLAIN statement again, that may give some clues as to what is going on during compiliation. - As far as I can tell it looks like it tries to preserve the larger of the 2 tables for dynamic partition pruning. - hive.explain.user just creates a more "user-friendly" explain, but sometimes the plan is shown a little differently so sometimes it helps to see it without that option.
... View more
09-30-2016
03:07 PM
Since you running pig while hive.execution.engine is in tez mode, you can tune these parameters OR set the upper limit in hive-env either ways you should be able to control how much memory is allocated for your job. This community article explains the ideal values in detail: https://community.hortonworks.com/articles/14309/demystify-tez-tuning-step-by-step.html In short: Set the values for tez.am.resource.memory.mb equivalent to yarn.scheduler.minimum-allocation-mb Try that and see if that helps.
... View more
06-14-2016
08:56 AM
When I added the hive-site.xml first, I missed a few properties, now I added all properties mentioned by @allen huang in this link https://community.hortonworks.com/questions/25121/oozie-execute-sqoop-falls.html#answer-25291 So even if the sqoop is called using ooziee shell action, I had to add hive-site.xml with properties mentioned by Allen. Thank you Allen :). My script is working fine now.
... View more
06-10-2016
07:53 AM
Thanks, I was able to set up the SSH and it is working. But I have a question. What is this oozie ID? I am logging in to Linux using my ID. I submit the workflow either using my ID or I do a kinit to other ID and submit the workflow using that ID. When I see in the UI logs, oozie workflow is shown to be submitted using either my ID or other ID for which ticket was obtained using Kinit. What I dont understand is where does this "oozie" user id fit in. Even I had to go to the home directory of this user "oozie" and get its keys and added it to my destination server authprized_keys file. Can you please explain the purpose of this id? And also how to find this "oozie user id" Is this user id available in oozie-site.xml? Based on this article I also searched for oozie id, but what if it were different? how to find this oozie id? Thanks!
... View more
05-13-2016
06:15 PM
Once you changed it, try using A_Filtered = FILTER A BY Col1 == '1'; From the error, it shows that right hand side is a number and not a string. Use '' to search for a string and this will work.
... View more
05-13-2016
09:59 PM
Please read this https://phoenix.apache.org/salted.html
... View more
05-13-2016
03:47 AM
Thanks for the info.
... View more
05-27-2016
05:06 PM
Had the same error in my config, fixing it to proposed resolved an issue
... View more
04-25-2016
11:59 PM
Hi, Thanks for your reply. I tried to query the same table today. And I was able to query it. Not sure why it was an issue earlier. I queried using the same ID again and it worked. Earlier it was an issue only from Tableau. I was able to query the hive external table and also Hbase table directly using command line without issues. Now this works fine.
... View more
03-25-2016
06:50 PM
Hi I just tried again the next day. I didnt change anything. Same variables for hadoop home hive home, hcat home and Hcat lib jars. Today it worked with both 1.3 and 1.4 TDCH.. Not sure why it didnt work the first time. Thanks for your time and help!
... View more