Member since
10-01-2015
3933
Posts
1150
Kudos Received
374
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 3655 | 05-03-2017 05:13 PM | |
| 3013 | 05-02-2017 08:38 AM | |
| 3275 | 05-02-2017 08:13 AM | |
| 3220 | 04-10-2017 10:51 PM | |
| 1684 | 03-28-2017 02:27 AM |
02-20-2016
01:40 PM
Make sure mapreduce is up if youre not executing using Tez. It is preferred if you use tez though as it is faster.
... View more
02-19-2016
11:47 PM
@Cecilia Posadas Please read https://www.slideshare.net/mobile/martyhall/hadoop-tutorial-oozie
... View more
02-19-2016
11:08 PM
Then you should have access to your workflow somewhere, its probably in /user/hue, can you submit the workflowanually with Oozie command and see if it works, If so, issue is with hue. @Cecilia Posadas
... View more
02-19-2016
10:57 PM
@Cecilia Posadas Can you ssh to the machine and execute Sqoop command manually? ssh -P 2222 root@127.0.0.1
... View more
02-19-2016
10:41 PM
@Cecilia Posadas click on history link inside there
... View more
02-19-2016
08:21 PM
go to sandbox.hortonworks.com:8088 and find your job there. If you have access to Ambari, you can find the same information by going to sandbox.hortonworks.com:8080 then clicking oozie service and go to oozie UI. From Oozie UI you can find your job. @Cecilia Posadas
... View more
02-19-2016
08:03 PM
1. as long as you're conforming to HCat rules, you will be able to see Hive tables. I suggest you read https://cwiki.apache.org/confluence/display/Hive/HCatalog+UsingHCat 2. I can't think of any other way. HCatalog serves as the common metadata repository. Would be curious to learn if there's another approach. 3. yes you can do this A = load 'fromHCat' using HCatLoader();
B = load 'fromHBase' using HBaseStorageHandler();
... do something and make sure data types don't conflict and combine data
store joined_dataset into 'toHCat' using HCatStorer(); https://cwiki.apache.org/confluence/display/HCATALOG/HCatalog+HBase+Integration+Design 4. maybe you missed a jar or something? I don't know, I tried that once and it didn't work for me, seems like more pain than just calling -useHCatalog
... View more
02-19-2016
07:45 PM
@Cecilia Posadas the error you provided is generic, to find out the real reason you're having issue you only possible if you go to the task attempt, Hue will not give you that.
... View more
02-19-2016
07:22 PM
go to ambari > yarn > resource manager UI > find your job, drill down to task attempt. It is not in Hue. @Cecilia Posadas
... View more
02-19-2016
07:20 PM
@R M 1. no not the same, HCatalog has different data types in some instances than Hive. It's possible, make sure HCatalog knows about the HBase table. 2. yes you can use HBaseStorage and HCatStorer and HCatLoader but keep in mind HCatalog needs to be the storage for all data, so in your case you can load from HBaseStorage but HCatStorer needs to be the output, or read from HCat and store to HBaseStorage, makes sense? HCatalog pig example in Oozie here https://github.com/dbist/oozie/tree/master/apps/hcatalog 3. You don't always want to load the libs, global settings are not always recommended, you will be pulling unnecessarily a lot of libs. Use register for any small number of libs. Essentially it's the same thing.
... View more