Created 03-22-2016 09:47 AM
Hi,
I would like to create/update Hive tables let's say once per hour.
Which tool should i use to schedule the execution of my hql script?
Thank you in advance
Created 03-23-2016 04:51 AM
Want to get a detailed solution you have to login/registered on the community
Register/LoginCreated 03-22-2016 11:20 AM
why can't you use oozie time based workflow.
Created 03-22-2016 12:25 PM
Well, most of the tutorials i found on Oozie were written 2 or 3 years ago so i was wondering if it was still the recommended tech for this kind of things.
Created 03-22-2016 12:34 PM
You can also use falocn with hive action.
Created 03-23-2016 04:51 AM
Want to get a detailed solution you have to login/registered on the community
Register/LoginCreated 03-23-2016 06:52 AM
you also invested time in learning nifi, nifi has a cron based scheduler, would be interesting to see it leveraged for this use case. Look under scheduling tab https://nifi.apache.org/docs/nifi-docs/html/user-guide.html#Configuring_a_Processor
Created 03-23-2016 08:44 AM
Yes i use it to request the API i'm interested in once a week (except for the twitter streaming api of course).