base_table is not a exernal table.How we are loading the data into base_table is not clear during first run is not clear?could you please provide input on this?we are not using any load statement or insert into statement? I think after using below statement.Manually we have to load the data from files present in path:- /user/hive/incremental_table/incremental_table into table base_table sqoop import --connect jdbc:teradata://{host name or ip address}/Database=retail --connection-manager org.apache.sqoop.teradata.TeradataConnManager --username dbc --password dbc --table SOURCE_TBL --target-dir /user/hive/incremental_table -m 1 ... View more

Hi folks Any input on my clarification ... View more

a)Thanks for input @Artem Ervits .Your input is always appreciated. I will go for coordinator Job with time and data availability-based scheduling but still have following clarifications clarification 1:- suppose if i am using below command to trigger the coordinator job.Is it one time activity in production to run this command once in production since it will trigger based on frequency for day 2?please correct me if i am wrong or do i need to run this command on day2 also? oozie job -oozie http://sandbox.hortonworks.com:11000/oozie -config /path/to/job.properties -run <coordinator-app name="my_first_job" start="2014-01-01T02:00Z" end="2014-12-31T02:00Z" frequency="${coord:days(1)}" xmlns="uri:oozie:coordinator:0.4"> clarification 2:-How to Implement condition logic in your Oozie workflow and if there's new data, run the actions, otherwise proceed to end action? ... View more

Hi experts, Any input on my clarification ... View more

HI @Santhosh B Gowda Thanks for input. a)My question is how to run below command in production since we should not run manually. oozie job --oozie http://host_nameofoozieserver:8080/oozie -Doozie.wf.application.path=hdfs://namenodepath/pathof_workflow_xml/workflow.xml-run b)I know about coordinator but at this point of time i am not sure whether i have to use data or time triggers. currently we are running flume continusoly ... View more

Hi @Mahesh Mallikarjunappa what is the purpose of test.hql? logic behind it? ... View more

HI @Greg Keys Could you please provide input on my clarification ... View more