what would be the most optimal way to import tables in oozie (let's say 8-10 tables ) from a database that has 100's of them. Now, I can not use exclude option with import all and specify 90 tables which I need to exclude. Also, I believe that the table imports should be parallel jobs in oozie? Since these are independent of each other, why not? In that case, 1. how exactly do I specify tables imports in parallel? (from same and different databases). 2. How do I have incremental imports every day i.e I import only the newly added data everyday at a particular time?(I have a co-ordinator.xml but not sure about passing the date / recordnum. for incremental imports). 3. How do I specify different frequencies ? i.e some of the imports happen daily and rest may be once in 3 days? 4. The APPEND option can limit data movement only to new or updated records. How exactly? how is it different from incremental imports? Which one is performance-wise better and faster)? Also, Thank you so much for maintaining this wonderfully informed community :).
... View more
