Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Execute SQL Missing Records - While loading from DB table

Execute SQL Missing Records - While loading from DB table

New Contributor

The use-case is to load data from an oracle table on an incremental basis/near-real time streaming mode (table gets loaded in parallel) . I have a data flow designed as Generate Table Fetch -> Execute SQL-> Convert Avro to Json, while doing this i noticed that some of the records are missed at the end of the flow. The field value from the Generate table fetch state is matching with the field in source oracle table. But i'm not getting the exact count of records in source oracle table at the end of data flow. Tried lot of work-around's but no luck. Any idea/suggestions/solutions?

Thanks,