Support Questions
Find answers, ask questions, and share your expertise

How to fetch hive queries present in json file dynamically and pass into oozie sub workflows, track the status

How to fetch hive queries present in json file dynamically and pass into oozie sub workflows, track the status

New Contributor

We have an use case described below:

We need to run hive queries in parallel by fetching them from a json file(config)

Example json;

{
"Test_file1":"SELECT * FROM TABLE A",
"Test_file2":"SELECT * FROM TABLE B",
"Test_file3":"SELECT * FROM TABLE C"
}

 

We need to fetch query from each Key value present in json and run those queries in parallel as sub workflows using oozie.

We need to track the status of execution of those queries as well.

Please suggest if we can achive this using Oozie.