We are trying to migrate data from Oracle to Elasticsearch using Apache Nifi. We are trying to establish a one to many relationships(represented as multiple tables in Oracle) in a single elastic index. What we are trying to achieve can be summarized as below. select * from table1 . ( The primary key of table1 is key1 ) For each fetched record, We want to extract data from another table using the key from table 1. Something like select * from table2 where foreign_key = key1 . We checked the ExecuteSQLRecord processor which has select query and post query but are unable to figure out how to reference key from table1 in the query to table2 Please let us know if there are any other processors specifically designed for this use case ... View more

Hi Team,   We are trying to migrate data from RDBMS to elastic search using Apache Nifi. We have created pipelines in Nifi and are able to transfer data but are facing some issues and wanted to check if someone already got over them. Please provide inputs on the below items. How to avoid auto-generating _id in elastic search. We want this to be set from a DB column. We tried providing the column name in the " Identifier Record Path" attribute in the PutElasticSearchHTTPRecord processor but were getting an error that the attribute name is not valid. Can you please let us know the acceptable format. How to load nested objects into the index using NIfi? We are looking to maintain one to many relationships in the index using nested objects but were unable to find a configuration to do so. Do we have any processors to do this in Nifi? Please let us know.   Thanks in Advance!   ... View more