Hi everyone
I have spent several days trying to solve the following case.
I need to join two flowfiles (master-detail) using Nifi flow, I tried using queryrecord and mergerecord but i couldn't did it.
I have some json based files in a HDFS (Apache Spark) i need to make a join and put de result in a database table (using nifi v1.11.4). I can read HDFS files but i cant' perform a join.
Example:
master_file content:
{
"FALLA_ID" : 40217, "FALLA_FECHA" : "1998-01-01 00:00:00", "FALLA_RPT_NRO" : 25, "FALLA_FRECUENCIA" : "60.0000"
}
detail_file content:
{
"FALLA_ID" : 40217, "PRINCIPAL" : 1, "FALLA_DTL_ID" : 1, "FALLA_CLASE" : 1, "TPF_FALLA_ID" : 1
},
{
"FALLA_ID" : 40217, "PRINCIPAL" : 1, "FALLA_DTL_ID" : 2, "FALLA_CLASE" : 2, "TPF_FALLA_ID" : 5
}
Expected_File content:
{
"FALLA_ID" : 40217, "FALLA_FECHA" : "1998-01-01 00:00:00", "FALLA_RPT_NRO" : 25, "FALLA_FRECUENCIA" : "60.0000",
"PRINCIPAL" : 1,
"FALLA_CLASE" : 2
}
As you can see, the FALLA_ID field is the common field to make a join.
Have you some ideas?
Thank you!!
... View more
