Hello, I am trying to convert multiple json file into csv file in that, In source folder i am getting different json file with different schema. need to convert json file to csv file with dynamic schema mapping and put that file into destination folder. I have tried bellow flow, 1) getFile processor- to get file from source. 2) UpdateAttribute - set attribute schema.name : record 3) inferAvroSchema -configure Schema Output Destination : flowfile-attribute Input Content Type : json 4)convertRecord processor - Record Reader :JsonTreeReader Record Writer :CSVRecordSetWriter 5) putFile : put file into destination folder. But in above flow getting error in convertRecord Processor, Error: Failed to process StandardFlowFileRecord[uuid=69603ac0-ac43-44b5-82f3-5c1c89e4abaf,claim=StandardContentClaim [resourceClaim=StandardResourceClaim[id=1547526092906-1, container=default, section=1], offset=878, length=878],offset=0,name=orders1.json.avro,size=878]; will route to failure: Failed to create schema from the Schema Text after evaluating FlowFile Attributes. Please find the attached screen-shot of configuration of convert record processor. Thanks ... View more

Hello, I have a two flow, from every flow get one flow file. May be there some delay between getting file from different flow How to compare one flow file attribute with other flow file attribute. After that send mail depending on success or failure condition Is there any easy way to do that in Apache NIFI. Thanks in advance. ... View more

Hello, I have Fetch Open source API data using GetHTTP processor and save as text file. Is there any way to auto increment page because size of data is more. Thanks ... View more

Hello, I am new in Apache NIFI, I have to import CRM data into hive. what is possible way to import data into hive. Thanks in advance ... View more

Hello, I have design the nifi flow like this selectHiveQL->convertAvroToJson->SplitJson->EvaluateJsonPath->RoutOnAttribute(depends on condition the query goes on) ->presto or ->ReplaceText->putHiveQL hive table is query_id job_type query 1 presto create table hive.db.table as select * from mysql.db.table 2 hive ALTER table db.table set tblproperties ("orc.create.index"="true") 3 hive ALTER table db.table set tblproperties ("transactional"="true") 4 presto create table hive.db.table_stage as select * from mysql.db.table selectHiveQL-select query on hive table contain query_id, job_type and query convertAvroToJson->convert avro format into json SplitJson-split the record EvaluateJsonPath-set the query_id, job_type and query attribute RoutOnAttribute-depending on condition of job_type that query is executed in presto or hive presto-custom processor executed the query ReplaceText-set the putHiveQL query putHiveQL-execute hive query complete flow-flow.png problems: 1) How to stop the flow if any query failed from any processor. 2) I have tried to connect the presto failure to presto processor that time if query failed the next query not goes to presto processor but failed query is continuously executed in presto processor. 3) if the query is alternate and presto query failed that time hive query goes to hive processor(backpressure of hive failure also set to 1). 4) How to send email notification if the flow is successfully completed or failed? Please provide your suggestions . Thanks in advance . ... View more