1)CREATE TABLE md ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.avro.AvroSerDe' WITH SERDEPROPERTIES () 'avro.schema.url'='/user/cloudera/departments.avsc') STORED as INPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerInputFormat' OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.avro.AvroContainerOutputFormat'; 2)LOAD DATA INPATH '/user/cloudera/departments/part-m-00000.avro' into table md; hive> SET hive.exec.dynamic.partition = true; hive> SET hive.exec.dynamic.partition.mode = nonstrict; 3)create table mda(a int) partitioned by(name string); 4)nsert overwrite table mda partition(name) select department_id,department_name from md; Try this way you can create paritions from avro file too ... View more

You can use RounteOnAttribute if you have some way to identifying which files goes to which destination like in filename, path etc. Check attributes of the flow file to see if any can be used. Then use those attributes to create 3 paths, something like: https://community.hortonworks.com/questions/54811/redirecting-flow-based-on-certain-condition-nifi.html ... View more

Bin packing is the standard strategy that is used when merging together data, it just writes the bytes of each flow file one after another, inserting optional header, footer, and demarcators. Defragment strategy is for when you have previously used one of the "split" processors and want to undo the split back to a single flow file. This mode requires that all of the incoming flow files have the standard "fragment" attributes like fragment.identifier, fragment.index, and fragment.count which are created by the split processors. ... View more

@Adithya Sajjanam, It will overwrite the data. It will not append the data ... View more

Thanks @Matt Burgess ... View more

@Andrew Watson Hi Andrew did you find a way out for this issue ... View more