was going through some ORC based processing from pdf. looks it works better if each page is split into a monochrome image. Examples online show Ghostscript as an option. I was able to leverage this processor to extract images and with a property change it to grayscale if needed. I could now send this to OCR processor for extraction. @Jeremy Dyer ... View more

https://github.com/rkarthik29/pdfprocessors ... View more

@Muhammad idrees for 2.6.1 you have to use a mpack to installation of solr. https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.1/bk_solr-search-installation/content/ch_hdp-search-install-ambari.html. try that ... View more

@Muhammad idrees var/lib/ambari-server/resources/stacks/HDP/2.5/repos/repoinfo.xml , are you trying this with 2.5? ... View more

i tried on 1.1 it worked fine. json2avro.xml { "type": "record", "name": "testdata", "fields": [ { "name": "timestamp", "type": {"type":"string","logicalType":"timestamp-millis"} }, { "name": "c1", "type": "double" }, { "name": "c2", "type": "double" }, { "name": "c3", "type": "double" }, { "name": "c4", "type": "double" }, { "name": "c5", "type": "double" }, { "name": "c6", "type": "double" }, { "name": "c7", "type": "double" }, { "name": "c8", "type": "double" }, { "name": "c9", "type": "double" }, { "name": "c10", "type": "double" }, { "name": "c11", "type": "double" }, { "name": "postal_code", "type": "string" }, { "name": "country", "type": "string" } ] } ... View more

hmm, strange which version of nifi were you on? ... View more

as per the avro doc, timestamp-millis is a logicaltype, so you have to use something like this... {"name":"timestamp","type": {"type": "string", "logicalType": "timestamp-millis"} see if that works. https://github.com/mtth/avsc/wiki/Advanced-usage#logical-types ... View more

@Arun A K why not use an the new Record oriented processors, store the schema locally in nifi using the avroschemaregistry. https://community.hortonworks.com/questions/113959/use-nifi-to-change-the-format-of-numeric-date-and.html ... View more

This will give you provenance in nifi, which provides you with confirmation of how much data in bytes was extracted and sent to hdfs, so no need to do this additional check. ... View more