@Giuseppe Maldarizzi HDF/NiFi can be used for this particular case. You can use the GetHDFS processor to listen for incoming files and index them with the PutSolr processor. This would also give you more control if you need it as you can then add additional metadata to index on the files such as source, etc. If you prefer to do something a bit more custom you can use HDFS iNotify hooks and listen for incoming files to process. Look at this codebase done a while ago that implements a java daemon as well as a storm topology for processing document from HDFS and indexing into Solr. It should help you get started and give good direction. Java Daemon: https://github.com/acesir/hdfs-daemon Storm Topology: https://github.com/acesir/hdfs-storm-indexer ... View more

If you want to keep the XML tags then you should be indexing the document without using XML update handlers and just index everything as raw/plain text. Modify schema xml file and cleanup the fields. Create some literal fields for metadata information about the file and just index the entire XML as a multi valued field. Honestly, this will make the search itself very poor as tags and words will be tokenized so to improve search and optimization add stop-words around tags to improve it. ... View more