08-26-2015 07:51 AM
I checked the Solr tutorial and managed to run a basic SolrCloud and created and index/core.
After posting som documents bin/post -c mycore ~/mylib/*.py I succesfully indexed all my python files.
But I didnt find nowhere a tutorial/guide how to index files stored inside the HDFS.
Can anybody point me in the right direction?
12-12-2015 10:55 AM
01-05-2016 09:35 AM
You can use the MapReduceIndexerTool, coupled with the hdfsFindTool:
The hdfsFindTool will generate a list of documents, based on the find parameters you've specified, and then those can be piped to the MapReduceIndexerTool with the '--input-list -' option (to specify the input-list is coming from std input)