@Raf Mohammed I recreated your error and tested it, although I was not using HDFS, which should not be any different. To delete the corrupt collection you can do these steps. shut down solr delete all of the shard directories for the collection. (e.g. hdfs dfs -rm -r /solr/tweets/core_node*, or just move them to another directory outside of the "dataDir" directory) start solr issue the collection DELETE command (e.g. http://localhost:8984/solr/admin/collections?action=DELETE&name=collection2) recreate the collection I recommend shutting down Solr and HDFS gracefully to avoid index corruption. Also, you can create backup copies if you want to recover in the future. Having replicas will also probably help with this situation. ... View more

@Avijeet Dash, The suggestion from Sunile is great. But, where you can't do that, here is a solution. If you need to manually delete all but the last X files named with a certain file pattern (*.zip, files*.log, etc), you can run something like this command which finds all but the most recent 5 matching files. # find MY_LOG_DIR -type f -name "FILE_PATTERN" -printf "%T+\t%p\n" | sort |awk '{print $2}' |head -n -5 |xargs -i CMD_FOR_EACH_FILE {} Replace the bold parts as needed. For example, the following command will find all but the most recent 5 files matching pattern *.log.20##-##-## and deletes them. Note, since this command is a delete command, before running something so drastic, you should test first by replacing the "rm" with "ls -l" or do a "mv" instead. Test, test, test. # find /var/log/hive -type f -name "*.log.20[0-9][0-9]-[0-2][0-9]-[0-9][0-9]" -printf "%T+\t%p\n" | sort |awk '{print $2}' |head -n -5 |xargs -i rm {} There are always many ways to solve a problem and I'm sure there is a more elegant solution. ... View more

@Bilal Arshad All of the files in ATLAS_HOME/conf/solr are probably needed in a directory on the Solr host so that when you run the solr create command it will upload those files into zookeeper for Solr to access for that collection (no matter which host Solr is running on). The files in this directory are as follows (from the link you provided) |- solr |- currency.xml |- lang |- stopwords_en.txt |- protowords.txt |- schema.xml |- solrconfig.xml |- stopwords.txt |- synonyms.txt solrconfig.xml is has configuration parameters such as what rest endpoints are available for the collection. schema.xml describes the fields and how they are handled (indexed, stored, and so forth). The other files are used by the schema.xml (assuming they are used) as they should be listed/referenced in the schema.xml. So, for this collection, I assume the following are referenced from the schema: synonyms.txt --- listing words that can be searched and considered equivalent (e.g. car and automobile) stopwords.txt -- listing highly common words that will not be indexed such as "the" and "a" protowords.xml -- listing words that should not be stemmed (broken into equivalent root words) stopwords_en.txt -- same as stopwords above but specific for English. currency.xml -- money exchange rates Even if all of these files are not used, it shouldn't hurt anything including them. ... View more