Solr 5.5 Solr Exception Error opening new searcher (NiFi Flow)

[#1]

Hi - Solr 5.5 was working fine with NiFi, until I restarted my VM. Now when I start Nifi and Solr, I get the following message in Solr:

tweets_shard1_replica1: org.apache.solr.common.SolrException:org.apache.solr.common.SolrException: Error opening new searcher

I'm attaching the complete solr log. Please can someone help?

Thank Youtweets-shard1-replica1.txt

[#2]

The attached file doesn't look like a normal Solr log, did that come from solr_home/server/logs/solr.log ?

[#3]

@Bryan Bende I got the info from Solr UI, under 'Logging'.

[#4]

@Bryan Bende any ideas?

[#5]

<response>

<lst name="responseHeader">

<int name="status">0</int> <int name="QTime">0</int> </lst>

<arr name="collections">

<str>collection1</str> <str>tweets</str> </arr>

</response>

[root@sandbox ~]# su solr

[solr@sandbox root]$ /opt/lucidworks-hdpsearch/solr/bin/solr create -c tweets -d tweet_configs -s 1 -rf 1 -p 8983

Connecting to ZooKeeper at sandbox.hortonworks.com:2181/solr ...

Re-using existing configuration directory tweets

ERROR:

Collection 'tweets' already exists!

Checked collection existence using Collections API command:

http://sandbox.hortonworks.com:8983/solr/admin/collections?action=list

[#6]

@Raf Mohammed It looks like your transaction log has some issue and is preventing solr from opening a new searcher. Have you tried to restart solr or issue a manual commit ? Is your HDFS healthy?

You could remove the recent transaction logs, which should resolve this issue, however you will loose the most recent ingested data.

Got a checksum exception for /solr/tweets/core_node1/data/tlog/tlog.0000000000000000338 at BP-1464254149-172.17.0.2-1477381671113:blk_1073759482_18761:1024 from xxxxxxxxx:50010\cell \row

.

[#7]

@Jonas Straub HDFS is healthy and solr has been restarted however I'm not sure how to go about doing a manual commit...?

http://localhost:8983/solr/update?commit=true

Please can you tell me how to remove the recent transaction logs? I don't mind losing previously ingested data as this is a test environment. Thanks!

[#8]

@Jonas Straub @Neeraj Sabharwal hi, some guidance on this would be highly appreciated

[#9]

@Raf Mohammed - This is a transaction log file: /solr/tweets/core_node1/data/tlog/tlog.0000000000000000338, so just delete them (I always prefer to move files I'm going to delete to another directory called "TODELETE" in the event that I actually need them and once things look good I then delete them). You may need to restart Solr if you delete these files out from under Solr.

A manual commit should be like this assuming your collection is named "tweets":

http://localhost:8983/solr/tweets/update?commit=true

[#10]

@james.jones Sorry, how can i access and remove these logs please? *newbie* i'm not concerned about losing any previously ingested data, as they were just a collection of tweets from that particular day.