Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

solr post command for HDFS

solr post command for HDFS

Explorer

I am playing around with the "post" command for solr to ingest/index documents into my collection, and i was trying to use the post command with HDFS without any luck. Does anyone know if this is possible? currently i have not issues pulling from a local path, but i cant figure out a way to pull from a HDFS path.

1 REPLY 1
Highlighted

Re: solr post command for HDFS

Cloudera Employee

You can use standard hdfs commands to write to stdout and have bin/post read from stdin.

This blog entry is quite helpful:

https://lucidworks.com/blog/2015/08/04/solr-5-new-binpost-utility/

hdfs dfs -cat /tmp/copyme.txt 2>&1 | /opt/lucidworks-hdpsearch/solr/bin/post -c tweets -type text/csv -d

The above sample was run on a sandbox.

Don't have an account?
Coming from Hortonworks? Activate your account here