question Loading data in pig when HDFS in High Available mode (HA) in Archives of Support Questions (Read Only)

Loading data in pig when HDFS in High Available mode (HA)

TomasTF — Fri, 16 Sep 2022 09:22:03 GMT

I have a simple pig program, with a simple LOAD and STORE/DUMP statement, but it refuse to load the test data file. The path in HDFS is in /user/dwh/ the file is called test.txt.

I assume the pig is not aware of the HA setting of my cluster, Any ideas?

Input path does not exist: hdfs://nameservice1/user/dwh/test.txt

Re: Loading data in pig when HDFS in High Available mode (HA)

neerjakhattar — Fri, 27 Feb 2015 21:01:58 GMT

please check if test.txt exist in hdfs .check if it is not text.txt rather than test.txt

Re: Loading data in pig when HDFS in High Available mode (HA)

neerjakhattar — Mon, 02 Mar 2015 18:29:31 GMT

test.xml or text.xml needs to be present in hdfs and that should be passed in LOAD command