Support Questions

Find answers, ask questions, and share your expertise

Loading data in pig when HDFS in High Available mode (HA)

avatar
Expert Contributor

I have a simple pig program, with a simple LOAD and STORE/DUMP statement, but it refuse to load the test data file. The path in HDFS is in /user/dwh/ the file is called test.txt.

 

I assume the pig is not aware of the HA setting of my cluster, Any ideas?

 

Input path does not exist: hdfs://nameservice1/user/dwh/test.txt

 

 

 

 

1 ACCEPTED SOLUTION

avatar
Rising Star
test.xml or text.xml needs to be present in hdfs and that should be passed in LOAD command

View solution in original post

2 REPLIES 2

avatar
Rising Star
please check if test.txt exist in hdfs .check if it is not text.txt rather than test.txt

avatar
Rising Star
test.xml or text.xml needs to be present in hdfs and that should be passed in LOAD command