question Re: getting error when trying to deilimit the rows of data using pigStorage('|') in Archives of Support Questions (Read Only)

getting error when trying to deilimit the rows of data using pigStorage('|')

aditya_it_99 — Fri, 16 Sep 2022 12:00:06 GMT

>>lp = load '/employee.txt ' using pigStorage('|') as (aa,bb,cc,dd,ee);

And error is like above

2017-07-27 22:16:48,830 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 1070: Could not resolve pigStorage using imports: [, java.lang., org.apache.pig.builtin., org.apache.pig.impl.builtin.] Details at logfile: /root/Desktop/pig_1501174002903.log

Re: getting error when trying to deilimit the rows of data using pigStorage('|')

sreeviswa_athic — Fri, 28 Jul 2017 18:04:07 GMT

We generally encounter such errors when the delimiter specified in command doesn't match the delimiter in input file. Also make sure you are giving complete and right path of file

Please try below syntax

load '/path_to_file' using PigStorage('|') as (aa,bb,cc,dd,ee);

Re: getting error when trying to deilimit the rows of data using pigStorage('|')

gkeys — Fri, 28 Jul 2017 19:34:46 GMT

@Aditya Jadhav

Small mistake: you need uppercase PigStorage('|').

lp = load '/employee.txt ' using PigStorage('|') as (aa,bb,cc,dd,ee);

Error shows that it is looking for a java function called pigStorage and cannot find it. In addition to Pig's native functions (which PigStorage belongs) functions can be found in referenced libraries (e.g. 3rd party or ones you build yourself as User Defined Functions).

Re: getting error when trying to deilimit the rows of data using pigStorage('|')

gkeys — Fri, 28 Jul 2017 19:55:09 GMT

One point: if you specify a delimiter that is not the true delimiter in the file ... no error will be thrown. Rather, it will treat the full record (including its true delimiters) as a single field. In this case, the true delims will just be characters in a string.