Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 02-19-2016 05:59 AM
2016-02-19 02:29:21,118 [main] INFO org.apache.pig.Main - Logging error messages to: /hadoop/yarn/local/usercache/admin/appcache/application_1455824286177_0003/container_e03_1455824286177_0003_01_000002/pig_1455848961114.log 2016-02-19 02:29:22,717 [main] ERROR org.apache.pig.Main - ERROR 2997: Encountered IOException. File –useHCatalog does not exist
Created 02-25-2016 01:53 AM
Created 02-19-2016 06:13 AM
@Prakash Punj, Have you checked below link?:
http://stackoverflow.com/questions/24370338/filenotfoundexception-with-pig
Hope it helps you solving this ERROR?
Created 02-19-2016 09:40 AM
Just one question, did you cut and paste the command? Word has the bad habit of replacing the - sign with a different character that looks the same. Can you verify that the - is really the normal linux command line - ?
Created 02-19-2016 06:30 PM
Confirmed, the pasted character is not a minus sign (ASCII 45 in decimal). You can verify with the 'od' command.
Created 02-19-2016 11:17 AM
you're most likely encountering this problem please see https://community.hortonworks.com/questions/8518/hcatloader-error.html
There's a known bug in sandbox
Created 02-23-2016 02:41 AM
@Prakash Punj use the following
org.apache.hive.hcatalog.pig.HCatLoader instead of org.apache.hcatalog.pig.HCatLoader
Created 02-23-2016 03:33 AM
@Artem Ervits
Below is the code that I m using in pig script. a = LOAD 'geolocation' using org.apache.hive.hcatalog.pig.HCatLoader(); b = filter a by event != 'normal'; c = foreach b generate driverid, event, (int) '1' as occurance; d = group c by driverid; e = foreach d generate group as driverid, SUM(c.occurance) as t_occ; g = LOAD 'drivermileage' using org.apache.hive.hcatalog.pig.HCatLoader(); h = join e by driverid, g by driverid; final_data = foreach h generate $0 as driverid, $1 as events, $3 as totmiles, (float) $3/$1 as riskfactor; store final_data into 'riskfactor' using org.apache.hive.hcatalog.pig.HCatStorer(); ERROR that I AM GETTING IS: ARNING: Use "yarn jar" to launch YARN applications. 16/02/23 03:31:35 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL 16/02/23 03:31:35 INFO pig.ExecTypeProvider: Trying ExecType : MAPREDUCE 16/02/23 03:31:35 INFO pig.ExecTypeProvider: Picked MAPREDUCE as the ExecType 2016-02-23 03:31:35,609 [main] INFO org.apache.pig.Main - Apache Pig version 0.15.0.2.3.4.0-3485 (rexported) compiled Dec 16 2015, 04:30:33 2016-02-23 03:31:35,609 [main] INFO org.apache.pig.Main - Logging error messages to: /hadoop/yarn/local/usercache/admin/appcache/application_1455824286177_0013/container_e03_1455824286177_0013_01_000002/pig_1456198295607.log 2016-02-23 03:31:38,312 [main] ERROR org.apache.pig.Main - ERROR 2997: Encountered IOException. File –useHCatalog does not exist Details at logfile: /hadoop/yarn/local/usercache/admin/appcache/application_1455824286177_0013/container_e03_1455824286177_0013_01_000002/pig_1456198295607.log 2016-02-23 03:31:38,339 [main] INFO org.apache.pig.Main - Pig script completed in 3 seconds and 412 milliseconds (3412 ms)
Created 02-23-2016 11:00 AM
You are executing pig script incorrectly, it accepts your -useHCatalog as filename. You can use the pig Ambari view and type -useHCatalog in additional parameters or run command in the terminal. Documentation https://cwiki.apache.org/confluence/display/Hive/HCatalog+LoadStore#HCatalogLoadStore-The-useHCatalo...
pig -x tez -useHCatalog filename
Created 02-25-2016 02:10 AM
have you seen my response? What happens if you run your script as I show above?
Created 02-24-2016 08:01 PM
Can you verify whether you are still experiencing an issue after replacing the hyphen/dash/minus symbol with the correct character, as described by Benjamin below?