File does not exist Error with org.apache.hive.hcatalog.pig.HCatLoader

[#1]

Pig Script in Ambari Pig View with useHCatalog tag:

a = LOAD 'batting_data' using org.apache.hive.hcatalog.pig.HCatLoader(); b = LOAD 'master_data' using org.apache.hive.hcatalog.pig.HCatLoader(); c = join a by playerid, b by playerid; dump c;

--------------

Confirmed that tables exist in default database, but get following error:

File does not exist: /user/admin/pig/jobs/bb_16-02-2016-02-38-56/stdout at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:68) at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:58) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsUpdateTimes(FSNamesystem.java:1964) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsInt(FSNamesystem.java:1905) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1885) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1857) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:622) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:364) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:619) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:962) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2141) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2137) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2135)

[#2 · Accepted solution]

@Ojustwin Naik

If you are using HDP 2.3 here is the solution there was a kira already resolved. link

Let me know if that helped

[#3]

The link tells you to restart all services. We had to explicitly restart the YARN services after restarting all services in order to get YARN to work, and then the execution of the Pig script would work. Note that we explicitly added the \pigscripts directory and made sure permissions were set to 777 before we restarted.