I have a Pig Script Error executing the Script for Computing the Driver Risk and dont know what to do. Does anybody know what to do ? Its the Tutorial Getting Started with Hadoop Lab 3.

martin_van-huse · ‎02-24-2017

ls: cannot access /hadoop/yarn/local/usercache/admin/appcache/application_1487940575822_0002/container_1487940575822_0002_01_000002/hive.tar.gz/hive/lib/slf4j-api-*.jar: No such file or directory
ls: cannot access /hadoop/yarn/local/usercache/admin/appcache/application_1487940575822_0002/container_1487940575822_0002_01_000002/hive.tar.gz/hive/hcatalog/lib/*hbase-storage-handler-*.jar: No such file or directory
WARNING: Use "yarn jar" to launch YARN applications.
17/02/24 13:00:06 INFO pig.ExecTypeProvider: Trying ExecType : LOCAL
17/02/24 13:00:06 INFO pig.ExecTypeProvider: Trying ExecType : MAPREDUCE
17/02/24 13:00:06 INFO pig.ExecTypeProvider: Trying ExecType : TEZ_LOCAL
17/02/24 13:00:06 INFO pig.ExecTypeProvider: Trying ExecType : TEZ
17/02/24 13:00:06 INFO pig.ExecTypeProvider: Picked TEZ as the ExecType
2017-02-24 13:00:06,556 [main] INFO  org.apache.pig.Main - Apache Pig version 0.16.0.2.5.0.0-1245 (rexported) compiled Aug 26 2016, 02:07:35
2017-02-24 13:00:06,556 [main] INFO  org.apache.pig.Main - Logging error messages to: /hadoop/yarn/local/usercache/admin/appcache/application_1487940575822_0002/container_1487940575822_0002_01_000002/pig_1487941206542.log
2017-02-24 13:00:11,600 [main] INFO  org.apache.pig.impl.util.Utils - Default bootup file /home/yarn/.pigbootup not found
2017-02-24 13:00:12,838 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: hdfs://sandbox.hortonworks.com:8020
2017-02-24 13:00:19,111 [main] INFO  org.apache.pig.PigServer - Pig Script ID for the session: PIG-script.pig-a1001e0c-c0ad-4d2a-8c0d-6ef4e646f029
2017-02-24 13:00:22,291 [main] INFO  org.apache.hadoop.yarn.client.api.impl.TimelineClientImpl - Timeline service address: http://sandbox.hortonworks.com:8188/ws/v1/timeline/
2017-02-24 13:00:44,897 [main] INFO  org.apache.pig.backend.hadoop.PigATSClient - Created ATS Hook
2017-02-24 13:00:56,270 [main] WARN  org.apache.hadoop.hive.conf.HiveConf - HiveConf of name hive.metastore.local does not exist
2017-02-24 13:00:57,367 [main] INFO  hive.metastore - Trying to connect to metastore with URI thrift://sandbox.hortonworks.com:9083
2017-02-24 13:01:15,064 [main] INFO  hive.metastore - Connected to metastore.
2017-02-24 13:01:47,023 [main] WARN  org.apache.hadoop.hive.conf.HiveConf - HiveConf of name hive.metastore.local does not exist
2017-02-24 13:01:47,049 [main] INFO  hive.metastore - Trying to connect to metastore with URI thrift://sandbox.hortonworks.com:9083
2017-02-24 13:01:47,075 [main] INFO  hive.metastore - Connected to metastore.
2017-02-24 13:01:47,698 [main] WARN  org.apache.pig.newplan.BaseOperatorPlan - Encountered Warning IMPLICIT_CAST_TO_FLOAT 1 time(s).
2017-02-24 13:01:47,891 [main] WARN  org.apache.hadoop.hive.conf.HiveConf - HiveConf of name hive.metastore.local does not exist
2017-02-24 13:01:47,989 [main] INFO  hive.metastore - Trying to connect to metastore with URI thrift://sandbox.hortonworks.com:9083
2017-02-24 13:01:47,995 [main] INFO  hive.metastore - Connected to metastore.
2017-02-24 13:01:49,349 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 0: 
<file script.pig, line 9, column 0> Output Location Validation Failed for: 'riskfactor More info to follow:
Pig 'double' type in column 2(0-based) cannot map to HCat 'BIGINT'type.  Target filed must be of HCat type {DOUBLE}
Details at logfile: /hadoop/yarn/local/usercache/admin/appcache/application_1487940575822_0002/container_1487940575822_0002_01_000002/pig_1487941206542.log
2017-02-24 13:01:49,382 [main] INFO  org.apache.pig.Main - Pig script completed in 1 minute, 44 seconds and 277 milliseconds (104277 ms)

aervits · ‎02-24-2017

Try steps in this thread, we need to fix that tutorial

https://community.hortonworks.com/questions/58614/i-need-help-with-the-riskfactor-pig-script-from-th...