Created 06-17-2016 02:12 AM
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/pig/backend/executionengine/ExecException at java.lang.Class.getDeclaredMethods0(Native Method)
I am running the example on HDP 2.4 and get this error. Investigating logs.
Created 06-17-2016 02:21 AM
Resources:
http://www.graphviz.org/Download_linux_rhel.php
https://github.com/Netflix/Lipstick/wiki/Getting-Started
yum list available 'graphviz*'yum install 'graphviz*'./gradlew assemble
I always like to rename gradlew, avengers.
then
./gradlew run-app
(Make sure you add that port/open firewall/etc...)
That worked!
2016-06-17 02:36:44,558 [main] INFO org.apache.pig.tools.pigstats.mapreduce.SimplePigStats - Script Statistics: HadoopVersionPigVersionUserIdStartedAtFinishedAtFeatures 2.4.0root2016-06-17 02:36:402016-06-17 02:36:44HASH_JOIN,FILTER,LIMIT Success! Job Stats (time in seconds): JobIdMapsReducesMaxMapTimeMinMapTImeAvgMapTimeMedianMapTimeMaxReduceTimeMinReduceTimeAvgReduceTimeMedianReducetimeAliasFeatureOutputs job_local2036219587_000121n/an/an/an/an/an/an/an/afruit_names_join,fruits,limited,namesHASH_JOIN job_local406327028_000211n/an/an/an/an/an/an/an/afruit_namesfile:/tmp/temp195796189/tmp-2027262369, Input(s): Successfully read 3 records from: "file:///opt/demo/certification/pig/Lipstick/quickstart/1.dat" Successfully read 3 records from: "file:///opt/demo/certification/pig/Lipstick/quickstart/2.dat" Output(s): Successfully stored 1 records in: "file:/tmp/temp195796189/tmp-2027262369" Counters: Total records written : 1 Total bytes written : 0 Spillable Memory Manager spill count : 0 Total bags proactively spilled: 0 Total records proactively spilled: 0 Job DAG: job_local2036219587_0001->job_local406327028_0002, job_local406327028_0002 2016-06-17 02:36:44,568 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Success! 2016-06-17 02:36:44,571 [main] WARN org.apache.pig.data.SchemaTupleBackend - SchemaTupleBackend has already been initialized 2016-06-17 02:36:44,582 [main] INFO org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to process : 1 2016-06-17 02:36:44,583 [main] INFO org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil - Total input paths to process : 1 (orange,ORANGE)
Created 06-17-2016 02:21 AM
Resources:
http://www.graphviz.org/Download_linux_rhel.php
https://github.com/Netflix/Lipstick/wiki/Getting-Started
yum list available 'graphviz*'yum install 'graphviz*'./gradlew assemble
I always like to rename gradlew, avengers.
then
./gradlew run-app
(Make sure you add that port/open firewall/etc...)
That worked!
2016-06-17 02:36:44,558 [main] INFO org.apache.pig.tools.pigstats.mapreduce.SimplePigStats - Script Statistics: HadoopVersionPigVersionUserIdStartedAtFinishedAtFeatures 2.4.0root2016-06-17 02:36:402016-06-17 02:36:44HASH_JOIN,FILTER,LIMIT Success! Job Stats (time in seconds): JobIdMapsReducesMaxMapTimeMinMapTImeAvgMapTimeMedianMapTimeMaxReduceTimeMinReduceTimeAvgReduceTimeMedianReducetimeAliasFeatureOutputs job_local2036219587_000121n/an/an/an/an/an/an/an/afruit_names_join,fruits,limited,namesHASH_JOIN job_local406327028_000211n/an/an/an/an/an/an/an/afruit_namesfile:/tmp/temp195796189/tmp-2027262369, Input(s): Successfully read 3 records from: "file:///opt/demo/certification/pig/Lipstick/quickstart/1.dat" Successfully read 3 records from: "file:///opt/demo/certification/pig/Lipstick/quickstart/2.dat" Output(s): Successfully stored 1 records in: "file:/tmp/temp195796189/tmp-2027262369" Counters: Total records written : 1 Total bytes written : 0 Spillable Memory Manager spill count : 0 Total bags proactively spilled: 0 Total records proactively spilled: 0 Job DAG: job_local2036219587_0001->job_local406327028_0002, job_local406327028_0002 2016-06-17 02:36:44,568 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Success! 2016-06-17 02:36:44,571 [main] WARN org.apache.pig.data.SchemaTupleBackend - SchemaTupleBackend has already been initialized 2016-06-17 02:36:44,582 [main] INFO org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to process : 1 2016-06-17 02:36:44,583 [main] INFO org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil - Total input paths to process : 1 (orange,ORANGE)