Our Community is getting an upgrade! To get everything ready for the relaunch, we’ll be placing the site in read-only mode starting September 21st.
We really appreciate your understanding while we get things set up behind the scenes. Catch up on all the exciting details about the move here.
Need help or have questions? Drop us a line at [email protected]
Created 06-17-2016 02:12 AM
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/pig/backend/executionengine/ExecException at java.lang.Class.getDeclaredMethods0(Native Method)
I am running the example on HDP 2.4 and get this error. Investigating logs.
Created 06-17-2016 02:21 AM
Resources:
http://www.graphviz.org/Download_linux_rhel.php
https://github.com/Netflix/Lipstick/wiki/Getting-Started
yum list available 'graphviz*'yum install 'graphviz*'./gradlew assemble
I always like to rename gradlew, avengers.
then
./gradlew run-app
(Make sure you add that port/open firewall/etc...)
That worked!
2016-06-17 02:36:44,558 [main] INFO org.apache.pig.tools.pigstats.mapreduce.SimplePigStats - Script Statistics: HadoopVersionPigVersionUserIdStartedAtFinishedAtFeatures 2.4.0root2016-06-17 02:36:402016-06-17 02:36:44HASH_JOIN,FILTER,LIMIT Success! Job Stats (time in seconds): JobIdMapsReducesMaxMapTimeMinMapTImeAvgMapTimeMedianMapTimeMaxReduceTimeMinReduceTimeAvgReduceTimeMedianReducetimeAliasFeatureOutputs job_local2036219587_000121n/an/an/an/an/an/an/an/afruit_names_join,fruits,limited,namesHASH_JOIN job_local406327028_000211n/an/an/an/an/an/an/an/afruit_namesfile:/tmp/temp195796189/tmp-2027262369, Input(s): Successfully read 3 records from: "file:///opt/demo/certification/pig/Lipstick/quickstart/1.dat" Successfully read 3 records from: "file:///opt/demo/certification/pig/Lipstick/quickstart/2.dat" Output(s): Successfully stored 1 records in: "file:/tmp/temp195796189/tmp-2027262369" Counters: Total records written : 1 Total bytes written : 0 Spillable Memory Manager spill count : 0 Total bags proactively spilled: 0 Total records proactively spilled: 0 Job DAG: job_local2036219587_0001->job_local406327028_0002, job_local406327028_0002 2016-06-17 02:36:44,568 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Success! 2016-06-17 02:36:44,571 [main] WARN org.apache.pig.data.SchemaTupleBackend - SchemaTupleBackend has already been initialized 2016-06-17 02:36:44,582 [main] INFO org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to process : 1 2016-06-17 02:36:44,583 [main] INFO org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil - Total input paths to process : 1 (orange,ORANGE)
Created 06-17-2016 02:21 AM
Resources:
http://www.graphviz.org/Download_linux_rhel.php
https://github.com/Netflix/Lipstick/wiki/Getting-Started
yum list available 'graphviz*'yum install 'graphviz*'./gradlew assemble
I always like to rename gradlew, avengers.
then
./gradlew run-app
(Make sure you add that port/open firewall/etc...)
That worked!
2016-06-17 02:36:44,558 [main] INFO org.apache.pig.tools.pigstats.mapreduce.SimplePigStats - Script Statistics: HadoopVersionPigVersionUserIdStartedAtFinishedAtFeatures 2.4.0root2016-06-17 02:36:402016-06-17 02:36:44HASH_JOIN,FILTER,LIMIT Success! Job Stats (time in seconds): JobIdMapsReducesMaxMapTimeMinMapTImeAvgMapTimeMedianMapTimeMaxReduceTimeMinReduceTimeAvgReduceTimeMedianReducetimeAliasFeatureOutputs job_local2036219587_000121n/an/an/an/an/an/an/an/afruit_names_join,fruits,limited,namesHASH_JOIN job_local406327028_000211n/an/an/an/an/an/an/an/afruit_namesfile:/tmp/temp195796189/tmp-2027262369, Input(s): Successfully read 3 records from: "file:///opt/demo/certification/pig/Lipstick/quickstart/1.dat" Successfully read 3 records from: "file:///opt/demo/certification/pig/Lipstick/quickstart/2.dat" Output(s): Successfully stored 1 records in: "file:/tmp/temp195796189/tmp-2027262369" Counters: Total records written : 1 Total bytes written : 0 Spillable Memory Manager spill count : 0 Total bags proactively spilled: 0 Total records proactively spilled: 0 Job DAG: job_local2036219587_0001->job_local406327028_0002, job_local406327028_0002 2016-06-17 02:36:44,568 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Success! 2016-06-17 02:36:44,571 [main] WARN org.apache.pig.data.SchemaTupleBackend - SchemaTupleBackend has already been initialized 2016-06-17 02:36:44,582 [main] INFO org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to process : 1 2016-06-17 02:36:44,583 [main] INFO org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil - Total input paths to process : 1 (orange,ORANGE)