Member since
08-08-2013
339
Posts
132
Kudos Received
27
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
14754 | 01-18-2018 08:38 AM | |
1542 | 05-11-2017 06:50 PM | |
9077 | 04-28-2017 11:00 AM | |
3400 | 04-12-2017 01:36 AM | |
2800 | 02-14-2017 05:11 AM |
04-28-2014
06:48 AM
5 Kudos
Hi, some further googling enlightened me about the correct syntax 😉 for interested people the correct syntax is: hadoop jar /opt/cloudera/parcels/CDH/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar pi -Dmapred.job.queue.name=lowprio 10 100
... View more
04-17-2014
06:46 AM
Hi, the previous error at trying to access a parquet based table via shark "java.lang.ClassNotFoundException: org.apache.hadoop.hive.ql.io.parquet.MapredParquetInputFormat" has been resolved by adding parquet-hive-bundle-1.4.1.jar to shark's lib folder. Now the Hive metastore can be read successfully (also the parquet based table). But if I want to select from that table I receive: org.apache.spark.SparkException: Job aborted: Task 0.0:0 failed 4 times (most recent failure: Exception failure: java.lang.ClassNotFoundException: org.apache.hadoop.hive.ql.io.parquet.serde.ParquetHiveSerDe) at org.apache.spark.scheduler.DAGScheduler$$anonfun$org$apache$spark$scheduler$DAGScheduler$$abortStage$1.apply(DAGScheduler.scala:1020) at org.apache.spark.scheduler.DAGScheduler$$anonfun$org$apache$spark$scheduler$DAGScheduler$$abortStage$1.apply(DAGScheduler.scala:1018) This is really strange, since the class org.apache.hadoop.hive.ql.io.parquet.serde.ParquetHiveSerDe is included in the parquet-hive-bundle-1.4.1.jar, too ?!?! I copied that .jar to both lib folders, shark (/opt/shark/shark-0.9.1/lib) and spark (under /opt/cloudera/parcels...) ...getting more and more confused 😉 any help ? regards, Gerd
... View more
04-15-2014
12:17 PM
1 Kudo
Hi, issue has been solved. Problem was that there was a mismatch between directory permissions and ownership (owner was 700, not the permissions, stupid thing 😉 ). Nevertheless the error message is somehow misleading and it would preferrably print that the user/permissions are incorrect. Gerd
... View more
03-04-2014
05:24 AM
Hi Chris, thanks, restarting the MGMT services solved the test issues. bye...Gerd...
... View more
02-12-2014
06:29 AM
Nice, many thanks, Clint. Looking forward to your feedback.....br, Gerd
... View more
02-04-2014
04:15 AM
1 Kudo
Solved ! The repo URL was missing the part "/latest" at the end => http://archive.cloudera.com/spark/parcels/latest
... View more
01-27-2014
07:20 AM
1 Kudo
Glad to hear everything is workign now! The problem with the Accumulo parcels is your Cloudera Manager version. The Accumulo integration uses a new extensibility feature only available in Cloudera Manager 5's current beta release.
... View more
01-06-2014
01:30 AM
Hi, many thanks for your explanation. I'll check out the custom sink wrapper stuff...
... View more
12-15-2013
11:42 PM
Hi Eric, many thanks for answering that quickly. Maybe I have to check IntelliJ as alternative to the heavyweight-Eclipse 😉 br...Gerd...
... View more
12-12-2013
11:54 AM
Hi Philip, many thanks for your additional explanation, sounds absolutely reasonable. Keep up your great work for CM, brilliant tool best regards...Gerd...
... View more
- « Previous
- Next »