Reply
Highlighted
Explorer
Posts: 6
Registered: ‎07-21-2018

Unable to get join method even after creating paired RDD in CDH 5.13

I am using CDH 5.13 and I want to join my datasets so I created pairedRDD but when I see all the available methods for pair RDD I am unable to get joins methods. However when I try it in spark 2.x it works smoothly on pair RDDs as well. So why is it so ?? Is it a bug in this version of cloudera ??  Or how to fix it ?? Any help is appreciated coz I am practicing it on cloudera from exam perspective, so want to stick to it. Below is my pairRdd code along with available methods after creating it.

 

creating pairRDD

 

Announcements

Currently incubating in Cloudera Labs:

Envelope
HTrace
Ibis
Impyla
Livy
Oryx
Phoenix
Spark Runner for Beam SDK
Time Series for Spark
YCSB