Trying to display pivoted RRD with Scala, either directly or by converting to dataframe. However, take(), toDF(), and show all produce similar errors - not a member of org.apache.spark.sql.GroupedData import org.apache.spark.sql.SQLContext._ val meterdata = sqlContext.read.format("com.databricks.spark.csv").option("delimiter", ",").option("header", "false").load("/CBIES/meters/") val meters = meterdata.groupBy("C0").pivot("C1") meters.toDF meters.take(10).foreach(println) <console>:71: error: value toDF is not a member of org.apache.spark.sql.GroupedData error: value take is not a member of org.apache.spark.sql.GroupedData <console>:83: error: value show is not a member of org.apache.spark.sql.GroupedData error: value toDF is not a member of org.apache.spark.sql.GroupedData ... View more

Cannoted display/show/print pivoted dataframe in with PySpark. Although apparently created pivoted dataframe fine, when try to show says AttributeError: 'GroupedData' object has no attribute 'show'. Here's the code meterdata = sqlContext.read.format("com.databricks.spark.csv").option("delimiter", ",").option("header", "false").load("/CBIES/meters/") metercols = meterdata.groupBy("C0").pivot("C1") metercols.show() Output: Traceback (most recent call last): File "/tmp/zeppelin_pyspark-8003809301447367155.py", line 239, in <module> eval(compiledCode) File "<string>", line 1, in <module> AttributeError: 'GroupedData' object has no attribute 'show' ... View more