Use df.map(row => {
val row1 = row.getAs[String]("vbeln")
val make = if (row1.toLowerCase == "125") "S" else "its 123"
(row(0),make,row(0)) }).collect().foreach(println)
Instead of: df.map(row => {
val row1 = row.getAs[String]("vbeln")
val make = if (row1.toLowerCase == "125") "S" else "its 123"
Row(row(0),make,row(0)) }).collect().foreach(println) You can map each line to a new one, but you don't need to return with a new Row. You should map each record to a new tuple (in case of simple types) or a new case class instance.
... View more
