Member since
12-22-2020
2
Posts
0
Kudos Received
0
Solutions
12-23-2020
02:38 AM
1) import csv with open("./prueba.csv") as file: data = file.read().replace("/x0f", ",").replace("/x0e", "\n") f = open('./prueba2.csv','w') f.write(data) f.close() 2) df = spark.read.format("csv")\ .option("delimiter",",")\ .option("header","true")\ .load("./prueba2.csv") df.show()
... View more
12-22-2020
02:46 AM
.option("quote", "\"")\ .option("escape", "\"")\ -Example: contractsDF = spark.read\ .option("header", "true")\ .option("inferSchema", "true")\ .option("quote", "\"")\ .option("escape", "\"")\ .csv("gs://data/Major_Contract_Awards.csv")
... View more