Assume you have a file /tmp/test.csv" like
Col1|Col2|Col3|Col4
12|34|"56|78"|9A
"AB"|"CD"|EF|"GH:"|:"IJ"
If I load it with Spark I get val df = sqlContext.read.format("com.databricks.spark.csv").option("header", "true")
.option("delimiter", "|").option("escape", ":").load("/tmp/test.csv")
df.show()
+----+----+-----+-------+
|Col1|Col2| Col3| Col4|
+----+----+-----+-------+
| 12| 34|56|78| 9A|
| AB| CD| EF|GH"|"IJ|
+----+----+-----+-------+ So the example contains delimiter in quotes and escaped quotes. I use ":" to escape quotes, you can many other characters (don't use e.g. "#") Is this something you want to achieve?
... View more
