question Re: how to read csv have comma in cell and new line character as well in Support Questions https://community.cloudera.com/t5/Support-Questions/how-to-read-csv-have-comma-in-cell-and-new-line-character-as/m-p/288309#M213563 <P>Right and Thank You. What format you suggest?</P> Sat, 25 Jan 2020 20:05:58 GMT Atif_Tariq_PK 2020-01-25T20:05:58Z how to read csv have comma in cell and new line character as well https://community.cloudera.com/t5/Support-Questions/how-to-read-csv-have-comma-in-cell-and-new-line-character-as/m-p/288258#M213529 <P>how to read csv have comma in cell and new line character as well . like i have somme columns with description (hi,how are you).</P> <P>&nbsp;i am trying to read with spark in scala .</P> <P>please guide</P> Sat, 25 Jan 2020 22:54:51 GMT https://community.cloudera.com/t5/Support-Questions/how-to-read-csv-have-comma-in-cell-and-new-line-character-as/m-p/288258#M213529 Atif_Tariq_PK 2020-01-25T22:54:51Z Re: how to read csv have comma in cell and new line character as well https://community.cloudera.com/t5/Support-Questions/how-to-read-csv-have-comma-in-cell-and-new-line-character-as/m-p/288272#M213535 <P>I would recommend not using CSV in your case. If you have commas in the fields then you can't really delimit them with commas because, as you have noticed, you will have field breaks in the middle of a field.</P><P>&nbsp;</P><P>Can you get the source data exported some other way?</P> Fri, 24 Jan 2020 14:56:33 GMT https://community.cloudera.com/t5/Support-Questions/how-to-read-csv-have-comma-in-cell-and-new-line-character-as/m-p/288272#M213535 mridley 2020-01-24T14:56:33Z Re: how to read csv have comma in cell and new line character as well https://community.cloudera.com/t5/Support-Questions/how-to-read-csv-have-comma-in-cell-and-new-line-character-as/m-p/288287#M213548 <P>Have you tried using openSerde In DDL?</P><P>Create Table tablename(columns)</P><P>ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.OpenCSVSerde';</P><P>&nbsp;</P><P>Thanks,</P><P>Manoj</P> Fri, 24 Jan 2020 21:36:21 GMT https://community.cloudera.com/t5/Support-Questions/how-to-read-csv-have-comma-in-cell-and-new-line-character-as/m-p/288287#M213548 Manoj_hadoop 2020-01-24T21:36:21Z Re: how to read csv have comma in cell and new line character as well https://community.cloudera.com/t5/Support-Questions/how-to-read-csv-have-comma-in-cell-and-new-line-character-as/m-p/288309#M213563 <P>Right and Thank You. What format you suggest?</P> Sat, 25 Jan 2020 20:05:58 GMT https://community.cloudera.com/t5/Support-Questions/how-to-read-csv-have-comma-in-cell-and-new-line-character-as/m-p/288309#M213563 Atif_Tariq_PK 2020-01-25T20:05:58Z Re: how to read csv have comma in cell and new line character as well https://community.cloudera.com/t5/Support-Questions/how-to-read-csv-have-comma-in-cell-and-new-line-character-as/m-p/288310#M213564 <P>actually, i am getting file from ftp and reading using spark. i didn't try to push directly to hive because some enrichment i have to made. this is a big problem for me.</P><P>Thanks</P> Sat, 25 Jan 2020 20:29:27 GMT https://community.cloudera.com/t5/Support-Questions/how-to-read-csv-have-comma-in-cell-and-new-line-character-as/m-p/288310#M213564 Atif_Tariq_PK 2020-01-25T20:29:27Z Re: how to read csv have comma in cell and new line character as well https://community.cloudera.com/t5/Support-Questions/how-to-read-csv-have-comma-in-cell-and-new-line-character-as/m-p/288311#M213565 <P>do you think ? does it work if i copy file direct into mysql then replace commas and after read with spark?</P> Sat, 25 Jan 2020 20:38:07 GMT https://community.cloudera.com/t5/Support-Questions/how-to-read-csv-have-comma-in-cell-and-new-line-character-as/m-p/288311#M213565 Atif_Tariq_PK 2020-01-25T20:38:07Z Re: how to read csv have comma in cell and new line character as well https://community.cloudera.com/t5/Support-Questions/how-to-read-csv-have-comma-in-cell-and-new-line-character-as/m-p/288327#M213577 <P>Where is the data coming from? You could use a binary format like Avro or Parquet if your source system can export that way. If you MUST have a text file with a delimiter, you need a delimiter that is not anywhere in the data.</P> Sun, 26 Jan 2020 15:35:01 GMT https://community.cloudera.com/t5/Support-Questions/how-to-read-csv-have-comma-in-cell-and-new-line-character-as/m-p/288327#M213577 mridley 2020-01-26T15:35:01Z Re: how to read csv have comma in cell and new line character as well https://community.cloudera.com/t5/Support-Questions/how-to-read-csv-have-comma-in-cell-and-new-line-character-as/m-p/288334#M213579 <P>it is coming from oracle database</P> Sun, 26 Jan 2020 18:35:02 GMT https://community.cloudera.com/t5/Support-Questions/how-to-read-csv-have-comma-in-cell-and-new-line-character-as/m-p/288334#M213579 Atif_Tariq_PK 2020-01-26T18:35:02Z Re: how to read csv have comma in cell and new line character as well https://community.cloudera.com/t5/Support-Questions/how-to-read-csv-have-comma-in-cell-and-new-line-character-as/m-p/288357#M213592 <P>Can you use sqoop to retrieve the data directly from the database and dump it into Hive? That will solve your delimiter problem.</P> Mon, 27 Jan 2020 14:51:18 GMT https://community.cloudera.com/t5/Support-Questions/how-to-read-csv-have-comma-in-cell-and-new-line-character-as/m-p/288357#M213592 mridley 2020-01-27T14:51:18Z Re: how to read csv have comma in cell and new line character as well https://community.cloudera.com/t5/Support-Questions/how-to-read-csv-have-comma-in-cell-and-new-line-character-as/m-p/288362#M213597 <P>great option. Thank You Very Much <span class="lia-unicode-emoji" title=":slightly_smiling_face:">🙂</span></P> Mon, 27 Jan 2020 18:03:12 GMT https://community.cloudera.com/t5/Support-Questions/how-to-read-csv-have-comma-in-cell-and-new-line-character-as/m-p/288362#M213597 Atif_Tariq_PK 2020-01-27T18:03:12Z