Member since
11-05-2017
4
Posts
0
Kudos Received
0
Solutions
11-06-2017
04:05 PM
Thank you for your response. but when I use only insertInto(table)... it always inserts new data into table. Without deleting or overwriting anything. Which was strange for me. That's why I asked. May be only using insertInto by default does append ??
... View more
11-05-2017
07:57 AM
Hi Everyone, I have a basic question. While inserting data from a dataframe to an existing Hive Table. I am using like in pySpark, which is always adding new data into table. (works fine as per requirement) df.write.insertInto(table) but as per Spark docs, it's mentioned I should use command as df.write.mode("append").insertInto("table") Is it necessary to use mode("append") ?
... View more
Labels:
- Labels:
-
Apache Hive
-
Apache Spark