Member since
04-06-2017
2
Posts
0
Kudos Received
0
Solutions
04-21-2017
09:15 AM
Hi, I am using the above in saveasTable option pyspark and the file gets created under user/hive/warehouse. However the table is not reflected in hive. df.write.mode("overwrite").saveAsTable("temp_d") leads to file creation in hdfs but no table in hive Will hive auto infer the schema from dataframe or should we specify the schema in write? Other option I tried, create a new table based on df=> select col1,col2 from table and then write it as a new table in hive df.write.mode("append").saveAsTable("temp_d") leads to "No table exists error" Is append not the correct option to save as a new table? Kindly help!!
... View more