Folks, Trying to insert/update csv data in oracle db table. consider csv file having ID,NAME,AGE,CITY and ID as Primary Key in a table Tried below approach 1. GetFile 2.PutDatabaseRecord :- To first insert data (thinking that since unique key constraint violation will cause failure for few records) 3.PutDatabaseRecord :- Another one to update the failed ones from above. But, its seen that the data with new record is not inserted. Basically, I want to perform UPSERT. Thanks in Advance 🙂 ... View more

Hi Folks, Can Spark be a good solution to load csv,xml data from filesystem(local FS and not HDFS) and insert/update data in MySQL.? As per my knowledge on Spark, its mostly used in opposite scenario where data is taken up from MySQL to perform analysis. If not, what other technology/solution can perform better for this use case ? Thanks in advance. ... View more