I have 2 data sets and the ask is to partial match of model in DS1 to title in DS2. I want to do this in spark/scala, can somebody help how to do the partial match {"product_name":"Samsung_TL220","manufacturer":"Samsung","model":"TL220","announced-date":"2009-08-12T20:00:00.000-04:00"}
{"title":"Genuine Samsung TL220 Galaxy ","manufacturer":"Samsung","currency":"CAD","price":"199.96"} I created 2 dataframes and then registered as temp table and tried this but no luck spark.sql("select * from list,prd where list.manufacturer = prd.manufacturer and list.title like '%'+prd.model+'%' ").show()
... View more
