I have mapped CSV to hive . In case my CSV has nothing for value i.e is an empty string for a column value, hive shows column value as " So, in this case, I can not check if the value is NULL,because for hive, value is " . if I see CSV in a text editor, I can see that the value there is """" double quotes with in double quotes. Is there a way I can fix it? ... View more

I get some rows broken like: admin,base,Default,configurable,"50,76,188,467",IN1541MTODREWHT-187,1,Plush Maxi Dress,Buy Plush Maxi Dress Online | Maxi Dresses | StalkBuyLove,/i/n/in1541mtodrewht-187-front.jpg,/i/n/in1541mtodrewht-187-front.jpg,plush-maxi-dress,plush-maxi-dress-97763-SBLPR.html,"""","""",Block after Info Column,"""","""","""", ,No,"""",No,Tax 5,"""",NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL,NULL ",61.8""", 61.8 actually comes into next row and when I open it in excel , it looks like; ,61.8" in the field. I don't want my rows breaking. It happens after I use CSV serde and then download the data from hive. ... View more

I have around 15 queries saved in a HQL file. The queries include CREATE TABLE/DROP TABLE and SELECT statement at the end of the file. It seems like I can not execute all of these in one go. How do I syntactically format or write hive queries so that hive can understand that we have the next query starting after end of one query .It should then finally should give results of select query. ... View more

1. I download the file using download.file function in R 2. Save it locally 3. Move it to HDFS My hive table is mapped to this location of file in HDFS. Now, this file has `,` as the delimiter/separator which I cannot change using download.file function from R. There is a field that has `,` in its content. How do I tell hive to drop this delimiter if found anywhere within the field contents? I understand we can change the delimiter but is there really a way I can drop it like sqoop allows us to do? My R script is as simple as download.file() hdfs.put Is there a workaround? ... View more

How to use data from outer query in the inner query or subquery in hive?I am trying to use ndo.FromDate and ndo.ToDate in the second JOIN but that would not work LEFT JOIN Temp.NumberOfDaysOnline ndo ON ndo.sku = nr.sku JOIN gadb.gasessiondata gasessiondata ON 1=1 LEFT JOIN ( SELECT SUM(gasessiondata.sessions) As visitsOnDaysSKUWasLive FROM gadb.gasessiondata gasessiondata WHERE gasessiondata.date >= ndo.FromDate AND gasessiondata.date < ndo.ToDate ) AS visits ... View more