Hello @ssubhas , the above worked however, when we try the same with LazySerde, it is able to escape the delimiter but loads few NULL values at the end. PFB snippet of statement I used: CREATE TABLE test1(5columns string) ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe' WITH SERDEPROPERTIES( 'separatorChar'='|', 'escapeChar'='\\' ) STORED AS INPUTFORMAT 'org.apache.hadoop.mapred.TextInputFormat' OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat';   NOTE: also tried field.delim=|, format.serialization=|. It works when serde properties are not mentioned and we use escape by Clause as you suggested, any way to make it work with LazySerde as well? (Data is Pipe delimited & may also have pipe in the data). Please suggest and help.                   ... View more

@Ramya Jayathirtha Okay,the way it works is : In simple terms,think that The main Thread of your code launches another thread in which your streamingquery logic runs. meanwhile ,your maincode is blocking due to initDF.awaitTermination(). sparkSession.sql("select * from initDF").show() => This code run on the mainthread ,and it reaches there only for the first time. So update your code to : StreamingQuery initDF = df.writeStream() .outputMode("append") .format("memory") .queryName("initDF") .trigger(Trigger.ProcessingTime(1000)) .start(); while(initDF.isActive){ Thread.sleep(10000) sparkSession.sql("select * from initDF").show() } Now the main thread of your code will be going through the loop over and over again and it queries the table. ... View more

@Dinesh Chitlangia That helped. Thank you..!! ... View more

Hello folks, Please help me with the following query: There are two tables T1 and T2 find the sum of price if customer buys all the product how much he has to pay after discount. Table : T1 ================================ ProductID | ProductName | Price -------------------------------- 1 | p1 | 1000 2 | p2 | 2000 3 | p3 | 3000 4 | p4 | 4000 5 | p5 | 5000 Table : T2 ======================= ProductID | Disocunt % ----------------------- 1 | 10 2 | 15 3 | 10 4 | 15 5 | 20 , Hello everyone, Please help me with the following query in Hive. There are two tables T1 and T2 find the sum of price if customer buys all the product how much he has to pay after discount. Table : T1 ================================ ProductID | ProductName | Price -------------------------------- 1 | p1 | 1000 2 | p2 | 2000 3 | p3 | 3000 4 | p4 | 4000 5 | p5 | 5000 Table : T2 ======================= ProductID | Disocunt % ----------------------- 1 | 10 2 | 15 3 | 10 4 | 15 5 | 20 ... View more

Thank you @Dinesh Chitlangia. This solved the issue. ... View more

@Shu How is number of Mappers/reducers decided for a given query will be decided in runtime ? Is it dependet on how many number of Joins or group by or order by clauses that are used in the query ? If yes, then please let me know how many mappers and reducers are launched for the below query. select name, count(*) as cnt from test group by name order by name; ... View more

Thank you @Dinesh Chitlangia !! That helped. ... View more

Thank you..!! It worked. ... View more

Thank you @Nandish B Naidu..!! The solution worked. ... View more