Thank you but what I am loooking for is that: 1: Read   the data from underlying Hive  table. 2: Store the result  of above read into one dataframe. 3: Now apply some basic checks on few columns like  append the KM at the last with column  X,  Also  write the sum of  one column data into tailer record of the file 4: And than  create  a file .   Basically some function which read the  rows one by  one  from hive table and  apply the  checks and than save it to file ... View more

Thank you  for the reply. But instrea of constant value my requirement is to pouplate it  with uique number. 1,2,3....n ... View more