Hi @mark_hadoop , Is this solved ? If yes ,what was the issue and how were you able to fix it ?   Thanks, Albin ... View more

@shubh As this is an older post that has been marked solved in 2018. You would have a better chance of receiving a resolution by starting a new thread. This will also provide the opportunity to provide details specific to your environment that could aid others in providing a more accurate answer to your question.  ... View more

Regex always gives me a go.  Knowing if you have a typo, or are completely missing what works and what doesn't is always a big pain.   Try working with something like this Regex Tester to get your regex string setup:     https://regex101.com ... View more

@Shu Thankyou ... View more

@rtheron for some reason I cannot follow the first approach. I tried creating an intermediate orc with partitions and loaded the data in to it from external table. now when I load in to the destination from the intermediate table, puthiveql is taking a lot of time. any suggestions are appreciated. ... View more

@Bryan Bende I have checked my data, it has no new blank spaces, but was arriving like batches. I am merging the files and appending using puthdfs. When I use the configurations you suggested, some times I am getting a new blank line at the beginning of the file which is appended using puthdfs. Can you please help me how to avoid the blank line at the beginning of the file, also the file is big (1GB). ... View more

@Felix Albani Thanks for the helping arm, I will go through them and could ask for suggsetions if required. Thank you. ... View more