Also LEAD() function can be used with COALESCE() For example    coalesce(sepan, lead(sepan, 1) over (partition by sourcedata order by timestamps)) as sepan   That will replace NULL values in sepan column with next non null value. The timestamps column could be ordered in asc order depending on the value you wan to copy. ... View more

@sunile_manjee Your article is too good and informative. I am searching for Benchmarking Hadoop with TeraGen, TeraSort, and TeraValidate with ease and I get exact article i am thankful to you for sharing this educational article . and the way you written is also good, you covered up all the points which i searching for & I am impressed by reading this article. Keep writing and sharing educational article like this which can help us to grow our knowledge. Regards : Sevenmentor ... View more

Hi,   Could you please let us know what do you mean by not yet deployed? Does you mean that the jobs that has not been kicked off after you running the spark submit command (or) Could you please explain in detail.     Thanks Akr ... View more

@Aditya Pathak It works, I was able to fix the pid issue. But, upon accessing the activity explorer, it still inaccessible. ... View more

@apathak: Thank you for your help. I was able to fix this issue. Cheers!! ... View more

I tried it but does not show anything. ... View more

For a multi-node production cluster, it is sufficient to update hosts files and restart agents in each of the nodes showing the wrong IP. ... View more

I like the idea SS for Mobile Phones, we thought about it and dismissed it because there won't be many users. But, before creating an app, i really need to know how many users will be interested in using this app and how helpful it will be. We need to do a vote to see how many users are interested. ... View more

@Aravindan Vijayan : Thanks! it fixes my issue. ... View more

@Scott Shaw: Hi Scott, just wanted to know can I possibly access the REST API of Ambari. Is there a way so that I could further conduct analysis with the data thrown in the collector. ... View more