@Sunile Manjee yes absolutely, there are many knobs to tweak, manipulate the file so that only important data is sent, compress, then you can load balance nifi so then when you split file into smaller chunks and compress then can be routed through multiple nifi clusters. There are file, architecture and pipeline tricks you can do. Maybe you'd like to specify what product you're positioning nifi against so we could concentrate on pros and cons of that? ... View more

First fix RM issues then go into Hive and execute show tables I want to make sure table exists. But I think your issues is not pig script but your environment, @Rupinder Singh ... View more

@yong yang you need to make sure sandbox.Hortonworks.com is in your windows hosts file. Your windows needs to know such an address exists. Find path for your OS version http://www.thewindowsclub.com/hosts-file-in-windows ... View more

If network is unavailable no nifi trick can help but as soon as there's connectivity if that file is marked as highest priority, it will take precedence. ... View more

@khushi kalra https://github.com/shivajid/atlas/tree/master/tutorial ... View more

@khushi kalra Atlas is the tool. Tagging is on the roadmap. ... View more

@Rupinder Singh I would suggest to run service checks on all components including pig and tez. Once you validate everything works, I would open a pig grunt shell and try running each pig statement one at a time and look for errors. Additionally, you can dump after each executed command in pig to see where you fail. It can be many things and really hard to tell from what you've told us so far. ... View more

@khushi kalra take a look at Atlas for tagging. http://atlas.incubator.apache.org/Bridge-Falcon.html ... View more