@Saikrishna Tarapareddy The attribute to correlate on needs to be present in the flowfile for the Merge processor to use it. If you are using FetchFile to get the file, you can add an attribute into that processor using the filename or the substring of the file name. Then it will be present in the flowfile for subsequent processors to use. ... View more

@Satya KONDAPALLI Fundamentally, Spark is a data processing engine while NiFi is a data movement tool. Spark is intended for doing complex computations on large amounts of data, combining data sets, applying analytical models, etc. Spark Streaming provides micro batch processing of data to bring this processing closer to real time. NiFi is intended to collect data and move it to the place for it to be processed with some certain modifications or computations on the data as it flows to its final destination. ... View more

@Steen Manniche You are correct that Solr/Ranger is only capable of collection level security at this time. This Solr Wiki page describes a couple of options for adding document level security to Solr (e.g. ManifoldCF) ... View more

@Kaliyug Antagonist Hue requires Python 2.6 while RHEL/CentOS 7 uses Python 2.7. This is why Hue is not supported on RHEL/CentOS 7. There are alternatives in Ambari for most of the functionality provided by Hue. Amber includes views for Hive access, HDFS File management, YARN queue management, Pig scripting, and Tez job management. The only functionality of Hue that isn't covered by Ambari Views is the Oozie Workflow creation. This functionality is coming soon in Ambari. Please see the Ambari Views documentation for more information. If you need to use Hue for Oozie workflow management, You can install Hue on a RHEL/CentOS 6 node and configure it to point to your HDP cluster. ... View more