@Timothy Spann The best way to accomplish this is with the GetTwitter processor and the MergeContent processor. GetTwitter will connect up to a Twitter dev account and pull tweets (you can even filter them). Then you can use MergeContent to collect the tweets into manageable pieces based on number of records, size of file, or a timeout value. ... View more

@Kaliyug Antagonist HDFS security is multi-tiered: Ranger authorization policies are checked first HDFS ACLs implemented outside of Ranger HDFS POSIX permissions (e.g. rwxr-xr-x) So, what you can do for user home directories is to set the POSIX permissions to 700 and make sure the ownership is <username>:hdfs. This will ensure that only the user has access to his/her home directory. You don't need to create a Ranger policy to allow the access for this. You can do the same for the /tmp directory (set permissions to 777). There are some best practices for securing HDFS with Ranger. ... View more

@Benjamin R The permissions of the keytabs are not all 440. Only some of them are (hdfs, hbase, ambari-qa, accumulo, and spnego). Those keytabs are used by other services than just the owner for testing connectivity, and other functions on startup. All of the other keytabs are only readable by the service account that owns the file. The group that owns the keytabs is the hadoop group, and should be reserved for service accounts. This will ensure the security of your cluster. ... View more

@David Whoitmore Yes, you can install an alternative version of Python. You will need to install it in a non-system location (leave 2.6 in place and put 2.7 in a new home). Many of the HDP components rely on Python and require v2.6 in the standard place on RedHat 6 in order to work properly. ... View more

@Bhanu Pittampally At present, Presto is not supported with Ranger. You can control the HDFS and Hive services via Ranger to enable Presto to access those resources, but there won't be any control for Presto security mechanisms. Currently, the supported components in Ranger (0.5) are HDFS, YARN, Hive, HBase, Kafka, Storm, Knox, and Solr. ... View more

@Teddy Brewski This can be done! Install the Knox server on multiple hosts (can be done by going to Hosts -> hostname -> Add Service -> Knox Gateway). Create a config group for Knox and assign nodes to each config group (Knox -> Configs -> Manage Config Groups) Modify the Advanced Topology for each config group (accessed with the drop down at the top of the Configs page) to change the AD configuration as appropriate. ... View more