@devers If you mean a way to decrypt a file that has been encrypted with HDFS encryption, then no. The encryption and decryption with HDFS as-rest encryption is more complex. The EEK is stored with the file, and you have to talk to the KMS to get the decrypted key, etc. You can use HDFS encryption with Hive and Spark to take care of this for you. If you want to generate a key pair and use that for both Hive and Spark to encrypt/decrypt data, that can be done, but would be part of loading and working with the data. You'd need to define a UDF for Hive to use for decryption so you could reference it with a select statement, and you'd need to use libraries in Scala or Python for Spark to decrypt the data. Both would have to have access to the keys for decryption, though, and that may be difficult to architect in a secure fashion. ... View more

@Ovidiu Petridean Per the release notes, HDP 2.4.2 includes Kafka 0.9.0.1. I see that the packages are named something like kafka_2_4_2_0_258-0.9.0.2.4.2.0-258.el6.noarch, however, you'll notice that all of the 2.4.2 packages end with 2.4.2.0-258 (the final version of 2.4.2). The Kafka version is actually 0.9.0.1 in the packages. ... View more

@Ash Pad You need to provide additional privileges to the user via keyadmin. The user will need "Get Keys", "Get Metadata", and "Decrypt EEK" privileges on the key to read files in the encryption zone. ... View more

@kavitha velaga The audit logs are created on the respective nodes within the cluster where the services run (not on the edge node). For example, if you are looking for the Hive audit logs, look in /var/log/hive on the node in your cluster where Hiveserver2 runs. Alternatively, you can view access and admin audit information through the Ranger UI on the "Audit" tab. ... View more

@Alexander Feldman You should be able to export policies via the REST API from the 0.4 system and import them into the 0.5 system. Here's a link to the Ranger REST API docs. ... View more

@Kashif Khan Make sure your Ambari Metrics service is running and that it was running for the time period for which you are trying to request data. On my Sandbox, the Metrics service was shut down. When I started it, the query still didn't return anything because there was no data available to return. When there is data, you will still get the header that you are getting plus the data points. Here is what I get on a different cluster: { "href" : "https://localhost:8443/api/v1/clusters/SMESecurityTEST?fields=metrics/load[1462233600,1462406399]&_=1462350240", "Clusters" : { "cluster_name" : "SMESecurityTEST", "version" : "HDP-2.4" }, "metrics" : { "load" : { "1-min" : [ [ 0.0, 1462233600 ], [ 0.3094347587719297, 1462234576 ], [ 0.32168695175438616, 1462238176 ], [ 0.433827850877193, 1462241776 ], ---truncated---- ... View more

@Radhakrishna kaligotla On the Sandbox Download Page, there's a "Hortonworks Sandbox Archive" expandable list under the "Sandbox in the Cloud" section. You can find the 2.3 version of the Sandbox there. ... View more