HDP 2.4.3 - Ranger 0.5.2 and Atlas 0.5 Atlas UI does not provide a way to create a tag through UI. But, I understand that we can create a tag using the API provided by Atlas. Now, can Ranger 0.5.2 get/know about this tag information that was created in Atlas? ... View more

There is a DC wide Ganglia monitoring in place where in the clusters have been HDP 2.2 as of today. Now some of the new clusters need to have HDP 2.4. HDP 2.4 does not support Ganglia. Is there a way by which Ambari metrics can push data to Ganglia for the details needed by Ganglia. ... View more

Can Ranger be used for data entitlements in an object store. Essentially does Ranger have plugins for objects stores like Amazon S3 or VMWare ECS (elastic cloud storage) ... View more

Can Ranger policies be used for doing data governance across multiple clusters. A sample scenario: Let us say I have around 10 clusters. For all these clusters, want to apply same ranger policies for data access - which user can access what data through Ranger. ... View more

HDP-2.3.4.7-4 Ambari Version 2.2.1.1 All services are up and running except for History server. Could not find any related errors in namenode or data node logs. Following is the error reported by Ambari. File "/usr/lib/python2.6/site-packages/resource_management/libraries/providers/hdfs_resource.py", line 191, in run_command raise Fail(err_msg) resource_management.core.exceptions.Fail: Execution of 'curl -sS -L -w '%{http_code}' -X PUT -T /usr/hdp/2.3.4.7-4/hadoop/mapreduce.tar.gz 'http://standbynamenode.sample.com:50070/webhdfs/v1/hdp/apps/2.3.4.7-4/mapreduce/mapreduce.tar.gz?op=CREATE&user.name=hdfs&overwrite=True&permission=444'' returned status_code=403. { "RemoteException": { "exception": "ConnectException", "javaClassName": "java.net.ConnectException", "message": "Call From datanode.sample.com/10.250.98.101 to localhost:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused" } } Status code: 403 indicates that the request is correct, but not probably authroized? Any pointers will be helpful. Thanks, ... View more

Wanted to set up HA (active name node and standby name node)cluster. We did not want to have a secondary name node to be present. Just two name nodes and one of them will be active and the other as standby. Used the Ambari blueprint exactly as outlined in the link: https://cwiki.apache.org/confluence/display/AMBARI/Blueprint+Support+for+HA+Clusters Getting an error: {\n "status" : 400,\n "message" : "Cluster Topology validation failed. Invalid service component count: [SECONDARY_NAMENODE(actual=0, required=1)]. To disable topology validation and create the blueprint, add the following to the end of the url: \'?validate_topology=false\'"\n} Tried to disable topology validation with validate_topology=false, Blueprint registered but while creating cluster creation failed with the error given below java.util.concurrent.ExecutionException: java.lang.Exception: java.lang.IllegalArgumentException: Unable to update configuration property 'dfs.namenode.https-address' with topology information. Component 'NAMENODE' is mapped to an invalid number of hosts '2'. Any pointers to sort this out will be very helpful. Thanks, Mohan ... View more

Does ranger support Cassandra ACLs like the way it supports HIVE ... View more

In Ambari blueprint, we tried giving the stack_version as 2.3 and it installed HDP 2.3.0.0. Instead we want the latest HDP 2.3.4.7. How do we specify this in the blue print.... or is there any other property or configuration parameter that we should use so that Ambari installs 2.3.4.7. Any pointers will be very much helpful for us. Thanks. { "configurations" : [ ], "host_groups" : [ ], "Blueprints" : { "stack_name" : "HDP", "stack_version" : "2.3" } } ... View more

HDP 2.3.x cluster ranger-admin directory not present, while installing ranger 0.5 by using the command "yum install ranger-admin" ranger0.4 – Command - sudo yum install ranger-admin The ranger-admin directory is getting created as below: [ec2-user@ip- ~]$ cd /usr/hdp/current/ranger-admin/ [ec2-user@ip- ranger-admin]$ ls -lt total 96 drwxr-xr-x. 2 root root 4096 Mar 29 06:25 unixauth-config ...... many more files Ranger0.5 – Command - sudo yum install ranger-admin The ranger directory was not created. Instead saw a symbolic link. cd /usr/hdp/current [ec2-user@da current]$ ls -lt ranger* lrwxrwxrwx. 1 root root 34 Mar 29 05:12 ranger-admin -> /usr/hdp/2.3.4.0-3485/ranger-admin lrwxrwxrwx. 1 root root 32 Mar 29 05:12 ranger-kms -> /usr/hdp/2.3.4.0-3485/ranger-kms lrwxrwxrwx. 1 root root 37 Mar 29 05:12 ranger-usersync -> /usr/hdp/2.3.4.0-3485/ranger-usersync If we list the link /usr/hdp/2.3.4.0-3485/, ranger-admin directory is not found [ec2-user@da current]$ ls -lt /usr/hdp/2.3.4.0-3485/ total 40 drwxr-xr-x. 11 root root 4096 Mar 29 05:12 hadoop drwxr-xr-x. 7 root root 4096 Mar 29 05:12 zookeeper drwxr-xr-x. 5 root root 4096 Mar 29 05:11 hadoop-httpfs drwxr-xr-x. 8 root root 4096 Mar 29 05:11 etc drwxr-xr-x. 4 root root 4096 Mar 29 05:11 usr drwxr-xr-x. 7 root root 4096 Mar 29 05:11 hadoop-hdfs drwxr-xr-x. 6 root root 4096 Mar 29 05:10 hadoop-mapreduce drwxr-xr-x. 6 root root 4096 Mar 29 05:09 hadoop-yarn drwxr-xr-x. 4 root root 4096 Mar 29 05:09 ranger-hdfs-plugin drwxr-xr-x. 4 root root 4096 Mar 29 05:08 ranger-yarn-plugin ranger-admin directory is not there. Thanks, Mohana Murali ... View more