Member since
04-17-2016
75
Posts
9
Kudos Received
0
Solutions
03-22-2017
02:44 PM
Now, it behaves differently. I updated the same policy. But still getting error while accessing the directory in hdfs. I think, the policy is not enforced. In the updated policy, there is no exclude condition, only the user jkris03 is allowed for the permission. Also, please look at the audits for the same service but the source is different. However, for the source datameer also, the ranger policy is not working, but we can see the audits. But, for my source, It is not displaying the audits too.
... View more
03-22-2017
01:33 PM
Hi Deepak, Thanks for your reply. But, the parameter has already been configured. For your infor, for hive plugin, it works well(audit source is solr). But, for hdfs , i can see the log in "Admin" tab if i update the policy and the "Plugin" tab says the policy is synced. But in the "Access" tab, i am not seeing any audits. Note that, for the same service(hdfs) , I am seeing audits for other source but not mine(/tmp/ranger_test) .
... View more
03-22-2017
12:57 AM
Hi vperiasamy and Namit Maheshwari, Thank you very much for your reply. We are using HDP 2.5.3. I am not seeing any error. The interesting thing is, jkris03 is the owner of the directory with permission 400 in HDFS. But, when i tried to copy a file to the directory, it gave error like permission denied. But, the user rkurumb(my colleague) could able to copy file to the directory and i checked with other user(ftam) and he also got permission denied error. Since, there is no audit log, i could not see whether the ranger acl or hadoop acl is being enforced. We use Active Directory and it is synced with Apache Ranger. The group name i have used here is of Active Directory.
... View more
03-21-2017
08:30 PM
Hi there, In my work place, HDFS plugin for Ranger has been enabled. I created a policy for the source in hdfs /tmp/ranger_test(which has access permission 400 in HDFS). I can see that the policy has been synced in ranger Plugins tab. But, It is not showing up any audit logs and it does not enforce the ranger policy while accessing the directory in hdfs. For your information, the audit log is enabled. Don't know the reason why it does not work in the way i expected. No audit logs are displayed in ranger Audit tab. But audit are enable for hdfs to solr. Please let me know what would be the reason and how to troubleshoot it. Thanks, kJ
... View more
Labels:
- Labels:
-
Apache Ranger
02-28-2017
03:38 PM
Hi there, I ran sqoop command to list-databases and I am getting error. This is the sqoop command i ran: sqoop list-databases --connect jdbc:netezza://xxxxxxxx/ --username xxxx --password xxx; The error I am getting is : ERROR manager.SqlManager: Generic SqlManager.listDatabases() not implemented. For your Information, I added Netezza jar like export HADOOP_CLASSPATH=$HADOOP_CLASSPATH:<path to the jar> Please share your knowledge on this. Thanks.
... View more
Labels:
- Labels:
-
Apache Sqoop
02-24-2017
02:33 PM
Hi, Here I have attached the screenshot. Please take a look to what the error is.kaferror.png
... View more
02-23-2017
09:28 PM
I ran as you said. This is the screenshot for the output. zoo-out.png
... View more
02-23-2017
09:02 PM
Hi, I ran the command as you said. Here is the ouptut. broker-id.png also I checked the vi /var/log/kafka/server.log.2017-02-23-14 [2017-02-23 14:07:13,099] INFO [Group Metadata Manager on Broker 1]: Removed 0 expired offsets in 0 milliseconds. (kafka.coordinator.GroupMetadataManager)
[2017-02-23 14:17:13,099] INFO [Group Metadata Manager on Broker 1]: Removed 0 expired offsets in 0 milliseconds. (kafka.coordinator.GroupMetadataManager)
[2017-02-23 14:27:13,099] INFO [Group Metadata Manager on Broker 1]: Removed 0 expired offsets in 0 milliseconds. (kafka.coordinator.GroupMetadataManager)
[2017-02-23 14:37:13,099] INFO [Group Metadata Manager on Broker 1]: Removed 0 expired offsets in 0 milliseconds. (kafka.coordinator.GroupMetadataManager)
[2017-02-23 14:47:13,099] INFO [Group Metadata Manager on Broker 1]: Removed 0 expired offsets in 0 milliseconds. (kafka.coordinator.GroupMetadataManager)
[2017-02-23 14:57:13,099] INFO [Group Metadata Manager on Broker 1]: Removed 0 expired offsets in 0 milliseconds. (kafka.coordinator.GroupMetadataManager)
~
~
... View more
02-23-2017
08:49 PM
Hi, here i have attached the zookeeper screenshot for your reference. zookeeper-screenshot.png
... View more
02-23-2017
08:41 PM
Thanks for your reply. Here I have attached the Kafka-Broker screenshot for your reference. kafka-error.png
... View more