Cloudera Community
fullhouse
user rank
Explorer
My Accepted Solutions
Show All

Re: Ranger tagsync with file source

by Explorer in Support Questions
‎06-26-2019 12:17 PM
‎06-26-2019 12:17 PM
For the futures. Far along time i'm create correct view of tagsync source json file. Work example of HIVE-service tagfile At this example, database "default" , table "personal data", column "address" mark with PII tag; database "default" , table "personal data", column "phone" mark with PAD tag : { "op": "add_or_update", "serviceName": "AUTH_HIVE", "tagVersion": 3, "tagDefinitions": { "1":{"id":1, "guid":"tagdef-1", "name":"PAD", "attributeDefs":[], "owner":0}, "2":{"id":2, "guid":"tagdef-2", "name":"PII", "attributeDefs":[], "owner":0} }, "tags": { "1": { "type": "PAD", "attributes": {}, "id": 1, "guid": "tag-pad-1-guid" }, "2": { "type": "PII", "attributes": {}, "id": 2, "guid": "tag-pii-2-guid" } }, "serviceResources": [ { "serviceName": "AUTH_HIVE", "resourceElements": { "database": { "values": [ "default" ] }, "table": { "values": [ "personal_data" ] }, "column": { "values": [ "address" ] } }, "id": 1, "guid": "employee.personal.address-guid" }, { "serviceName": "AUTH_HIVE", "resourceElements": { "database": { "values": [ "default" ] }, "table": { "values": [ "personal_data" ] }, "column": { "values": [ "phone" ] } }, "id": 2, "guid": "employee.personal.phone-guid" } ], "resourceToTagIds": { "1": [ 1 ], "2": [ 2 ] } } Work example for HBASE-service hbase table "weblog" with column-family "user_profile" is hiding : { "op": "add_or_update", "serviceName": "AUTH_HBASE", "tagVersion": 3, "tagDefinitions": { "1":{"id":1, "guid":"tagdef-hb1", "name":"PII", "attributeDefs":[], "owner":0} }, "tags": { "1": { "type": "PII", "attributes": {}, "id": 1, "guid": "tag-pii-hb1-guid" } }, "serviceResources": [ { "serviceName": "AUTH_HBASE", "resourceElements": { "table": { "values": [ "default:weblog" ] }, "column-family": { "values": [ "user_profile" ] } }, "id": 1, "guid": "weblog.user.profile-guid" } ], "resourceToTagIds": { "1": [ 1 ] } } Ask your questions ... View more

Re: Bug with ranger kafka plugin installation

by Explorer in Support Questions
‎06-20-2019 08:19 AM
‎06-20-2019 08:19 AM
Resolved. For the descedants. Try this: ./bin/kafka-run-class.sh -> insert env variable with kafka path "CLASSPATH=/lib/kafka/config" ... View more

Bug with ranger kafka plugin installation

by Explorer in Support Questions
‎06-07-2019 06:01 PM
‎06-07-2019 06:01 PM
Hi there, colleagues Past several days i tried to implement integration apache ranger and ranger-kafka plugin. My versions: kafka: 2.12_2.2.0 ranger: 1.2.0 , ranger-plugin 1.2.0 My current problem: as far as i understand, kafka cant find the ranger-created audit files that i made with enable-kafka-plugin.sh script (ranger-kafka-audit.xml and ranger-kafka-security.xml). I sold this files everywhere in file system but this class still cant find it and cause fatal error: [2019-06-06 13:22:44,584] INFO getFilesInDirectory('/usr/lib/kafka/libs/ranger-kafka-plugin-impl'): adding /usr/lib/kafka/libs/ranger-kafka-plugin-impl/guava-17.0.jar (org.apache.ranger.plugin.classloader.RangerPluginClassLoaderUtil) [2019-06-06 13:22:44,584] INFO getFilesInDirectory('/usr/lib/kafka/libs/ranger-kafka-plugin-impl'): adding /usr/lib/kafka/libs/ranger-kafka-plugin-impl/ranger-plugins-common-1.2.0.jar (org.apache.ranger.plugin.classloader.RangerPluginClassLoaderUtil) [2019-06-06 13:22:44,615] INFO [Transaction Marker Channel Manager 0]: Starting (kafka.coordinator.transaction.TransactionMarkerChannelManager) [2019-06-06 13:22:44,648] ERROR Error getting principal. (org.apache.ranger.authorization.kafka.authorizer.RangerKafkaAuthorizer) java.lang.NoSuchMethodError: org.apache.kafka.common.security.JaasContext.load(Lorg/apache/kafka/common/security/JaasContext$Type;Lorg/apache/kafka/common/network/ListenerName;Ljava/util/Map;)Lorg/apache/kafka/common/security/JaasContext; at org.apache.ranger.authorization.kafka.authorizer.RangerKafkaAuthorizer.configure(RangerKafkaAuthorizer.java:98) at org.apache.ranger.authorization.kafka.authorizer.RangerKafkaAuthorizer.configure(RangerKafkaAuthorizer.java:94) at kafka.server.KafkaServer.$anonfun$startup$5(KafkaServer.scala:288) at scala.Option.map(Option.scala:163) at kafka.server.KafkaServer.startup(KafkaServer.scala:286) at kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:38) at kafka.Kafka$.main(Kafka.scala:75) at kafka.Kafka.main(Kafka.scala) [2019-06-06 13:22:44,689] INFO Calling plugin.init() (org.apache.ranger.authorization.kafka.authorizer.RangerKafkaAuthorizer) [2019-06-06 13:22:44,733] ERROR addResourceIfReadable(ranger-kafka-audit.xml): couldn't find resource file location (org.apache.ranger.authorization.hadoop.config.RangerConfiguration) [2019-06-06 13:22:44,734] ERROR addResourceIfReadable(ranger-kafka-security.xml): couldn't find resource file location (org.apache.ranger.authorization.hadoop.config.RangerConfiguration) [2019-06-06 13:22:44,758] INFO AuditProviderFactory: creating.. (org.apache.ranger.audit.provider.AuditProviderFactory) [2019-06-06 13:22:44,758] INFO AuditProviderFactory: initializing.. (org.apache.ranger.audit.provider.AuditProviderFactory) [2019-06-06 13:22:44,900] INFO No v3 audit configuration found. Trying v2 audit configurations (org.apache.ranger.audit.provider.AuditProviderFactory) [2019-06-06 13:22:44,900] INFO AuditProviderFactory: Audit not enabled.. (org.apache.ranger.audit.provider.AuditProviderFactory) [2019-06-06 13:22:44,900] INFO PolicyEngineOptions: { evaluatorType: auto, cacheAuditResult: false, disableContextEnrichers: false, disableCustomConditions: false, disableTrieLookupPrefilter: false, optimizeTrieForRetrieval: false } (org.apache.ranger.plugin.service.RangerBasePlugin) [2019-06-06 13:22:44,917] ERROR [KafkaServer id=0] Fatal error during KafkaServer startup. Prepare to shutdown (kafka.server.KafkaServer) java.lang.NullPointerException [root@myhost kafka]# find / -name ranger-kafka-security.xml | xargs ls -lah {} ls: cannot access {}: No such file or directory -rwxr--r-- 1 root root 2.9K Jun 5 20:41 /opt/kafka/conf/ranger-kafka-security.xml -rwxr--r-- 1 root root 2.9K Jun 5 20:41 /opt/kafka/ranger-kafka-security.xml -rwxr-xr-x 1 kafka kafka 2.6K Jun 6 12:58 /ranger-kafka-security.xml -rwx------ 1 cloud-user root 2.6K Sep 27 2018 /usr/lib/data/ranger-1.2.0-kafka-plugin/install/conf.templates/enable/ranger-kafka-security.xml -rwxr--r-- 1 root root 2.9K Jun 5 21:01 /usr/lib/data/ranger-1.2.0-kafka-plugin/ranger-kafka-security.xml -rwxrwxrwx 1 kafka kafka 2.9K Jun 5 20:21 /usr/lib/kafka/bin/ranger-kafka-security.xml -rwxrwxrwx 1 kafka kafka 2.9K Jun 5 20:59 /usr/lib/kafka/config/META-INF/ranger-kafka-security.xml -rwxrwxrwx 1 kafka kafka 2.9K Jun 5 12:50 /usr/lib/kafka/config/ranger-kafka-security.xml -rwxrwxrwx 1 kafka kafka 2.9K Jun 5 20:59 /usr/lib/kafka/conf/META-INF/ranger-kafka-security.xml -rwxrwxrwx 1 kafka kafka 2.9K Jun 5 16:19 /usr/lib/kafka/conf/ranger-kafka-security.xml -rwxr-xr-x 1 kafka kafka 2.6K Jun 6 12:43 /usr/lib/kafka/libs/ranger-kafka-security.xml -rwxr-xr-x 1 root root 2.9K Jun 6 10:46 /usr/lib/kafka/META-INF/conf/ranger-kafka-security.xml -rwxrwxrwx 1 kafka kafka 2.9K Jun 5 20:59 /usr/lib/kafka/META-INF/ranger-kafka-security.xml -rwxr-xr-x 1 root root 2.9K Jun 6 10:46 /usr/lib/kafka/META-INF/services/ranger-kafka-security.xml -rwxrwxrwx 1 kafka kafka 2.9K Jun 5 20:20 /usr/lib/kafka/ranger-kafka-security.xml -rwxrwxrwx 1 kafka kafka 2.9K Jun 5 20:38 /usr/lib/kafka/site-docs/ranger-kafka-security.xml [root@myhost kafka]# [root@myhost kafka]# ll /etc/kafka lrwxrwxrwx 1 root root 15 Jun 5 19:49 /etc/kafka -> /usr/lib/kafka/ My configurations: kafka server.properties for ranger ( Bigger part of configuration i find in this guide https://www.cnblogs.com/felixzh/p/10475171.html ) authorizer.class.name=org.apache.ranger.authorization.kafka.authorizer.RangerKafkaAuthorizer listeners=SASL_PLAINTEXT://myhost.domain.example:6667 security.inter.broker.protocol=SASL_PLAINTEXT sasl.mechanism.inter.broker.protocol=GSSAPI sasl.enabled.mechanisms=GSSAPI isasl.kerberos.service.name=kafka My logs: I'm try to investigate this bug with strace, debug mode, and java-lib inspections but dont find any. Some debug-logs part with successfull export ranger-libs and failed .xml search (care , too long): [2019-06-05 20:47:10,799] DEBUG RangerPluginClassLoader.findClass(org.apache.commons.collections.IterableMap): calling childClassLoader().findClass() (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,799] DEBUG <== RangerPluginClassLoader.findClass(org.apache.commons.collections.IterableMap): interface org.apache.commons.collections.IterableMap (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,799] DEBUG <== RangerPluginClassLoader.loadClass(org.apache.commons.collections.IterableMap): interface org.apache.commons.collections.IterableMap (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,799] DEBUG ==> RangerPluginClassLoader.loadClass(org.apache.commons.collections.Unmodifiable) (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,799] DEBUG RangerPluginClassLoader.loadClass(org.apache.commons.collections.Unmodifiable): calling childClassLoader.findClass() (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,799] DEBUG ==> RangerPluginClassLoader.findClass(org.apache.commons.collections.Unmodifiable) (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,799] DEBUG RangerPluginClassLoader.findClass(org.apache.commons.collections.Unmodifiable): calling childClassLoader().findClass() (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,800] DEBUG <== RangerPluginClassLoader.findClass(org.apache.commons.collections.Unmodifiable): interface org.apache.commons.collections.Unmodifiable (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,800] DEBUG <== RangerPluginClassLoader.loadClass(org.apache.commons.collections.Unmodifiable): interface org.apache.commons.collections.Unmodifiable (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,800] DEBUG ==> RangerPluginClassLoader.loadClass(org.apache.commons.collections.map.AbstractMapDecorator) (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,800] DEBUG RangerPluginClassLoader.loadClass(org.apache.commons.collections.map.AbstractMapDecorator): calling childClassLoader.findClass() (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,800] DEBUG ==> RangerPluginClassLoader.findClass(org.apache.commons.collections.map.AbstractMapDecorator) (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,800] DEBUG RangerPluginClassLoader.findClass(org.apache.commons.collections.map.AbstractMapDecorator): calling childClassLoader().findClass() (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,800] DEBUG <== RangerPluginClassLoader.findClass(org.apache.commons.collections.map.AbstractMapDecorator): class org.apache.commons.collections.map.AbstractMapDecorator (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,800] DEBUG <== RangerPluginClassLoader.loadClass(org.apache.commons.collections.map.AbstractMapDecorator): class org.apache.commons.collections.map.AbstractMapDecorator (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,800] DEBUG <== RangerPluginClassLoader.findClass(org.apache.commons.collections.map.UnmodifiableMap): class org.apache.commons.collections.map.UnmodifiableMap (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,800] DEBUG <== RangerPluginClassLoader.loadClass(org.apache.commons.collections.map.UnmodifiableMap): class org.apache.commons.collections.map.UnmodifiableMap (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,800] DEBUG ==> RangerPluginClassLoader.loadClass(org.apache.commons.collections.MapIterator) (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,800] DEBUG RangerPluginClassLoader.loadClass(org.apache.commons.collections.MapIterator): calling childClassLoader.findClass() (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,800] DEBUG ==> RangerPluginClassLoader.findClass(org.apache.commons.collections.MapIterator) (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,800] DEBUG RangerPluginClassLoader.findClass(org.apache.commons.collections.MapIterator): calling childClassLoader().findClass() (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,801] DEBUG ==> RangerPluginClassLoader.loadClass(java.util.Iterator) (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,801] DEBUG RangerPluginClassLoader.loadClass(java.util.Iterator): calling childClassLoader.findClass() (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,801] DEBUG <== RangerPluginClassLoader.loadClass(java.util.Iterator): interface java.util.Iterator (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,801] DEBUG <== RangerPluginClassLoader.findClass(org.apache.commons.collections.MapIterator): interface org.apache.commons.collections.MapIterator (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,801] DEBUG <== RangerPluginClassLoader.loadClass(org.apache.commons.collections.MapIterator): interface org.apache.commons.collections.MapIterator (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,801] DEBUG ==> RangerPluginClassLoader.findResource(hadoop-site.xml) (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,801] DEBUG RangerPluginClassLoader.findResource(hadoop-site.xml): calling componentClassLoader.getResources() (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,801] DEBUG <== RangerPluginClassLoader.findResource(hadoop-site.xml): null (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,802] DEBUG ==> RangerPluginClassLoader.loadClass(java.util.ArrayList) (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,802] DEBUG RangerPluginClassLoader.loadClass(java.util.ArrayList): calling childClassLoader.findClass() (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,802] DEBUG <== RangerPluginClassLoader.loadClass(java.util.ArrayList): class java.util.ArrayList (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,802] DEBUG ==> RangerPluginClassLoader.loadClass(java.util.Collections) (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,802] DEBUG RangerPluginClassLoader.loadClass(java.util.Collections): calling childClassLoader.findClass() (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,802] DEBUG <== RangerPluginClassLoader.loadClass(java.util.Collections): class java.util.Collections (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,802] DEBUG ==> addResourceIfReadable(ranger-kafka-audit.xml) (org.apache.ranger.authorization.hadoop.config.RangerConfiguration) [2019-06-05 20:47:10,802] DEBUG ==> RangerPluginClassLoader.findResource(ranger-kafka-audit.xml) (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,802] DEBUG RangerPluginClassLoader.findResource(ranger-kafka-audit.xml): calling componentClassLoader.getResources() (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,802] DEBUG <== RangerPluginClassLoader.findResource(ranger-kafka-audit.xml): null (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,802] DEBUG ==> RangerPluginClassLoader.findResource(/ranger-kafka-audit.xml) (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,802] DEBUG RangerPluginClassLoader.findResource(/ranger-kafka-audit.xml): calling componentClassLoader.getResources() (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,803] DEBUG <== RangerPluginClassLoader.findResource(/ranger-kafka-audit.xml): null (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,803] ERROR addResourceIfReadable(ranger-kafka-audit.xml): couldn't find resource file location (org.apache.ranger.authorization.hadoop.config.RangerConfiguration) [2019-06-05 20:47:10,803] DEBUG <== addResourceIfReadable(ranger-kafka-audit.xml), result=false (org.apache.ranger.authorization.hadoop.config.RangerConfiguration) [2019-06-05 20:47:10,803] DEBUG ==> addAuditResource(Service Type: kafka (org.apache.ranger.authorization.hadoop.config.RangerConfiguration) [2019-06-05 20:47:10,803] DEBUG ==> RangerPluginClassLoader.loadClass(org.apache.ranger.authorization.hadoop.config.RangerLegacyConfigBuilder) (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,803] DEBUG RangerPluginClassLoader.loadClass(org.apache.ranger.authorization.hadoop.config.RangerLegacyConfigBuilder): calling childClassLoader.findClass() (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,803] DEBUG ==> RangerPluginClassLoader.findClass(org.apache.ranger.authorization.hadoop.config.RangerLegacyConfigBuilder) (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,803] DEBUG RangerPluginClassLoader.findClass(org.apache.ranger.authorization.hadoop.config.RangerLegacyConfigBuilder): calling childClassLoader().findClass() (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,803] DEBUG <== RangerPluginClassLoader.findClass(org.apache.ranger.authorization.hadoop.config.RangerLegacyConfigBuilder): class org.apache.ranger.authorization.hadoop.config.RangerLegacyConfigBuilder (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,803] DEBUG <== RangerPluginClassLoader.loadClass(org.apache.ranger.authorization.hadoop.config.RangerLegacyConfigBuilder): class org.apache.ranger.authorization.hadoop.config.RangerLegacyConfigBuilder (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,815] DEBUG ==> RangerPluginClassLoader.findResource(hive-site.xml) (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,815] DEBUG RangerPluginClassLoader.findResource(hive-site.xml): calling componentClassLoader.getResources() (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,815] DEBUG <== RangerPluginClassLoader.findResource(hive-site.xml): null (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,815] DEBUG ==> RangerPluginClassLoader.findResource(/hive-site.xml) (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,815] DEBUG RangerPluginClassLoader.findResource(/hive-site.xml): calling componentClassLoader.getResources() (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,815] DEBUG <== RangerPluginClassLoader.findResource(/hive-site.xml): null (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,815] DEBUG ==> RangerPluginClassLoader.findResource(hbase-site.xml) (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,815] DEBUG RangerPluginClassLoader.findResource(hbase-site.xml): calling componentClassLoader.getResources() (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,815] DEBUG <== RangerPluginClassLoader.findResource(hbase-site.xml): null (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,815] DEBUG ==> RangerPluginClassLoader.findResource(/hbase-site.xml) (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,815] DEBUG RangerPluginClassLoader.findResource(/hbase-site.xml): calling componentClassLoader.getResources() (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,815] DEBUG <== RangerPluginClassLoader.findResource(/hbase-site.xml): null (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,815] DEBUG ==> RangerPluginClassLoader.findResource(hdfs-site.xml) (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,815] DEBUG RangerPluginClassLoader.findResource(hdfs-site.xml): calling componentClassLoader.getResources() (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,816] DEBUG <== RangerPluginClassLoader.findResource(hdfs-site.xml): null (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,816] DEBUG ==> RangerPluginClassLoader.findResource(/hdfs-site.xml) (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,816] DEBUG RangerPluginClassLoader.findResource(/hdfs-site.xml): calling componentClassLoader.getResources() (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,816] DEBUG <== RangerPluginClassLoader.findResource(/hdfs-site.xml): null (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,816] DEBUG <== addAuditResource(Service Type: kafka) (org.apache.ranger.authorization.hadoop.config.RangerConfiguration) [2019-06-05 20:47:10,816] DEBUG ==> addResourceIfReadable(ranger-kafka-security.xml) (org.apache.ranger.authorization.hadoop.config.RangerConfiguration) [2019-06-05 20:47:10,816] DEBUG ==> RangerPluginClassLoader.findResource(ranger-kafka-security.xml) (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,816] DEBUG RangerPluginClassLoader.findResource(ranger-kafka-security.xml): calling componentClassLoader.getResources() (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,816] DEBUG <== RangerPluginClassLoader.findResource(ranger-kafka-security.xml): null (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,816] DEBUG ==> RangerPluginClassLoader.findResource(/ranger-kafka-security.xml) (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,816] DEBUG RangerPluginClassLoader.findResource(/ranger-kafka-security.xml): calling componentClassLoader.getResources() (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,816] DEBUG <== RangerPluginClassLoader.findResource(/ranger-kafka-security.xml): null (org.apache.ranger.plugin.classloader.RangerPluginClassLoader) [2019-06-05 20:47:10,816] ERROR addResourceIfReadable(ranger-kafka-security.xml): couldn't find resource file location (org.apache.ranger.authorization.hadoop.config.RangerConfiguration) I'm don't sure about my capability and need your help and advices. Thank you. ... View more
Labels:

Ranger tagsync with file source

by Explorer in Support Questions
‎04-24-2019 12:14 PM
‎04-24-2019 12:14 PM
Hi there! I'm try to deploy Apache Ranger ranger-tagsync module without Apache Atlas. I'm enable option "TAG_SOURCE_FILE_ENABLED = true" but can't understand the way of creating needed tags.json file. In my plan, my own deamon will simply generate this file for tagging hive-columns giving tag-based policies opportunity masking this columns for usergroups. Mostly i'am follow next article: https://community.hortonworks.com/articles/135895/how-to-mask-columns-in-hive-with-atlas-and-ranger.html but it's a problem to create working file-prototype. I'am need worked examples of this file or Atlas REST output with same actions. Thank you. ... View more
Labels:
Contact Me
Online
Offline
Last Visited
‎04-28-2022 06:33 PM
Community Statistics
Member Since ‎04-24-2019 11:03 AM
Last Visited ‎04-28-2022 06:33 PM
Posts 5