Created 08-22-2022 10:50 PM
Unable integrate hbase with Atlas.
we are trying to integrate hbase into atlas 2.2.0
we are not using embedded kafka and hbase , seperately installed in same machine.
hbase version:2.4.13
ranger@:~/apache-atlas-sources-2.2.0/hook-bin$ ./import-hbase.sh -n <hbase namespace name>
>>>>> ./import-hbase.sh
>>>>> /home/ranger/apache-atlas-sources-2.2.0
Using HBase configuration directory [/data/hbase/conf/]
Log file for import is /var/log/atlas/import-hbase.log
Picked up _JAVA_OPTIONS: -Xms1024m -Xmx1024m -XX:MaxPermSize=512m
OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0
ImportHBaseEntities failed. Please check the log file for the detailed error message
Failed to import HBase Data Model!!!
Output of /var/log/atlas/import-hbase.log:
2022-08-23 05:33:25,927 INFO - [main:] ~ Looking for atlas-application.properties in classpath (ApplicationProperties:124)
2022-08-23 05:33:25,931 INFO - [main:] ~ Loading atlas-application.properties from file:/data/hbase/conf/atlas-application.properties (ApplicationProperties:137)
2022-08-23 05:33:25,960 INFO - [main:] ~ Using graphdb backend 'janus' (ApplicationProperties:317)
2022-08-23 05:33:25,961 INFO - [main:] ~ Using storage backend 'hbase2' (ApplicationProperties:328)
2022-08-23 05:33:25,962 INFO - [main:] ~ Using index backend 'solr' (ApplicationProperties:339)
2022-08-23 05:33:25,962 INFO - [main:] ~ Atlas is running in MODE: PROD. (ApplicationProperties:343)
2022-08-23 05:33:25,963 INFO - [main:] ~ Setting solr.wait-searcher property 'true' (ApplicationProperties:350)
2022-08-23 05:33:25,963 INFO - [main:] ~ Setting index.search.map-name property 'false' (ApplicationProperties:354)
2022-08-23 05:33:25,963 INFO - [main:] ~ Setting atlas.graph.index.search.max-result-set-size = 150 (ApplicationProperties:364)
2022-08-23 05:33:25,963 INFO - [main:] ~ Setting atlas.graph.index.search.solr.wait-searcher = true (ApplicationProperties:365)
2022-08-23 05:33:25,963 INFO - [main:] ~ Property (set to default) atlas.graph.cache.db-cache = true (ApplicationProperties:377)
2022-08-23 05:33:25,964 INFO - [main:] ~ Property (set to default) atlas.graph.cache.db-cache-clean-wait = 20 (ApplicationProperties:377)
2022-08-23 05:33:25,964 INFO - [main:] ~ Property (set to default) atlas.graph.cache.db-cache-size = 0.5 (ApplicationProperties:377)
2022-08-23 05:33:25,964 INFO - [main:] ~ Property (set to default) atlas.graph.cache.tx-cache-size = 15000 (ApplicationProperties:377)
2022-08-23 05:33:25,964 INFO - [main:] ~ Property (set to default) atlas.graph.cache.tx-dirty-size = 120 (ApplicationProperties:377)
2022-08-23 05:33:25,971 ERROR - [main:] ~ ImportHBaseEntities failed (HBaseBridge:198)
org.apache.atlas.AtlasException: Failed to load application properties
at org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:150)
at org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:103)
at org.apache.atlas.hbase.bridge.HBaseBridge.main(HBaseBridge.java:140)
Caused by: org.apache.commons.configuration.ConversionException: 'atlas.graph.index.search.map-name' doesn't map to a List object: false, a java.lang.Boolean
at org.apache.commons.configuration.AbstractConfiguration.getList(AbstractConfiguration.java:1144)
at org.apache.commons.configuration.AbstractConfiguration.getList(AbstractConfiguration.java:1109)
at org.apache.commons.configuration.AbstractConfiguration.interpolatedConfiguration(AbstractConfiguration.java:1274)
at org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:145)
... 2 more
2022-08-23 05:35:07,422 INFO - [main:] ~ Looking for atlas-application.properties in classpath (ApplicationProperties:124)
2022-08-23 05:35:07,426 INFO - [main:] ~ Loading atlas-application.properties from file:/data/hbase/conf/atlas-application.properties (ApplicationProperties:137)
2022-08-23 05:35:07,464 INFO - [main:] ~ Using graphdb backend 'janus' (ApplicationProperties:317)
2022-08-23 05:35:07,464 INFO - [main:] ~ Using storage backend 'hbase2' (ApplicationProperties:328)
2022-08-23 05:35:07,466 INFO - [main:] ~ Using index backend 'solr' (ApplicationProperties:339)
2022-08-23 05:35:07,467 INFO - [main:] ~ Atlas is running in MODE: PROD. (ApplicationProperties:343)
2022-08-23 05:35:07,467 INFO - [main:] ~ Setting solr.wait-searcher property 'true' (ApplicationProperties:350)
2022-08-23 05:35:07,468 INFO - [main:] ~ Setting index.search.map-name property 'false' (ApplicationProperties:354)
2022-08-23 05:35:07,468 INFO - [main:] ~ Setting atlas.graph.index.search.max-result-set-size = 150 (ApplicationProperties:364)
2022-08-23 05:35:07,468 INFO - [main:] ~ Setting atlas.graph.index.search.solr.wait-searcher = true (ApplicationProperties:365)
2022-08-23 05:35:07,468 INFO - [main:] ~ Property (set to default) atlas.graph.cache.db-cache = true (ApplicationProperties:377)
2022-08-23 05:35:07,468 INFO - [main:] ~ Property (set to default) atlas.graph.cache.db-cache-clean-wait = 20 (ApplicationProperties:377)
2022-08-23 05:35:07,468 INFO - [main:] ~ Property (set to default) atlas.graph.cache.db-cache-size = 0.5 (ApplicationProperties:377)
2022-08-23 05:35:07,468 INFO - [main:] ~ Property (set to default) atlas.graph.cache.tx-cache-size = 15000 (ApplicationProperties:377)
2022-08-23 05:35:07,469 INFO - [main:] ~ Property (set to default) atlas.graph.cache.tx-dirty-size = 120 (ApplicationProperties:377)
2022-08-23 05:35:07,476 ERROR - [main:] ~ ImportHBaseEntities failed (HBaseBridge:198)
org.apache.atlas.AtlasException: Failed to load application properties
at org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:150)
at org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:103)
at org.apache.atlas.hbase.bridge.HBaseBridge.main(HBaseBridge.java:140)
Caused by: org.apache.commons.configuration.ConversionException: 'atlas.graph.index.search.map-name' doesn't map to a List object: false, a java.lang.Boolean
at org.apache.commons.configuration.AbstractConfiguration.getList(AbstractConfiguration.java:1144)
at org.apache.commons.configuration.AbstractConfiguration.getList(AbstractConfiguration.java:1109)
at org.apache.commons.configuration.AbstractConfiguration.interpolatedConfiguration(AbstractConfiguration.java:1274)
at org.apache.atlas.ApplicationProperties.get(ApplicationProperties.java:145)
... 2 more