Member since
01-21-2019
122
Posts
12
Kudos Received
10
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
6316 | 02-12-2019 04:26 AM | |
2281 | 01-24-2019 09:14 AM | |
1793 | 02-20-2018 06:47 AM | |
2230 | 01-04-2018 05:56 AM | |
1934 | 09-09-2017 02:50 PM |
05-30-2017
06:44 AM
@Muhammad Imran Tariq Following information is passed from Hive to Atlas-Hive Hook from Hive whenever any DML statement is executed when Atlas Hive hook is configured. refer this code on github - final HiveEventContext event = new HiveEventContext();
event.setInputs(hookContext.getInputs());
event.setOutputs(hookContext.getOutputs());
event.setHookType(hookContext.getHookType());
final UserGroupInformation ugi = hookContext.getUgi() == null ? Utils.getUGI() : hookContext.getUgi();
event.setUgi(ugi);
event.setUser(getUser(hookContext.getUserName(), hookContext.getUgi()));
event.setOperation(OPERATION_MAP.get(hookContext.getOperationName()));
event.setQueryId(hookContext.getQueryPlan().getQueryId());
event.setQueryStr(hookContext.getQueryPlan().getQueryStr());
event.setQueryStartTime(hookContext.getQueryPlan().getQueryStartTime());
event.setQueryType(hookContext.getQueryPlan().getQueryPlan().getQueryType());
event.setLineageInfo(hookContext.getLinfo());
... View more
05-29-2017
01:07 PM
1 Kudo
@Muhammad Imran Tariq, Atlas Hive Hook in configured in Hive by set-up in hive-site.xml. <property>
<name>hive.exec.post.hooks</name>
<value>org.apache.atlas.hive.hook.HiveHook</value>
</property> whenever a table is created in hive, a event is triggered which invokes the atlas hive hook. This hook sends message to Atlas via notification to kafka, The notification in kafka is consumed by Atlas and hive entity is created. Refer:- http://atlas.incubator.apache.org/Bridge-Hive.html
... View more
05-21-2017
04:59 PM
@Shafi Ahmad I reviewed the atlas-application properties file From the atlas-application properties it looks you are trying to using embeded kafka Do you intent to use embeded kafka or external Kafka for Atlas ? the below property is confusing atlas.kafka.bootstrap.servers=localhost2:6667,localhost3:9092
I can suggest you properties depending on whether it embeded kafka or external Kafka for Atlas. Let me know
... View more
05-17-2017
06:11 AM
@Shafi Ahmad Which HDP version you using, normally HDP use external kafka, did you change the atlas config to use embeded kafka ? Can you attached atlas-application.properties from /etc/atlas/conf/ Nixon
... View more
05-15-2017
09:16 AM
@Saurabh, these two files are needed by Atlas for authentication. I think files were not copied to atlas conf properly when you upgrade HDP.
... View more
05-13-2017
08:38 AM
@Saurabh
Can you attach atlas application.log file.
... View more
04-06-2017
12:58 PM
Yes, it will allow all (*) or none.
... View more
04-06-2017
12:18 PM
@Naseem Rafique, you have to specify * for Atlas 0.8, granular level authorization in pipeline.
... View more
04-04-2017
06:24 AM
@Naseem Rafique Good Atlas is up and working with berkeley-elasticsearch profile , hbase-solr profile also should work. I use ideaInteliJ as IDE and do packaging from cmd line, so not aware of this eclipse issue, I would recommend that you close this thread and open a new topic of eclipse issue where developer having good knowledge. Nixon
... View more
03-29-2017
11:01 AM
@Naseem Rafique, From atlas_start.py console logs hbase and solr are started, check whether you are able to create table in hbase Also Please check whether you are allowed to open port with 21000 range on ec2 instance.
... View more