Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

How to use Atlas metadata with DynamoDB

Solved Go to solution

How to use Atlas metadata with DynamoDB

New Contributor

Hi, I have created 'BerkeleyDB and Elastic search' build for Atlas which are used by Titan as back-end

Is there any way to integrate/export this data with DynamoDB or MySQL type of databases?

1 ACCEPTED SOLUTION

Accepted Solutions

Re: How to use Atlas metadata with DynamoDB

@Muhammad Imran Tariq

No, Atlas requires Titan Graph Database which only supports BerkeleyDB, HBase and Cassandra as storage backends.

http://atlas.apache.org/Architecture.html

http://titan.thinkaurelius.com/

14 REPLIES 14

Re: How to use Atlas metadata with DynamoDB

@Muhammad Imran Tariq

No, Atlas requires Titan Graph Database which only supports BerkeleyDB, HBase and Cassandra as storage backends.

http://atlas.apache.org/Architecture.html

http://titan.thinkaurelius.com/

Highlighted

Re: How to use Atlas metadata with DynamoDB

New Contributor

@Eyad Garelnabi

I want to use metadata stored in Atlas outside of Atlas. What could be the possible way?

Re: How to use Atlas metadata with DynamoDB

How are you trying to use the metadata?

In most of our implementations we use the Atlas REST API (http://atlas.apache.org/api/v2/index.html ) for metadata/lineage import and export. Have you considered using that?

Please note that I have linked above to the new API, the legacy API ( http://atlas.apache.org/api/rest.html ) has been deprecated with HDP 2.6 (Atlas 0.8) and will be removed in a future version.

Re: How to use Atlas metadata with DynamoDB

New Contributor

@Eyad Garelnabi Yes I checked this API. I export metadata and this API export this data in the form of different files. Yes I am trying to use metadata outside of Atlas.

Re: How to use Atlas metadata with DynamoDB

New Contributor

@Eyad Garelnabi

According to Amazon it also support DynamoDB

My purpose of this question is that I also want my metadata to be queried and search in any other system/tool other than Atlas. Currently BerkeleyDB did not allow me to connect and search data directly into it without using Atlas.

Re: How to use Atlas metadata with DynamoDB

Please share a link to the source. There might be some confusion.

Re: How to use Atlas metadata with DynamoDB

New Contributor

Re: How to use Atlas metadata with DynamoDB

When you follow the links to the Github repo you'll see that AWS has built custom adapters to allow integration with JanusGraph not Titan. JanusGraph is a fork of the Titan project and has some differences.

Re: How to use Atlas metadata with DynamoDB

New Contributor

Oh I see. This means in order to use DynamoDB, we have to use Janusgraph in Atlas instead of Titan. Right?

Don't have an account?
Coming from Hortonworks? Activate your account here