Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Manually load data into Apache Atlas

Manually load data into Apache Atlas

New Contributor

Hi,

I have installed Apache Atlas on EC2 instance. This is a single node cluster. (Hadoop isnt installed on it).
Can we any way load the data manually into Atlas without hooking up with HIVE/SQOOP or so components??

If i have to install HIVE on the same instance, how should I hook it up??

Any help is appreciated

Thanks

6 REPLIES 6

Re: Manually load data into Apache Atlas

Expert Contributor
@Anji Raju

>> Can we any way load the data manually into Atlas without hooking up with HIVE/SQOOP or so components??

Would you like to create the hive entities manually by yourself in Atlas without Hive sending it ? You can use Atlas REST APIs to do that . But would you mind sharing the requirement behind this ?

>> If i have to install HIVE on the same instance, how should I hook it up??

Please refer to http://atlas.apache.org/Hook-Hive.html.

Re: Manually load data into Apache Atlas

New Contributor

@Sharmadha Sainath Yes, I would like to create hive entities manually into Atlas without hive sending it. I did try to use the REST API's but I am failing to post the data into atlas.

Whenever i try to create a new entity, its showing only HDFS_PATH, HBASE only in the drop down list.
I was looking into it to test data, how the data can be loaded into it.

Thanks,

Re: Manually load data into Apache Atlas

Expert Contributor

@Anji Raju

UI shows only few types. You may add a property atlas.ui.editable.entity.types=* in atlas-application properties to list down all the types or atlas.ui.editable.entity.types=hive_table,hive_column to list down only hive_table and hive_column types.

Re: Manually load data into Apache Atlas

New Contributor

hi @Sharmadha Sainath,

Apache Atlas natively been build with with Berkeley DB and Elastic,

I did follow the link below to install it.

https://community.hortonworks.com/questions/121326/can-anyone-make-a-tutorial-for-installing-apache-...


What i was trying to do is to load data into the DB, which i cannot see.

If you can help me to load data into DB that would be helpful

Highlighted

Re: Manually load data into Apache Atlas

Contributor

@Anji Raju what is the error that you run into when using the atlas api ? Also take a look at this HCC article - https://community.hortonworks.com/articles/74919/how-to-create-hive-table-and-lineage-using-rest-ap....

Re: Manually load data into Apache Atlas

New Contributor

Hi @Prabhu M,

I did try the API usage but , the location of the entity is not getting created.