Support Questions
Find answers, ask questions, and share your expertise

Manually load data into Apache Atlas

Explorer

Hi,

I have installed Apache Atlas on EC2 instance. This is a single node cluster. (Hadoop isnt installed on it).
Can we any way load the data manually into Atlas without hooking up with HIVE/SQOOP or so components??

If i have to install HIVE on the same instance, how should I hook it up??

Any help is appreciated

Thanks

6 REPLIES 6

Expert Contributor
@Anji Raju

>> Can we any way load the data manually into Atlas without hooking up with HIVE/SQOOP or so components??

Would you like to create the hive entities manually by yourself in Atlas without Hive sending it ? You can use Atlas REST APIs to do that . But would you mind sharing the requirement behind this ?

>> If i have to install HIVE on the same instance, how should I hook it up??

Please refer to http://atlas.apache.org/Hook-Hive.html.

Explorer

@Sharmadha Sainath Yes, I would like to create hive entities manually into Atlas without hive sending it. I did try to use the REST API's but I am failing to post the data into atlas.

Whenever i try to create a new entity, its showing only HDFS_PATH, HBASE only in the drop down list.
I was looking into it to test data, how the data can be loaded into it.

Thanks,

Expert Contributor

@Anji Raju

UI shows only few types. You may add a property atlas.ui.editable.entity.types=* in atlas-application properties to list down all the types or atlas.ui.editable.entity.types=hive_table,hive_column to list down only hive_table and hive_column types.

Explorer

hi @Sharmadha Sainath,

Apache Atlas natively been build with with Berkeley DB and Elastic,

I did follow the link below to install it.

https://community.hortonworks.com/questions/121326/can-anyone-make-a-tutorial-for-installing-apache-...


What i was trying to do is to load data into the DB, which i cannot see.

If you can help me to load data into DB that would be helpful

Contributor

@Anji Raju what is the error that you run into when using the atlas api ? Also take a look at this HCC article - https://community.hortonworks.com/articles/74919/how-to-create-hive-table-and-lineage-using-rest-ap....

Explorer

Hi @Prabhu M,

I did try the API usage but , the location of the entity is not getting created.