Member since
11-22-2016
83
Posts
23
Kudos Received
13
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2113 | 08-03-2018 08:13 PM | |
1881 | 06-02-2018 05:24 PM | |
1286 | 05-31-2018 07:54 PM | |
2043 | 02-08-2018 12:38 AM | |
1475 | 02-07-2018 11:38 PM |
11-06-2017
06:16 PM
@Arsalan Siddiqi Can you please let us know roughly how much data you have?
... View more
11-02-2017
12:52 AM
1 Kudo
Can you tell if you see this line in the logs? jetty-8.1.19.v20160209 (Server:272) From the log it appears that the classpath of the old version and the new version may be getting mixed up. This is causing Jetty not to serve up the pages correctly. Is it possible to try this: Stop Atlas via Ambari. Ensure that /usr/hdp/current/atlas-server/server/webapp/atlas.war exists. Remove this directory /usr/hdp/current/atlas-server/server/webapp/atlas Start Atlas via Ambar
... View more
10-31-2017
07:56 PM
Attached is a small sample of lineage in action. Use the following command to import the attached ZIP. You should see lineage for the only table present in the database. curl -g -X POST -u admin:admin -H "Content-Type: multipart/form-data" -H "Cache-Control: no-cache" -F data=@./Stocks-2.zip "http://localhost:21000/api/atlas/admin/import" Please extract the ZIP to see the entity definition for hive_process. stocks-2.zip
... View more
10-31-2017
06:48 PM
You seem to be using v1 APIs. What version of Atlas are you working on? Please look at this link for V2 API usage. This has some attached JSONs and CURL calls that help with table creation. Hope this helps.
... View more
10-23-2017
02:30 AM
@Arsalan Siddiqi I agree with @Vadim Vaks 's suggestion on structuring the types. I will attempt to try out your JSON's today and try to see if I can get a better insight on the lineage behavior with the setup.
... View more
10-13-2017
04:28 PM
@subash sharma Have taken a look at the Hive Hook code? This should give you a good idea of the approach used. I don't know if that will be sufficient for all your needs, but it should give you a good idea on how to approach the problem. Hope this helps.
... View more
10-09-2017
04:42 PM
If you could let us know these details, it will help in getting towards a solution: What are the deployment environment details? How was the build done? Information about Maven parameters will help. Is it SSL or non-SSL environment? Is Kerboros used? When atlas_start.py is executed, do you see new process getting created? If yes, what are the classpath details?
... View more
10-05-2017
05:49 PM
That is correct. The ZIP file has the output and the TXT is the input.
... View more
10-04-2017
08:38 PM
I copied the JSON contents from the create-hive-table-entity.txt to a file entity-create.json. Now I had to make a change to it so that the hive_db guid present in it had to be replaced with a guid of an already existing database. I replaced 90a7d3af-873a-4c10-a815-069f2d47d490 with 53ce4850-803e-457f-9f41-dfd01a761d9c. I used this CURL command: curl -k -X POST -u admin:admin -H "Content-Type: application/json" -H "Cache-Control: no-cache" "https://localhost:21443/api/atlas/v2/entity" -d @../docs/entity-create.json I was able to create the entities. Note that my instance of Atlas has SSL enabled. Can you please attempt this and let me know the results.
... View more
10-03-2017
08:51 PM
Let me attempt to answer all your questions: 1. Think of composite as composition in object oriented design world. An entity is part of the dependent entity. The lifetime of the child (contained entity) is determined by its parent. Child cannot exist without the parent. 2. I don't think there is a place where all of this is defined. We should definitely improve on our documentation. Here's link to code where this is defined. It is not ideal but better than nothing. 3. Relationships is a new concept. This implementation is only is master now. There is backward compatibility. Here's what the concept is: So far (before relationships) we would define associations between 2 entities as containment just by referencing one entity into another. See hive model in branch 0.8. Relationships merely allow you to capture this more comprehensively by modeling it separately. This will be apparent if you simply compare the hive model in master and branch-0.8. 4. For defining entities with composition, you could useAtlasEntity.AtlasEntityWithExtInfo. Add parent entity to the constructor and define the entities referenced as AtlasObjectIds. The creation API will take care of resolving the references. I am attaching JSON for reference. CURL entity creation is also added for reference. Also see these object diagrams. Hope this helps. @Sarath Subramanian Thanks for your help in drafting this reply. hive-table-sample.zipcreate-hive-table-entity.txt
... View more