Member since
07-25-2016
61
Posts
32
Kudos Received
10
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1410 | 11-14-2018 07:51 PM | |
4867 | 09-20-2018 03:48 AM | |
4332 | 09-13-2017 05:38 PM | |
4010 | 07-27-2017 06:54 PM | |
1071 | 06-30-2017 05:21 AM |
07-11-2017
08:10 AM
1 Kudo
@subash sharma, do you see the lineage graph rendered in UI when you select one of the hive column in CTAS table ? Alternatively could you issue the below curl command on one of the column guid and see if you can get edges with label "__Process.outputs" or "__Process.inputs". curl -X GET "http://localhost:21000/api/atlas/discovery/search/gremlin?query=g.V("__guid","<column_guid>").inE.toList()" Hope this helps.
... View more
06-30-2017
05:21 AM
1 Kudo
@mliem, The basic search in Atlas can be used to search using parent tag and all entities tagged with parent tag and all its sub tag will be searched. The following API can be used. Hope this helps. http://localhost:21000/api/atlas/v2/search/basic?limit=25&excludeDeletedEntities=true&typeName=hive_table&classification=PII
... View more
06-20-2017
03:50 PM
The below link have some gremlin queries (in TinkerPop2) we use in atlas https://github.com/apache/incubator-atlas/blob/master/repository/src/main/java/org/apache/atlas/util/AtlasGremlin2QueryProvider.java Gremlin doc: http://gremlindocs.spmallette.documentup.com
... View more
06-20-2017
03:38 PM
1 Kudo
@subash sharma Like @Ayub Khan mentioned currently there is no explicit REST end point to fetch all untagged entities, filtered by type (or by any other attributes). Alternatively you could use gremlin query to fetch untagged entities and add additional filters. But please note these queries may not be efficient for large number of entities and tags in the system. Also the result of gremlin query returns a list of vertices in its raw format and needs to be mapped to atlas structure. http://localhost:21000/api/atlas/discovery/search/gremlin?query=g.V().has('__traitNames', T.notin, g.V().has('__type', 'typeSystem').filter{it.getProperty('__type.category').name() == 'TRAIT'}.'__type.name'.toSet()).has('__typeName', 'hive_column').toList()
... View more
06-19-2017
05:27 PM
3 Kudos
@Laura Ngo, "options" was added to AtlasBaseTypeDef to allow additional metadata properties to be included with the type definition. These properties allow users to specify any key/value property or constraint on the type definition e.g. cluster = test_cluster contains_all_primitive_attributes=true The options map is not being used currently but added for future use cases.
... View more
06-15-2017
10:49 PM
2 Kudos
@Saba Baig, Hive have the notion of post execution hooks which handles hive events and messages. Any Hive event triggers a hook message (post execution hook) and Atlas receives and processes the hook message. When table B is created from table A - a hook message is triggered and sent out about this event and atlas updates the related entities - hive_table, hive_db. This will also be used to track lineage and other hive event information in atlas.
... View more
06-12-2017
09:28 PM
1 Kudo
The following gremlin query can also be used the get the count of entity type: http://localhost:21000/api/atlas/discovery/search/gremlin?query=g.V("__typeName", "hive_db").count() http://localhost:21000/api/atlas/discovery/search/gremlin?query=g.V("__typeName", "hive_table").count()
... View more
06-12-2017
07:38 PM
4 Kudos
Hi @Laura Ngo, The documentation for 'Atlas types' is still not updated with v2 types. It should ideally be - "Composite metatypes – Entity, Struct and Classification" Struct Type: You cannot create instances for Struct types as they do not have an identity of their own (it doesn't have a GUID), it always exists with an entity. e.g. entity attribute can be of type struct. Classification type: Each classification instance is associated with an entity. The v2 type name for "trait" is "classification" and it is derived from Struct. e.g. Associate tag/classification to an entity. Checkout Working with Atlas Tags to know more about how you can assign tag/classification to an entity.
... View more
05-09-2017
04:18 PM
can you mention the version of Apache Atlas and HDP you are using?
... View more
05-08-2017
03:56 PM
@Rajesh Reddy, the error says "Unknown superType Referenceable in definition of type hive_storagedesc". Referenceable is one of the system type in Atlas and is registered as a new type when Atlas starts for the first time. Can you copy the atlas application.log here to make sure if the type registration succeeded during atlas startup. Can you also confirm if you can see the system type - "Referenceable" in http://<atlas_url>:21000/api/atlas/types call.
... View more
- « Previous
- Next »