Member since
04-20-2017
39
Posts
2
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1891 | 07-28-2017 05:41 AM |
08-01-2017
09:44 AM
You could use Messaging API with Kafka to access to entities. It is very impressive.
... View more
08-01-2017
09:42 AM
@Graham Martin Thks for your expanation. I am going to install & to use Kerberos.
... View more
08-01-2017
08:09 AM
@Graham Martin Thks for your quick reply. Is there an alternative to Kerberos ? May be Apache Knox + LDAP ? I went to the link: indeed, it explains only the use of Kerberos.
... View more
08-01-2017
07:08 AM
Hello, I could access all topics on kafka without authentification. My question : how I could secure access on kafka topics ? Thks.
... View more
Labels:
- Labels:
-
Apache Atlas
-
Apache Kafka
07-28-2017
05:41 AM
Please look at: https://community.hortonworks.com/questions/115749/messaging-api-with-kafka-lineage.html
... View more
07-28-2017
05:37 AM
@Sarath Subramanian Excellent! It works. Your are the best 🙂 Thks also to @Ashutosh Mestry for helping.
... View more
07-27-2017
07:35 AM
@Ashutosh Mestry With REST APIs: it works very well. For my use case I need to use Kafka messaging.
... View more
07-26-2017
07:13 AM
Hi @Ashutosh Mestry 2 entities exist : 513cd2cd-3139-4baa-a017-16f83ca2b383: {
"requestId": "pool-2-thread-9 - 8629abee-a74c-43a4-a969-758fd20704e4",
"definition": {
"jsonClass": "org.apache.atlas.typesystem.json.InstanceSerialization$_Reference",
"id": {
"jsonClass": "org.apache.atlas.typesystem.json.InstanceSerialization$_Id",
"id": "513cd2cd-3139-4baa-a017-16f83ca2b383",
"version": 0,
"typeName": "hdfs_path",
"state": "ACTIVE"
},
"typeName": "hdfs_path",
"values": {
"name": "Data_Kafka2",
"path": "/user/data/dept.csv",
"posixPermissions": null,
"createTime": "1970-01-01T00:00:00.000Z",
"description": "Test with Kafka",
"isSymlink": false,
"extendedAttributes": null,
"numberOfReplicas": 0,
"qualifiedName": "deptData2",
"isFile": false,
"fileSize": 0,
"owner": "admin",
"modifiedTime": "1970-01-01T00:00:00.000Z",
"clusterName": null,
"group": null
},
"traitNames": [
"Catalog.Technical.IT",
"Retainable"
],
"traits": {
"Catalog.Technical.IT": {
"jsonClass": "org.apache.atlas.typesystem.json.InstanceSerialization$_Struct",
"typeName": "Catalog.Technical.IT",
"values": {
"name": "Catalog.Technical.IT",
"acceptable_use": null,
"description": "technical test",
"available_as_tag": false,
"taxonomy.namespace": "atlas.taxonomy"
}
},
"Retainable": {
"jsonClass": "org.apache.atlas.typesystem.json.InstanceSerialization$_Struct",
"typeName": "Retainable",
"values": {
"retentionPeriod": 100
}
}
},
"systemAttributes": {
"createdBy": "admin",
"modifiedBy": "admin",
"createdTime": "2017-06-28T07:32:37.288Z",
"modifiedTime": "2017-06-29T12:34:30.304Z"
}
}
}
d5c27069-d7b6-4b58-8e61-adbdc4b8d208 :
{
"requestId": "pool-2-thread-6 - e16f006a-962d-45b5-a2b6-6914ec6ea0ab",
"definition": {
"jsonClass": "org.apache.atlas.typesystem.json.InstanceSerialization$_Reference",
"id": {
"jsonClass": "org.apache.atlas.typesystem.json.InstanceSerialization$_Id",
"id": "d5c27069-d7b6-4b58-8e61-adbdc4b8d208",
"version": 0,
"typeName": "hdfs_path",
"state": "ACTIVE"
},
"typeName": "hdfs_path",
"values": {
"name": "Data_Kafka1",
"path": "/user/data/dept.csv",
"posixPermissions": null,
"createTime": "1970-01-01T00:00:00.000Z",
"description": "Test with Kafka",
"isSymlink": false,
"extendedAttributes": null,
"numberOfReplicas": 0,
"qualifiedName": "deptData",
"isFile": false,
"fileSize": 0,
"owner": "admin",
"modifiedTime": "1970-01-01T00:00:00.000Z",
"clusterName": null,
"group": null
},
"traitNames": [ ],
"traits": { },
"systemAttributes": {
"createdBy": "admin",
"modifiedBy": "admin",
"createdTime": "2017-07-21T07:40:37.357Z",
"modifiedTime": "2017-07-21T07:52:59.405Z"
}
}
}
... View more
07-26-2017
06:41 AM
Hi @Sarath Subramanian This is my message: {
"message": {
"entities": [
{
"id": {
"id": "-1467290565135246000",
"jsonClass": "org.apache.atlas.typesystem.json.InstanceSerialization$_Id",
"state": "ACTIVE",
"typeName": "hdfs_path",
"version": 0
},
"jsonClass": "org.apache.atlas.typesystem.json.InstanceSerialization$_Reference",
"traitNames": [],
"traits": {},
"typeName": "hdfs_path",
"values": {
"createTime": "1970-01-01T00:00:00.000Z",
"description": "Test with Kafka",
"extendedAttributes": null,
"isSymlink": false,
"name": "Data_Kafka",
"numberOfReplicas": 0,
"owner": "admin",
"path": "/user/data/dept.csv",
"posixPermissions": null,
"qualifiedName": "deptData"
}
}
],
"type": "ENTITY_CREATE",
"user": "admin"
},
"version": {
"version": "1.0.0"
}
}
... View more