Member since
09-11-2015
269
Posts
281
Kudos Received
55
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3244 | 03-15-2017 07:12 AM | |
1828 | 03-14-2017 07:08 PM | |
2266 | 03-14-2017 03:36 PM | |
1867 | 02-28-2017 04:32 PM | |
1332 | 02-28-2017 10:02 AM |
09-23-2016
07:32 AM
2 Kudos
@Avijeet Dash Seems like Atlas is not in running state. Can you please provide the snapshot of atlas application.log when this issue is seen? This will help to debug the issue further.
... View more
09-23-2016
07:29 AM
2 Kudos
@Mohana Murali Gurunathan Similar question is already discussed here(https://community.hortonworks.com/questions/6922/is-it-possible-to-manage-multiple-clusters-using-o.html). Let me know if this is what you are looking for.
... View more
09-16-2016
02:37 PM
1 Kudo
@Jitendra Yadav Can you check your rule regex is as per the rules syntax? Check here: https://community.hortonworks.com/articles/14463/auth-to-local-rules-syntax.html
... View more
08-26-2016
07:00 AM
2 Kudos
@Ethan HsiehTwo authorization methods are available for Atlas: Simple and Ranger. Simple Authorization The default setting is Simple, and the following properties are automatically set under Advanced application-properties on the Advanced tab. Table: Apache Atlas Simple Authorization Property Value atlas.authorizer.impl simple atlas.auth.policy.file {{conf_dir}}/policy-store.txt The policy-store.txt file has the following format: Policy_Name;;User_Name:Operations_Allowed;;Group_Name:Operations_Allowed;;Resource_Type:Resource_Name For example: adminPolicy;;admin:rwud;;ROLE_ADMIN:rwud;;type:*,entity:*,operation:*,taxonomy:*,term:*
userReadPolicy;;readUser1:r,readUser2:r;;DATA_SCIENTIST:r;;type:*,entity:*,operation:*,taxonomy:*,term:*
userWritePolicy;;writeUser1:rwu,writeUser2:rwu;;BUSINESS_GROUP:rwu,DATA_STEWARD:rwud;;type:*,entity:*,operation:*,taxonomy:*,term:* In this example readUser1 , readUser2 , writeUser1 and writeUser2 are the user IDs, each with its corresponding access rights. The User_Name , Group_Name and Operations_Allowed are comma-separated lists. Authorizer Resource Types:
Operation Type Entity Taxonomy Term Unknown Operations_Allowed are r = read, w = write, u = update, d = delete Let me know if you have Ranger enabled in your cluster, different operations would be needed for Ranger authorization.
... View more
08-24-2016
04:38 PM
In case of embedded kafka, the auto create of topics is a configuration parameter in Kaka, which is set to true by default. With this setting, when a producer produces message for the first time, Kafka will automatically create the topic. No need for anything specific to be done by the client.
... View more
08-24-2016
03:53 PM
1 Kudo
@Sunile Manjee Atlas works with both embedded as well as standalone Kafka, it depends on how Atlas is configured. When Atlas config property "atlas.notification.embedded" is set to true, Kafka is started in embedded mode(as part of Atlas process) else it expects a standalone Kafka running in your cluster. Regarding the Kafka timeout exception, it seems like topic does not exists. So please create the topics like below. $KAFKA_HOME/bin/kafka-topics.sh --zookeeper $ZK_ENDPOINT --topic ATLAS_HOOK --create --partitions 1 --replication-factor $KAFKA_REPL_FACTOR
$KAFKA_HOME/bin/kafka-topics.sh --zookeeper $ZK_ENDPOINT --topic ATLAS_ENTITIES --create --partitions 1 --replication-factor $KAFKA_REPL_FACTOR Let me know if you are still seeing this issue. Hope this helps.
... View more
08-24-2016
04:02 AM
1 Kudo
@Sunile Manjee See this thread for examples of how to create entities: https://community.hortonworks.com/questions/41409/how-to-use-the-function-of-data-classification-of.html See this tread for examples of how to create traits (tags) https://community.hortonworks.com/questions/33501/how-to-create-attribute-sets-and-collections-using.html
... View more
08-23-2016
03:59 PM
@Sunile Manjee you can try as it is but either ways should be fine.
... View more
08-23-2016
11:00 AM
1 Kudo
@Sunile Manjee Below is an example to create type. Save below json to some file(example type.json) {
"enumTypes": [
],
"structTypes": [
],
"traitTypes": [
],
"classTypes": [
{
"superTypes": [
],
"hierarchicalMetaTypeName": "org.apache.atlas.typesystem.types.ClassType",
"typeName": "myNewType1",
"typeDescription": null,
"attributeDefinitions": [
{
"name": "multiplicityRequired",
"dataTypeName": "string",
"multiplicity": "required",
"isComposite": true,
"isUnique": true,
"isIndexable": true,
"reverseAttributeName": null
}
]
}
]
}
Submit HTTP POST request to atlas to create a type of above. Command:
curl -X POST -d @type.json -u <username>:<password> -H 'Content-Type: application/json; charset=UTF-8' http(s)://<atlas-hostname>:<atlas-port>/api/atlas/types
Output:
{"requestId":"qtp513700442-26 - b84cee5b-7940-4308-a35b-fc9af5de0b81","types":[{"name":"myNewType1"}]}
Please refer to this post for more information: https://community.hortonworks.com/content/kbentry/124/atlas-api-tips-create-trait-type-example.html Hope this helps.
... View more
08-19-2016
07:56 PM
1 Kudo
@Ethan Hsieh Can you paste the console output for the executed sqoop command here? Also please make sure to add the atlas.rest.address property to the sqoop-site.xml or atlas-application.properties file and run the command to see if there is any difference.
... View more