Member since
05-05-2016
8
Posts
2
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
978 | 06-09-2016 01:01 PM |
09-20-2016
02:44 AM
I have figured out a solution. For anyone who is
interested in this particular problem the approach that I took was to run the
following commands: curl -u admin:admin -H "X-Requested-By:ambari"
-iX PUT -d @<json-file>
http://<ambari-server>:8080/api/v1/clusters/<cluster-name>; where <json-file> has the same structure as
mentioned in @Ian Roberts solution. Note that 'tag' needs to have a unique
value. The resource manager in yarn then
needs to be restarted which can be done via: curl -u admin:admin -H "X-Requested-By:ambari"
-iX PUT -d
'{"ServiceComponentInfo":{"state":"INSTALLED"}}'
http://<ambari-server>:8080/api/v1/clusters/<cluster-name>/services/YARN/components/RESOURCEMANAGER curl -u admin:admin -H "X-Requested-By:ambari"
-iX PUT -d
'{"ServiceComponentInfo":{"state":"STARTED"}}'
http://<ambari-server>:8080/api/v1/clusters/<cluster-name>/services/YARN/components/RESOURCEMANAGER All the best, John
... View more
09-20-2016
12:00 AM
Hi @Ian Roberts, I know this is a bit of an old thread but I was wondering if you know if the syntax has changed at all with the new HDP version. I have been using HDP 2.5 sandbox and calling this gives me a 415 error indicating that application/json requests are not supported. Do you know how I can implement this programatically in the new HDP version? Thanks, John
... View more
06-09-2016
01:01 PM
1 Kudo
Hi @Sean Bhatnagar, I actually asked the same question at the following link: https://community.hortonworks.com/questions/31714/installing-atlas-06-under-hdp-24.html The jist is that you would have to do a manual install and then manage Atlas independent of Ambari. There's been a lot of discussion about a new HDP release some time this month though and it will have an even newer version of Atlas. There's been a lot of mention of version 0.7. Best regards,
John
... View more
05-11-2016
01:16 AM
Hi @drussell, Thank you very much for the help and for the informative response. It certainly sounds like there is a lot in store for Atlas. I'm not too sure of the exact extent of my project yet but I believe the data rules would be more for data validation, perhaps setting up an automatic tag or flag for invalid entries and/or categorization depending upon certain statistics (maybe low, medium, high spending for example). I've been exploring the Atlas-Ranger tech preview and have been attempting to install 0.6 on our cluster. It seems like this would be possible in 0.6 but I'm not completely sure. Thanks again, John
... View more
05-09-2016
06:51 PM
1 Kudo
Hello, I am wondering about the current Atlas functionality and the plans for Atlas moving forward. I have a project for which I would like to use Atlas but I wonder if it is the best tool for the job and if the current functionalities support the required tasks. I'm wondering about if/how Atlas can do the following tasks: - Manage unstructured data metadata that does not pass through HIVE - Import data profiling results from third party software - Track element level lineage or the lineage of particular columns of tables - Implement global rule definitions into Atlas Could Falcon be used for some of these? I'm currently using Atlas 0.5 for testing and imagine the same version will be used throughout the project. Thanks, John
... View more
Labels:
05-05-2016
07:59 PM
Hi @hduraiswamy, thank you very much. I was afraid that was the case. I was trying the Ranger-Atlas VM which used 0.6 and I was hoping there would be an easy way to implement 0.6 for web UI tag definitions.
... View more
05-05-2016
02:45 PM
Hello, I am wondering how to properly update the Atlas version from 0.5 to 0.6. I've been following the steps listed at:
http://atlas.incubator.apache.org/0.6.0-incubating/InstallationSteps.html I'm a bit unsure as to where I should place the contents within the atlas folder. I was transferring the contents of the atlas-${project.version} to my /usr/hdp/current/atlas-server/ folder, after I created a backup of the atlas-server folder. Then I created a new conf folder in /etc/atlas. I created a soft-link between the conf in the atlas-server folder and the new conf folder (mimicking the setup of the original atlas-server folder). The server seems to start when I run atlas_start.py but then if I try to run quick_start.py the command just hangs. From Ambari, I get an error about hdp version check failed. Is this the correct procedure or is there another way to update to 0.6? (Sorry I can't provide snapshots, I performed the install at home and wanted to try and update to 0.6 on our work cluster) Thanks,
John
... View more
Labels:
- Labels:
-
Apache Atlas