Created 11-13-2018 11:05 PM
Hi ,
I have installed apache atlas on ec2 instance on single node. I did follow the steps as listed in the below link:
http://atlas.apache.org/InstallationSteps.html
I am unable to find te atlas_start.py to start the script. (I did find the script in distro/src/bin/) but couldnt run the script. I am expecting the file to be in distro/target.
Could anyone help me if I am missing something??
Thanks,
Created 11-13-2018 11:37 PM
It may be because you there may be some build failure when you tried to build the package:
# tar xvfz apache-atlas-1.1.0-sources.tar.gz # cd apache-atlas-sources-1.1.0/ #export MAVEN_OPTS="-Xms2g -Xmx2g" # mvn clean -DskipTests install # mvn clean -DskipTests package -Pdist
.
Did you notice any failure while executing any of this command?
I see that the file is already present in the Atlas 1.1.0 branch. https://github.com/apache/atlas/blob/release-1.1.0-rc0/distro/src/bin/atlas_start.py
.
Please refer to the Apache Atlas Github instructions to build your desired distro: https://github.com/apache/atlas/tree/release-1.1.0-rc0
Build Process ============= 1. Get Atlas sources to your local directory, for example with following commands $ cd <your-local-directory> $ git clone <a href="https://github.com/apache/atlas.git">https://github.com/apache/atlas.git</a> $ cd atlas # Checkout the branch or tag you would like to build # # to checkout a branch $ git checkout <branch> # to checkout a tag $ git checkout tags/<tag> 2. Execute the following commands to build Apache Atlas $ export MAVEN_OPTS="-Xms2g -Xmx2g" $ mvn clean install $ mvn clean package -Pdist
.
Created 11-13-2018 11:18 PM
If you have installed Atlas using Yum command as following OR used Ambari UI to install Atlas Service
# yum install atlas-metadata<br>
Then you should be able to see the mentioned file in some location like following:
# ls -l /usr/hdp/w.x.y.z/atlas/bin/atlas_start.py (OR) # ls -l /usr/hdp/current/atlas-client/bin/atlas_start.py # ls -l /usr/hdp/current/atlas-server/bin/atlas_start.py
Here the "w.x.y.z" will be your HDP version.
Example:
# ls -l /usr/hdp/2.6.5.0-292/atlas/bin/atlas_start.py -rwxr-xr-x. 1 atlas hadoop 6025 May 11 2018 /usr/hdp/2.6.5.0-292/atlas/bin/atlas_start.py
Please refer to the following link to install Atlas from hortonworks repo: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.5/bk_data-governance/content/ch_hdp_data_gove...
.
With HDP 2.6 you get Apache Atlas 0.8.0 See: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.5/bk_release-notes/content/comp_versions.html
With HDP 3.0 you get Apache Atlas 1.0.0 See: https://docs.hortonworks.com/HDPDocuments/HDP3/HDP-3.0.0/release-notes/content/comp_versions.html
Created 11-13-2018 11:31 PM
hi @Jay Kumar SenSharma I dont have any HDP setup. I am installing it on single node ec2 instance.
moreover in the distro, the target isnt created. I am definetly missing something
Created 11-13-2018 11:37 PM
It may be because you there may be some build failure when you tried to build the package:
# tar xvfz apache-atlas-1.1.0-sources.tar.gz # cd apache-atlas-sources-1.1.0/ #export MAVEN_OPTS="-Xms2g -Xmx2g" # mvn clean -DskipTests install # mvn clean -DskipTests package -Pdist
.
Did you notice any failure while executing any of this command?
I see that the file is already present in the Atlas 1.1.0 branch. https://github.com/apache/atlas/blob/release-1.1.0-rc0/distro/src/bin/atlas_start.py
.
Please refer to the Apache Atlas Github instructions to build your desired distro: https://github.com/apache/atlas/tree/release-1.1.0-rc0
Build Process ============= 1. Get Atlas sources to your local directory, for example with following commands $ cd <your-local-directory> $ git clone <a href="https://github.com/apache/atlas.git">https://github.com/apache/atlas.git</a> $ cd atlas # Checkout the branch or tag you would like to build # # to checkout a branch $ git checkout <branch> # to checkout a tag $ git checkout tags/<tag> 2. Execute the following commands to build Apache Atlas $ export MAVEN_OPTS="-Xms2g -Xmx2g" $ mvn clean install $ mvn clean package -Pdist
.
Created 11-13-2018 11:59 PM
hi @Jay Kumar SenSharma Thanks for the suggestions. There were few build failures. I did correct them AND after the steps atlas got successfullt installed.
p.p1 {margin: 0.0px 0.0px 0.0px 0.0px; font: 11.0px Menlo; color: #000000; background-color: #ffffff} p.p2 {margin: 0.0px 0.0px 0.0px 0.0px; font: 11.0px Menlo; color: #000000; background-color: #ffffff; min-height: 13.0px} span.s1 {font-variant-ligatures: no-common-ligatures}
./bin/atlas_start.py
configured for local elasticsearch.
elasticsearch started.
starting atlas on host localhost
starting atlas on port 21000
....
Apache Atlas Server started!!!
However when i am trying to use curl to check the atlas, its throwing an following Error:
<html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 503 </title>
</head>
<body>
<h2>HTTP ERROR: 503</h2>
<p>Problem accessing /api/atlas/admin/version. Reason:
<pre>Service Unavailable</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.14.v20161028</a><hr/>
</body>
</html>
I was checking the pom.xml file, but wasn't sure what to add or delete from the properties
Created 11-14-2018 12:01 AM
Ok as you are noticing a 503 Service Unavailable Error in Http Response which means there must be some Error logged inside the Atlas logs.
If you can take a look at the atlas logs then you will get better idea on why atlas is not responding fine.
Created 11-14-2018 12:43 AM
I am able to see something like this
p.p1 {margin: 0.0px 0.0px 0.0px 0.0px; font: 11.0px Menlo; color: #000000; background-color: #ffffff}
span.s1 {font-variant-ligatures: no-common-ligatures}
Exception caught in <EventBatchPublisher(Thread-5435, started daemon 140041392408320)>
Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/cwlogs/threads.py", line 58, in run
self._run()
File "/usr/lib/python2.7/dist-packages/cwlogs/push.py", line 1403, in _run
self._publish_event_batch()
File "/usr/lib/python2.7/dist-packages/cwlogs/push.py", line 1210, in _publish_event_batch
self.sequence_token = self._put_log_events(self.event_batch)
File "/usr/lib/python2.7/dist-packages/cwlogs/push.py", line 1248, in _put_log_events
response = self.logs_service.put_log_events(**params)
File "/root/.local/lib/python2.7/site-packages/botocore/client.py", line 320, in _api_call
return self._make_api_call(operation_name, kwargs)
File "/root/.local/lib/python2.7/site-packages/botocore/client.py", line 623, in _make_api_call
raise error_class(parsed_response, operation_name)
Created 11-14-2018 12:43 AM
@Jay Kumar SenSharmaI can see the error as
Exception caught in <EventBatchPublisher(Thread-5435, started daemon 140041392408320)>
Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/cwlogs/threads.py", line 58, in run
self._run()
File "/usr/lib/python2.7/dist-packages/cwlogs/push.py", line 1403, in _run
self._publish_event_batch()
File "/usr/lib/python2.7/dist-packages/cwlogs/push.py", line 1210, in _publish_event_batch
self.sequence_token = self._put_log_events(self.event_batch)
File "/usr/lib/python2.7/dist-packages/cwlogs/push.py", line 1248, in _put_log_events
response = self.logs_service.put_log_events(**params)
File "/root/.local/lib/python2.7/site-packages/botocore/client.py", line 320, in _api_call
return self._make_api_call(operation_name, kwargs)
File "/root/.local/lib/python2.7/site-packages/botocore/client.py", line 623, in _make_api_call
raise error_class(parsed_response, operation_name)