question Re: Where can i find atlas_start.py? in Archives of Support Questions (Read Only)

Where can i find atlas_start.py?

anjiraju33 — Wed, 14 Nov 2018 07:05:53 GMT

Hi ,

I have installed apache atlas on ec2 instance on single node. I did follow the steps as listed in the below link:

http://atlas.apache.org/InstallationSteps.html

I am unable to find te atlas_start.py to start the script. (I did find the script in distro/src/bin/) but couldnt run the script. I am expecting the file to be in distro/target.

Could anyone help me if I am missing something??

Thanks,

Re: Where can i find atlas_start.py?

jsensharma — Wed, 14 Nov 2018 07:18:27 GMT

@Anji Raju

If you have installed Atlas using Yum command as following OR used Ambari UI to install Atlas Service

# yum install atlas-metadata<br>

Then you should be able to see the mentioned file in some location like following:

# ls -l /usr/hdp/w.x.y.z/atlas/bin/atlas_start.py
(OR)
# ls -l /usr/hdp/current/atlas-client/bin/atlas_start.py
# ls -l /usr/hdp/current/atlas-server/bin/atlas_start.py

Here the "w.x.y.z" will be your HDP version.

Example:

# ls -l /usr/hdp/2.6.5.0-292/atlas/bin/atlas_start.py
-rwxr-xr-x. 1 atlas hadoop 6025 May 11  2018 /usr/hdp/2.6.5.0-292/atlas/bin/atlas_start.py

Please refer to the following link to install Atlas from hortonworks repo: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.5/bk_data-governance/content/ch_hdp_data_governance_install_atlas_ambari.html

With HDP 2.6 you get Apache Atlas 0.8.0 See: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.5/bk_release-notes/content/comp_versions.html

With HDP 3.0 you get Apache Atlas 1.0.0 See: https://docs.hortonworks.com/HDPDocuments/HDP3/HDP-3.0.0/release-notes/content/comp_versions.html

Re: Where can i find atlas_start.py?

anjiraju33 — Wed, 14 Nov 2018 07:31:46 GMT

hi @Jay Kumar SenSharma I dont have any HDP setup. I am installing it on single node ec2 instance.

moreover in the distro, the target isnt created. I am definetly missing something

Re: Where can i find atlas_start.py?

jsensharma — Wed, 14 Nov 2018 07:37:04 GMT

@Anji Raju

It may be because you there may be some build failure when you tried to build the package:

# tar xvfz apache-atlas-1.1.0-sources.tar.gz
# cd apache-atlas-sources-1.1.0/
#export MAVEN_OPTS="-Xms2g -Xmx2g"
# mvn clean -DskipTests install
# mvn clean -DskipTests package -Pdist

Did you notice any failure while executing any of this command?

I see that the file is already present in the Atlas 1.1.0 branch. https://github.com/apache/atlas/blob/release-1.1.0-rc0/distro/src/bin/atlas_start.py

Please refer to the Apache Atlas Github instructions to build your desired distro: https://github.com/apache/atlas/tree/release-1.1.0-rc0

Build Process
=============

1. Get Atlas sources to your local directory, for example with following commands  
   $ cd <your-local-directory>
   $ git clone <a href="https://github.com/apache/atlas.git">https://github.com/apache/atlas.git</a>
   $ cd atlas

   # Checkout the branch or tag you would like to build
   #
   # to checkout a branch
     $ git checkout <branch>

   # to checkout a tag
     $ git checkout tags/<tag>

2. Execute the following commands to build Apache Atlas

   $ export MAVEN_OPTS="-Xms2g -Xmx2g"
   $ mvn clean install
   $ mvn clean package -Pdist

Re: Where can i find atlas_start.py?

anjiraju33 — Wed, 14 Nov 2018 07:59:39 GMT

hi @Jay Kumar SenSharma Thanks for the suggestions. There were few build failures. I did correct them AND after the steps atlas got successfullt installed.

p.p1 {margin: 0.0px 0.0px 0.0px 0.0px; font: 11.0px Menlo; color: #000000; background-color: #ffffff} p.p2 {margin: 0.0px 0.0px 0.0px 0.0px; font: 11.0px Menlo; color: #000000; background-color: #ffffff; min-height: 13.0px} span.s1 {font-variant-ligatures: no-common-ligatures}

./bin/atlas_start.py

configured for local elasticsearch.

elasticsearch started.

starting atlas on host localhost

starting atlas on port 21000

....

Apache Atlas Server started!!!

However when i am trying to use curl to check the atlas, its throwing an following Error:

<html>

<head>

<title>Error 503 </title>

</head>

<body>

<h2>HTTP ERROR: 503</h2>

<p>Problem accessing /api/atlas/admin/version. Reason:

<pre>Service Unavailable</pre></p>

<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.14.v20161028</a><hr/>

</body>

</html>

I was checking the pom.xml file, but wasn't sure what to add or delete from the properties

Re: Where can i find atlas_start.py?

jsensharma — Wed, 14 Nov 2018 08:01:42 GMT

@Anji Raju

Ok as you are noticing a 503 Service Unavailable Error in Http Response which means there must be some Error logged inside the Atlas logs.

If you can take a look at the atlas logs then you will get better idea on why atlas is not responding fine.

Re: Where can i find atlas_start.py?

anjiraju33 — Wed, 14 Nov 2018 08:43:13 GMT

I am able to see something like this

p.p1 {margin: 0.0px 0.0px 0.0px 0.0px; font: 11.0px Menlo; color: #000000; background-color: #ffffff} span.s1 {font-variant-ligatures: no-common-ligatures}

Exception caught in <EventBatchPublisher(Thread-5435, started daemon 140041392408320)>

Traceback (most recent call last):

File "/usr/lib/python2.7/dist-packages/cwlogs/threads.py", line 58, in run

self._run()

File "/usr/lib/python2.7/dist-packages/cwlogs/push.py", line 1403, in _run

self._publish_event_batch()

File "/usr/lib/python2.7/dist-packages/cwlogs/push.py", line 1210, in _publish_event_batch

self.sequence_token = self._put_log_events(self.event_batch)

File "/usr/lib/python2.7/dist-packages/cwlogs/push.py", line 1248, in _put_log_events

response = self.logs_service.put_log_events(**params)

File "/root/.local/lib/python2.7/site-packages/botocore/client.py", line 320, in _api_call

return self._make_api_call(operation_name, kwargs)

File "/root/.local/lib/python2.7/site-packages/botocore/client.py", line 623, in _make_api_call

raise error_class(parsed_response, operation_name)

Re: Where can i find atlas_start.py?

anjiraju33 — Wed, 14 Nov 2018 08:43:15 GMT

@Jay Kumar SenSharmaI can see the error as

Exception caught in <EventBatchPublisher(Thread-5435, started daemon 140041392408320)>

Traceback (most recent call last):

File "/usr/lib/python2.7/dist-packages/cwlogs/threads.py", line 58, in run

self._run()

File "/usr/lib/python2.7/dist-packages/cwlogs/push.py", line 1403, in _run

self._publish_event_batch()

File "/usr/lib/python2.7/dist-packages/cwlogs/push.py", line 1210, in _publish_event_batch

self.sequence_token = self._put_log_events(self.event_batch)

File "/usr/lib/python2.7/dist-packages/cwlogs/push.py", line 1248, in _put_log_events

response = self.logs_service.put_log_events(**params)

File "/root/.local/lib/python2.7/site-packages/botocore/client.py", line 320, in _api_call

return self._make_api_call(operation_name, kwargs)

File "/root/.local/lib/python2.7/site-packages/botocore/client.py", line 623, in _make_api_call

raise error_class(parsed_response, operation_name)