Where is import-hive.sh in HDP 2.5.3

[#1]

Installing Atlas with HDP 2.5.3, but could not locate import-hive.sh

It used to be under either folder

/usr/hdp/current/atlas-server/bin/
/usr/hdp/current/atlas-server/hook-bin/

But in HDP 2.5.3, it is no longer there

[root@qwang-hdp3 ~]# ll /usr/hdp/2.5.3.0-37/atlas/bin
total 56
-rwxr-xr-x. 1 root root  1394 Nov 30 04:50 atlas_admin.py
-rwxr-xr-x. 1 root root  2848 Nov 30 04:50 atlas_client_cmdline.py
-rwxr-xr-x. 1 root root 16576 Nov 30 04:50 atlas_config.py
-rwxr-xr-x. 1 root root  1491 Nov 30 04:50 atlas_kafka_setup_hook.py
-rwxr-xr-x. 1 root root  1481 Nov 30 04:50 atlas_kafka_setup.py
-rwxr-xr-x. 1 root root  6093 Nov 30 04:50 atlas_start.py
-rwxr-xr-x. 1 root root  2266 Nov 30 04:50 atlas_stop.py
-rwxr-xr-x. 1 root root  1965 Nov 30 04:50 cputil.py
-rwxr-xr-x. 1 root root  1574 Nov 30 04:50 quick_start.py

Without the script, no Hive schema is synced in atlas after install

[#2 · Accepted solution]

@Qi Wang

I can see that in the right location, can you please redploy and see if this issue persists for you

>>>>>>># ls -lrt /usr/hdp/current/atlas-server/hook-bin/
total 88
-rwxr-xr-x 1 root root  3621 Nov 29 10:55 import-hive.sh
-rwxr-xr-x 1 root root  1491 Nov 29 11:17 atlas_kafka_setup_hook.py
-rwxr-xr-x 1 root root 16576 Nov 29 11:17 atlas_config.py
-rwxr-xr-x 1 root root  2848 Nov 29 11:17 atlas_client_cmdline.py
-rw-r--r-- 1 root root  1029 Nov 29 11:19 atlas_kafka_setup_hook.pyo
-rw-r--r-- 1 root root  1029 Nov 29 11:19 atlas_kafka_setup_hook.pyc
-rw-r--r-- 1 root root 20211 Nov 29 11:19 atlas_config.pyo
-rw-r--r-- 1 root root 20211 Nov 29 11:19 atlas_config.pyc
-rw-r--r-- 1 root root  2322 Nov 29 11:19 atlas_client_cmdline.pyo
-rw-r--r-- 1 root root  2322 Nov 29 11:19 atlas_client_cmdline.pyc




>>>>>>># ls -lrt /usr/hdp/2.5.3.0-35/atlas/hook-bin/
total 88
-rwxr-xr-x 1 root root  3621 Nov 29 10:55 import-hive.sh
-rwxr-xr-x 1 root root  1491 Nov 29 11:17 atlas_kafka_setup_hook.py
-rwxr-xr-x 1 root root 16576 Nov 29 11:17 atlas_config.py
-rwxr-xr-x 1 root root  2848 Nov 29 11:17 atlas_client_cmdline.py
-rw-r--r-- 1 root root  1029 Nov 29 11:19 atlas_kafka_setup_hook.pyo
-rw-r--r-- 1 root root  1029 Nov 29 11:19 atlas_kafka_setup_hook.pyc
-rw-r--r-- 1 root root 20211 Nov 29 11:19 atlas_config.pyo
-rw-r--r-- 1 root root 20211 Nov 29 11:19 atlas_config.pyc
-rw-r--r-- 1 root root  2322 Nov 29 11:19 atlas_client_cmdline.pyo
-rw-r--r-- 1 root root  2322 Nov 29 11:19 atlas_client_cmdline.pyc

[#3]

After reinstall Atlas, still not seeing import-hive.sh. One thing I noticed is the minor version difference between your build and mine, 2.5.3.0-35 vs 2.5.3.0-37

There is no hook-bin folder under Atlas

 [root@qwang-hdp3 ~]# ll /usr/hdp/current/atlas-server/
total 40
drwxr-xr-x. 2 root  root    4096 Dec  3 03:42 bin
lrwxrwxrwx. 1 root  root      23 Dec  3 03:42 conf -> /etc/atlas/2.5.3.0-37/0
drwxr-xr-x. 2 atlas hadoop     6 Dec  3 03:42 data
-rwxr-xr-x. 1 root  root     698 Nov 30 04:34 DISCLAIMER.txt
drwxr-xr-x. 6 root  root    4096 Dec  3 03:42 docs
drwxr-xr-x. 2 root  root      33 Dec  3 03:42 examples
drwxr-xr-x. 3 root  root    4096 Dec  3 03:42 libext
-rwxr-xr-x. 1 root  root   13430 Nov 30 04:34 LICENSE
drwxr-xr-x. 2 root  root    4096 Dec  3 03:42 models
-rwxr-xr-x. 1 root  root     900 Nov 30 04:34 NOTICE
drwxr-xr-x. 3 root  root      19 Dec  3 03:42 server
[root@qwang-hdp3 ~]# ll /usr/hdp/2.5.3.0-37/atlas/
total 40
drwxr-xr-x. 2 root  root    4096 Dec  3 03:42 bin
lrwxrwxrwx. 1 root  root      23 Dec  3 03:42 conf -> /etc/atlas/2.5.3.0-37/0
drwxr-xr-x. 2 atlas hadoop     6 Dec  3 03:42 data
-rwxr-xr-x. 1 root  root     698 Nov 30 04:34 DISCLAIMER.txt
drwxr-xr-x. 6 root  root    4096 Dec  3 03:42 docs
drwxr-xr-x. 2 root  root      33 Dec  3 03:42 examples
drwxr-xr-x. 3 root  root    4096 Dec  3 03:42 libext
-rwxr-xr-x. 1 root  root   13430 Nov 30 04:34 LICENSE
drwxr-xr-x. 2 root  root    4096 Dec  3 03:42 models
-rwxr-xr-x. 1 root  root     900 Nov 30 04:34 NOTICE
drwxr-xr-x. 3 root  root      19 Dec  3 03:42 server

And under bin folder there is no import-hive.sh

[root@qwang-hdp3 ~]# ll /usr/hdp/current/atlas-server/bin/
total 56
-rwxr-xr-x. 1 root root  1394 Nov 30 04:50 atlas_admin.py
-rwxr-xr-x. 1 root root  2848 Nov 30 04:50 atlas_client_cmdline.py
-rwxr-xr-x. 1 root root 16576 Nov 30 04:50 atlas_config.py
-rwxr-xr-x. 1 root root  1491 Nov 30 04:50 atlas_kafka_setup_hook.py
-rwxr-xr-x. 1 root root  1481 Nov 30 04:50 atlas_kafka_setup.py
-rwxr-xr-x. 1 root root  6093 Nov 30 04:50 atlas_start.py
-rwxr-xr-x. 1 root root  2266 Nov 30 04:50 atlas_stop.py
-rwxr-xr-x. 1 root root  1965 Nov 30 04:50 cputil.py
-rwxr-xr-x. 1 root root  1574 Nov 30 04:50 quick_start.py
[root@qwang-hdp3 ~]# ll /usr/hdp/2.5.3.0-37/atlas/bin
total 56
-rwxr-xr-x. 1 root root  1394 Nov 30 04:50 atlas_admin.py
-rwxr-xr-x. 1 root root  2848 Nov 30 04:50 atlas_client_cmdline.py
-rwxr-xr-x. 1 root root 16576 Nov 30 04:50 atlas_config.py
-rwxr-xr-x. 1 root root  1491 Nov 30 04:50 atlas_kafka_setup_hook.py
-rwxr-xr-x. 1 root root  1481 Nov 30 04:50 atlas_kafka_setup.py
-rwxr-xr-x. 1 root root  6093 Nov 30 04:50 atlas_start.py
-rwxr-xr-x. 1 root root  2266 Nov 30 04:50 atlas_stop.py
-rwxr-xr-x. 1 root root  1965 Nov 30 04:50 cputil.py
-rwxr-xr-x. 1 root root  1574 Nov 30 04:50 quick_start.py

[#4]

The problem is gone after I did a fresh install. It may be a problem with just one repo.

[#5]

Build 35 of HDP 2.5.3 was a near final candidate, but not the final. But good to hear your problem was resolved. Weird.