question Where is import-hive.sh in HDP 2.5.3 in Archives of Support Questions (Read Only)

Where is import-hive.sh in HDP 2.5.3

qiwang — Sat, 03 Dec 2016 12:34:05 GMT

Installing Atlas with HDP 2.5.3, but could not locate import-hive.sh

It used to be under either folder

/usr/hdp/current/atlas-server/bin/
/usr/hdp/current/atlas-server/hook-bin/

But in HDP 2.5.3, it is no longer there

[root@qwang-hdp3 ~]# ll /usr/hdp/2.5.3.0-37/atlas/bin
total 56
-rwxr-xr-x. 1 root root  1394 Nov 30 04:50 atlas_admin.py
-rwxr-xr-x. 1 root root  2848 Nov 30 04:50 atlas_client_cmdline.py
-rwxr-xr-x. 1 root root 16576 Nov 30 04:50 atlas_config.py
-rwxr-xr-x. 1 root root  1491 Nov 30 04:50 atlas_kafka_setup_hook.py
-rwxr-xr-x. 1 root root  1481 Nov 30 04:50 atlas_kafka_setup.py
-rwxr-xr-x. 1 root root  6093 Nov 30 04:50 atlas_start.py
-rwxr-xr-x. 1 root root  2266 Nov 30 04:50 atlas_stop.py
-rwxr-xr-x. 1 root root  1965 Nov 30 04:50 cputil.py
-rwxr-xr-x. 1 root root  1574 Nov 30 04:50 quick_start.py

Without the script, no Hive schema is synced in atlas after install

Re: Where is import-hive.sh in HDP 2.5.3

apathan — Sat, 03 Dec 2016 13:10:18 GMT

@Qi Wang

I can see that in the right location, can you please redploy and see if this issue persists for you

>>>>>>># ls -lrt /usr/hdp/current/atlas-server/hook-bin/
total 88
-rwxr-xr-x 1 root root  3621 Nov 29 10:55 import-hive.sh
-rwxr-xr-x 1 root root  1491 Nov 29 11:17 atlas_kafka_setup_hook.py
-rwxr-xr-x 1 root root 16576 Nov 29 11:17 atlas_config.py
-rwxr-xr-x 1 root root  2848 Nov 29 11:17 atlas_client_cmdline.py
-rw-r--r-- 1 root root  1029 Nov 29 11:19 atlas_kafka_setup_hook.pyo
-rw-r--r-- 1 root root  1029 Nov 29 11:19 atlas_kafka_setup_hook.pyc
-rw-r--r-- 1 root root 20211 Nov 29 11:19 atlas_config.pyo
-rw-r--r-- 1 root root 20211 Nov 29 11:19 atlas_config.pyc
-rw-r--r-- 1 root root  2322 Nov 29 11:19 atlas_client_cmdline.pyo
-rw-r--r-- 1 root root  2322 Nov 29 11:19 atlas_client_cmdline.pyc




>>>>>>># ls -lrt /usr/hdp/2.5.3.0-35/atlas/hook-bin/
total 88
-rwxr-xr-x 1 root root  3621 Nov 29 10:55 import-hive.sh
-rwxr-xr-x 1 root root  1491 Nov 29 11:17 atlas_kafka_setup_hook.py
-rwxr-xr-x 1 root root 16576 Nov 29 11:17 atlas_config.py
-rwxr-xr-x 1 root root  2848 Nov 29 11:17 atlas_client_cmdline.py
-rw-r--r-- 1 root root  1029 Nov 29 11:19 atlas_kafka_setup_hook.pyo
-rw-r--r-- 1 root root  1029 Nov 29 11:19 atlas_kafka_setup_hook.pyc
-rw-r--r-- 1 root root 20211 Nov 29 11:19 atlas_config.pyo
-rw-r--r-- 1 root root 20211 Nov 29 11:19 atlas_config.pyc
-rw-r--r-- 1 root root  2322 Nov 29 11:19 atlas_client_cmdline.pyo
-rw-r--r-- 1 root root  2322 Nov 29 11:19 atlas_client_cmdline.pyc

Re: Where is import-hive.sh in HDP 2.5.3

qiwang — Sun, 04 Dec 2016 00:40:41 GMT

After reinstall Atlas, still not seeing import-hive.sh. One thing I noticed is the minor version difference between your build and mine, 2.5.3.0-35 vs 2.5.3.0-37

There is no hook-bin folder under Atlas

 [root@qwang-hdp3 ~]# ll /usr/hdp/current/atlas-server/
total 40
drwxr-xr-x. 2 root  root    4096 Dec  3 03:42 bin
lrwxrwxrwx. 1 root  root      23 Dec  3 03:42 conf -> /etc/atlas/2.5.3.0-37/0
drwxr-xr-x. 2 atlas hadoop     6 Dec  3 03:42 data
-rwxr-xr-x. 1 root  root     698 Nov 30 04:34 DISCLAIMER.txt
drwxr-xr-x. 6 root  root    4096 Dec  3 03:42 docs
drwxr-xr-x. 2 root  root      33 Dec  3 03:42 examples
drwxr-xr-x. 3 root  root    4096 Dec  3 03:42 libext
-rwxr-xr-x. 1 root  root   13430 Nov 30 04:34 LICENSE
drwxr-xr-x. 2 root  root    4096 Dec  3 03:42 models
-rwxr-xr-x. 1 root  root     900 Nov 30 04:34 NOTICE
drwxr-xr-x. 3 root  root      19 Dec  3 03:42 server
[root@qwang-hdp3 ~]# ll /usr/hdp/2.5.3.0-37/atlas/
total 40
drwxr-xr-x. 2 root  root    4096 Dec  3 03:42 bin
lrwxrwxrwx. 1 root  root      23 Dec  3 03:42 conf -> /etc/atlas/2.5.3.0-37/0
drwxr-xr-x. 2 atlas hadoop     6 Dec  3 03:42 data
-rwxr-xr-x. 1 root  root     698 Nov 30 04:34 DISCLAIMER.txt
drwxr-xr-x. 6 root  root    4096 Dec  3 03:42 docs
drwxr-xr-x. 2 root  root      33 Dec  3 03:42 examples
drwxr-xr-x. 3 root  root    4096 Dec  3 03:42 libext
-rwxr-xr-x. 1 root  root   13430 Nov 30 04:34 LICENSE
drwxr-xr-x. 2 root  root    4096 Dec  3 03:42 models
-rwxr-xr-x. 1 root  root     900 Nov 30 04:34 NOTICE
drwxr-xr-x. 3 root  root      19 Dec  3 03:42 server

And under bin folder there is no import-hive.sh

[root@qwang-hdp3 ~]# ll /usr/hdp/current/atlas-server/bin/
total 56
-rwxr-xr-x. 1 root root  1394 Nov 30 04:50 atlas_admin.py
-rwxr-xr-x. 1 root root  2848 Nov 30 04:50 atlas_client_cmdline.py
-rwxr-xr-x. 1 root root 16576 Nov 30 04:50 atlas_config.py
-rwxr-xr-x. 1 root root  1491 Nov 30 04:50 atlas_kafka_setup_hook.py
-rwxr-xr-x. 1 root root  1481 Nov 30 04:50 atlas_kafka_setup.py
-rwxr-xr-x. 1 root root  6093 Nov 30 04:50 atlas_start.py
-rwxr-xr-x. 1 root root  2266 Nov 30 04:50 atlas_stop.py
-rwxr-xr-x. 1 root root  1965 Nov 30 04:50 cputil.py
-rwxr-xr-x. 1 root root  1574 Nov 30 04:50 quick_start.py
[root@qwang-hdp3 ~]# ll /usr/hdp/2.5.3.0-37/atlas/bin
total 56
-rwxr-xr-x. 1 root root  1394 Nov 30 04:50 atlas_admin.py
-rwxr-xr-x. 1 root root  2848 Nov 30 04:50 atlas_client_cmdline.py
-rwxr-xr-x. 1 root root 16576 Nov 30 04:50 atlas_config.py
-rwxr-xr-x. 1 root root  1491 Nov 30 04:50 atlas_kafka_setup_hook.py
-rwxr-xr-x. 1 root root  1481 Nov 30 04:50 atlas_kafka_setup.py
-rwxr-xr-x. 1 root root  6093 Nov 30 04:50 atlas_start.py
-rwxr-xr-x. 1 root root  2266 Nov 30 04:50 atlas_stop.py
-rwxr-xr-x. 1 root root  1965 Nov 30 04:50 cputil.py
-rwxr-xr-x. 1 root root  1574 Nov 30 04:50 quick_start.py

Re: Where is import-hive.sh in HDP 2.5.3

qiwang — Fri, 09 Dec 2016 10:34:45 GMT

The problem is gone after I did a fresh install. It may be a problem with just one repo.

Re: Where is import-hive.sh in HDP 2.5.3

abennett — Sat, 07 Jan 2017 09:01:10 GMT

Build 35 of HDP 2.5.3 was a near final candidate, but not the final. But good to hear your problem was resolved. Weird.