Support Questions
Find answers, ask questions, and share your expertise

Instalation of HUE using Ambari for hdp 2.6.5

Rising Star

Team ,

 

I am following below link to install managed by Ambari .

Hdp version :- 2.6.5

Ambari version :-

 

https://github.com/EsharEditor/ambari-hue-service .

 

After following  few steps and when i try to install the HUE services from ambari  i am getting below error .

 

2020-03-31 16:43:07,626 - Stack Feature Version Info: Cluster Stack=2.6, Command Stack=None, Command Version=None -> 2.6
2020-03-31 16:43:07,630 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
2020-03-31 16:43:07,631 - Group['kms'] {}
2020-03-31 16:43:07,634 - Group['livy'] {}
2020-03-31 16:43:07,634 - Group['spark'] {}
2020-03-31 16:43:07,634 - Group['ranger'] {}
2020-03-31 16:43:07,635 - Group['hue'] {}
2020-03-31 16:43:07,642 - Adding group Group['hue']
2020-03-31 16:43:07,670 - Group['hdfs'] {}
2020-03-31 16:43:07,671 - Group['zeppelin'] {}
2020-03-31 16:43:07,672 - Group['hadoop'] {}
2020-03-31 16:43:07,673 - Group['users'] {}
2020-03-31 16:43:07,673 - Group['knox'] {}
2020-03-31 16:43:07,675 - User['hive'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:07,679 - User['infra-solr'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:07,682 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:07,685 - User['superset'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:07,687 - User['oozie'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users'], 'uid': None}
2020-03-31 16:43:07,688 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:07,690 - User['ranger'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'ranger'], 'uid': None}
2020-03-31 16:43:07,691 - User['tez'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users'], 'uid': None}
2020-03-31 16:43:07,693 - User['zeppelin'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'zeppelin', u'hadoop'], 'uid': None}
2020-03-31 16:43:07,694 - User['kms'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:07,696 - User['livy'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:07,697 - User['druid'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:07,699 - User['spark'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:07,700 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users'], 'uid': None}
2020-03-31 16:43:07,701 - User['flume'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:07,703 - User['hue'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:07,721 - Adding user User['hue']
2020-03-31 16:43:08,285 - User['hdfs'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hdfs'], 'uid': None}
2020-03-31 16:43:08,288 - User['sqoop'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:08,292 - User['yarn'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:08,295 - User['hbase'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:08,297 - User['hcat'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:08,298 - User['mapred'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:08,301 - User['knox'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None}
2020-03-31 16:43:08,303 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2020-03-31 16:43:08,307 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}
2020-03-31 16:43:08,317 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] due to not_if
2020-03-31 16:43:08,317 - Directory['/tmp/hbase-hbase'] {'owner': 'hbase', 'create_parents': True, 'mode': 0775, 'cd_access': 'a'}
2020-03-31 16:43:08,318 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2020-03-31 16:43:08,319 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2020-03-31 16:43:08,320 - call['/var/lib/ambari-agent/tmp/changeUid.sh hbase'] {}
2020-03-31 16:43:08,333 - call returned (0, '57467')
2020-03-31 16:43:08,333 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase 57467'] {'not_if': '(test $(id -u hbase) -gt 1000) || (false)'}
2020-03-31 16:43:08,340 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase 57467'] due to not_if
2020-03-31 16:43:08,340 - Group['hdfs'] {}
2020-03-31 16:43:08,342 - User['hdfs'] {'fetch_nonlocal_groups': True, 'groups': ['hdfs', u'hdfs']}
2020-03-31 16:43:08,343 - User['admin'] {'fetch_nonlocal_groups': True}
2020-03-31 16:43:08,345 - FS Type: 
2020-03-31 16:43:08,346 - Directory['/etc/hadoop'] {'mode': 0755}
2020-03-31 16:43:08,362 - File['/usr/hdp/current/hadoop-client/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'root', 'group': 'hadoop'}
2020-03-31 16:43:08,363 - Writing File['/usr/hdp/current/hadoop-client/conf/hadoop-env.sh'] because contents don't match
2020-03-31 16:43:08,363 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 01777}
2020-03-31 16:43:08,377 - Repository['HDP-2.6-repo-301'] {'append_to_file': False, 'base_url': 'http://private-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.5.128-2', 'action': ['create'], 'components': [u'HDP', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-301', 'mirror_list': None}
2020-03-31 16:43:08,384 - File['/etc/yum.repos.d/ambari-hdp-301.repo'] {'content': '[HDP-2.6-repo-301]\nname=HDP-2.6-repo-301\nbaseurl=http://private-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.5.128-2\n\npath=/\nenabled=1\ngpgcheck=0'}
2020-03-31 16:43:08,385 - Writing File['/etc/yum.repos.d/ambari-hdp-301.repo'] because contents don't match
2020-03-31 16:43:08,385 - Repository with url http://public-repo-1.hortonworks.com/HDP-GPL/centos7/2.x/updates/2.6.5.1050 is not created due to its tags: set([u'GPL'])
2020-03-31 16:43:08,385 - Repository['HDP-UTILS-1.1.0.22-repo-301'] {'append_to_file': True, 'base_url': 'http://private-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/centos7', 'action': ['create'], 'components': [u'HDP-UTILS', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-301', 'mirror_list': None}
2020-03-31 16:43:08,388 - File['/etc/yum.repos.d/ambari-hdp-301.repo'] {'content': '[HDP-2.6-repo-301]\nname=HDP-2.6-repo-301\nbaseurl=http://private-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.5.128-2\n\npath=/\nenabled=1\ngpgcheck=0\n[HDP-UTILS-1.1.0.22-repo-301]\nname=HDP-UTILS-1.1.0.22-repo-301\nbaseurl=http://private-repo-1.hortonworks.com/HDP-UTILS-1.1.0.22/repos/centos7\n\npath=/\nenabled=1\ngpgcheck=0'}
2020-03-31 16:43:08,388 - Writing File['/etc/yum.repos.d/ambari-hdp-301.repo'] because contents don't match
2020-03-31 16:43:08,388 - Package['unzip'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2020-03-31 16:43:08,836 - Skipping installation of existing package unzip
2020-03-31 16:43:08,836 - Package['curl'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2020-03-31 16:43:08,919 - Skipping installation of existing package curl
2020-03-31 16:43:08,919 - Package['hdp-select'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2020-03-31 16:43:09,003 - Skipping installation of existing package hdp-select
2020-03-31 16:43:09,007 - The repository with version 2.6.5.128-2 for this command has been marked as resolved. It will be used to report the version of the component which was installed
2020-03-31 16:43:09,011 - Skipping stack-select on HUE because it does not exist in the stack-select package structure.
2020-03-31 16:43:09,257 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
2020-03-31 16:43:09,260 - Package['wget'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2020-03-31 16:43:09,428 - Skipping installation of existing package wget
2020-03-31 16:43:09,429 - Package['tar'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2020-03-31 16:43:09,561 - Skipping installation of existing package tar
2020-03-31 16:43:09,562 - Package['asciidoc'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2020-03-31 16:43:09,646 - Installing package asciidoc ('/usr/bin/yum -d 0 -e 0 -y install asciidoc')
2020-03-31 16:43:10,410 - Execution of '/usr/bin/yum -d 0 -e 0 -y install asciidoc' returned 1. Error: Nothing to do
Loaded plugins: product-id
Cannot upload enabled repos report, is this client registered?
2020-03-31 16:43:10,410 - Failed to install package asciidoc. Executing '/usr/bin/yum clean metadata'
2020-03-31 16:43:10,623 - Retrying to install package asciidoc after 30 seconds
2020-03-31 16:43:41,768 - The repository with version 2.6.5.128-2 for this command has been marked as resolved. It will be used to report the version of the component which was installed
2020-03-31 16:43:41,773 - Skipping stack-select on HUE because it does not exist in the stack-select package structure.

 

 

Any advice or solution is highly appreciated  .

 

Regards

Bharad

 

25 REPLIES 25

@bhara I believe this question was asked and answered here. Hope that helps. 

 

 

 

Bill Brooks, Community Moderator
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.

@bhara I replied on the other topic you responded on.    

 

I am shifting into high gear to get my management pack ready for the original Ambari Hue Service (3.x).

 

I should have it ready here this morning:

 

https://github.com/steven-dfheinz/HDP3-Hue-Service

https://github.com/steven-dfheinz/dfhz_hue_mpack

Rising Star

@stevenmatison 

 

Thank you Sir . We are in HDP 2.6.x and if we can get Hue 4.x management pack it would be really helpful .

 

Thanks

Bharad

Working on HDP 2.4 with hue 3.11 now.  These are the minimal required version to get the original repo working with gethue.com.  Hue and Hortonworks changed since it was created.  This is why the original repo doesn't work.


Soon as I am done I will make another one for HDP 2.x with 4.x.   

 

 

Rising Star

Thank you Sir . Just wondering what does the time like look like for both of them to be out .

 

Regards

Bharad

@bhara Sorry I don't know how long this stuff takes, sometimes takes me a few days.  I have had some issues with the HDP 2 Management Pack.

 

I did get the Hue Service working and created a repo for those required changes.   You can find that here:

https://github.com/steven-dfheinz/HDP2-Hue-Service

 

Install is very easy and it should work out of the box if there are no dependency issues.  The dependencies are documented at gethue.com.  For my test the epel repo was what I needed to get centos 7.4 ready to install everything.

 

Here are the node commands in my test to install Ambari and HDP 2.6.5:

yum install nano git wget -y
yum --enablerepo=extras install epel-release -y
wget -nv http://public-repo-1.hortonworks.com/ambari/centos6/2.x/updates/2.6.2.0/ambari.repo -O /etc/yum.repos.d/ambari.repo
yum install java java-devel mariadb mariadb-server mysql-connector-java ambari-server ambari-agent -y
ambari-server setup -s && ambari-server setup --jdbc-db=mysql --jdbc-driver=/usr/share/java/mysql-connector-java.jar && ambari-server start && ambari-agent start && service mariadb start && chkconfig mariadb on

 Next I installed ambari and then once everything was running the actual Hue Service Install is just:

 

sudo git clone https://github.com/steven-dfheinz/HDP2-Hue-Service.git /var/lib/ambari-server/resources/stacks/HDP/2.6/services/HUE
service ambari-server restart

 Then install from Ambari.  

 

I am working on a repo for Hue 4.6.0 now:

 

https://github.com/steven-dfheinz/HDP2-Hue4-Service

 

I am installing it now.  This should work, but I want to make some disclosures so you understand.  This is a custom service and not supported.   It will work just fine but you will have to do more work after "install".

 

The change from Hue3 to Hue4 is quite a bit more differences than just the required differences to make the original service work.   The Hue 3 included a configuration for "pseudo-distributed.ini".  The Hue 4 uses a default "hue.ini" file with minimal changes.

 

Once you install, you will need to make changes to the configs hue.ini via ambari as you work towards getting Hue Plugins configured: HDFS, Hive, Hbase, Zeppelin, etc.     

If you have any issues please open a new question here and tag me in it.

 

 

Rising Star

@stevenmatisonI have tried the above 4.6 approach and i am getting belwo error .

 

creating build/lib.linux-x86_64-2.7
copying _mysql_exceptions.py -> build/lib.linux-x86_64-2.7
creating build/lib.linux-x86_64-2.7/MySQLdb
copying MySQLdb/__init__.py -> build/lib.linux-x86_64-2.7/MySQLdb
copying MySQLdb/converters.py -> build/lib.linux-x86_64-2.7/MySQLdb
copying MySQLdb/connections.py -> build/lib.linux-x86_64-2.7/MySQLdb
copying MySQLdb/cursors.py -> build/lib.linux-x86_64-2.7/MySQLdb
copying MySQLdb/release.py -> build/lib.linux-x86_64-2.7/MySQLdb
copying MySQLdb/times.py -> build/lib.linux-x86_64-2.7/MySQLdb
creating build/lib.linux-x86_64-2.7/MySQLdb/constants
copying MySQLdb/constants/__init__.py -> build/lib.linux-x86_64-2.7/MySQLdb/constants
copying MySQLdb/constants/CR.py -> build/lib.linux-x86_64-2.7/MySQLdb/constants
copying MySQLdb/constants/FIELD_TYPE.py -> build/lib.linux-x86_64-2.7/MySQLdb/constants
copying MySQLdb/constants/ER.py -> build/lib.linux-x86_64-2.7/MySQLdb/constants
copying MySQLdb/constants/FLAG.py -> build/lib.linux-x86_64-2.7/MySQLdb/constants
copying MySQLdb/constants/REFRESH.py -> build/lib.linux-x86_64-2.7/MySQLdb/constants
copying MySQLdb/constants/CLIENT.py -> build/lib.linux-x86_64-2.7/MySQLdb/constants
running build_ext
building '_mysql' extension
creating build/temp.linux-x86_64-2.7
gcc -pthread -fno-strict-aliasing -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -Dversion_info=(1,2,5,'final',1) -D__version__=1.2.5 -I/usr/include/mysql -I/usr/include/python2.7 -c _mysql.c -o build/temp.linux-x86_64-2.7/_mysql.o -m64
_mysql.c:44:23: fatal error: my_config.h: No such file or directory
 #include "my_config.h"
                       ^
compilation terminated.
error: command 'gcc' failed with exit status 1
make[2]: *** [/usr/local/hue-4.6.0/desktop/core/build/MySQL-python-1.2.5/egg.stamp] Error 1
make[2]: Leaving directory `/usr/local/hue-4.6.0/desktop/core'
make[1]: *** [.recursive-install-bdist/core] Error 2
make[1]: Leaving directory `/usr/local/hue-4.6.0/desktop'
make: *** [install-desktop] Error 2

That is a dependency issue during the command "make install" for hue.  Your specific error seems to be related to python-tools and mysql client.

 

You need to make sure you have the environment ready before installing Hue.

 

https://docs.gethue.com/administrator/installation/dependencies/

 

I put them all into the service, but if your environment does not contain repos to deliver the dependencies, then they will fail.

 

 

What operating system are you testing with?

Rising Star

Hi ,

 

I am working with Red Hat Enterprise Linux Server release 7.6 (Maipo) . Let me check the dependencies once again .

Rising Star

@stevenmatison  I have installed all the dependencies .

 

and now getting into different error  .

 

File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 102, in checked_call
    tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy)
  File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 150, in _call_wrapper
    result = _call(command, **kwargs_copy)
  File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 303, in _call
    raise ExecutionFailed(err_msg, code, out, err)
resource_management.core.exceptions.ExecutionFailed: Execution of 'cd /usr/local/hue-4.6.0 && PREFIX=/usr/local make install' returned 2. "PYTHON_VER is python2.7"
ERROR: /usr/local/hue not empty. Cowardly refusing to continue.
make: *** [install-check] Error 1

Trying to get in touch with my system admin to check on this  . if you have any thoughts please let me know .

 

Regards

Bharad

 

@bhara  looking good on dependencies.  This error is from the previous install.  If you bailed out,  some of items were completed on previous  attempts.  You need to reset everything and start again.  For the error above it is just an issue with the existing symlinks (see commands below).

 

For your error just execute, and retry, or re-install

 

rm -rf /usr/local/hue
rm -rf /usr/hdp/current/hue-server
rm -rf /usr/local/hue-*

 

The full reset commands are:

 

rm -rf /var/lib/ambari-server/resources/stacks/HDP/2.6/services/HUE
rm -rf /var/lib/ambari-agent/cache/stacks/HDP/2.6/services/HUE/
rm -rf /usr/local/hue
rm -rf /usr/hdp/current/hue-server
rm -rf /usr/local/hue-*

 

If you do full reset, you have to start all over again with putting the service into the ambari-server, and restart ambari...

 

@bhara FYI:  I have an HDP2.6.5 install going now from the management pack with version 3.11.0.  Its looking good.  Tomorrow morning I should be able to release the 3.11 management pack, and then create the HDP2 + Hue 4.6.0 version.   All of this needed to be able to create 1 single management pack to cover all versions.  Quite a task....

 

 

 

Rising Star

@stevenmatison 

 

Appreciate your support sir .

 

  For the above (Hue 4.6.0 install in HDP 2.x) i tried multiple times but i was not able to get past the above steps . even though i have all the dependent packages avilable on the server i am getting below error .

copying MySQLdb/constants/ER.py -> build/lib.linux-x86_64-2.7/MySQLdb/constants
copying MySQLdb/constants/FLAG.py -> build/lib.linux-x86_64-2.7/MySQLdb/constants
copying MySQLdb/constants/REFRESH.py -> build/lib.linux-x86_64-2.7/MySQLdb/constants
copying MySQLdb/constants/CLIENT.py -> build/lib.linux-x86_64-2.7/MySQLdb/constants
running build_ext
building '_mysql' extension
creating build/temp.linux-x86_64-2.7
gcc -pthread -fno-strict-aliasing -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -Dversion_info=(1,2,5,'final',1) -D__version__=1.2.5 -I/usr/include/mysql -I/usr/include/python2.7 -c _mysql.c -o build/temp.linux-x86_64-2.7/_mysql.o -m64
_mysql.c:44:23: fatal error: my_config.h: No such file or directory
 #include "my_config.h"
                       ^
compilation terminated.
error: command 'gcc' failed with exit status 1
make[2]: *** [/usr/local/hue-4.6.0/desktop/core/build/MySQL-python-1.2.5/egg.stamp] Error 1
make[2]: Leaving directory `/usr/local/hue-4.6.0/desktop/core'
make[1]: *** [.recursive-install-bdist/core] Error 2
make[1]: Leaving directory `/usr/local/hue-4.6.0/desktop'
make: *** [install-desktop] Error 2

 

I have all the dependencies available on the server

 

sudo yum install ant asciidoc cyrus-sasl-devel cyrus-sasl-gssapi cyrus-sasl-plain gcc gcc-c++ krb5-devel libffi-devel libxml2-devel libxslt-devel make mysql mysql-devel openldap-devel python-devel sqlite-devel gmp-devel
Loaded plugins: enabled_repos_upload, package_upload, product-id, search-disabled-repos, subscription-manager
IDS_EPEL_EPEL_7_Server | 2.4 kB 00:00:00
IDS_NewRelic_RHEL7 | 2.1 kB 00:00:00
IDS_UIMS_RHEL7 | 2.1 kB 00:00:00
rhel-7-server-optional-rpms | 2.0 kB 00:00:00
rhel-7-server-rpms | 2.0 kB 00:00:00
rhel-7-server-satellite-tools-6.6-rpms | 2.1 kB 00:00:00
rhel-7-server-supplementary-rpms | 2.0 kB 00:00:00
Package ant-1.9.4-2.el7.noarch already installed and latest version
Package asciidoc-8.6.8-5.el7.noarch already installed and latest version
Package cyrus-sasl-devel-2.1.26-23.el7.x86_64 already installed and latest version
Package cyrus-sasl-gssapi-2.1.26-23.el7.x86_64 already installed and latest version
Package cyrus-sasl-plain-2.1.26-23.el7.x86_64 already installed and latest version
Package gcc-4.8.5-39.el7.x86_64 already installed and latest version
Package gcc-c++-4.8.5-39.el7.x86_64 already installed and latest version
Package krb5-devel-1.15.1-37.el7_7.2.x86_64 already installed and latest version
Package libffi-devel-3.0.13-18.el7.x86_64 already installed and latest version
Package libxml2-devel-2.9.1-6.el7_2.3.x86_64 already installed and latest version
Package libxslt-devel-1.1.28-5.el7.x86_64 already installed and latest version
Package 1:make-3.82-24.el7.x86_64 already installed and latest version
Package mysql-community-client-8.0.17-1.el7.x86_64 already installed and latest version
Package mysql-community-devel-8.0.17-1.el7.x86_64 already installed and latest version
Package openldap-devel-2.4.44-21.el7_6.x86_64 already installed and latest version
Package python-devel-2.7.5-86.el7.x86_64 already installed and latest version
Package sqlite-devel-3.7.17-8.el7_7.1.x86_64 already installed and latest version
Package 1:gmp-devel-6.0.0-15.el7.x86_64 already installed and latest version
Nothing to do
Uploading Enabled Repositories Report
Loaded plugins: product-id, subscription-manager

 

its weird behavior from ambari server and agent ..

I am out of ideas and energy for now 🙂  .I will wait for Mpack and try that . Thanks for all your efforts .

 

Regards

Bharad

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

@bhara In a previous post you got past the "Hue Service is installed" step, which means all dependencies must have not caused any errors in "make install".     Your last reply is an error in make install.    Maybe you can just try again and see if that resolves it.

 

Also make sure you have package npm and maven.

 

If you are stuck in install attempt,  you can also manually go to the node and finish the install:

 

rm -rf /usr/local/hue
cd /usr/local/hue-4.6.0 
PREFIX=/usr/local/ make install

Let this run and see if it finishes.   It is sometimes necessary to do the manual install and resolve the issues for dependency or to at least know confidently the make install works.    If it does work, the dependencies are good.   After this manual test, the next thing to do is a full reset  from ambari and try all over again.

 

Full reset is:

  1. Stop Service in Ambari
  2. Delete Service
  3. Execute the rm commands
    rm -rf /var/lib/ambari-server/resources/stacks/HDP/2.6/services/HUE
    rm -rf /var/lib/ambari-agent/cache/stacks/HDP/2.6/services/HUE/
    rm -rf /usr/local/hue
    rm -rf /usr/hdp/current/hue-server
    rm -rf /usr/local/hue-*
  4. Re-install Custom Hue Service or Install Management Pack
  5. Restart Ambari
  6. Attempt fresh install

Rising Star

@stevenmatisonI was able to resolve the dependency issue . when i run the install through Ambari its failing with the below error

 

Statement":947,"ShowDatabasesStatement":948,"ShowFunctionsStatement":949,"ShowGrantStatement":950,"ShowIndexStatement":951,"ShowLocksStatement":952,"ShowPartitionsStatement":953,"ShowRolesStatement":954,"ShowRoleStatement":955,"ShowTablesStatement":956,"ShowTableStatement":957,"ShowTblPropertiesStatement":958,"ShowTransactionsStatement":959,"ShowViewsStatement":960,"ShowColumnsStatement_EDIT":961,"ShowCreateTableStatement_EDIT":962,"ShowCurrentRolesStatement_EDIT":963,"ShowDatabasesStatement_EDIT":964,"ShowGrantStatement_EDIT":965,"ShowIndexStatement_EDIT":966,"ShowLocksStatement_EDIT":967,"ShowPartitionsStatement_EDIT":968,"ShowRoleStatement_EDIT":969,"ShowTablesStatement_EDIT":970,"ShowTableStatement_EDIT":971,"ShowTblPropertiesStatement_EDIT":972,"ShowViewsStatement_EDIT":973,"TableOrView":974,"OptionalPrincipalName":975,"OptionalPrincipalName_EDIT":976,"OptionalInOrFromDatabase":977,"OptionalLike":978,"InOrFromDatabase_EDIT":979,"Like_EDIT":980,"TargetTable":981,"OptionalFromJoinedTable":982,"TargetTable_EDIT":983,"FromJoinedTable_EDIT":984,"TableName":985,"TableName_EDIT":986,"SetClause":987,"SetClause_EDIT":988,"SetTarget":989,"UpdateSource":990,"UpdateSource_EDIT":991,"CaseWhenThenList":992,"CaseWhenThenList_EDIT":993,"CaseWhenThenListPartTwo":994,"CaseWhenThenListPartTwo_EDIT":995,"$accept":0,"$end":1},
    at Parser._raise (/usr/local/hue/node_modules/@babel/parser/lib/index.js:742:17)
    at Parser.raiseWithData (/usr/local/hue/node_modules/@babel/parser/lib/index.js:735:17)
    at Parser.raise (/usr/local/hue/node_modules/@babel/parser/lib/index.js:729:17)
    at Parser.unexpected (/usr/local/hue/node_modules/@babel/parser/lib/index.js:8757:16)
    at Parser.parseExprAtom (/usr/local/hue/node_modules/@babel/parser/lib/index.js:10052:20)
    at Parser.parseExprSubscripts (/usr/local/hue/node_modules/@babel/parser/lib/index.js:9602:23)
    at Parser.parseMaybeUnary (/usr/local/hue/node_modules/@babel/parser/lib/index.js:9582:21)
    at Parser.parseExprOps (/usr/local/hue/node_modules/@babel/parser/lib/index.js:9452:23)
    at Parser.parseMaybeConditional (/usr/local/hue/node_modules/@babel/parser/lib/index.js:9425:23)
    at Parser.parseMaybeAssign (/usr/local/hue/node_modules/@babel/parser/lib/index.js:9380:21)
    at Parser.parseExpression (/usr/local/hue/node_modules/@babel/parser/lib/index.js:9332:23)
    at Parser.parseStatementContent (/usr/local/hue/node_modules/@babel/parser/lib/index.js:11210:23)
    at Parser.parseStatement (/usr/local/hue/node_modules/@babel/parser/lib/index.js:11081:17)
    at node.body.withTopicForbiddingContext (/usr/local/hue/node_modules/@babel/parser/lib/index.js:11699:60)
    at Parser.withTopicForbiddingContext (/usr/local/hue/node_modules/@babel/parser/lib/index.js:10956:14)
    at Parser.parseFor (/usr/local/hue/node_modules/@babel/parser/lib/index.js:11699:22)
    at Parser.parseForStatement (/usr/local/hue/node_modules/@babel/parser/lib/index.js:11422:17)
    at Parser.parseStatementContent (/usr/local/hue/node_modules/@babel/parser/lib/index.js:11106:21)
    at Parser.parseStatement (/usr/local/hue/node_modules/@babel/parser/lib/index.js:11081:17)
    at Parser.parseBlockOrModuleBlockBody (/usr/local/hue/node_modules/@babel/parser/lib/index.js:11656:25)
    at Parser.parseBlockBody (/usr/local/hue/node_modules/@babel/parser/lib/index.js:11642:10)
    at Parser.parseBlock (/usr/local/hue/node_modules/@babel/parser/lib/index.js:11626:10)
    at Parser.parseFunctionBody (/usr/local/hue/node_modules/@babel/parser/lib/index.js:10634:24)
    at Parser.parseFunctionBodyAndFinish (/usr/local/hue/node_modules/@babel/parser/lib/index.js:10617:10)
    at withTopicForbiddingContext (/usr/local/hue/node_modules/@babel/parser/lib/index.js:11796:12)
    at Parser.withTopicForbiddingContext (/usr/local/hue/node_modules/@babel/parser/lib/index.js:10956:14)
    at Parser.parseFunction (/usr/local/hue/node_modules/@babel/parser/lib/index.js:11795:10)
    at Parser.parseFunctionExpression (/usr/local/hue/node_modules/@babel/parser/lib/index.js:10093:17)
    at Parser.parseExprAtom (/usr/local/hue/node_modules/@babel/parser/lib/index.js:10001:21)
    at Parser.parseExprSubscripts (/usr/local/hue/node_modules/@babel/parser/lib/index.js:9602:23)
 @ ./desktop/core/src/desktop/js/parse/sql/sqlParserRepository.js 117:11-119:34
 @ ./desktop/core/src/desktop/js/sql/sqlLocationWebWorker.js
 @ multi ./desktop/core/src/desktop/js/sql/sqlLocationWebWorker.js

npm ERR! Linux 3.10.0-514.16.1.el7.x86_64
npm ERR! argv "/usr/bin/node" "/bin/npm" "run" "webpack-workers"
npm ERR! node v6.14.0
npm ERR! npm  v3.10.10
npm ERR! code ELIFECYCLE
npm ERR! hue@4.6.0 webpack-workers: `webpack --config webpack.config.workers.js`
npm ERR! Exit status 2
npm ERR! 
npm ERR! Failed at the hue@4.6.0 webpack-workers script 'webpack --config webpack.config.workers.js'.
npm ERR! Make sure you have the latest version of node.js and npm installed.
npm ERR! If you do, this is most likely a problem with the hue package,
npm ERR! not with npm itself.
npm ERR! Tell the author that this fails on your system:
npm ERR!     webpack --config webpack.config.workers.js
npm ERR! You can get information on how to open an issue for this project with:
npm ERR!     npm bugs hue
npm ERR! Or if that isn't available, you can get their info via:
npm ERR!     npm owner ls hue
npm ERR! There is likely additional logging output above.

npm ERR! Please include the following file with any support request:
npm ERR!     /usr/local/hue/npm-debug.log
make[1]: *** [npm-install] Error 1
make[1]: Leaving directory `/usr/local/hue'
make: *** [install-env] Error 2

 

When i run manual install it suceeds .please find last few lines on manual install where it suceeded .

 

Post-processed 'jobsub/css/jobsub.css' as 'jobsub/css/jobsub.4dd97953214b.css'
Post-processed 'desktop/css/roboto.css' as 'desktop/css/roboto.895233d7bf84.css'
Post-processed 'metastore/css/metastore.css' as 'metastore/css/metastore.0bd1490fe916.css'
Post-processed 'desktop/css/bootstrap-medium-editor.css' as 'desktop/css/bootstrap-medium-editor.307d202ce21d.css'
Post-processed 'admin/css/login.css' as 'admin/css/login.a846c0e2ef65.css'
Post-processed 'admin/css/rtl.css' as 'admin/css/rtl.4c867197b256.css'
Post-processed 'oozie/css/workflow.css' as 'oozie/css/workflow.5bf771c653dc.css'
Post-processed 'debug_toolbar/css/toolbar.css' as 'debug_toolbar/css/toolbar.b35523ea26ab.css'
Post-processed 'impala/css/impala-dashboard.css' as 'impala/css/impala-dashboard.60e7988b5afe.css'
Post-processed 'desktop/css/bootstrap-daterangepicker.css' as 'desktop/css/bootstrap-daterangepicker.3b118749763b.css'
Post-processed 'desktop/css/jqCron.css' as 'desktop/css/jqCron.ad6fb9a1edc5.css'
Post-processed 'pig/css/pig.css' as 'pig/css/pig.971ef685eb43.css'
Post-processed 'oozie/css/workflow-editor.css' as 'oozie/css/workflow-editor.fb64c90799c5.css'
Post-processed 'desktop/css/bootstrap-spinedit.css' as 'desktop/css/bootstrap-spinedit.983726642cbb.css'

66 static files copied to '/usr/local/hue/build/static', 1518 unmodified, 318 post-processed.
make[1]: Leaving directory `/usr/local/hue'

 

 

 

@bhara you should be good to do a full reset and re-install and it should work.

 

Make sure you follow all the commands for reset.   If it fails again its going to be from previous attempts (not removing all parts) or dependency (should be resolved).

 

HDP 2.6.5 Hue 4.6.0 Management pack worked for me today:

 

ambari-server install-mpack --mpack=https://github.com/steven-dfheinz/dfhz_hue_mpack/raw/master/hue_mpack-4.6.0-0.0.tar.gz --verbose
ambari-server restart

 https://github.com/steven-dfheinz/dfhz_hue_mpack

Rising Star

@stevenmatison 

 

Finally i was able to install using mpack (all thanks to you )  . But hue server wont start . below is the error i am getting

 

Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/common-services/HUE/4.6.0/package/scripts/hue_server.py", line 76, in <module>
    HueServer().execute()
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 375, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/common-services/HUE/4.6.0/package/scripts/hue_server.py", line 28, in start
    self.configure(env)
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 120, in locking_configure
    original_configure(obj, *args, **kw)
  File "/var/lib/ambari-agent/cache/common-services/HUE/4.6.0/package/scripts/hue_server.py", line 23, in configure
    setup_hue()
  File "/var/lib/ambari-agent/cache/common-services/HUE/4.6.0/package/scripts/setup_hue.py", line 52, in setup_hue
    add_hdfs_configuration(params.has_ranger_admin, params.security_enabled)
  File "/var/lib/ambari-agent/cache/common-services/HUE/4.6.0/package/scripts/common.py", line 99, in add_hdfs_configuration
    add_configurations(services_configurations)
  File "/var/lib/ambari-agent/cache/common-services/HUE/4.6.0/package/scripts/common.py", line 161, in add_configurations
    Execute(cmd)
  File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__
    self.env.run()
  File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run
    self.run_action(resource, action)
  File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 124, in run_action
    provider_action()
  File "/usr/lib/ambari-agent/lib/resource_management/core/providers/system.py", line 262, in action_run
    tries=self.resource.tries, try_sleep=self.resource.try_sleep)
  File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 72, in inner
    result = function(command, **kwargs)
  File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 102, in checked_call
    tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy)
  File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 150, in _call_wrapper
    result = _call(command, **kwargs_copy)
  File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 303, in _call
    raise ExecutionFailed(err_msg, code, out, err)
resource_management.core.exceptions.ExecutionFailed: Execution of '/var/lib/ambari-agent/cache/common-services/HUE/4.6.0/package/files/configs.sh set catl0dlbd00028.corp.cox.com HDP_ANALYTICS_DEV httpfs-site 'httpfs.proxyuser.hue.groups' '*'' returned 1. [ERROR] "httpfs-site" not found in server response.
[ERROR] Output of `curl -k -s -u admin:admin "http://catl0dlbd00028.corp.cox.com:8080/api/v1/clusters/HDP_ANALYTICS_DEV?fields=Clusters/desired_configs"` is:
[ERROR]

 

@bhara  Install completed, that's some good progress!   Congrats.

 

Your start error is saying problem with:

Execution of '/var/lib/ambari-agent/cache/common-services/HUE/4.6.0/package/files/configs.sh set catl0dlbd00028.corp.cox.com HDP_ANALYTICS_DEV httpfs-site 'httpfs.proxyuser.hue.groups' '*'' returned 1. 
[ERROR] "httpfs-site" not found in server response.
[ERROR] Output of `curl -k -s -u admin:admin "http://catl0dlbd00028.corp.cox.com:8080/api/v1/clusters/HDP_ANALYTICS_DEV?fields=Clusters/desired_configs"` is: [ERROR]

You will need to fix that to get it to start.

 

In that error its trying to login to Ambari API via admin user with admin password.   Does this login work?   If your user is different or password is changed you need to adjust the ambari user credentials in this file:

/var/lib/ambari-agent/cache/common-services/HUE/4.6.0/package/files/configs.sh

Then try to start again.

 

If admin user is correct.  Then I think best bet is to comment line 92,93,94 in common.py:

/var/lib/ambari-agent/cache/common-services/HUE/4.6.0/package/scripts/common.py

Or can bypass this section entirely in params.py:

/var/lib/ambari-agent/cache/common-services/HUE/4.6.0/package/scripts/common.py

Set line X True to False (line 182)

Rising Star

@stevenmatison 

 i have changed the password  - it did not work

I have updated lines 92-94 in common.py - it did not work

i made changes to params.py - it gave the below error .

 

Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/common-services/HUE/4.6.0/package/scripts/hue_server.py", line 76, in <module>
    HueServer().execute()
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 375, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/common-services/HUE/4.6.0/package/scripts/hue_server.py", line 26, in start
    import params
  File "/var/lib/ambari-agent/cache/common-services/HUE/4.6.0/package/scripts/params.py", line 194, in <module>
    webhdfs_url = format('http://' + dfs_namenode_http_address + '/webhdfs/v1')
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/config_dictionary.py", line 73, in __getattr__
    raise Fail("Configuration parameter '" + self.name + "' was not found in configurations dictionary!")
resource_management.core.exceptions.Fail: Configuration parameter 'dfs.namenode.http-address' was not found in configurations dictionary!

and i see these (dfs.namenode.http-address are configured under HDFS configuration . Do i have to do anything separately for HUE  .

 

Regards

Bharad

Regards

Bharad

; ;