Support Questions

Find answers, ask questions, and share your expertise
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Advanced Search

HDF install showing HDP and HDF Components (Fresh install)

jpetro416
Expert Contributor

Created on ‎09-27-2017 09:52 PM - edited ‎08-17-2019 11:49 PM

My HDF install is showing HDP components...

39584-hdf-issue.png

I've already run:

ambari-server install-mpack --mpack=hdf-ambari-mpack-3.0.1.1-5.tar.gz --verbose


ambari-server install-mpack --mpack=hdf-ambari-mpack-3.0.1.1-5.tar.gz --verbose
Using python  /usr/bin/python
Installing management pack
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
INFO: Installing management pack hdf-ambari-mpack-3.0.1.1-5.tar.gz
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
INFO: Download management pack to temp location /var/lib/ambari-server/data/tmp/hdf-ambari-mpack-3.0.1.1-5.tar.gz
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
INFO: Expand management pack at temp location /var/lib/ambari-server/data/tmp/hdf-ambari-mpack-3.0.1.1-5/
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
INFO: Stage management pack hdf-ambari-mpack-3.0.1.1-5 to staging location /var/lib/ambari-server/resources/mpacks/hdf-ambari-mpack-3.0.1.1-5
INFO: Processing artifact hdf-service-definitions of type service-definitions in /var/lib/ambari-server/resources/mpacks/hdf-ambari-mpack-3.0.1.1-5/common-services
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
INFO: Symlink: /var/lib/ambari-server/resources/common-services/NIFI/1.0.0
INFO: Symlink: /var/lib/ambari-server/resources/common-services/NIFI/1.1.0
INFO: Symlink: /var/lib/ambari-server/resources/common-services/NIFI/1.2.0
INFO: Symlink: /var/lib/ambari-server/resources/common-services/REGISTRY/0.3.0
INFO: Symlink: /var/lib/ambari-server/resources/common-services/STREAMLINE/0.5.0
INFO: Processing artifact hdf-stack-definitions of type stack-definitions in /var/lib/ambari-server/resources/mpacks/hdf-ambari-mpack-3.0.1.1-5/stacks
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/2.0/configuration
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/2.0/hooks
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/2.0/kerberos.json
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/2.0/metainfo.xml
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/2.0/properties
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/2.0/repos
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/2.0/role_command_order.json
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/2.0/services/AMBARI_INFRA
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/2.0/services/AMBARI_METRICS
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/2.0/services/KAFKA
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/2.0/services/KERBEROS
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/2.0/services/LOGSEARCH
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/2.0/services/NIFI
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/2.0/services/RANGER
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/2.0/services/STORM
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/2.0/services/ZOOKEEPER
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/2.0/services/stack_advisor.py
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/2.0/upgrades
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/2.0/widgets.json
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/2.1/metainfo.xml
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/2.1/repos
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/2.1/services/KAFKA
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/2.1/services/NIFI
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/2.1/services/RANGER
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/2.1/services/STORM
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/2.1/services/ZOOKEEPER
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/2.1/services/stack_advisor.py
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/2.1/upgrades
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/3.0/configuration
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/3.0/metainfo.xml
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/3.0/properties
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/3.0/repos
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/3.0/services/KAFKA
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/3.0/services/NIFI
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/3.0/services/RANGER
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/3.0/services/REGISTRY
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/3.0/services/STORM
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/3.0/services/STREAMLINE
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/3.0/services/ZOOKEEPER
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/3.0/services/stack_advisor.py
INFO: Symlink: /var/lib/ambari-server/resources/stacks/HDF/3.0/upgrades
INFO: Processing artifact hdp-addon-services of type stack-addon-service-definitions in /var/lib/ambari-server/resources/mpacks/hdf-ambari-mpack-3.0.1.1-5/hdp-addon-services
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
INFO: Adjusting file permissions and ownerships
INFO: about to run command: chmod  -R  0755 /var/lib/ambari-server/resources/stacks
INFO: 
process_pid=81323
INFO: about to run command: chown  -R -L ambari /var/lib/ambari-server/resources/stacks
INFO: 
process_pid=81324
INFO: about to run command: chmod  -R  0755 /var/lib/ambari-server/resources/extensions
INFO: 
process_pid=81325
INFO: about to run command: chown  -R -L ambari /var/lib/ambari-server/resources/extensions
INFO: 
process_pid=81326
INFO: about to run command: chmod  -R  0755 /var/lib/ambari-server/resources/common-services
INFO: 
process_pid=81327
INFO: about to run command: chown  -R -L ambari /var/lib/ambari-server/resources/common-services
INFO: 
process_pid=81328
INFO: about to run command: chmod  -R  0755 /var/lib/ambari-server/resources/mpacks
INFO: 
process_pid=81329
INFO: about to run command: chown  -R -L ambari /var/lib/ambari-server/resources/mpacks
INFO: 
process_pid=81330
INFO: about to run command: chmod  -R  0755 /var/lib/ambari-server/resources/mpacks/cache
INFO: 
process_pid=81331
INFO: about to run command: chown  -R -L ambari /var/lib/ambari-server/resources/mpacks/cache
INFO: 
process_pid=81332
INFO: about to run command: chmod  -R  0755 /var/lib/ambari-server/resources/dashboards
INFO: 
process_pid=81333
INFO: about to run command: chown  -R -L ambari /var/lib/ambari-server/resources/dashboards
INFO: 
process_pid=81335
INFO: about to run command: chown  -R -L ambari /var/lib/ambari-server/resources/stacks
INFO: 
process_pid=81338
INFO: about to run command: chown  -R -L ambari /var/lib/ambari-server/resources/extensions
INFO: 
process_pid=81340
INFO: about to run command: chown  -R -L ambari /var/lib/ambari-server/resources/common-services
INFO: 
process_pid=81341
INFO: about to run command: chown  -R -L ambari /var/lib/ambari-server/resources/mpacks
INFO: 
process_pid=81342
INFO: about to run command: chown  -R -L ambari /var/lib/ambari-server/resources/mpacks/cache
INFO: 
process_pid=81343
INFO: about to run command: chown  -R -L ambari /var/lib/ambari-server/resources/dashboards
INFO: 
process_pid=81344
INFO: Management pack hdf-ambari-mpack-3.0.1.1-5 successfully installed! Please restart ambari-server.
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
Ambari Server 'install-mpack' completed successfully.
1,305 Views
0 Kudos
3 REPLIES 3

bandarusridhar1
Guru

Created ‎09-27-2017 10:11 PM

@Joe

From latest version of Ambari they are supporting both HDP and HDF installation/managing with single instance of Ambari. If you need only HDF you can even install that as well.

Link: https://docs.hortonworks.com/HDPDocuments/HDF3/HDF-3.0.1.1/index.html

Hope this helps you.

750 Views
0 Kudos

MattWho
Master Guru

Created ‎09-28-2017 12:53 PM

@Joe

In HDF 2.x and HDF 3.0.x versions, the installation of Ambari contains HDP by default. With HDF 3.0, Ambari will now support having both HDP and HDF services managed by the same Ambari.

That being said, if you intent is to install and make only HDF services available, you can add the "--purge" option to command used to install the HDF mpack. This will purge the existing HDP and replace it with HDF only.

ambari-server install-mpack --mpack=hdf-ambari-mpack-3.0.1.1-5.tar.gz --purge --verbose

Thanks,

Matt

750 Views
0 Kudos

jpetro416
Expert Contributor

Created ‎09-28-2017 01:36 PM

Matt, do you know how to do this after already running the install command? This is what I'm getting from your command: 

ambari-server install-mpack --mpack=hdf-ambari-mpack-3.0.1.1-5.tar.gz --purge --verbose
Using python  /usr/bin/python
Installing management pack
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
INFO: Installing management pack hdf-ambari-mpack-3.0.1.1-5.tar.gz
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
INFO: Download management pack to temp location /var/lib/ambari-server/data/tmp/hdf-ambari-mpack-3.0.1.1-5.tar.gz
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
INFO: Expand management pack at temp location /var/lib/ambari-server/data/tmp/hdf-ambari-mpack-3.0.1.1-5/
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
INFO: AMBARI_SERVER_LIB is not set, using default /usr/lib/ambari-server
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
INFO: about to run command: /usr/jdk64/jdk1.8.0_112/bin/java -cp '/etc/ambari-server/conf:/usr/lib/ambari-server/*:/usr/share/java/mysql-connector-java.jar' org.apache.ambari.server.checks.MpackInstallChecker --mpack-stacks HDF
INFO: 
process_pid=123456
CAUTION: You have specified the --purge option with --purge-list=['stack-definitions', 'mpacks']. This will replace all existing stack definitions, management packs currently installed.
Are you absolutely sure you want to perform the purge [yes/no]? (no)y
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
INFO: Purging existing stack definitions and management packs
INFO: Purging stack location: /var/lib/ambari-server/resources/stacks
INFO: Purging mpacks staging location: /var/lib/ambari-server/resources/mpacks
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
INFO: Stage management pack hdf-ambari-mpack-3.0.1.1-5 to staging location /var/lib/ambari-server/resources/mpacks/hdf-ambari-mpack-3.0.1.1-5
INFO: Processing artifact hdf-service-definitions of type service-definitions in /var/lib/ambari-server/resources/mpacks/hdf-ambari-mpack-3.0.1.1-5/common-services
INFO: Loading properties from /etc/ambari-server/conf/ambari.properties
Traceback (most recent call last):
  File "/usr/sbin/ambari-server.py", line 941, in <module>
    mainBody()
  File "/usr/sbin/ambari-server.py", line 911, in mainBody
    main(options, args, parser)
  File "/usr/sbin/ambari-server.py", line 863, in main
    action_obj.execute()
  File "/usr/sbin/ambari-server.py", line 78, in execute
    self.fn(*self.args, **self.kwargs)
  File "/usr/lib/python2.6/site-packages/ambari_server/setupMpacks.py", line 896, in install_mpack
    (mpack_metadata, mpack_name, mpack_version, mpack_staging_dir, mpack_archive_path) = _install_mpack(options, replay_mode)
  File "/usr/lib/python2.6/site-packages/ambari_server/setupMpacks.py", line 792, in _install_mpack
    process_service_definitions_artifact(artifact, artifact_source_dir, options)
  File "/usr/lib/python2.6/site-packages/ambari_server/setupMpacks.py", line 515, in process_service_definitions_artifact
    create_symlink(src_service_definitions_dir, dest_service_definitions_dir, file, options.force)
  File "/usr/lib/python2.6/site-packages/ambari_server/setupMpacks.py", line 235, in create_symlink
    create_symlink_using_path(src_path, dest_link, force)
  File "/usr/lib/python2.6/site-packages/ambari_server/setupMpacks.py", line 247, in create_symlink_using_path
    sudo.symlink(src_path, dest_link)
  File "/usr/lib/python2.6/site-packages/resource_management/core/sudo.py", line 123, in symlink
    os.symlink(source, link_name)
OSError: [Errno 17] File exists
750 Views
0 Kudos
Take a Tour of the Community
Don't have an account?
Register
Your experience may be limited. Sign in to explore more.
Announcements
Community Announcements
March 2023 Community Highlights
What's New @ Cloudera
Cloudera DataFlow Designer for self-service data flow development is now generally available to all CDP Public Cloud customers
What's New @ Cloudera
Cloudera Operational Database (COD) UI provides the JWT configuration details to connect to your HBase client
What's New @ Cloudera
Cloudera Operational Database (COD) UI allows storage type selection when creating an operational database
What's New @ Cloudera
Release of Cloudera Streaming Analytics (CSA) 1.9.0 for CDP 7.1.7 SP2 & CDP 7.1.8
View More Announcements