Re: Configure ambari.properties using blueprint?

jeff1 · ‎10-19-2017

Hello, thank you for the feedback. For clarity: are you looking to bring images for HDP into Marketplace and use those? Or use Cloudbreak (which is available from Marketplace) with images for HDP that are also in Marketplace? Just want to make sure I have the distinction. Thanks, Jeff

jeff1 · ‎05-01-2017

Hello, So you are using Controller 1.14.0. A few more questions: - What HDP version are you attempting to launch? - What Cluster Type? - What is your Worker + Compute count? Spot instances? Etc? - Maybe just post the .json (that would be used for the cluster create CLI) and we can see all the options you selected. Thanks! Jeff

jeff1 · ‎02-02-2017

Hi There, can you confirm a few things: - What version of HWCloud are you using (1.8 or 1.11)? - Which Cluster Type did you choose with HDP 2.5)? - For your three nodes, that 1 Master + 3 Workers? Thanks!

jeff1 · ‎11-02-2016

Hi @Mark Miller Apologies for the confusion. We have fixed the repositories for the HDP 2.5 software (2.5.0.1-31 below) but are still fixing the HDP 2.4 software (2.4.10.0-80). Can you use an HDP 2.5 cluster configuration instead of HDP 2.4? Thanks, Jeff cc @Ram Venkatesh @Dominika B

jeff1 · ‎10-24-2016

Hi @Gerrit Slot Posting my comment here just in case: We have identified an issue with the current TP #1.7 and working to correct. Things should be squared away shortly with the repositories. Thank you!

jeff1 · ‎10-24-2016

@Gerrit Slot thank you for reaching out regarding your issues with TP #1.7. We have found the issue related to the repository and are working to correct it. And please watch our blog and HCC for announcements related to new releases and Technical Previews! Thanks.

jeff1 · ‎09-22-2016

We just updated Hortonworks Data Cloud for AWS to Technical Preview. This new TP (version #1.6) includes few bug fixes and a new Command Line Interface to help with scripting + automating cluster creation. Checkout the Release Notes for more details: http://hortonworks.github.io/hdp-aws/releasenotes/index.html Get Started and Launch Hortonworks Data Cloud in your AWS environment: http://hortonworks.github.io/hdp-aws/index.html Check it out. You can provide feedback and ask questions here at the Hortonworks Community Connection: http://hortonworks.github.io/hdp-aws/feedback/index.html#how-to-create-a-question Have fun!

jeff1 · ‎09-22-2016

We'd like to announce the immediate availability of Ambari 2.4.1. Please refer to the product documentation for more details about this maintenance release. Ambari 2.4.1 Product Documentation http://docs.hortonworks.com/HDPDocuments/Ambari/Ambari-2.4.1.0/index.html Ambari 2.4.1 Upgrade Guide http://docs.hortonworks.com/HDPDocuments/Ambari-2.4.1.0/bk_ambari-upgrade/content/upgrading_ambari.html Ambari 2.4.1 Release Notes http://docs.hortonworks.com/HDPDocuments/Ambari-2.4.1.0/bk_ambari-release-notes/content/ch_relnotes-ambari-2.4.1.0.html

jeff1 · ‎09-19-2016

Correct, if the change is non-destructive, it will be considered for a maint. release. But I should point out that the community tries to minimize this though. Cheers.

jeff1 · ‎09-07-2016

Hi @Aengus Rooney Yes, there might be an issue with & or * in passwords. We've added a note into the documentation about that limitation. As well, TP #1.5 has just been posted in case you want to re-try with the latest bits. http://hortonworks.github.io/hdp-aws/ Cheers.

jeff1 · ‎09-02-2016

What version of Ambari are you using? ambari-server --version

jeff1 · ‎08-31-2016

What is the output of the following when run on the agent host? hostname -f hadoopmaster.training

jeff1 · ‎08-22-2016

We just updated Hortonworks Data Cloud for AWS to Technical Preview #3. This update includes the following new features: Ability to use an Existing VPC for the Cloud Controller and your clusters. Centrally manage your Hive Metastore database instances, to make re-using the Metastore between clusters much easier. Optionally receive an email notification once your cluster is ready. Checkout the Release Notes for more details: http://hortonworks.github.io/hdp-aws/releasenotes/ Get Started and Launch Hortonworks Data Cloud in your AWS environment: http://hortonworks.github.io/hdp-aws/ Check it out. You can provide feedback and ask questions here at the Hortonworks Community Connection: http://hortonworks.github.io/hdp-aws/feedback/#how-to-create-a-question Have fun!

jeff1 · ‎08-22-2016

It is not possible to configure the Ambari Server instance (ambari.properties) via Blueprints. The idea is Ambari Server is already setup and configured, then you use Blueprints for cluster install. You'll need to automate running "ambari-server setup-ldap" (and the other Ambari Server setup commands), or handle modifying the ambari.properties file to get the Ambari Server configured how you want. Then use the Server with a Blueprint for cluster install. Hope this helps.

jeff1 · ‎08-18-2016

Hi, It current is not. You can manually resize scale-up/down but cannot setup auto-scaling via Hortonworks Data Cloud. We are considering this a roadmap item. Thanks.

jeff1 · ‎08-02-2016

A few weeks ago, we announced the availability of Hortonworks Connected Data Cloud for AWS Technical Preview. We have just updated the Technical Preview (to RC#36) with the following new features: Ability to manage cluster templates to make re-using cluster configurations a whole lot easier Ability to set custom properties on cluster create to fine-tune your cluster configuration Checkout the Release Notes for more details: http://hortonworks.github.io/hdp-aws/releasenotes/ Get Started and Launch Hortonworks Cloud in your AWS environment: http://hortonworks.github.io/hdp-aws/ Check it out. You can provide feedback and ask questions here at the Hortonworks Community Connection: http://hortonworks.github.io/hdp-aws/feedback/#how-to-create-a-question Have fun!

jeff1 · ‎07-27-2016

Thanks @milind pandit for posting this summary! FWIW: folks can find out some more here too... https://hortonworks.com/blog/quickly-launch-hortonworks-data-platform-amazon-web-services/ Have fun!

jeff1 · ‎06-03-2016

Wonder if you are hitting this issue? https://issues.apache.org/jira/browse/AMBARI-13875 It's fixed in Ambari 2.2+. The latest Ambari is 2.2.2.0 and upgrade docs / general docs can be found here: http://docs.hortonworks.com/HDPDocuments/Ambari/Ambari-2.2.2.0/index.html

jeff1 · ‎06-02-2016

Also note, config changes are logged to: /var/log/ambari-server/ambari-config-changes.log

jeff1 · ‎06-01-2016

Correct, there is no current "lockout" feature in Ambari when using the default Local user store. Please file an Improvement JIRA in Ambari project. This is a good enhancements to consider. Note: You can set users as Active/Inactive if you want to lockout users. And also Note: it's always best practice to make sure to change the default password for the admin user out of the box.

jeff1 · ‎05-31-2016

If you are asking about Ambari: To change the Ambari DB: you can re-run "ambari-server setup", enter the "advanced database configuration" section and setup for the DB you want to use. You are responsible for migrating the data from the embedded PostgreSQL to the SQL DB you plan to use. If you are asking about Hive: To change the Hive DB (after installing your cluster and leaving Ambari to install a default MySQL instance), you can modify the database settings in Services > Hive > Configs and choose "Existing MySQL" (or other option) that you can point to your own MySQL instance. Refer to this section of the docs for how to setup Hive to use an existing MySQL database (i.e. not the MySQL that Ambari has installed by default to use with Hive). http://docs.hortonworks.com/HDPDocuments/Ambari-2.2.2.0/bk_ambari_reference_guide/content/ch_amb_ref_using_non_default_databases.html

jeff1 · ‎05-31-2016

The design was to leave space to handle more than one cluster at a time in a single Ambari Server instance. Maybe Ambari could have a convenient resource /api/v1/cluster (like you mention) that will convert to the [0] cluster automatically? If that makes sense, maybe file that JIRA in Ambari project?

jeff1 · ‎05-23-2016

Can you post the tail of ambari-server.log? Likely an exception in there

jeff1 · ‎05-23-2016

There is also an Ambari project wiki page on using the Ambari API for Kerberos: https://cwiki.apache.org/confluence/display/AMBARI/Automated+Kerberizaton

jeff1 · ‎05-23-2016

In case you want to perform this via the UI, the docs for enabling Kerberos via Ambari can be found here: http://docs.hortonworks.com/HDPDocuments/Ambari-2.2.2.0/bk_Ambari_Security_Guide/content/ch_configuring_amb_hdp_for_kerberos.html Including a section on setting up an MIT KDC: http://docs.hortonworks.com/HDPDocuments/Ambari-2.2.2.0/bk_Ambari_Security_Guide/content/_optional_install_a_new_mit_kdc.html

jeff1 · ‎05-23-2016

FWIW, There is API info on how to determine and restart host components on a given host. https://cwiki.apache.org/confluence/display/AMBARI/Restart+Host+Components And this is the JIRA for Ambari to support auto-start of services + components: https://issues.apache.org/jira/browse/AMBARI-2330

jeff1 · ‎05-20-2016

Latest / Trunk code for the Grafana DataSource can be found here... https://github.com/apache/ambari/tree/trunk/ambari-metrics/ambari-metrics-grafana

jeff1 · ‎05-11-2016

I think that message is meant to be more "INFO" than "WARNING". It's checking if there is a previous ambari-env.sh.rpmsave file that was created already and letting you know since there is none, there is are no old env settings to merge. Looks like it has been changed to INFO (in future Ambari release) to avoid potential concern. https://github.com/apache/ambari/commit/a5807823299cc575e8269167a6c0f45b003bb60c

jeff1 · ‎05-11-2016

@Roberto Sancho in the browser, are you seeing an JavaScript errors?

jeff1 · ‎05-09-2016

Also you might want to checkout the Capacity Scheduler view: http://docs.hortonworks.com/HDPDocuments/Ambari-2.2.1.1/bk_ambari_views_guide/content/ch_using_capacity_scheduler_view.html

Online	Offline
Last Visited	‎05-23-2019 10:52 AM

Date Registered	‎09-29-2015 12:16 AM
Last Visited	‎05-23-2019 10:52 AM
Total Messages Posted	67
Total Kudos Received	50

Re: Configure ambari.properties using blueprint?

Re: Autoscaling on Hortonworks Connected Data Clou...

Re: Ambari Hive View: How to make Hive queries run...

Re: Ambari lockout on default authentication

Re: Ambari API Question

Re: Closed - Cloudbreak on Azure: Support for "b...

Re: Horotonworks Data Cloud error autoscaling toke...

Re: Hortonworks Cloud - minReplication issue

Re: Hortonworks Data Cloud cluster create fails si...

Re: Hortonworks Cloud for AWS Technical Preview Up...

Re: Hortonworks Data Cloud cluster create fails si...

New Hortonworks Data Cloud for AWS Technical Previ...

Product Availability: Ambari 2.4.1 is released and...

Re: Ambari release versioning

Re: hortonworks cloud for aws technical preview cr...

Re: Can someone please advise how I can get past a...

Re: Cannot Register the other hosts in the cluster...

Hortonworks Data Cloud for AWS Technical Preview #...

Re: Configure ambari.properties using blueprint?

Re: Autoscaling on Hortonworks Connected Data Clou...

Hortonworks Cloud for AWS Technical Preview Update

Re: Hortonworks Connected Data Cloud Overview

Re: Ambari Hive View: How to make Hive queries run...

Re: Does Ambari supports any kind of change manage...

Re: Ambari lockout on default authentication

Re: Un-manage mysql

Re: Ambari API Question

Re: Remove Zeppelin from Ambari then Add it back

Re: Automated Kerberos Installation and Configurat...

Re: Automated Kerberos Installation and Configurat...

Re: How to get automatically services started when...

Re: Use Grafana with Ambari as a Data Source

Re: Ambari 2.2.2 upgrade rpmsave

Re: Adding Hosts to a Cluster

Re: YARN ACLS creation from Ambari and Command lin...