Member since
09-17-2015
436
Posts
736
Kudos Received
81
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
3608 | 01-14-2017 01:52 AM | |
5611 | 12-07-2016 06:41 PM | |
6424 | 11-02-2016 06:56 PM | |
2114 | 10-19-2016 08:10 PM | |
5552 | 10-19-2016 08:05 AM |
07-12-2016
05:32 PM
@zblanco actually no...wasn't aware of it until you pointed it out
... View more
07-12-2016
12:24 AM
1 Kudo
@zblanco I had run into same issues with trucking demo service. Once the cluster is up you can't really have one service start up another (e.g. Storm depends on Zookeeper. But if Zookeeper is down, starting storm will not start zookeeper automatically). Best you can do is to declare start dependencies for your components so that when user clicks "Start all services" (or does fresh install), the components are started in the right order (e.g. zookeeper first then storm then trucking demo). To do this you would need to modify the role_command_order.json where these dependencies are managed. Note that in Ambari 2.2 and earlier this was defined at the stack level (e.g. /var/lib/ambari-server/resources/stacks/HDP/<version>/role_command_order.json) so you could not override it from within your service code. But in Ambari 2.3 onwards you can override this at the service level itself (see AMBARI-9363) Simple example of how to do this can be seen in the instructions for doing fresh install of demo Solr service, where we are asking user to modify this file prior to install to declare a dependency of Solr on zookeeper (to ensure Solr is started after zookeeper during install): https://github.com/abajwa-hw/solr-stack#option-2-automated-deployment-of-fresh-cluster-via-blueprint Long story short: best option is to update the role_command_order.json, (restart ambari-server) and then have end users use "Start all" to start components in correct order (note: if you don't want to start a specific service, stop it and put it in maintenance mode and it should remain down)
... View more
07-11-2016
04:38 AM
@Mukesh Kumar just had a chance to look at your logs. Seems like when Ambari attempted to download the zip, there was a problem and the zip is corrupted. You can double check your sandbox has internet access (eg. by pinging hortonworks.com) and run below command to remove the incomplete download. Then follow the steps here to remove the failed install in Ambari and repeat the install steps here rm -f /tmp/nifi-*zip
... View more
07-10-2016
07:55 PM
@Peter Kim great! Please mark the answer as accepted to close the issue...so it doesn't show up on our list of open questions
... View more
07-10-2016
07:06 PM
@Peter Kim Based on the log and lsof output, it seems zeppelin server is up and running. If its not opening in the browser, you may need to disable firewalls. Can you ensure you can ping the host running zeppelin from your local host? Also try to telnet into port 9995 from your local host.
... View more
07-10-2016
06:29 PM
@Peter Kim could you check in the zeppelin logs (under /var/log/zeppelin*) if any other errors appeared this time? In the earlier log it was complaining about the screenshots subdir. If you already removed it and tried restarting Zeppelin and it still did not come up, there probably another problem as well. There was another recent fix that went in which maybe causing the problem now: https://github.com/hortonworks-gallery/zeppelin-notebooks/pull/19/commits/027f4ad29f71289121949eedd0c88f3a96439f64
... View more
07-10-2016
05:47 PM
1 Kudo
1. On HDP 2.4.x there are two options to install: one is to use the Ambari service (which is what you are using) and other option is to install manually. See tutorial for full details 2. Only error I can see is that its complaining about the screenshots dir. Can you try removing it (using command below) and restarting Zeppelin via Ambari? Then try to access Zeppelin on port 9995 on whichever node you installed on (e.g. http://<IP_OF_ZEPPELIN_NODE>:9995 rm -rf /usr/hdp/current/zeppelin-server/lib/notebook/screenshots The note.json files are sample notebooks that are installed to help beginners get started with Zeppelin. You can preview these here: https://github.com/hortonworks-gallery/zeppelin-notebooks 3. For now I would recommend keeping zeppelin.install_python_packages=false. As far as I know this option was only tested on CentOS6 so may not work on other OS's
... View more
07-10-2016
04:58 AM
4 Kudos
@Timothy Spann Ok finally got a chance to try this out. Couple of things: 1. You can remove failed installs easily in Ambari 2.4 via the UI by clicking on Nifi > Service Actions > Delete 2. Nifi is not causing the popup about HDFS/YARN configs. If you try to add ANY service it will give you the same warnings. Why? Because on sandbox they have setup their own configs to get the VM to perform on single node env, and Ambari is warning about those. I think it should be safe to ignore those. 3. Installing Nifi via Ambari was failing because of some Ambari API changes in 2.4. So any service definition written prior to 2.4 will probably fail without making some updates. I have now updated the code on the github now so should work on both Ambari 2.4, as well as earlier versions as well. So to try it out, once you have imported the 2.5 sandbox, just run the below commands and proceed with the install as usual (via 'Add service' wizard): VERSION=`hdp-select status hadoop-client | sed 's/hadoop-client - \([0-9]\.[0-9]\).*/\1/'`
rm -rf /var/lib/ambari-server/resources/stacks/HDP/$VERSION/services/NIFI
sudo git clone https://github.com/abajwa-hw/ambari-nifi-service.git /var/lib/ambari-server/resources/stacks/HDP/$VERSION/services/NIFI
service ambari restart Once installed, you can access Nifi UI on port 9090 (there is already a port forwarding rule on the VM). Also note that by default you will not see any metrics for Nifi (because Ambari Metrics is down) Screenshots @rmolina fyi...when you build your next sandbox, you should get the updated Nifi service definition automatically. So with future 2.5 sandboxes, the above manual workaround will no longer be required
... View more
07-07-2016
09:44 PM
1 Kudo
+@rmolina @Timothy Spann: What error does it fail with? Sandbox team had included the demo Nifi service definition (https://github.com/abajwa-hw/ambari-nifi-service) on 2.4 sandbox to make it easy to install Nifi for the tutorials In 2.4 the service definition was under below: /var/lib/ambari-server/resources/stacks/HDP/2.4/services/NIFI/ Can you check if NIFI dir is present under both /var/lib/ambari-server/resources/stacks/HDP/2.4/services/ and /var/lib/ambari-server/resources/stacks/HDP/2.5/services directories? If so, remove the 2.4 version and restart ambari-server before installing
... View more
07-05-2016
03:50 PM
@Sunile Manjee : See article @rmolina wrote about this (he included it in the email he sent out) https://community.hortonworks.com/articles/42213/zeppelin-ambari-view-not-being-displayed-within-sa.html
... View more