Member since
10-19-2016
151
Posts
59
Kudos Received
17
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
1792 | 03-22-2018 11:48 AM | |
2899 | 01-12-2018 06:25 PM | |
5148 | 01-12-2018 03:56 AM | |
7179 | 01-12-2018 03:38 AM | |
3706 | 01-02-2018 10:29 PM |
04-04-2017
01:36 PM
@Edgar Orendain Waiting for 15 minutes did the trick. Thanks!
... View more
03-30-2017
11:00 PM
yes, thanks it work now
... View more
04-03-2017
08:57 PM
@Francisco Pires It looks like something may have become corrupt. Here's a related docker issue (more explanatory than a solution) https://github.com/docker/docker/issues/18010 . A dmesg might help track things down
... View more
03-28-2017
01:47 AM
1 Kudo
Introduction
The Hortonworks Sandbox running on Azure requires opening ports a bit differently than when the sandbox is running locally on Virtualbox or Docker. We’ll walk through how to open a port in Azure so that outside connections make their way into the sandbox, which is a Docker container inside an Azure virtual machine.
Note: There are multiple ways to open ports to a Docker container (i.e. the sandbox). This tutorial will cover the simplest method, which reinitializes the sandbox to its original state. In other words, you will lose all changes made to the sandbox.
Prerequisites
Deploying Hortonworks Sandbox on Microsoft Azure
Outline
SSH Into The Azure VM
Add Ports to the Docker Script
Remove the Current Sandbox Container)
Restart the Azure VM
(Optional) Add New Ports to the SSH Config
SSH Into the Azure VM
If you followed the previous tutorial, Deploying Hortonworks Sandbox on Microsoft Azure, this step is as easy as running:
ssh azureSandbox
Otherwise, follow whichever method you prefer to SSH into the Azure VM that is running the sandbox.
Add Ports to the Docker Script
The script in the Azure VM that is responsible for creating the dockerized Sandbox container is located at /root/start_scripts/start_sandbox.sh .
Note: You’re probably not logged in as root, so do not forget to sudo your commands.
Open /root/start_scripts/start_sandbox.sh to reveal the docker script, which looks something like the following:
docker run -v hadoop:/hadoop --name sandbox --hostname "sandbox.hortonworks.com" --privileged -d \
-p 6080:6080 \
-p 9090:9090 \
-p 9000:9000 \
-p 8000:8000 \
-p 8020:8020 \
-p 2181:2181 \
-p 42111:42111 \
...
Edit this file and add your desired port forward. In this example, we’re going to forward host port 15000 to sandbox port 15000. The file should now look something like the following:
docker run -v hadoop:/hadoop --name sandbox --hostname "sandbox.hortonworks.com" --privileged -d \
-p 15000:15000 \
-p 6080:6080 \
-p 9090:9090 \
-p 9000:9000 \
-p 8000:8000 \
-p 8020:8020 \
-p 2181:2181 \
-p 42111:42111 \
...
Remove the Current Sandbox Container
Terminate the existing sandbox container, and then remove it.
Warning: Be aware that this deletes the sandbox, changes are not saved.
sudo docker stop sandbox
sudo docker rm sandbox
Restart the Azure VM
We now restart the Azure VM. Upon restart, the script we modified above will be run in order to start the sandbox container. Since we removed the container in the previous step, the sandbox container is first rebuilt with your newly specified port forwards.
You may restart the Azure VM by stopping and starting via the Azure Portal, or you can execute the following while SSH’d in.
sudo init 6
(Optional) Add New Ports to the SSH Config
If you’re connecting to Azure via SSH tunneling, be sure to add new forwarding directives to your SSH config. See the Deploying Hortonworks Sandbox on Microsoft Azure tutorial for more information.
... View more
Labels:
03-22-2017
11:41 PM
@Satish Duggana @Sriharsha Chintalapani The configs were the issue, thanks! I had tracked this down before and made the appropriate change, though kept running into the same problem. Debugging showed that the Kafka serializer was being intialized/configured correctly, though the issue kept coming up. The registry webservice was accessible from Storm supervisor nodes, and serializers showed the correct configs. After reading these comments, I booted up a fresh cluster, deployed the same topology with the same configs ... and wallah. I'll have to keep an eye open for what changes could have caused this, or do in the future. Thanks for prompting me to double check all of this!
... View more
03-14-2017
10:10 AM
@Sravani Yajamanam
Just a tip: you might have accidentally selected "None" in the second pane of the configuration: If this is not the case, a quick advice to circumvent similar situations in the future: you can manage deployments in the Resource Group level, if you delete the resource group of Sandbox install itself, it will remove the related resources as well (like public IP). Additionally, after a successful deployment you should check if the the "Public IP address" is present in the resource group.
... View more
03-01-2017
09:30 PM
Thanks @Patrick Picard Fixed! https://hortonworks.com/hadoop-tutorial/deploying-hortonworks-sandbox-on-microsoft-azure
... View more
02-13-2019
02:08 PM
Why would you put a Google Drive link to something protected in a blog post? 🙂
... View more
07-31-2018
01:02 PM
@Pierre Villard This works for me if I leave out the `clientID` part as NiFi will generate it's own, but I have a use case where I would like to provide my own UUID. Is this possible? I tried using `uuidgen` to get a UUID in bash but the POST then fails.
... View more
01-17-2017
08:56 PM
Fantastic, that did the trick! Thank you
... View more
- « Previous
- Next »