Member since
09-09-2016
29
Posts
8
Kudos Received
3
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
2982 | 03-18-2017 08:42 PM | |
4403 | 09-11-2016 01:51 PM | |
1871 | 09-11-2016 01:49 PM |
03-18-2017
09:44 PM
@Asier Gomez - Do you mean disable the firewall on your local machine/computer or is there a firewall included in the Sandbox?
... View more
03-18-2017
08:42 PM
@jwhitmore solved this problem with his detailed advice on this post: https://community.hortonworks.com/questions/79042/step-12-not-showing-welcome-page-as-mentioned.html
... View more
03-18-2017
08:37 PM
Tips for others reading the above instructions: 1. For step 2, it's important you execute 'ssh -p 2222 root@localhost' AFTER ssh'g into your SANDBOX as root. In other words, locahost is relative to your sandbox. I saw similar advice on other posts but the excerpt above made it obvious. Thank you @jwhitmore for so much detail! 2. The system prompts you for the default password ('hadoop') twice, first when you ssh over port 2222 to local host ('root@localhost's password' in excerpt above) and again after the admonition to change your password ('(current) UNIX password:). Only then do you enter your NEW password. That confused me the first time round.
... View more
03-18-2017
04:06 PM
Thanks @Edgar Orendain ... I read those port-forwarding instructions too literally. Modified my ~./ssh/config using the username I created when I set up my Sandbox and was able to ssh in using the port-forwarding alias, however I still get ‘command not found’ when running ‘ambari-admin-password-reset’ as root. After setting up port-forwarding, literally typing ‘http://localhost:8888' got me to the splash screen. When I clicked on ‘Launch Dashboard’ I got a log on screen and tried ever username/password combination I could think of. No luck. Also when I try ‘http://localhost:8080’ I get an error that my browser can’t connect.
... View more
03-17-2017
10:30 AM
In that tutorial, local host (127.0.0.1) is for folks who have the Sandbox set up on a local VM (VMWare, VirtualBox, etc). It specifically says that "In case of Azure, your host can be found under Public IP Address on the dashboard." Further down in the document it says to use 'ssh <username>@<host> -p 22' to ssh into the Sandbox on Azure. Another document says to set up port-forwarding and log in as 'azure' but it doesn't tell you want azure's default password is so that doesn't 100% work: https://hortonworks.com/hadoop-tutorial/deploying-hortonworks-sandbox-on-microsoft-azure/
... View more
03-17-2017
12:28 AM
Mushtaq Rizvi - This isn't working for me, for HDP 2.5 Sandbox on Azure. See my other post 'Cannot log into Ambari Dashboard for HDP2.5 Azure Sandbox'. Any debugging tips? I tried 'ssh -p2222 root@xx.xx.xx.xx' (where IP is that of my VM). Timed out. Tried 'ssh -p2222 root@127.0.0.1'. Connection refused
... View more
03-17-2017
12:15 AM
Unfortunately, all of the below variants time-out (where xx.xxx.xx.xxxx is my VM's static IP address). Should I not be using that IP address? FYI I posted a question on that Azure article I referenced above. ssh root@xx.xxx.xx.xxx -p 2222
ssh root@xx.xxx.xx.xxx -p 2122
ssh hdfs@xx.xxx.xx.xxx -p 2222
ssh ambari@xx.xxx.xx.xxx -p 2222
... View more
03-16-2017
11:44 PM
yvora - There are no ambari logs at all in /var/log in my HDP2.5 VM; however they do exist in my HDP2.4 VM! Trying to understand the 2 other questions you shared with me. The first seems to suggest I need to run 'ambari-agent-password-reset' as user hdfs, not root? Not clear on that. I've long since changed my root password, if that's all that's about? The other one sounds promising but I'm having trouble understanding it. The Azure VM has a Docker container inside it? Wow! I thought they were competing technologies but I just found this announcement: https://azure.microsoft.com/en-us/blog/running-docker-container-on-azure-batch ! So if I'm understanding correctly, I ssh in on port 2222 to log into the Docker container with the VM? Just tried that though and it didn't work (timed out). Same with 2122 (also mentioned in that post).
... View more
03-16-2017
10:09 PM
Thanks yvora ... but I'm wondering ... if the server and agent are running then howcome the 'ambari-agent-password-reset' can't be found?
... View more
03-16-2017
09:30 PM
Created a new HDP2.5 Sandbox on Azure today. I can log into Ambari Dashboard for my old HDP2.4 Sandox using http://host:8080 or http://host:8888 but not with my new HDP2.5 one. It just times out. I tried ssh'g into my Sandbox to check if Ambari was running and/or start it manually but no luck. Any advice anyone? [root@sandbox ~]# ambari-agent-password-reset
-bash: ambari-agent-password-reset: command not found
[root@sandbox ~]# ps -ef | grep Ambari
root 4772 1 2 18:53 ? 00:03:13 /usr/lib/jvm/java/bin/java -server -XX:NewRatio=3 -XX:+UseConcMarkSweepGC -XX:-UseGCOverheadLimit -XX:CMSInitiatingOccupancyFraction=60 -XX:+CMSClassUnloadingEnabled -Dsun.zip.disableMemoryMapping=true -Xms512m -Xmx2048m -XX:MaxPermSize=128m -Djava.security.auth.login.config=/etc/ambari-server/conf/krb5JAASLogin.conf -Djava.security.krb5.conf=/etc/krb5.conf -Djavax.security.auth.useSubjectCredsOnly=false -cp /etc/ambari-server/conf:/usr/lib/ambari-server/*:/usr/share/java/postgresql-jdbc.jar org.apache.ambari.server.controller.AmbariServer
root 7473 1 0 18:56 ? 00:00:00 /usr/bin/python /usr/lib/python2.6/site-packages/ambari_agent/AmbariAgent.py start
root 18654 18552 0 21:12 pts/1 00:00:00 grep --color=auto Ambari
[root@sandbox ~]# ambari-server start
-bash: ambari-server: command not found
[root@sandbox ~]# yum list | grep ambari-agent
Repodata is over 2 weeks old. Install yum-cron? Or run: yum makecache fast
[root@sandbox ~]# rpm -qa | grep ambari-server
[root@sandbox ~]#
... View more
Labels:
03-13-2017
12:24 AM
Ambari ver 2.2.1.0 came with the HDP 2.4 Sandbox I set up back around Sep 2016. I am thinking of just killing my current Sandbox and setting up a new HDP 2.5 Sandbox and am especially looking forward to Ambari ver 2.4 because of its feature list. I would like to hear from anyone who already has the HDP 2.5 Sandbox set up on Azure to confirm that hope, as the Azure Marketplace item doesn't go into much detail.
... View more
03-05-2017
10:09 PM
@Attila Kanto - I see no option in Ambari to remove Atlas (which is an upgrade prerequisite), i.e. no 'Delete' option under 'Service Actions' for Atlas. After some research, realized that upgrading Ambari to 2.4 is prerequisite to upgrading HDP to 2.5 because the 'remove service' functionality was added to Ambari in 2.4: http://docs.hortonworks.com/HDPDocuments/Ambari-2.4.2.0/bk_ambari-release-notes/content/ambari_relnotes-2.4.2.0-new-features.html Related Links: https://docs.hortonworks.com/HDPDocuments/Ambari-2.4.2.0/bk_ambari-upgrade/content/upgrading_HDP_prerequisites.html http://docs.hortonworks.com/HDPDocuments/Ambari-2.4.2.0/bk_ambari-user-guide/content/removing_a_service.html
... View more
09-12-2016
12:26 PM
I agree. It was a HUGE hint. I had a few other things to think through but knowing I had to scp in as root was pivotal. Thank you! BTW the tutorial needs a little correction/elaboration on that step; not sure exactly who that needs to be communicated to?
... View more
09-11-2016
01:51 PM
3 Kudos
OK, I finally got it to work! The instruction in Step 1.4 in Section 2 of the "Learning the Ropes ..." tutorial (Sandbox in Microsoft Azure) is wrong, in 3 ways: The scp port for Azure is 22, not 2222 You must scp into Azure as root; therefore you must reset the root password in your Sandbox first using 'sudo passwd root' Your home directory is not just “RemoteUser” from root’s perspective, but /home/RemoterUser'
... View more
09-11-2016
01:49 PM
1 Kudo
OK, I finally got it to work! The instruction in Step 1.4 in Section 2 of the "Learning the Ropes ..." tutorial (Sandbox in Microsoft Azure) is wrong, in 3 ways: The scp port for Azure is 22, not 2222 You must scp into Azure as root; therefore you must reset the root password in your Sandbox first using 'sudo passwd root' Your home directory is not just “RemoteUser” from root’s perspective, but “/home/RemoterUser'
... View more
09-11-2016
02:09 AM
@slachterman The ‘Learning the Ropes’ tutorial (step 1.4 in Section 2) actually says to use localhost but I eventually realized that didn't make sense so I started using the Public IP address from my Azure Sandbox settings; that's what I mean by xx.xx.xx.xx in my subsequent posts. Sorry if that wasn't clear. I also tried my fully-qualified pubic hostname, logging in as root, and got the same result as when I used the IP address. The tutorial instructions say to use port 2222, but the SSH port is configured as 22 in my Azure Sandbox. In other words, the following 2 commands do not work. According to the console output, the file is transferred but I cannot find it anywhere on my Sandbox. scp -P 22 /Path/Somefile.txt root@40.76.83.227:/RemoteDirectory scp -P 22 /Path/Somefile.txt root@sdimant.cloudapp.azure.com:/RemoteDirectory
... View more
09-10-2016
04:38 PM
@Mayur Bhokase This did not work for me. Do you have a user on your Mac with the same name as a user on your Sandbox? Is your VM on Azure or on your machine?
... View more
09-10-2016
04:14 PM
Update: I was able to make a little progress by resetting my root password on my Sandbox (using 'sudo passwd root') and then scp'g in as root with that password. The console response makes it seems as if a file was actually transferred but I cannot find it anywhere on my Sandbox (even using 'find /*.txt'). In that case the console output was: root@xx.xx.xx.xx:'s password: Somefile.txt 100% 133KB 133.4KB/s 00:00 When I try port 2222 (as per the tutorial), I just time-out with the response below (I read in other posts that people are recommending port 22 for Azure): ssh: connect to host xx.xx.xx.xx port 2222: Operation timed out lost connection When I try to scp in as root from the web client, I'm back to ground zero: root@xx.xx.xx.xx:'s password: /Path/Somefile.txt: No such file or directory So confused ... 😞
... View more
09-10-2016
04:07 PM
It basically just says "Permission denied". MyMac:~ LocalUser$ scp -P 22 /Path/Somefile.txt RemoteUser@xx.xx.xx.xx:/RemoteUser RemoteUser@xx.xx.xx.xx:'s password: scp: /RemoteUser: Permission denied When I try port 2222 (as per the tutorial), I just time-out with: ssh: connect to host xx.xx.xx.xx port 2222: Operation timed out lost connection I was able to make a little progress by resetting my root password on my Sandbox (using 'sudo passwd root') and then scp'g in as root with that password. The console response makes it seems as if a file was actually transferred but I cannot find it anywhere on my Sandbox (even using 'find /*.txt'). In that case the console output was: root@xx.xx.xx.xx:'s password: Somefile.txt 100% 133KB 133.4KB/s 00:00 When I try to scp in as root from the web client, I'm back to ground zero: root@xx.xx.xx.xx:'s password: /Path/Somefile.txt: No such file or directory So confused ... 😞
... View more
09-10-2016
02:45 PM
@Donna Suddeth Kindly share how you solved this; I am having the same problem. CC @Simon Enion
... View more
09-10-2016
01:16 PM
I'm sorry, @Constantin Stanca ... I think I accepted your answer prematurely. I got past the password challenge, but then scp couldn't find my file so I opened a separate question "Aligning Home Directories between Sandbox and local Mac?" which is still unresolved. After some research, I am pretty sure the problem was that I running scp from inside my ssh session (trying to send a file from local to remote) which doesn't really make sense. When I run scp from a separate terminal window, I can't get past the password challenge. Also, the password I used to get past the password challenge (when I wrote back to you) was the one I used to set up my Sandbox in Azure. But I just realized that's not actually a root password, it's just a user account password. I just confirmed that by trying to "su" from within my ssh session and failing. I also tried ssh'g into my Sandbox as root and failed. How do I find and/or recover my Sandbox root password?
... View more
09-10-2016
12:50 PM
1 Kudo
I am on step 1.4 in Section 2 of the "Learning the Ropes ..." tutorial (Sandbox in Microsoft Azure). I am able to ssh into my Sandbox using the password I set up for it via Azure during initial setup. I am able to create files in my Sandbox and navigate around. But I cannot scp into the Sandbox! I am pretty sure I'm supposed to run scp from a separate terminal, although it's not 100% clear in the instructions. Assume my scp command is: scp -P 22 /Path/Somefile.txt MyName@localhost:/MyName When I run it from within the ssh session, I get: Console Response: /Path/Somefile.txt: No such file or directory This makes sense I guess because I'm supposed to be running scp from my local machine But when I run that same command from a separate terminal window, my Sandbox password is not accepted. I tried using "localhost" literally as well as replacing it with the IP address of my Sandbox host. I'm stumped. How can it be that the password which works for ssh does not work for scp?
... View more
Labels:
- Labels:
-
Hortonworks Data Platform (HDP)
09-09-2016
12:18 PM
Thank you @Constantin Stanca, that worked!
... View more
09-09-2016
01:41 AM
3 Kudos
I am able to ssh into my Sandbox on Azure but can't send a file via scp because I'm challenged for a localhost password which I do not know. Assuming my Azure username is myName, this is the command I'm running: scp -P 22 ~/Downloads/Somefile.txt MyName@localhost:/MyName The console returns with: MyName@locahost's password: I've tried my Azure password, my Mac's password, the ENTER key, and "hadoop". Nothing works. I tried both port 22 and port 2222. Please advise. I'd like to move on to some real tutorials but I can't even copy a file to my Sandbox! 😞 I get "Permission denied, please try again" and after 3 attempts "Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password)" and then "lost connection"
... View more
Labels:
- Labels:
-
Hortonworks Data Platform (HDP)