question Re: Not getting e-mails when starting Cloudera Live stack in Amazon. in Archives of Support Questions (Read Only)

Not getting e-mails when starting Cloudera Live stack in Amazon.

DEHallman — Thu, 11 Feb 2016 18:55:03 GMT

I registered for the demo trial and selected the Amazon Cloudera option (with Zoomdata). The first time I tried, the formation said it started, Amazon instances showed up running, and I got an e-mail directing me to the Guidance Page. I went to the Guidance Page where it showed the progress bar at 88%. But, it would not go any further and the page appeared to be looping.

I shut everything down and restarted twice. Now, I see the formation as created and the instances show up, but I get no e-mails at all. Just for fun I tried connecting to the manager node address through the browser but my browser tells me it can't find the page.

Note: I used the same Access Code for each attempt.

What am I doing wrong?

Re: Not getting e-mails when starting Cloudera Live stack in Amazon.

Sean — Thu, 11 Feb 2016 19:12:14 GMT

I would double check that your access key is correct and unique for each
attempt (if it's invalid, there unfortunately isn't a good way to notify
you). An access key is linked to specific VMs, so they're not reusable.
Also, make sure you don't reboot the instances until the initial deployment
is finished. When you reboot AWS assigns you new IPs, which the cluster can
deal with once it's running, but as long as you need external control (i.e.
for the initial deployment) the IPs must be consistent.

Anything else that depends on the user to be done correctly should result
in the stack being marked as a failure in CloudFormation, so if you're
pretty sure the above issues don't apply there may have been some other
kind of failure we should take a look at. If you would like to send me a
direct message with the access keys for your attempts I can retrieve the
detailed logs for your specific case and investigate other possibilities.

Re: Not getting e-mails when starting Cloudera Live stack in Amazon.

DEHallman — Thu, 11 Feb 2016 19:22:28 GMT

Well, that sounds like part of my problem right there. I have been using the same access key each time I've restarted. How do I get another access key associated with the information you already have?

Re: Not getting e-mails when starting Cloudera Live stack in Amazon.

DEHallman — Thu, 11 Feb 2016 19:37:02 GMT

I went ahead and registered again ( to get another access code). We'll see how this works.

Re: Not getting e-mails when starting Cloudera Live stack in Amazon.

Sean — Thu, 11 Feb 2016 20:50:14 GMT

Yeah you can register again with the same information and it should work.
If it goes wrong again, as I said - just send me the access code and I can
dig deeper.

Re: Not getting e-mails when starting Cloudera Live stack in Amazon.

DEHallman — Thu, 11 Feb 2016 22:13:46 GMT

I waited. It took a while. Now I got a page with links to tutorials/management etc. When I go to some of those pages I get asked for credentials. I have not received any additional e-mails yet. Am I supposed to get one that lists the credentials for getting into the various features (pages that are linked)?

Re: Not getting e-mails when starting Cloudera Live stack in Amazon.

Sean — Fri, 12 Feb 2016 00:10:14 GMT

Yes, you should get an email with credentials once the progress bar has
completed, however even without the email you can find the credentials to
the Hue and CM service in a file on the Master Node (you log into using the
ssh key you selected at deployment time) in the file
/var/tmp/cm_hue_admin_password.txt. Of course, usually the reason you don't
get the final email is if there's a problem in the deployment, and in that
case Hue and CM may not yet be set up properly.

I believe I found the access codes for your 2 attempts and had a look at
the logs. In one case, it looks like the machines were shutdown
mid-deployment outside of our control. It did look like the transfer of the
sample datasets from S3 were taking longer than usual, so I'll follow up on
that and see if that can be improved or if we need to adjust the time the
progress bar expects it to take. Another attempt looks like an SSH error
when setting up the Zoomdata sample datasets that might also have been a
shutdown of the instances outside our control, but I've seen the exact same
error on another Zoomdata deployment recently so that may be a bug that
I'll investigate further. I'll post back here when I have a solution
deployed or a workaround to recommend for you.

Re: Not getting e-mails when starting Cloudera Live stack in Amazon.

DEHallman — Fri, 12 Feb 2016 13:29:12 GMT

Yeah, I stopped the instances when I left last night. I just restarted them. I will look on the master node for the Hue and CM passwords. In any case this is what I'm seeing right now:

Going to look for those passwords now...

Re: Not getting e-mails when starting Cloudera Live stack in Amazon.

DEHallman — Fri, 12 Feb 2016 13:42:27 GMT

OK. I found the password file. My browser is showing the following while waiting for that nice link page:

This is what it was doing yesterday. It would flip between this and showing the progress bar. At some point it will succeed and I'll see the links page.

Re: Not getting e-mails when starting Cloudera Live stack in Amazon.

DEHallman — Fri, 12 Feb 2016 13:47:42 GMT

Decided to go to the Hue port directly. It looks to be up:

Re: Not getting e-mails when starting Cloudera Live stack in Amazon.

DEHallman — Fri, 12 Feb 2016 13:56:24 GMT

Went against the default Cloudera Manager port:

That looks to be up to although I have not worked with it before.

Re: Not getting e-mails when starting Cloudera Live stack in Amazon.

Sean — Fri, 12 Feb 2016 15:34:17 GMT

So if you restarted your instances before the deployment finished, the dpeloyment will not have finished. You may be missing datasets or some configuration in your cluster. If you didn't already read it, read the "Stopping and Starting Instances" section of the documentation, as there are some other caveats you should be aware of:

http://www.cloudera.com/get-started/cloudera-live/aws-documentation.html

Re: Not getting e-mails when starting Cloudera Live stack in Amazon.

DEHallman — Fri, 12 Feb 2016 15:49:51 GMT

I only stopped the instances on the latest attempts after I had gotten the page with all the links. In other words, it looked done. But, I had not received any e-mail messages. So, that is when I stopped. I'm getting to Hue and the Cloudera Manager. I'm also in through SSH doing some spark-shell work to prepare. But, the installation page that I started this morning is still on 96%. I would have thought that when I went to the screen again this morning that it would have simply shown me the links.

Is there any quick way you can tell if my installation looks good?

And, since I don't have the links page (yet), how do I get to Zoomdata?

Re: Not getting e-mails when starting Cloudera Live stack in Amazon.

Sean — Fri, 12 Feb 2016 20:58:14 GMT

In either CloudFormation or your list of instances, the instance Zoomdata
running on is specifically tagged. On that instance on port 8080, Zoomdata
should be running. But again, Zoomdata and the data for that tutorial is
one of the last things to be set up. I can look up your clusters and see
more specifically what's going on, but it's much easier if you can send me
a private message with the access code you used for a given attempt.

Re: Not getting e-mails when starting Cloudera Live stack in Amazon.

DEHallman — Mon, 15 Feb 2016 13:34:14 GMT

2fMDMN2ov6zxFoMr is the Access Code.
I just started up the instances for today's session: You can reach the
manager at: 54.152.109.102

Thanks for the help.

Re: Not getting e-mails when starting Cloudera Live stack in Amazon.

Sean — Mon, 15 Feb 2016 14:55:14 GMT

That doesn't appear to be a valid access code and I can't find any new
access codes with the same name as the ones I was looking at last week. You
say you 'started up the instances' for today's session: again, restarting
or stopping instances before the deployment has finished will fail, and
there's no recovering from that. I started investigating the other failure
that's now been seen twice during our Zoomdata deployment. I have not yet
gotten to the bottom of that, so I'll still need to find out why that's
happening and get back to you. Given that your current master node's
progress bar is stuck on that step, it's possible you're hitting that
failure again.

Re: Not getting e-mails when starting Cloudera Live stack in Amazon.

DEHallman — Mon, 15 Feb 2016 15:27:14 GMT

Do you think I should terminate my current formation and start a new one?

Re: Not getting e-mails when starting Cloudera Live stack in Amazon.

Sean — Tue, 16 Feb 2016 00:00:14 GMT

So I can't tell you anything about your current formation because as I
said, that access code appears to be incorrect, so I can't pull up the
logs. I tried some Zoomdata deployments and did run into one issue with
some operations timing out because they were trying to reach a Zoomdata
package repository that no longer exists. I have fixed that problem so it
shouldn't affect any new deployments. It's possible that was affecting your
previous attempts, but not in the logs I've found that appear to match your
forum username.

So if you do try another deployment, just be sure you have a new access
code that you haven't used before, and don't pause the instances
prematurely.

Re: Not getting e-mails when starting Cloudera Live stack in Amazon.

DEHallman — Wed, 17 Feb 2016 12:34:14 GMT

OK. I will close down my current formation, get a new access code and try
again. Thanks.

Re: Not getting e-mails when starting Cloudera Live stack in Amazon.

DEHallman — Fri, 19 Feb 2016 14:08:28 GMT

Just an FYI. This last time the install went fine. After Cloudera came up, Zoomdata was also available. Neat stuff!

Thanks