question Re: Trying to sort out cloudera products. What is inside what? in Archives of Support Questions (Read Only)

Trying to sort out cloudera products. What is inside what?

fletcher — Fri, 16 Sep 2022 09:02:55 GMT

Hi, a little confused here.

On the website I see Cloudera Enterprise and Cloudera Express and CDH and Cloudera Manager. It looks like

CDH is the actual product content?

And CM is the thing that installs it all for you

And you can install either Enterprise or Express?

And CM then provides the UI after installing?

is that right?

Re: Trying to sort out cloudera products. What is inside what?

jkestelyn — Mon, 21 Jul 2014 17:49:12 GMT

Cloudera has two products, Cloudera Express and Cloudera Enterprise:

Cloudera Express (FREE): includes the open source platform, CDH, and Cloudera Manager (cluster/system management software). No support.

Cloudera Enterprise (PAID): Includes CDH, Cloudera Manager + extended enterprise features, and support & indemnity. Pricing is based on for what components you want support (see editions here).

You can also choose to use CDH without Cloudera Manager, but you'll save yourself a lot of time and work if you do use the latter.

I hope that helps!

Re: Trying to sort out cloudera products. What is inside what?

fletcher — Mon, 21 Jul 2014 23:20:54 GMT

YEs thanks a lot, that is what I thought it sorted out to be

Can I ask one quick followup? I cant figure out where Hue is in the Enterprise version. I have found a number of webpages that show how to get it going, but .... they all seem to have different instructions.

Is there one place you could send me to find definitive instructions? I installed CM 5.1, so whatever else came in with that is what I have

thanks a lot

Fletcher Lokey

Re: Trying to sort out cloudera products. What is inside what?

Darren — Mon, 21 Jul 2014 23:36:49 GMT

Hi Fletcher,

Hue is available in both Express and Enterprise.

If you haven't added the Hue service, you can do so via the Add Service link on the dropdown menu next to your cluster name on the home page.

Once you've added Hue, click on the Hue service, then click on the link to the web UI. By default it listens on port 8888, so you can probably also just navigate your browser to the right host and add ":8888".

Here's documentation for how to add a service (such as Hue) in Cloudera Manager:
http://www.cloudera.com/content/cloudera-content/cloudera-docs/CM5/latest/Cloudera-Manager-Managing-Clusters/cm5mc_add_service.html

Thanks,
Darren

Re: Trying to sort out cloudera products. What is inside what?

fletcher — Mon, 21 Jul 2014 23:58:20 GMT

Sometimes I go too fast into big things. Cloudera is pretty big

I finally got CM installed and the UI up so I could log in and all, and I started looking around the place. I knew of course that installing on a single VMWare, I would only have a one-node cluster. Completely never realized that installing CM and logging in would not create a cluster. I looked all around the home page for the cluster and the dropdown, where in the world could it be that you were saying?????

finally gave up and googled for "cloudera manager home page add service link" and got a screen shot that showed a list of clusters where I had nothing at all.

DOH!! I just now clicked the button to Add Cluster and now I am on my way.

Re: Trying to sort out cloudera products. What is inside what?

fletcher — Tue, 22 Jul 2014 00:00:30 GMT

I'm such a noob. I clicked my own post as the solution, whereas dlo deserves it

Thanks All!

Re: Trying to sort out cloudera products. What is inside what?

fletcher — Tue, 22 Jul 2014 10:12:46 GMT

oh dear

It took a while to build the cluster, even with just one node. It was getting late but I stayed up, not wanting to leave before it was all done. The Vmware has hung overnight more than once. So I waited it out, and at the end it gave me the choice of setting up services so I chose the All option, which included Hue. It did something called First Run, which bombed out about halfway, failed on something like couldnt find a file or some such. So I went back into the UI and found the new cluster and selected to Add Service > Hue which completed successfully. I looked online for what port to go to for Hue [it said it was running] and found 8088 but that didnt connect in firefox

At that point I did go to bed, and I shut down the VM as I have been doing to avoid hangs. This morning I start it up and for the first time in the several days I have been playing with it, I cant connect to CM at 7180. I restarted the VM, and verified that CM is running

[root@localhost ~]# service cloudera-scm-server start
cloudera-scm-server is already running

so did something break when I did the cluster and added services???

Re: Trying to sort out cloudera products. What is inside what?

fletcher — Tue, 22 Jul 2014 10:33:35 GMT

sometimes just .... who knows???

After quite a few minutes this time, I did get into CM. And MANY minutes after that I have now finally got into Hue, using 8888 instead of the 8088 I found on various google sites.

In fact the whole VM has become very slow and sludgy today.

In any case, I am into Hue at last

Hope this is the end .... or rather the beginning

Re: Trying to sort out cloudera products. What is inside what?

Darren — Tue, 22 Jul 2014 18:05:40 GMT

When you couldn't connect to CM server, it may have still been booting up. It sounds like your machine is extremely slow, so this could take some time.

Installing all services requires a very large amount of RAM. If you don't have at least 10GB RAM (preferably more), then I recommend only the services you really want to try out.

You can also just stop the services you aren't currently using.

Thanks,
Darren

Re: Trying to sort out cloudera products. What is inside what?

fletcher — Wed, 23 Jul 2014 10:03:41 GMT

Darren - That's the issue. My machine is not particularly slow - but it's an ordinary home PC - Intel i5 3GHz with 8gb of RAM. I have assigned the VM to have 6gb, which I see now is pretty small. Poor thing.

And you are an employee. Could I ask a question? the reason I am exploring CM is that I applied for the job as QA in Nashua. I have been working QA for SAP for their SAP Control Center product, which has remarkable parallels to what I have seen in CM. SCC is also a server with an agent and running a number of services, and both have UI’s for monitoring, configuring, and alerts, with role based access control. And both are very very interesting, at least to me - I like that kind of stuff

What I would like to know is - what part of Cloudera does the Nashua office work on? The UI? The server side?

Re: Trying to sort out cloudera products. What is inside what?

Darren — Wed, 23 Jul 2014 17:20:11 GMT

Hi Fletcher,

Glad to hear you're interested to join!

The team in Nashua covers a wide variety of areas, including both front end and back end features. You can learn more by talking with HR, as I'm not totally sure of everything done in that office.

Thanks,
Darren

Re: Trying to sort out cloudera products. What is inside what?

fletcher — Wed, 23 Jul 2014 17:57:57 GMT

Thanks, I will probably find out soon. In fact I have a phone interview
today, in about a half hour.

And yes I am interested. I have been in QA the last several years for a
GUI product that manages and monitors SAP's database products. SAP
Control Center. Our offfice in Concord NH is being closed by the
corporate guys - consolidating locations they call it. Our office is
just too small for them. We dont know what to make of that, but there
it is

I have been looking around NH for openings, and this is far above any
other in the interest level for me. And the match with the job
description looks remarkable to me. Both CM and our SCC have a server
and agents and supporting services, and Alerts and role-based access
control and even the look and feel of it seems familiar. I feel like I
can "see" what CM does with the backend. And the scripts and logs and
xml files look like what I have worked with.

And I found a bug .... or what I would consider a bug for SCC. If you
go to Add Hosts to the Cluster, it lets you go through the wizard and
add a host that already belongs to the cluster. ???!!! In SCC we would
have a popup saying "That host is already in the cluster."

Anyway I am truly hopeful

Re: Trying to sort out cloudera products. What is inside what?

Darren — Wed, 23 Jul 2014 18:10:54 GMT

Good luck in your interview!

As for that bug, when I tried it out, then I saw that the wizard found the host, it told me it was already managed (there's a column in the results table for this), and I could not select the check box next to its name.

Re: Trying to sort out cloudera products. What is inside what?

fletcher — Thu, 24 Jul 2014 13:08:28 GMT

Darren - this is off topic, of course, and I hope it's not out of line, but would you be willing to tell me something about working at Cloudera? I dont know anyone yet, except the interviewer, who I found likable. Just wondering about the daily life, particularly the QA culture there. Could you contact me at flokey@metrocast.net, or through LinkedIn? I wont become I pest, I promise. And sign an NDA if you want 🙂

Fletcher

Re: Trying to sort out cloudera products. What is inside what?

Darren — Thu, 24 Jul 2014 17:37:05 GMT

Hi Fletcher,

I'm not in QA, nor in that office, so can't offer much insight here, unfortunately. Your inteverviewers should be able to give you the best idea of how the culture is.

We can discuss further on LinkedIn.

Thanks,

Darren

Re: Trying to sort out cloudera products. What is inside what?

fletcher — Thu, 24 Jul 2014 22:26:57 GMT

OK, thanks. let me know via ... InMail? I do have some thoughts to see
what you think of them. You are not QA yourself, but perhaps you can
tell me something about how your own project works with QA.

thanks again

Fletcher