Reply
Explorer
Posts: 6
Registered: ‎04-11-2017

csdw url - Bad Gateway error

Tried to install Data Science work bench following the documentation - in google cloud .

Domain name is - "c.valid-octagon-161920.internal"

cdh - 5.7.6

The configuration in csdw master node is below:

 

DOMAIN="cdsw.c.valid-octagon-161920.internal"

MASTER_IP= <internal ip of the master node>

DOCKER_BLOCK_DEVICES=<disk device>

APPLICATION_BLOCK_DEVICE=<another disk device>

 

============

 

Then I did => csdw init 

 

After that I am trying to login from my desktop ( windows 10 ) ,

 

I added the domain name in hosts file in windows

 

<external ip>    cdsw.c.valid-octagon-161920.internal

 

Now when I enter " cdsw.c.valid-octagon-161920.internal" in the browser ( chrome) url 

I am getting error - 

Bad Gateway

 

When I directly enter the master IP I am getting 404 page not found.

 

Below is the output of cdsw status.

 

[root@instance-4 ~]# cdsw status
Cloudera Data Science Workbench Status
Service Status
docker: active
kubelet: active
nfs: active
Checking kernel parameters...
Node Status
NAME         STATUS    AGE       STATEFUL
instance-4   Ready     9h        true
System Pod status
NAME                                 READY     STATUS    RESTARTS   AGE
dummy-2088944543-351x6               1/1       Running   0          9h
etcd-instance-4                      1/1       Running   0          9h
kube-apiserver-instance-4            1/1       Running   0          9h
kube-controller-manager-instance-4   1/1       Running   0          9h
kube-discovery-1150918428-1c6yh      1/1       Running   0          9h
kube-dns-3873593988-bzdit            0/3       Pending   0          9h
kube-proxy-lgt5p                     1/1       Running   0          9h
kube-scheduler-instance-4            1/1       Running   0          9h
node-problem-detector-v0.1-83xvv     1/1       Running   0          9h
weave-net-mizwk                      2/2       Running   0          9h
Cloudera Data Science Workbench Pod Status
NAME                                  READY     STATUS      RESTARTS   AGE       ROLE
cron-3971587342-bbks0                 1/1       Running     0          14m       cron
db-4066525870-gv1li                   1/1       Running     0          14m       db
db-migrate-abec968-msslh              0/1       Completed   0          14m       db-migrate
engine-deps-jebd9                     1/1       Running     0          14m       engine-deps
ingress-controller-2976678207-qghlp   1/1       Running     0          14m       ingress-controller
livelog-2494298876-j9aum              1/1       Running     0          14m       livelog
reconciler-577027981-bbftg            0/1       Pending     0          14m       reconciler
spark-port-forwarder-674tl            1/1       Running     0          14m       spark-port-forwarder
web-1304125449-jmzfg                  0/1       Pending     0          14m       web
web-1304125449-kubvi                  0/1       Pending     0          14m       web
web-1304125449-pjdr1                  0/1       Pending     0          14m       web
Cloudera Data Science Workbench is not ready yet: some system pods are not ready
[root@instance-4 ~]# 

 

Explorer
Posts: 6
Registered: ‎04-11-2017

Re: csdw url - Bad Gateway error

I have changed DOMAIN - 

 

# This domain for DNS and is unrelated to Kerberos or LDAP domains.
#DOMAIN="cdsw.c.valid-octagon-161920.internal"
DOMAIN="c.valid-octagon-161920.internal"

 

Now the cdsw status looks like below but still not able to access from workstation browser .

 

 

Cloudera Data Science Workbench Status
Service Status
docker: active
kubelet: active
nfs: active
Checking kernel parameters...
Node Status
NAME         STATUS    AGE       STATEFUL
instance-4   Ready     12h       true
System Pod status
NAME                                 READY     STATUS              RESTARTS   AGE
dummy-2088944543-351x6               1/1       Running             0          12h
etcd-instance-4                      1/1       Running             0          12h
kube-apiserver-instance-4            1/1       Running             0          12h
kube-controller-manager-instance-4   1/1       Running             0          12h
kube-discovery-1150918428-1c6yh      0/1       MatchNodeSelector   0          12h
kube-discovery-1150918428-651x7      1/1       Running             0          9m
kube-dns-3873593988-bzdit            0/3       Pending             0          12h
kube-proxy-lgt5p                     1/1       Running             0          11h
kube-scheduler-instance-4            1/1       Running             0          12h
node-problem-detector-v0.1-83xvv     1/1       Running             0          11h
weave-net-mizwk                      2/2       Running             0          11h
Cloudera Data Science Workbench Pod Status
NAME                                  READY     STATUS      RESTARTS   AGE       ROLE
cron-3971587342-f4yrr                 1/1       Running     0          8m        cron
db-4066525870-u765p                   1/1       Running     0          8m        db
db-migrate-abec968-125na              0/1       Completed   0          8m        db-migrate
engine-deps-9imhn                     1/1       Running     0          8m        engine-deps
ingress-controller-2976678207-8lbsq   1/1       Running     0          8m        ingress-controller
livelog-2494298876-x9tfw              1/1       Running     0          8m        livelog
reconciler-577027981-8ianu            1/1       Running     0          8m        reconciler
spark-port-forwarder-ou45p            1/1       Running     0          8m        spark-port-forwarder
web-1304125449-bosdi                  1/1       Running     0          8m        web
web-1304125449-egbmr                  1/1       Running     0          8m        web
web-1304125449-rrkwr                  1/1       Running     0          8m        web
Cloudera Data Science Workbench is not ready yet: some system pods are not ready

 

Cloudera Employee
Posts: 29
Registered: ‎04-28-2017

Re: csdw url - Bad Gateway error

I'm sorry your experiencing issues.

 

It appears you are using a host file on your Windows machine to resolve DNS.  As documented, you will need a proper wildcard DNS record for Cloudera Data Science Workbench to operate correctly.  These DNS settings must be resolvable from both within the cluster and on your personal computer.   After updating your DNS configuration and your cdsw.conf file to match, try running cdsw reset followed by cdsw init.  It may take 10-20 minutes to start the first time.

 

If you are only interested in testing Cloudera Data Science Workbench and cannot easily create a wildcard DNS entry, you can consider trying a service such as **bleep**.io.  However a proper wildcard DNS is strongly recommended for production installations.

 

Tristan

Explorer
Posts: 6
Registered: ‎04-11-2017

Re: csdw url - Bad Gateway error

Is there a documentation to setup bleep .

 

Cloudera Employee
Posts: 29
Registered: ‎04-28-2017

Re: csdw url - Bad Gateway error

Sorry, "bleep" was due to redaction.  You need to set up a proper wildcard DNS entry.  There are services like xip.io to provide automatic wildcard DNS resolution for hosts, but I strongly recommend setting up a proper wildcard DNS record since these services can be unreliable.

 

I hope that is helpful.

 

Best,

Tristan

Announcements