i followed below steps to create project
Setting Up a Scala Project
the session launching never complete with status of "ContainerCreating: Creating engine container" and scheduling
there was a problem with wildcard dns.
i built my own dns server and i went though and image and containers are created.
i can created and launch the projects.
the images/containers cannot resolve hostname with names but IP. scala project comes with error.
Setting default log level to "ERROR". To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel). 17/07/10 08:26:54 ERROR spark.SparkContext: Error initializing SparkContext. java.lang.IllegalArgumentException: java.net.UnknownHostException: CDH-MN-511-CE1.EOH.COM at org.apache.hadoop.security.SecurityUtil.buildTokenService(SecurityUtil.java:406) at org.apache.hadoop.hdfs.NameNodeProxies.createNonHAProxy(NameNodeProxies.java:310) at org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider$DefaultProxyFactory.createProxy(ConfiguredFailoverProxyProvider.java:68)
if i use terminal, i cannot ping the server with their names but i can with IPs
cdsw@zx991teec5q9o67g:~$ cat /etc/hosts
# Kubernetes-managed hosts file.
::1 localhost ip6-localhost ip6-loopback
cdsw@zx991teec5q9o67g:~$ ping master
ping: unknown host cdh-mn-511-ce1
cdsw@zx991teec5q9o67g:~$ ping 10.10.51.216
PING 10.10.51.216 (10.10.51.216) 56(84) bytes of data.
64 bytes from 10.10.51.216: icmp_seq=1 ttl=63 time=0.220 ms
64 bytes from 10.10.51.216: icmp_seq=2 ttl=63 time=0.209 ms
--- 10.10.51.216 ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 999ms
rtt min/avg/max/mdev = 0.209/0.214/0.220/0.015 ms
How to check the engine status in the backend ?
I have installed Cloudera Data Science Workbench after fulfilling prerequisites.
cdsw status and cdsw validate doesn't show any errors or warnings. But, when i open the workbench and try to start a scala,python or R sessions, it's showing the "ContainerCreating: Creating engine container" forever with red cursor at the bottom input box.
when i go back to projects and reopen the session, it's showing green.
But it doesn't take any input after that.
I somehow tried to check with "docker ps" command which shows only docker containers which are created when i submit the job which is not much informative.
I'm curious to check the logs about what's happening in the backend.
Can someone help the approach to troubleshoot this issue ?
Does anyone know how exactly it works in the backend ?