Hi,   Sparklyr is supported by RStudio, so it may be better to ask this question directory to RStudio or in a forum like StackOverflow.   However looking at the code it appears you are passing a string to copy_to rather than a dataframe.  If assetstatuses is a dataframe that is available, you can try copying it with copy_to(sc, assetstatuses) without quotes around assetstatuses.   See: http://spark.rstudio.com/reference/sparklyr/latest/copy_to.html   Best, Tristan ... View more

You need to configure a wildcard DNS entry to use CDSW.  See the documentation here:   https://www.cloudera.com/documentation/data-science-workbench/latest/topics/cdsw_install.html#set_up_wildcard_dns   While some features will work without a wildcard, running engines, accessing the terminal, or viewing the Spark UI will not.  Because these URLs are random, you cannot simply add them to your local hosts file.   Thanks, Tristan ... View more

Hi David,   This should be the IP address of the master CDSW node.  We will work to clarify this in the documentation.   Thanks, Tristan ... View more

Hi Pollylaw,   Have you set JAVA_HOME in your the Administration settings?  There is a known issue in 1.0.1 with custom JAVA_HOME directories that can lead to this error message.  A workaround is to remove JAVA_HOME from Admin > Engines and make sure Java is located at a location that can be detected by the bigtop-detect-javahome.sh script.  This will be fixed in a future release.   Please let us know if this workaround does not solve your issue or if this explanation does not match your configuration.   Tristan ... View more

For real installations, you should pull from a repository.  This will ensure all the nodes in your CDSW cluster have access to the image, not just the node where you built it.  Moreover, you should not assume that your Docker image store is persistent across upgrades or in long-running clusters where we may evict less used images to free space. By pushing your custom images to a repository, you will ensure that images are never deleted due to image eviction policies or other administration tasks. ... View more