Member since
11-22-2019
3
Posts
1
Kudos Received
0
Solutions
03-24-2021
07:20 PM
Hello, Nice tutorial, this library is fast! If anyone is running into java.sql.SQLExceptionPyRaisable : java.sql.SQLException: [Cloudera][ImpalaJDBCDriver](500605) Error occurred while opening a session with the server. No additional detail from the server regarding this error is available. Please ensure that the driver configuration is compatible with the server configuration. This type of error can also occur when the server is too busy to handle the request. Please try again later. I was able to fix it by changing the httpPath parameter in the impala hostname from "icml-data-mart/cdp-proxy-api/impala" to to "cliservice" as follows: "jdbc:impala://"+os.environ["IMPALA_HOST"]+":443/;ssl=1;transportMode=http;httpPath=cliservice;AuthMech=3;" Hope this helps anyone!
... View more
04-15-2020
12:08 PM
1 Kudo
Hi Chinedu, This should help: https://stackoverflow.com/questions/48406304/groupby-and-concat-array-columns-pyspark Thanks, Paul
... View more
04-14-2020
03:22 PM
Within a CDSW project, you have the option to manually upload files from your computer or import them from a github repository by pulling from it. Once you have created a project, you can access project files from the Overview Page, the Files page, or from within a terminal window if you launch a CDSW session. The project files are automatically loaded to the /home/cdsw directory but you can create additional directories at will. This quickstart guide will give you some more details on the above steps. https://docs.cloudera.com/documentation/data-science-workbench/1-7-x/topics/cdsw_quickstart.html Once you have created a project, create two scala files by clicking on "new session" and selecting the Scala Engine Kernel. I recommend leaving the default Workbench editor for the purposes of this example. Next, you can put your methods etc. in your first file, and import them from the second file. Finally, run the second file within the Scala session by clicking "Run" -> "Run All". I would recommend following this short tutorial example and creating project directories and files in CDSW https://www.cs.helsinki.fi/u/wikla/OTS/Sisalto/examples/html/ch13.html#sec2
... View more