Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Using Spark 1.5 to read data from SQL server and directly writing to Impala

Highlighted

Using Spark 1.5 to read data from SQL server and directly writing to Impala

New Contributor

Using Spark 1.5 to read data from SQL server and directly writing to Impala is it possiable

2 REPLIES 2

Re: Using Spark 1.5 to read data from SQL server and directly writing to Impala

Super Collaborator

We currently do not have Spark 1.5 as a released version and on top of that Spark SQL is not supported for any of the releases that we have done.

 

Could you explain a bit more what you are trying to do exactly then we might be able to help. Normally pulling data from a SQL database into a Hadoop cluster is something we use sqoop for and not Spark.

 

Wilfred

Re: Using Spark 1.5 to read data from SQL server and directly writing to Impala

Master Collaborator
I don't think anything about Spark helps you read from SQLServer, but
in principle you can use the JDBC-related support code to do so.
Writing to Impala means writing Parquet files, probably, which is
doable as well. It's not clear what you mean to do here, so not even
clear if Spark is the right tool.