Re: I need to create a spark streaming application...

sganeshkumar · ‎09-24-2018

sganeshkumar · ‎09-17-2018

@Sindhu If I increase the mappers, will the time consumed be less or How many mappers can we keep in general ??? Thanks!

sganeshkumar · ‎09-17-2018

$ sqoop import \ --connect jdbc:mysql://localhost/userdb \ --username root \ --table emp --m 1

sganeshkumar · ‎08-31-2018

@gulshad.ansari Where can we find the snapshot, exacty which location.

sganeshkumar · ‎08-30-2018

@Felix Albani If i delete my files in trash, is there any possibility to have reference anywhere ?

sganeshkumar · ‎08-30-2018

sganeshkumar · ‎08-30-2018

sganeshkumar · ‎08-27-2018

@Jay Kumar SenSharma Hi, When u import everything from sql package from 1st statement, will it not import SQLContext class ?

sganeshkumar · ‎08-27-2018

import org.apache.spark.sql._ import org.apache.spark.sql.SQLContext._

sganeshkumar · ‎08-17-2018

rddstudent.write.format("csv").saveAsTable("Student_Spark2") "WARN HiveExternalCatalog: Couldn't find corresponding Hive SerDe for data source provider csv. Persisting data source table `default`.`student_spark2` into Hive metastore in Spark SQL specific format, which is NOT compatible with Hive." Please let me know why I am not able to create a table using CSV as format

sganeshkumar · ‎08-16-2018

sganeshkumar · ‎08-16-2018

Hi @Sindhu, I tried but i m not getting it.

sganeshkumar · ‎08-16-2018

sganeshkumar · ‎08-16-2018

sganeshkumar · ‎08-16-2018

sganeshkumar · ‎08-14-2018

@Sandeep Nemuri Ya, i m able to use repartition for a different RDD. Is it possible to repartition the same RDD ?

sganeshkumar · ‎08-14-2018

sganeshkumar · ‎08-14-2018

sganeshkumar · ‎08-09-2018

Thanks @Felix Albani. I found it. For Scala code pls check this git hub link https://github.com/phatak-dev/spark2.0-examples/blob/master/src/main/scala/com/madhukaraphatak/examples/sparktwo/streaming/FileStreamExample.scala. This is exactly what i needed.

sganeshkumar · ‎08-07-2018

Online	Offline
Last Visited	‎10-01-2018 01:20 PM

Date Registered	‎08-07-2018 08:40 AM
Last Visited	‎10-01-2018 01:20 PM
Total Messages Posted	23

Re: I need to create a spark streaming application...

Can we run Logstash in Windows ? If so how to writ...

Re: What does --m 1 represent in sqoop import sta...

What does --m 1 represent in sqoop import stateme...

Re: If I delete a file in hdfs having replication ...

Re: If I delete a file in hdfs having replication ...

How to read edit_inprogress log file ?

If I delete a file in hdfs having replication fact...

Re: What is the difference between the below 2 imp...

What is the difference between the below 2 import ...

I am trying to create a table in spark. Below is t...

What is the significance of $ in this filter state...

Re: I have created a table in hive. What is the co...

I have created a table in hive. What is the comman...

I have created a table in hive. What is the comman...

I have created a table in hive. What is the comman...

Re: Is it possible to repartition an existing RDD ...

Is it possible to repartition an existing RDD whic...

I have a cluster of 5 nodes. If I do a HashPartiti...

Re: I need to create a spark streaming application...

I need to create a spark streaming application whi...