Member since
12-10-2015
5
Posts
3
Kudos Received
0
Solutions
12-29-2015
03:14 PM
2 Kudos
I am trying this command spark-submit --master local[4] --class com.oreilly.learningsparkexamples.scala.KafkaInput $ASSEMBLY_JAR localhost:2181 spark-readers pandas 1 but i get the following error Exception in thread "Thread-73" org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 0.0 failed 1 times, most recent failure: Lost task 0.0 in stage 0.0 (TID 0, localhost): java.lang.IllegalArgumentException: Missing required property 'groupid'
... View more
Labels:
- Labels:
-
Apache Kafka
-
Apache Spark
12-29-2015
01:06 PM
2014-08-27 10:50:47,196 WARN
component.AbstractLifeCycle (AbstractLifeCycle.java:setFailed(204)) -
FAILED SelectChannelConnector@0.0.0.0:4040: java.net.BindException:
Address already in use java.net.BindException: Address already in use
... View more
Labels:
- Labels:
-
Apache Kafka
-
Apache Spark
12-11-2015
11:12 AM
rdd = sc.parallelize(r1)
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
c = list(c) # Make it a list so we can compute its length
TypeError: 'PipelinedRDD' object is not iterable ~~~~~~~~~~~~~~~~~My commands are ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ >>> R = sc.textFile(filename);
>>> R.collect()
>>> r1 = R.map(lambda s: s.split(","))
>>> r1.collect()
>>> rdd = sc.parallelize(r1)
... View more
Labels:
- Labels:
-
Apache Spark