R is an RDD. So r1 is also an RDD. So you are trying to call "parallelize()" on an RDD, where you should not do that. Usually, use parallelize() on a local python object, like a list.
... View more
A few clarifying questions about rawTrainData: - How is this RDD generated? - Is it cached? - how many partitions does it have? Also, what is the variable "valores"?
... View more
The pyspark shell is just Python too. So using dir() should show all existing python variables (although it also shows all imports and a bunch of things you may not be looking for).
... View more
Looks like some conflict b/w Spark and Phoenix jars. No? Googling on the data in the stack trace, it looks related to Jackson. I'm not familair with Phoenix - does it use it's own version?
... View more
