Subject Author Views Posted
This is a topic with new unread messages
I have a Dataframe that I am trying to flatten. As part of the process, I want to explode it, so if...
98 ‎07-08-2017 11:59 PM
This is a topic with new unread messages
I am trying to load data into Hive table using Spark. Below are the first two lines I wrote. val...
99 ‎06-29-2017 06:28 AM
This is a topic with new unread messages
Hi,   Please advise what next is to be done.   I see below message for all my executors but not...
87 ‎06-26-2017 11:30 PM
This is a topic with new unread messages
I am trying to install spark 2 (spark 2.1.0 release 1) on CDH 5.11. However, I failed to do it with...
83 ‎06-16-2017 02:02 AM
This is a topic with new unread messages
What is the best way to deduplicate messages coming from Kafka in Spark Streaming consumer? Assumin...
100 ‎05-27-2017 01:30 PM
This is a topic with new unread messages
I just recently setup my cluster and when I attempt to run a spark job using python I am getting er...
99 ‎05-18-2017 06:49 PM
This is a topic with new unread messages
In HIVE I have a table that was created by using pyspark. I have created the table like below. df...
100 ‎05-17-2017 10:11 AM
This is a topic with new unread messages
Requirement: Trigger a spark job from UI by user action (say submit button click). Once the spark...
100 ‎05-14-2017 11:12 PM
This is a topic with new unread messages
I have recently created two node hadoop cluster with CDH5.11.0 with Cloudera manager. It installed ...
199 ‎05-12-2017 12:22 PM
This is a topic with new unread messages
  Hi guys,   I have a spark cluster (standalone mode) , when I submit a job (or open spark-shell...
100 ‎05-11-2017 03:06 AM
This is a topic with new unread messages
Is there a way to get Hive queries to run on Spark 2.x with CDH 5.10.x or higher?   This post mak...
261 ‎05-03-2017 09:36 AM
This is a topic with new unread messages
My spark Job is submmited by oozie in hue.The spark is running in YARN-CLUSTER mode .  I am trying ...
99 ‎05-03-2017 04:24 AM
This is a topic with new unread messages
17/05/02 17:09:01 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platfor...
199 ‎05-02-2017 05:01 AM
This is a topic with new unread messages
I am trying to read a file and add two extra columns. 1. Seq no and 2. filename. When I run spark j...
199 ‎04-26-2017 03:38 AM
This is a topic with new unread messages
I would like to create a Grafana Dashboard for Spark Streaming jobs. I have installed all the requir...
200 ‎04-25-2017 06:04 PM
This is a topic with new unread messages
In a previous post on Multiple Spark versions, already solved, it was defined how to use multiple S...
100 ‎04-20-2017 10:13 AM
This is a topic with new unread messages
Hi, I have pyspark kernel setup and was able to see and use the kernel in JupyterHub. However, ...
200 ‎04-13-2017 04:32 PM
This is a topic with new unread messages
Hi.   SparkSQL 2.1 throws the following warning :    WARN client.Shim_v1_1: Caught Hive MetaExc...
199 ‎04-13-2017 02:06 PM
This is a topic with new unread messages
Hello,   I am trying to implement NaiveBayes model using Cloudera PySpark ML libraries.(https://s...
102 ‎04-07-2017 07:01 AM
This is a topic with new unread messages
On CDH 5.2, In order to use Hue spark notebooks, im configurating Livy, but Livy requires Spark 1.6...
200 ‎04-05-2017 01:40 PM