Welcome to the Cloudera Community

Your Hybrid Data Community. With over 95,300 members and 20,700 solutions, you've come to the right place!

Advanced Search

Scala: read path from dataframe column and merge ... - ( ‎11-11-2022 01:39 AM )

by on

0 Replies 92 Views

0 Replies

92 Views

In pyspark dataframe.write.json() adds extra empty... - ( ‎10-30-2022 07:56 AM )

by on

0 Replies 62 Views

0 Replies

62 Views

How to read multiple gzipped files from S3 into da... - ( ‎10-07-2022 11:17 PM )

by on Latest post on by

1 Reply 227 Views

1 Reply

227 Views

Loading HDFS Files In a Spark Dataframe Using Loop - ( ‎09-24-2022 08:46 AM )

by on

0 Replies 391 Views

0 Replies

391 Views

write python dataframe (pandas, spark) from CML (W... - ( ‎06-28-2022 07:43 AM )

by on Latest post on by

4 Replies 416 Views

4 Replies

416 Views

Parquet as Array[Byte] to DataFrame without writin... - ( ‎04-29-2022 01:47 AM )

by on Latest post on by

1 Reply 821 Views

1 Reply

821 Views

Error: Output cell exceeds limit of 9.99 megabytes... - ( ‎10-22-2021 05:50 AM )

by on

0 Replies 567 Views

0 Replies

567 Views

Inserting nulls from dataframe to hive table - ( ‎10-18-2021 03:19 AM )

by on Latest post on by

1 Reply 796 Views

1 Reply

796 Views

Line Separator in Spark - ( ‎12-21-2020 08:03 PM )

by on Latest post on by

4 Replies 3126 Views

4 Replies

3126 Views

What is wrong in reading Nifi flowfile and creatin... - ( ‎04-28-2020 07:47 AM )

by on Latest post on by

1 Reply 1086 Views

1 Reply

1086 Views

dataframe count - without re-running it. - ( ‎02-19-2020 11:23 AM )

by on Latest post on by

2 Replies 607 Views

2 Replies

607 Views

Remove Leading zeros from column in Dataframe Joi... - ( ‎11-08-2019 08:51 PM )

by on Latest post on by

2 Replies 5238 Views

2 Replies

5238 Views

Spark : write ordered Dataframe to CSV - ( ‎10-14-2019 02:25 AM )

by on Latest post on by

1 Reply 3849 Views

1 Reply

3849 Views

Scala- How to find duplicated columns with all val... - ( ‎07-01-2019 02:28 AM )

by on Latest post on by

3 Replies 15007 Views

3 Replies

15007 Views

JSON is null in DataFrame - ( ‎05-08-2019 02:53 PM )

by on Latest post on by

1 Reply 646 Views

1 Reply

646 Views

I have written a simple logic to find association ... - ( ‎04-16-2019 01:42 PM )

by on Latest post on by

1 Reply 650 Views

1 Reply

650 Views

pyspark issue - ( ‎11-08-2018 02:03 PM )

by on Latest post on by

3 Replies 1889 Views

3 Replies

1889 Views

Process csv files where delimited is unknown? - ( ‎10-08-2018 11:54 AM )

by on Latest post on by

1 Reply 625 Views

1 Reply

625 Views

pyspark-java.lang.IllegalStateException: Input row... - ( ‎09-10-2018 02:19 AM )

by on Latest post on by

3 Replies 7602 Views

3 Replies

7602 Views

How to process too many files of same structure in... - ( ‎09-06-2018 01:46 PM )

by on Latest post on by

1 Reply 1745 Views

1 Reply

1745 Views

spark scala Dataframe adding new column Error - ( ‎08-26-2018 02:53 PM )

by on Latest post on by

1 Reply 2780 Views

1 Reply

2780 Views

how to replace a column having null values with pr... - ( ‎08-10-2018 09:46 AM )

by on Latest post on by

1 Reply 632 Views

1 Reply

632 Views

How to dispose or destroy broadcast dataframe? - ( ‎08-07-2018 05:04 AM )

by on Latest post on by

1 Reply 1363 Views

1 Reply

1363 Views

SparkSQL: Understanding different runtimes - ( ‎08-06-2018 07:28 AM )

by on Latest post on by

2 Replies 718 Views

2 Replies

718 Views

Spark HBase Connector (SHC) - How to delete HBAS... - ( ‎07-26-2018 11:54 AM )

by on Latest post on by

1 Reply 3186 Views

1 Reply

3186 Views

PostgreSQL count higher than Spark dataframe - ( ‎07-10-2018 06:56 AM )

by on Latest post on by

3 Replies 1448 Views

3 Replies

1448 Views

How to take record count when writing as ORC file. - ( ‎07-05-2018 11:41 AM )

by on Latest post on by

2 Replies 1306 Views

2 Replies

1306 Views

Pyspark can't show() a CSV with an array - ( ‎06-15-2018 03:08 AM )

by on Latest post on by

1 Reply 15655 Views

1 Reply

15655 Views

how to split row into multiple rows on the basis o... - ( ‎06-13-2018 02:33 PM )

by on Latest post on by

5 Replies 15812 Views

5 Replies

15812 Views

Write dataframe into parquet hive table ended with... - ( ‎06-11-2018 02:19 PM )

by on Latest post on by

6 Replies 15926 Views

6 Replies

15926 Views

Iterating through nested fields in spark DF - ( ‎05-31-2018 02:56 PM )

by on Latest post on by

2 Replies 11357 Views

2 Replies

11357 Views

Replacing values in the dataframe keeping original... - ( ‎05-16-2018 10:49 AM )

by on Latest post on by

1 Reply 13062 Views

1 Reply

13062 Views

Why the below Spark operation on Dataframe API sho... - ( ‎05-15-2018 06:38 AM )

by on Latest post on by

6 Replies 3302 Views

6 Replies

3302 Views

Spark - Get part-file suffix (part-NNNNN) - ( ‎05-01-2018 12:08 AM )

by on Latest post on by

4 Replies 2206 Views

4 Replies

2206 Views

2 master node and 3 data node setting up HA cluste... - ( ‎04-29-2018 12:09 AM )

by on Latest post on by

4 Replies 873 Views

4 Replies

873 Views

Help with scala syntax - how to pass a variable to... - ( ‎04-20-2018 05:01 PM )

by on Latest post on by

1 Reply 1955 Views

1 Reply

1955 Views

How to parse nested Json in spark2 Dataframe - ( ‎03-08-2018 02:16 PM )

by on Latest post on by

2 Replies 23730 Views

2 Replies

23730 Views

java.sql.SQLException: Protocol violation: [ 6, 7,... - ( ‎01-23-2018 02:24 PM )

by on Latest post on by

1 Reply 2863 Views

1 Reply

2863 Views

Difference between "Hortonworks Spark-HBase Connec... - ( ‎12-19-2017 07:08 AM )

by on Latest post on by

1 Reply 1141 Views

1 Reply

1141 Views

Phoenix Dynamic Columns in Spark Dataframe API - ( ‎12-14-2017 02:52 PM )

by on Latest post on by

2 Replies 2019 Views

2 Replies

2019 Views

SparkSQL performance issue with collect method - ( ‎11-30-2017 11:56 AM )

by on Latest post on by

1 Reply 814 Views

1 Reply

814 Views

Quote data at writing to HDFS does not work - ( ‎11-28-2017 11:21 PM )

by on Latest post on by

2 Replies 1657 Views

2 Replies

1657 Views

In HDP 2.6.3, Phoenix is not saving spark DataFram... - ( ‎11-19-2017 11:28 AM )

by on Latest post on by

4 Replies 833 Views

4 Replies

833 Views

Spark 1.6 - Dataframe read json throws org.apache.... - ( ‎11-13-2017 05:40 PM )

by on Latest post on by

2 Replies 6017 Views

2 Replies

6017 Views

pyspark - creating directory when trying to RDD as... - ( ‎10-25-2017 03:01 PM )

by on Latest post on by

4 Replies 17224 Views

4 Replies

17224 Views

Spark RDD/Dataframe caching - ( ‎10-16-2017 09:43 AM )

by on Latest post on by

2 Replies 8489 Views

2 Replies

8489 Views

How to read hive table1 from spark, using datafram... - ( ‎09-30-2017 12:46 AM )

by on Latest post on by

3 Replies 16255 Views

3 Replies

16255 Views

split spark dataframe and calculate average based ... - ( ‎09-15-2017 03:30 PM )

by on Latest post on by

1 Reply 9451 Views

1 Reply

9451 Views

What are the advantages of Dataframe in Apache Spa... - ( ‎09-05-2017 10:35 AM )

by on Latest post on by

2 Replies 1397 Views

2 Replies

1397 Views

Rowwise manipulation of a DataFrame in PySpark. - ( ‎08-22-2017 01:26 PM )

by on Latest post on by

4 Replies 20636 Views

4 Replies

20636 Views

Welcome to the Cloudera Community

Latest Tagged