Welcome to the Cloudera Community

Your Hybrid Data Community. With over 95,100 members and 20,700 solutions, you've come to the right place!

Advanced Search

Scala: read path from dataframe column and merge ... - ( ‎11-11-2022 01:39 AM )

by on

0 Replies 87 Views

0 Replies

87 Views

In pyspark dataframe.write.json() adds extra empty... - ( ‎10-30-2022 07:56 AM )

by on

0 Replies 55 Views

0 Replies

55 Views

How to read multiple gzipped files from S3 into da... - ( ‎10-07-2022 11:17 PM )

by on Latest post on by

1 Reply 201 Views

1 Reply

201 Views

Loading HDFS Files In a Spark Dataframe Using Loop - ( ‎09-24-2022 08:46 AM )

by on

0 Replies 356 Views

0 Replies

356 Views

write python dataframe (pandas, spark) from CML (W... - ( ‎06-28-2022 07:43 AM )

by on Latest post on by

4 Replies 365 Views

4 Replies

365 Views

Parquet as Array[Byte] to DataFrame without writin... - ( ‎04-29-2022 01:47 AM )

by on Latest post on by

1 Reply 783 Views

1 Reply

783 Views

Error: Output cell exceeds limit of 9.99 megabytes... - ( ‎10-22-2021 05:50 AM )

by on

0 Replies 553 Views

0 Replies

553 Views

Inserting nulls from dataframe to hive table - ( ‎10-18-2021 03:19 AM )

by on Latest post on by

1 Reply 774 Views

1 Reply

774 Views

Line Separator in Spark - ( ‎12-21-2020 08:03 PM )

by on Latest post on by

4 Replies 3082 Views

4 Replies

3082 Views

What is wrong in reading Nifi flowfile and creatin... - ( ‎04-28-2020 07:47 AM )

by on Latest post on by

1 Reply 1074 Views

1 Reply

1074 Views

dataframe count - without re-running it. - ( ‎02-19-2020 11:23 AM )

by on Latest post on by

2 Replies 600 Views

2 Replies

600 Views

Remove Leading zeros from column in Dataframe Joi... - ( ‎11-08-2019 08:51 PM )

by on Latest post on by

2 Replies 5212 Views

2 Replies

5212 Views

Spark : write ordered Dataframe to CSV - ( ‎10-14-2019 02:25 AM )

by on Latest post on by

1 Reply 3828 Views

1 Reply

3828 Views

SparkDFJoinUsingBroadcast - ( ‎12-10-2016 02:15 PM )

by on

0 Replies 244 Views

0 Replies

244 Views

Spark RDDs vs DataFrames vs SparkSQL - ( ‎06-28-2016 08:02 PM )

by on Latest post on by

4 Replies 87005 Views

4 Replies

87005 Views

JSON is null in DataFrame - ( ‎05-08-2019 02:53 PM )

by on Latest post on by

1 Reply 645 Views

1 Reply

645 Views

I have written a simple logic to find association ... - ( ‎04-16-2019 01:42 PM )

by on Latest post on by

1 Reply 648 Views

1 Reply

648 Views

pyspark issue - ( ‎11-08-2018 02:03 PM )

by on Latest post on by

3 Replies 1879 Views

3 Replies

1879 Views

Scala- How to find duplicated columns with all val... - ( ‎07-01-2019 02:28 AM )

by on Latest post on by

3 Replies 14971 Views

3 Replies

14971 Views

How to perform a Cartesian product join on Spark 1... - ( ‎07-10-2017 05:43 AM )

by on Latest post on by

2 Replies 2802 Views

2 Replies

2802 Views

What is the best way to perform row wise calculati... - ( ‎07-08-2017 03:06 AM )

by on Latest post on by

3 Replies 5158 Views

3 Replies

5158 Views

Pyspark can't show() a CSV with an array - ( ‎06-15-2018 03:08 AM )

by on Latest post on by

1 Reply 15497 Views

1 Reply

15497 Views

Phoenix Dynamic Columns in Spark Dataframe API - ( ‎12-14-2017 02:52 PM )

by on Latest post on by

2 Replies 2006 Views

2 Replies

2006 Views

pyspark - creating directory when trying to RDD as... - ( ‎10-25-2017 03:01 PM )

by on Latest post on by

4 Replies 17186 Views

4 Replies

17186 Views

2 master node and 3 data node setting up HA cluste... - ( ‎04-29-2018 12:09 AM )

by on Latest post on by

4 Replies 867 Views

4 Replies

867 Views

spark scala Dataframe adding new column Error - ( ‎08-26-2018 02:53 PM )

by on Latest post on by

1 Reply 2767 Views

1 Reply

2767 Views

Rowwise manipulation of a DataFrame in PySpark. - ( ‎08-22-2017 01:26 PM )

by on Latest post on by

4 Replies 20578 Views

4 Replies

20578 Views

Difference between "Hortonworks Spark-HBase Connec... - ( ‎12-19-2017 07:08 AM )

by on Latest post on by

1 Reply 1139 Views

1 Reply

1139 Views

Spark DataFrame - difference between sort and orde... - ( ‎05-10-2017 04:36 AM )

by on Latest post on by

5 Replies 41872 Views

5 Replies

41872 Views

Saving a dataframe to a hive table - ( ‎05-05-2017 03:00 PM )

by on Latest post on by

1 Reply 3935 Views

1 Reply

3935 Views

how to split row into multiple rows on the basis o... - ( ‎06-13-2018 02:33 PM )

by on Latest post on by

5 Replies 15773 Views

5 Replies

15773 Views

Help with scala syntax - how to pass a variable to... - ( ‎04-20-2018 05:01 PM )

by on Latest post on by

1 Reply 1945 Views

1 Reply

1945 Views

Spark RDD/Dataframe caching - ( ‎10-16-2017 09:43 AM )

by on Latest post on by

2 Replies 8482 Views

2 Replies

8482 Views

Write dataframe into parquet hive table ended with... - ( ‎06-11-2018 02:19 PM )

by on Latest post on by

6 Replies 15818 Views

6 Replies

15818 Views

how to replace a column having null values with pr... - ( ‎08-10-2018 09:46 AM )

by on Latest post on by

1 Reply 626 Views

1 Reply

626 Views

Loading a JSON File from URL into a Spark DataFram... - ( ‎08-14-2017 11:10 AM )

by on Latest post on by

4 Replies 34400 Views

4 Replies

34400 Views

How to dispose or destroy broadcast dataframe? - ( ‎08-07-2018 05:04 AM )

by on Latest post on by

1 Reply 1358 Views

1 Reply

1358 Views

Iterating through nested fields in spark DF - ( ‎05-31-2018 02:56 PM )

by on Latest post on by

2 Replies 11340 Views

2 Replies

11340 Views

SparkSQL performance issue with collect method - ( ‎11-30-2017 11:56 AM )

by on Latest post on by

1 Reply 810 Views

1 Reply

810 Views

Create a nested dataset from two flattened dataset... - ( ‎06-14-2017 09:25 PM )

by on Latest post on by

1 Reply 1279 Views

1 Reply

1279 Views

Select only inner fields from a StructType in Spar... - ( ‎08-09-2017 04:27 PM )

by on Latest post on by

4 Replies 863 Views

4 Replies

863 Views

Process csv files where delimited is unknown? - ( ‎10-08-2018 11:54 AM )

by on Latest post on by

1 Reply 622 Views

1 Reply

622 Views

Is there a way to do a count Approx for a datafram... - ( ‎06-13-2017 05:09 PM )

by on Latest post on by

2 Replies 4741 Views

2 Replies

4741 Views

Convert String column into date & timestamp Spark ... - ( ‎04-21-2017 01:03 PM )

by on Latest post on by

1 Reply 29689 Views

1 Reply

29689 Views

In HDP 2.6.3, Phoenix is not saving spark DataFram... - ( ‎11-19-2017 11:28 AM )

by on Latest post on by

4 Replies 829 Views

4 Replies

829 Views

SparkSQL: Understanding different runtimes - ( ‎08-06-2018 07:28 AM )

by on Latest post on by

2 Replies 715 Views

2 Replies

715 Views

How to read hive table1 from spark, using datafram... - ( ‎09-30-2017 12:46 AM )

by on Latest post on by

3 Replies 16234 Views

3 Replies

16234 Views

Quote data at writing to HDFS does not work - ( ‎11-28-2017 11:21 PM )

by on Latest post on by

2 Replies 1640 Views

2 Replies

1640 Views

Spark HBase Connector (SHC) - How to delete HBAS... - ( ‎07-26-2018 11:54 AM )

by on Latest post on by

1 Reply 3174 Views

1 Reply

3174 Views

java.sql.SQLException: Protocol violation: [ 6, 7,... - ( ‎01-23-2018 02:24 PM )

by on Latest post on by

1 Reply 2847 Views

1 Reply

2847 Views

Welcome to the Cloudera Community

Top Tagged