Explore
Groups
Cloudera Developers

Create topic
Login / Register

Welcome to the Cloudera Community!

Ask questions, get answers and engage with your peers

Try:What is an Open Lakehouse architecture?How do I manage Spark Memory?Error handling tips for NiFi?

26,656 Topics
93,458 Replies
69,486 Members

The new Cloudera Community is live!

- Read the Announcement

Community Forum

Start discussions, ask questions, get answers

Community Articles

Read community sourced technical articles

Blogs

Read the latest Engineering and Developer articles

Latest Technical Blogs

Why Your Data Platform Needs to Run Where Your Data Lives

Cloud transformed the way we build software and as a side effect, Infrastructure became programmable. Storage became very elastic and analytics is now...

1 month ago

1600

Mastering Safe Model Rollouts: Canary Deployments in Cloudera AI Inference

It’s 2:00 AM on a Friday. Maya, a Senior Machine Learning Engineer, wakes up to a piercing, relentless alarm from PagerDuty.A few hours prior, her tea...

1 month ago

1320

Introducing Cloudera Anywhere Cloud : What it means for Developers?

Enterprise data architecture has always been shaped by where data is allowed to live. Public cloud is one part of that landscape, but so are private d...

1 month ago

4580

Join Cloudera at Harness Unscripted 2026

AI continues to reshape software engineering, and one question is becoming increasingly important: Can we trust AI agents to do more than just assist?...

2 months ago

3210

Latest Questions

Recent
Unsolved

mariosabettaBronze III

asked in Q&A

Notification bell with job execution counter in Cloudera Data Engineering

Hi all,I’d like to suggest an enhancement for Cloudera Data Engineering (CDE): a notification bell in the UI header with a badge counter that increments when jobs are executed.Current situation: When jobs run, there’s no persistent, at-a-glance indic

111

2 hours ago

D

deepcode0526Bronze ⭐️⭐️⭐️

asked in Q&A

Copyright Question

Can Impala and Kudu be sold as commercial products?A Chinese company, Sensors Data, uses them as part of their commercial product.Is this okay?

112

6 hours ago

omeraranSilver ⭐️

asked in Q&A

Need Help About Apache NiFi

Hello,I have MsSql DB and Oracle DB. I am gonna try to explain what I want to do. I am fetching data from MsSQL DB than I am inserting that rows to Oracle DB but this structure not dynamic. Because I created TEST table on both side. So I am writ

27664

S

10 hours ago

AlokKumarGold ⭐️

asked in Q&A

View Data Provenance rows' content is empty

Hello when I try to View Data Provenance of a processor then it shows multiple rows but then when I try to view its content then I get "Content is no longer available in the content repository"though the size in KB of the input and output claims

1693

5 days ago

BobKingGold ⭐️

asked in Q&A

ExcelReader Controller Failing on valid date with proper Date Format setting

I am getting an error when using the ExcelReader to convert an Excel sheet to JSON. Everything works except for some dates. If I remove the Date Format setting on the controller, no issue, but get the date in milliseconds from 1/1/1970, which I do no

1053

1 month ago

jame1997Silver ⭐️⭐️⭐️

asked in Q&A

GetSFTP reporting Processing Failed

Hello,I have a 3 nodes cluster environment running Nifi version 1.29.  Nifi logs are sync to Elastic Search; I noticed that GetSFTP is reporting Processing Failed multiple times.  It appears the processor recover on its own for example from

411

1 month ago

AlokKumarGold ⭐️

asked in Q&A

How to read Email Body in NiFi

HelloHow to read the body of the mail in nifi? I don't see any relevant processor for this.I see there is an "ExtractEmailAttachments" processor but will it read body reliably? We tried to test and see that it is able to make two flowfiles after exec

1733

1 month ago

vowxx007Bronze ⭐️⭐️⭐️

asked in Q&A

Comprehensive monitoring command line Spark 3x

Hi There, We are currently using Cloudera On-Prem (CDP 7.1.9SP1, CFM 2.1.7, CM 7.13.1), where monitoring of Spark jobs (such as memory utilization, CPU usage, active jobs, completed jobs, and related metrics) appears to be primarily available th

992

1 month ago

fy-testSilver ⭐️⭐️

asked in Q&A

Approval/review workflow + audit logging for Bitbucket-based Flow Registry Clients?

Hi all — we're migrating from NiFi Registry to the git-based Flow Registry Client, specifically the BitbucketFlowRegistryClient (NiFi 2.11.0), and validating the workflow.From what we've seen so far, committing a flow version via the NiFi UI pushes d

960

1 month ago

Mike_CHU44Gold ⭐️

asked in Q&A

DELETE rows in table, how HDFS file size is impacted ?

Hello.Before deleting rows in a specific table (463,462 rows in table), HDFS file size is :$ hadoop fs -du -s -h /apps/hive/warehouse/prd_thmil.db/th_mil_fb_code_value_brut54.2 M 162.6 M /apps/hive/warehouse/prd_thmil.db/th_mil_fb_code_value_brut54.2

37478

1 month ago

Show more activity

mariosabettaBronze III

asked in Q&A

Notification bell with job execution counter in Cloudera Data Engineering

Hi all,I’d like to suggest an enhancement for Cloudera Data Engineering (CDE): a notification bell in the UI header with a badge counter that increments when jobs are executed.Current situation: When jobs run, there’s no persistent, at-a-glance indic

111

2 hours ago

D

deepcode0526Bronze ⭐️⭐️⭐️

asked in Q&A

Copyright Question

Can Impala and Kudu be sold as commercial products?A Chinese company, Sensors Data, uses them as part of their commercial product.Is this okay?

112

6 hours ago

omeraranSilver ⭐️

asked in Q&A

Need Help About Apache NiFi

Hello,I have MsSql DB and Oracle DB. I am gonna try to explain what I want to do. I am fetching data from MsSQL DB than I am inserting that rows to Oracle DB but this structure not dynamic. Because I created TEST table on both side. So I am writ

27664

S

10 hours ago

AlokKumarGold ⭐️

asked in Q&A

View Data Provenance rows' content is empty

Hello when I try to View Data Provenance of a processor then it shows multiple rows but then when I try to view its content then I get "Content is no longer available in the content repository"though the size in KB of the input and output claims

1693

5 days ago

jame1997Silver ⭐️⭐️⭐️

asked in Q&A

GetSFTP reporting Processing Failed

Hello,I have a 3 nodes cluster environment running Nifi version 1.29.  Nifi logs are sync to Elastic Search; I noticed that GetSFTP is reporting Processing Failed multiple times.  It appears the processor recover on its own for example from

411

1 month ago

vowxx007Bronze ⭐️⭐️⭐️

asked in Q&A

Comprehensive monitoring command line Spark 3x

Hi There, We are currently using Cloudera On-Prem (CDP 7.1.9SP1, CFM 2.1.7, CM 7.13.1), where monitoring of Spark jobs (such as memory utilization, CPU usage, active jobs, completed jobs, and related metrics) appears to be primarily available th

992

1 month ago

fy-testSilver ⭐️⭐️

asked in Q&A

Approval/review workflow + audit logging for Bitbucket-based Flow Registry Clients?

Hi all — we're migrating from NiFi Registry to the git-based Flow Registry Client, specifically the BitbucketFlowRegistryClient (NiFi 2.11.0), and validating the workflow.From what we've seen so far, committing a flow version via the NiFi UI pushes d

960

1 month ago

kswSilver ⭐️⭐️

asked in Q&A

Question about Angular dependency strategy in CFM 4.12.x

Apache NiFi 2.6.0 upstream ships with Angular 19.2.14. Apache did not change the Angular dependency within the NiFi 2.6.x release line. Instead, the Angular dependency update was introduced as part of the NiFi 2.7.0 development cycle.In contrast, CFM

2914

2 months ago

intersoldiBronze ⭐️⭐️⭐️

asked in Q&A

Kafka Connect to Snowflake connection via JDBC error

I have been trying to send data from Kafka to snowflake using the JDBC driver with Kafka connect. some details about the environment:Kafka is running in a Cloudera private cluster (Base 7.1.9).The version of the Snowflake-kafka connector driver is 2.

1571

2 months ago

DevOpsWorldBronze III

asked in Q&A

How to enable Spark 3.5 as a Runtime Addon for Cloudera AI Workbench sessions?

Hi all,We've upgraded our base cluster (Cloudera Runtime 7.1.9) to CDS 3.5via the new add-on parcel — that part is working fine.Now we're trying to make Spark 3.5 available as a selectable RuntimeAddon inside Cloudera AI Workbench sessions, but we're

1802

2 months ago

Show more activity

Unlock Your Customer and Partner Community Benefits:

✓ Elevated Access
✓ Account Recognition
✓ Extended Permissions

To access these benefits, ensure you are logged in with your official Cloudera account linked to your organization.

Announcements

The new Cloudera Community is live!

0

Announcing Cloudera Data Flow 3.2 for Cloudera on Cloud

0

Community Upgrade Announcement

0

Announcing Cloudera Flow Management Operator for Kubernetes v3.3

0

Announcing Cloudera Streams Messaging Operator for Kubernetes v1.7

0

Leaderboard

Show full leaderboard

Latest Community Articles

Fine-Tuning: The Memory Budget with a Frozen Base

Training a model from scratch is time consuming and can be expensive, which is why many teams rely on fine-tuning — take an open-weight base model tha...

1 month ago

420

Streaming Salesforce Change Data Capture(CDC) into Kafka: An Architecture Field Guide

Most enterprises treat Salesforce as a system of record for the business, and a data platform (a Lakehouse, a warehouse, a set of streaming jobs) as t...

1 month ago

330

Connecting Informatica IDMC (CDI) to Cloudera Data Warehouse & Iceberg

Purpose Demonstrate end-to-end connectivity from the latest versions of Informatica and Cloudera Data Warehouse (CDW) – Impala Virtual Warehouse & Ic...

1 month ago

330

Network configuration for Azure Key Vault CMK to be used with Cloudera Data Service for public Cloud .

Cloudera for Azure supports CMK with Azure Key Vault. This article describes how to set up a network for CDP for Azure to allow a successful Data Serv...