Explore
Groups
Cloudera Developers

Create topic
Login / Register

Welcome to the Cloudera Community!

Ask questions, get answers and engage with your peers

Try:What is an Open Lakehouse architecture?How do I manage Spark Memory?Error handling tips for NiFi?

26,653 Topics
93,454 Replies
69,470 Members

Welcome The new Cloudera Community is live!

- Read the Announcement

Community Forum

Start discussions, ask questions, get answers

Community Articles

Read community sourced technical articles

Blogs

Read the latest Engineering and Developer articles

Latest Technical Blogs

Why Your Data Platform Needs to Run Where Your Data Lives

Cloud transformed the way we build software and as a side effect, Infrastructure became programmable. Storage became very elastic and analytics is now...

1 month ago

1450

Latest Questions

Recent
Unsolved

AlokKumarGold ⭐️

asked in Q&A

View Data Provenance rows' content is empty

Hello when I try to View Data Provenance of a processor then it shows multiple rows but then when I try to view its content then I get "Content is no longer available in the content repository"though the size in KB of the input and output claims

1273

17 hours ago

BobKingGold ⭐️

asked in Q&A

ExcelReader Controller Failing on valid date with proper Date Format setting

I am getting an error when using the ExcelReader to convert an Excel sheet to JSON. Everything works except for some dates. If I remove the Date Format setting on the controller, no issue, but get the date in milliseconds from 1/1/1970, which I do no

933

1 month ago

jame1997Silver ⭐️⭐️⭐️

asked in Q&A

GetSFTP reporting Processing Failed

Hello,I have a 3 nodes cluster environment running Nifi version 1.29.  Nifi logs are sync to Elastic Search; I noticed that GetSFTP is reporting Processing Failed multiple times.  It appears the processor recover on its own for example from

361

1 month ago

AlokKumarGold ⭐️

asked in Q&A

How to read Email Body in NiFi

HelloHow to read the body of the mail in nifi? I don't see any relevant processor for this.I see there is an "ExtractEmailAttachments" processor but will it read body reliably? We tried to test and see that it is able to make two flowfiles after exec

1513

1 month ago

vowxx007Bronze ⭐️⭐️⭐️

asked in Q&A

Comprehensive monitoring command line Spark 3x

Hi There, We are currently using Cloudera On-Prem (CDP 7.1.9SP1, CFM 2.1.7, CM 7.13.1), where monitoring of Spark jobs (such as memory utilization, CPU usage, active jobs, completed jobs, and related metrics) appears to be primarily available th

852

1 month ago

fy-testSilver ⭐️⭐️

asked in Q&A

Approval/review workflow + audit logging for Bitbucket-based Flow Registry Clients?

Hi all — we're migrating from NiFi Registry to the git-based Flow Registry Client, specifically the BitbucketFlowRegistryClient (NiFi 2.11.0), and validating the workflow.From what we've seen so far, committing a flow version via the NiFi UI pushes d

910

1 month ago

Mike_CHU44Gold ⭐️

asked in Q&A

DELETE rows in table, how HDFS file size is impacted ?

Hello.Before deleting rows in a specific table (463,462 rows in table), HDFS file size is :$ hadoop fs -du -s -h /apps/hive/warehouse/prd_thmil.db/th_mil_fb_code_value_brut54.2 M 162.6 M /apps/hive/warehouse/prd_thmil.db/th_mil_fb_code_value_brut54.2

37308

1 month ago

ipsonGold ⭐️

asked in Q&A

Nifi PutIceberg Processor failed to acquire SAS token on Azure

I'm running several ETL flows in CDF/Nifi. The flows all involve writing some data to Iceberg tables. These flows are mostly running on a schedule that ranges from hourly to weekly (i.e., infrequent writes). Each data flow deployment has a few indepe

30737

1 month ago

kswSilver ⭐️⭐️

asked in Q&A

Question about Angular dependency strategy in CFM 4.12.x

Apache NiFi 2.6.0 upstream ships with Angular 19.2.14. Apache did not change the Angular dependency within the NiFi 2.6.x release line. Instead, the Angular dependency update was introduced as part of the NiFi 2.7.0 development cycle.In contrast, CFM

2814

1 month ago

intersoldiBronze ⭐️⭐️⭐️

asked in Q&A

Kafka Connect to Snowflake connection via JDBC error

I have been trying to send data from Kafka to snowflake using the JDBC driver with Kafka connect. some details about the environment:Kafka is running in a Cloudera private cluster (Base 7.1.9).The version of the Snowflake-kafka connector driver is 2.

1501

1 month ago

Show more activity

AlokKumarGold ⭐️

asked in Q&A

View Data Provenance rows' content is empty

Hello when I try to View Data Provenance of a processor then it shows multiple rows but then when I try to view its content then I get "Content is no longer available in the content repository"though the size in KB of the input and output claims

1273

17 hours ago

jame1997Silver ⭐️⭐️⭐️

asked in Q&A

GetSFTP reporting Processing Failed

Hello,I have a 3 nodes cluster environment running Nifi version 1.29.  Nifi logs are sync to Elastic Search; I noticed that GetSFTP is reporting Processing Failed multiple times.  It appears the processor recover on its own for example from

361

1 month ago

vowxx007Bronze ⭐️⭐️⭐️

asked in Q&A

Comprehensive monitoring command line Spark 3x

Hi There, We are currently using Cloudera On-Prem (CDP 7.1.9SP1, CFM 2.1.7, CM 7.13.1), where monitoring of Spark jobs (such as memory utilization, CPU usage, active jobs, completed jobs, and related metrics) appears to be primarily available th

852

1 month ago

fy-testSilver ⭐️⭐️

asked in Q&A

Approval/review workflow + audit logging for Bitbucket-based Flow Registry Clients?

Hi all — we're migrating from NiFi Registry to the git-based Flow Registry Client, specifically the BitbucketFlowRegistryClient (NiFi 2.11.0), and validating the workflow.From what we've seen so far, committing a flow version via the NiFi UI pushes d

910

1 month ago

kswSilver ⭐️⭐️

asked in Q&A

Question about Angular dependency strategy in CFM 4.12.x

Apache NiFi 2.6.0 upstream ships with Angular 19.2.14. Apache did not change the Angular dependency within the NiFi 2.6.x release line. Instead, the Angular dependency update was introduced as part of the NiFi 2.7.0 development cycle.In contrast, CFM

2814

1 month ago

intersoldiBronze ⭐️⭐️⭐️

asked in Q&A

Kafka Connect to Snowflake connection via JDBC error

I have been trying to send data from Kafka to snowflake using the JDBC driver with Kafka connect. some details about the environment:Kafka is running in a Cloudera private cluster (Base 7.1.9).The version of the Snowflake-kafka connector driver is 2.

1501

1 month ago

DevOpsWorldBronze III

asked in Q&A

How to enable Spark 3.5 as a Runtime Addon for Cloudera AI Workbench sessions?

Hi all,We've upgraded our base cluster (Cloudera Runtime 7.1.9) to CDS 3.5via the new add-on parcel — that part is working fine.Now we're trying to make Spark 3.5 available as a selectable RuntimeAddon inside Cloudera AI Workbench sessions, but we're

1622

1 month ago

learndebBronze III

asked in Q&A

Cloudera Impala session getting hanged intermittently

Hi, Recently in one of our critical Cloudera CDP 7.1.7_p1044 cluster we could see that Impala is getting hanged intermittently and whenever Impala session are getting hanged no one was being able to run even Show databases and all Impala session

19994

2 months ago

mohammad_shamimGold ⭐️

asked in Q&A

Hive Table copy from Prod to QA .

I have copied hive table from Prod to QA by using get and put command but while executing select counnt (*) is it showing 0 count but i can see physical location is having data however i have checked all permission are in place so i did invalidate me

12126

2 months ago

solardeluneBronze ⭐️⭐️⭐️

asked in Q&A

Max Query Mem Default doesn't working

I have set my impala.admission-control.min-query-mem-limit.root.default to 2GiB and my impala.admission-control.max-query-mem-limit.root.default to 57GiB, which aligned with the memory allocation for each Impala Executor node that I've set

5243

2 months ago

Show more activity

Unlock Your Customer and Partner Community Benefits:

✓ Elevated Access
✓ Account Recognition
✓ Extended Permissions

To access these benefits, ensure you are logged in with your official Cloudera account linked to your organization.

Announcements

The new Cloudera Community is live!

0

Announcing Cloudera Data Flow 3.2 for Cloudera on Cloud

0

Community Upgrade Announcement

0

Announcing Cloudera Flow Management Operator for Kubernetes v3.3

0

Announcing Cloudera Streams Messaging Operator for Kubernetes v1.7

0

Leaderboard

Show full leaderboard

Latest Community Articles

Fine-Tuning: The Memory Budget with a Frozen Base

Training a model from scratch is time consuming and can be expensive, which is why many teams rely on fine-tuning — take an open-weight base model tha...

1 month ago

330

Streaming Salesforce Change Data Capture(CDC) into Kafka: An Architecture Field Guide

Most enterprises treat Salesforce as a system of record for the business, and a data platform (a Lakehouse, a warehouse, a set of streaming jobs) as t...

1 month ago

260

Connecting Informatica IDMC (CDI) to Cloudera Data Warehouse & Iceberg

Purpose Demonstrate end-to-end connectivity from the latest versions of Informatica and Cloudera Data Warehouse (CDW) – Impala Virtual Warehouse & Ic...

1 month ago

280

Network configuration for Azure Key Vault CMK to be used with Cloudera Data Service for public Cloud .

Cloudera for Azure supports CMK with Azure Key Vault. This article describes how to set up a network for CDP for Azure to allow a successful Data Serv...