Ask questions, get answers and engage with your peers
HiI've got a CDE 1.22.0-h1-b3 cluster that fails to load the Spark UI after the job has completed. I can see the Spark UI during the running of a job but it fails to load/open once the job has completed.I see an http GET to the /jobs endpoi
Hello We have a pretty big flow in NiFi (NiFi 2.8.0) having many processors and my requirement is to determine how much time a particular request took. Most of the request starts with a HandleHttpRequest Processor and has some 250 processors in betwe
Hi all,I'm setting up a CML session with 64GB of RAM and 4 CPUs, then I set up a PySpark session with these configurationsspark = SparkSession.builder \.appName("OptimizedSparkSession") \.master("local[*]") \.config("spark.sql.execution.arrow.pyspark
Slide deck for my presentation at Confluent’s Current 2026. Thursday, November 5, 20262:50 PM - 3:05 PMTopic: Understanding Puffin File Format for Advanced Query Optimization in Apache Iceberg Apache Iceberg manifests store essential statistics such
We are testing Spark column-level lineage with Apache Atlas in CDP Private Cloud Base 7.1.9.A successful Spark CTAS operation creates this projection:CREATE TABLE tdc_spark_ctas_test.customers_expression_testUSING PARQUETASSELECT customer_id, f
Is there a roadmap or plan whether and if yes, when the Cloudera will support dbt v2? Even a rough timeframe would be very helpful.
Hive ODBC Driver 2.10.1 only have libcurl.dll 8.21.0-DEV.how to get version 8.22 from hotfix?C:\Program Files\Cloudera ODBC Driver for Apache Hive\lib\libcurl.dll Installed version : 8.21.0-DEV Fixed version : 8.22.0 Potential V
Hi all,I'm looking for the recommended way to avoid making the same database call for every file in NiFi.Environment- Apache NiFi version: 2.12.0- Deployment: [single node / cluster with X nodes]Use caseOur filenames include a suffix, for example: Sa
Why we started measuring VariantThere has been a lot of interest lately in migrating from JSON-as-string columns to the new native Apache Parquet VARIANT type. The design rationale is compelling: a self-describing binary encoding that avoids re-parsi
Dear support, community, As you all may have noticed there has been a lot of security issues and hacks being done these last few months. Exploiting vulnerabilities has never been so easy with the use of AI. Just last. week eMudhra CA certificates hav
Hi everyone,We’re setting up a few new worker nodes for our cluster and I’m stuck on memory. Our jobs are mostly Spark and Hive, and sometimes they run out of memory when a lot of them start at once.The servers we picked take and I’m trying to decid
Can Impala and Kudu be sold as commercial products?A Chinese company, Sensors Data, uses them as part of their commercial product.Is this okay?
Hello,I have MsSql DB and Oracle DB. I am gonna try to explain what I want to do. I am fetching data from MsSQL DB than I am inserting that rows to Oracle DB but this structure not dynamic. Because I created TEST table on both side. So I am writ
Hello when I try to View Data Provenance of a processor then it shows multiple rows but then when I try to view its content then I get "Content is no longer available in the content repository"though the size in KB of the input and output claims
Hello,I have a 3 nodes cluster environment running Nifi version 1.29. Nifi logs are sync to Elastic Search; I noticed that GetSFTP is reporting Processing Failed multiple times. It appears the processor recover on its own for example from
Hi There, We are currently using Cloudera On-Prem (CDP 7.1.9SP1, CFM 2.1.7, CM 7.13.1), where monitoring of Spark jobs (such as memory utilization, CPU usage, active jobs, completed jobs, and related metrics) appears to be primarily available th
Already have an account? Login
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.
