Community News

Here are some highlights from the month of November 120 new support questions 13 new community articles 474 new members Rank  Community Article Author Components/ Labels #1 Metadata in Cloudera data warehouses Anshul Gupta@Anshul_Gupta  Apache AtlasApache HiveApache Impala #2 How to optimize IMPALA/KUDU queries Shantanu Gope@ShantanuGope  Apache ImpalaApache Kudu Cloudera Data Platform (CDP) #3 How to connect to CDW (Impala) to return actively running query progress Ryan Cicak@RyanCicak  Cloudera Data Warehouse (CDW)Cloudera Machine Learning (CML) #4 CML Runtime with Nvidia Libs and VSCode Editor Paul De Fusco@pauldefusco  Cloudera Machine Learning (CML) #5 How to find Meta RegionServer detail via command line Akash Singh@aps  Apache HBase We would like to recognize the below community members and employees for their efforts over the last month to provide community solutions. 

Here are some highlights from the month of October 100 new support questions 9 new community articles 476 new members Rank  Community Article Author Components/ Labels #1 Enterprise Data Quality at Scale with Spark and Great Expectations in Cloudera Data Engineering (CDE) Paul de Fusco(@pauldefusco ) Apache Airflow Apache Spark Cloudera Data Engineering (CDE) Cloudera Data Platform (CDP) #2 Spark Geospatial with Apache Sedona in Cloudera Data Engineering (CDE) Paul de Fusco(@pauldefusco ) Apache SparkCloudera Data Engineering (CDE) Cloudera Data Platform (CDP) #3 Processing real-time unstructured data with GenAI using Cloudera and IBM watsonx.ai Anshul Gupta(@Anshul_Gupta ) Apache NiFi Cloudera Data Fkow (CDF) #4 Feature Releases of Apache Spark 3 minor versions Ranga Reddy (@RangaReddy ) Apache Spark #5 New method to capturing Cloudera Manager (CM 7.x+) performance profile information Dhruv Seth (

Here are some highlights from the month of September Coming next on November 2nd: ICEBERG FORUM @EVOLVE Check out the FY24 Cloudera Meetup Events Calendar for upcoming & past event details! Coming next on October 26th: Virtual Event: The Open Data Lakehouse For Trusted Ai   114 new support questions 6 new community articles 3990new members Rank  Community Article Author Components/ Labels #1 Garbage Collection Pauses in Namenode and Datanode Karthik Palanisamy@kpalanisamy  Cloudera Data Platform (CDP)HDFS #2 PandasOnSpark in Cloudera Machine Learning (CML) Paul de Fusco@pauldefusco  Apache SparkCloudera Machine Learning (CML) #3 How to use Flow Definition to update flows instead of Templates Usman Khan@usman35  Apache NiFiCloudera Data Fkow (CDF) #4 How to Connect to Hiveserver2 Using Cloudera JDBC driver Asish Kumar@asish  Apache Hive #5 New Cloudera AMP with Amazon Bedrock I

Here are some highlights from the month of July Coming next on October 25th: Storage User Group Meetup Check out the FY24 Cloudera Meetup Events Calendar for upcoming & past event details! Coming next on October 26th: Virtual Event: The Open Data Lakehouse For Trusted Ai   167 new support questions 6 new community articles 481 new members Rank  Community Article Author Components/ Labels #1 How to call a CML Deployed Model From Apache NiFi in 10 minutes Or Less Ian Brooks (ibrooks) Apache NiFi Cloudera Data Science Workbench (CDSW) Cloudera Machine Learning (CML) #2 How to integrate Apache Spark with Solr Framework Ranga Reddy (RangaReddy) Apache SolrApache SparkCloudera Data Platform (CDP)Cloudera Data Platform Private Cloud (CDP-Private) #3 How to split and transform complex XML with EvaluateXQuery Processor Samer Saleh(SAMSAL) Apache NiFi #4 Issues using newer versions of python packages such as mlflow

Today, we're delighted to introduce a new and improved Community designed to enhance your Cloudera community experience. What's New in the Community? Here are some of the changes that we have worked on to enhance your engagement within the community: A Redesigned Home Page Updated Profile Settings Fresh Notifications and Message Placements, and Improved Navigation Redesigned Home Page: What to Expect The redesigned home page is now better organized. Community questions, blogs, and articles are neatly categorized into distinct sections, resulting in faster page loading times and an enhanced browsing experience. Account Information: Where to Find It To ensure a seamless experience, we've merged the Cloudera Community and MyCloudera profiles. Both accounts can now be conveniently accessed through links located in your Profile section. Notification System Changes: What's New Your profile, notifications, and private message indicators have been strategically relocated to the upper right

Here are some highlights from the month of July Coming next on September 23rd: Cloudera Now 23: THE OPEN DATA LAKEHOUSE FOR TRUSTED AI   172 new support questions 6 new community articles 501 new members Rank  Community Article Author Components/ Labels #1 How to integrate Spark3 with HBase Ranga Reddy @RangaReddy  Apache HBase Apache Spark Cloudera Data Platform (CDP) Cloudera Data Platform Private Cloud (CDP-Private) Cloudera Operational DB #2 How to integrate Spark3 with Kudu Ranga Reddy @RangaReddy  Apache Kudu Apache Spark Cloudera Data Platform (CDP) #3 CML Customize Runtime with ease (Python, R, and CUDA all in one) Ryan Cicak@RyanCicak  Cloudera Machine Learning (CML) #4 CML - Custom Runtime - VsCode using Python 3.10 Ryan Cicak@RyanCicak  Cloudera Machine Learning (CML) #5 How to change NiFi temporary staging path in case of security hardening Usman Khan@usman35&nb

We're thrilled to announce some exciting changes that we've been working on to improve your experience here. We can't wait to share them with all of you!   Here's a sneak peek at what's in store: A redesigned home page Updated profile and notification placement Improved navigation Home Page Redesign Our revamped page showcases community questions, blogs, and articles separated into distinct sections, resulting in faster page load times and improved browsing experience. Profile And Notification Indicators Your profile, notifications, and private message indicators have been moved to the upper right side of the page, ensuring easy access to essential account information. Additionally, we have combined the Cloudera Community and MyCloudera profiles, offering convenient access to both accounts through links available in one convenient location. Site Navigation To enhance site navigation, we've made significant updates to the community header. Now, you can easily find categories li

Here are some highlights from the month of June COMING NEXT! Streaming Data Pipeline Development Check out the FY24 Cloudera Meetup Events Calendar for upcoming & past event details!   149 new support questions 34 new community articles 423 new members Rank  Community Article Author Components/ Labels #1 Spark in CML: Recommendations for using Spark in Cloudera Machine Learning Paul de Fusco  @pauldefusco  Apache Spark Cloudera Machine Learning (CML) #2 Explaining "block missing" and "block corruption" alerts in HDFS Karthik Palanisamy @kpalanisamy  HDFS #3 NIFI SSL in Modern Versions of NiFi Steven Matison @steven-matison  Apache NiFi #4 Sizing CML Workspaces: Must-Knows for properly planning workspace resources Paul de Fusco  @pauldefusco  Cloudera Data Platform (CDP)Cloudera Machine Learning (CML) #5 Publish_Kafka_1_0 processor not stops working after upgrading to CFM

Here are some highlights from the month of May   COMING NEXT! Streaming Data Pipeline Development Check out the FY24 Cloudera Meetup Events Calendar for upcoming & past event details!   182 new support questions 14 new community articles 472 new members Rank  Community Article Author Components/ Labels #1 Get data from Oracle by Apache NiFi , then save to Hive Parquet External Table Zhen Zeng @zzeng  Apache NiFi #2 Spark3 Integration Examples Ranga Reddy @RangaReddy  Apache HBase Apache Hive Apache Iceberg Apache Kafka Apache Kudu Apache Ozone Apache Phoenix Apache Spark Cloudera Data Platform (CDP) #3 Operationalize NiFi data flows with Cloudera DataFlow Steven Matison @steven-matison  Apache Spark Cloudera Data Platform (CDP) #4 CDW - RAZ Enabled : How to add S3 Bucket in Two Steps (That was EASY) Ryan Cicak@RyanCicak  Apache Ranger Cloudera Data Warehouse (CDW) #5

Here are some highlights from the month of March   COMING NEXT! Streaming Data Pipeline Development   Check out the FY24 Cloudera Meetup Events Calendar for upcoming & past event details!     198 new support questions 2 new community articles 592 new members Rank  Community Article Author Components/ Labels #1 Processing files within the CML EFS (better I/O performance) - Edge Case with non-tabular data Ryan Cicak @RyanCicak   Cloudera Machine Learning (CML)   We would like to recognize the below community members and employees for their efforts over the last month to provide community solutions.    See all our top participants at Top Solution Authors leaderboard and all the other leaderboards on our Leaderboards and Badges page.     @MattWho @smdas @steven-matison @mszurap @ckumar @cotopaul @SAMSAL @davehkd @BrianChan @jorgeoa

  Visit the Future of Data Meetup group page to join a local group & register for events!   178 new support questions 7 new community articles 517 new members   Community Article Author Components/ Labels Open Data Lakehouse powered by Apache Iceberg on Apache Ozone Saketa Chalamchala@saketa  Apache Hive Apache Impala Apache Spark Cloudera Data Platform (CDP) Cloudera Data Platform Private Cloud (CDP-Private) Installing Django in Cloudera Machine Learning (CML) Ryan Cicak@RyanCicak  Cloudera Machine Learning (CML) How to Spark Roll Event Log Files in CDP Ranga Reddy@RangaReddy  Apache Spark Cloudera Data Platform (CDP) CDSW - CML || How to import a private repository from Github, gitlab Girish Vaggar @gireeshn  Cloudera Data Science Workbench (CDSW)  Cloudera Machine Learning (CML) Navigator Metadata Service is not starting in CDH6.3.4 Amararam Gehlot @agehlot  Cl

Here are some highlights from the month of January 194 new support questions 5 new community articles 573 new members     Rank  Community Article Author Components/ Labels #1 CDP Public Cloud DL /DH vertical scaling for Azure based cluster  Usman Khan  @usman35  Cloudera Data Engineering (CDE) Cloudera Enterprise Data Hub Cloudera Machine Learning (CML) Data Engineering UI #2 How to install l Apache NiFi on Macbook, for learning Zhen Zeng  @zzeng  Apache NiFi #3 Importing additional python modules while making use of ExecuteProcess processor in NiFi Manick Mehra  @mmehra  Apache NiFi #4 Vertical scaling of DataHub Master VM in AWS Usman Khan @usman35  Cloudera Data Engineering (CDE) Cloudera Data Platform (CDP) Cloudera Data Science and Engineering Cloudera Enterprise Data Hub Cloudera Machine Learning (CML) #5 NFS Disk migration for Cloudera Machine Learning - Private C

Here are some highlights from the month of December 162 new support questions 1 new community article 493 new members       Rank  Community Article Author Components/ Labels #1 How to Integrate CDE with COD and Reading & Writing to Phoenix Tables using Data Engineering Service by leveraging PySpark on CDP Platform Syed Saleem Hameed @shameed  Apache HBase Apache Phoenix Apache Spark Cloudera Data Engineering (CDE) Cloudera Data Platform (CDP) Cloudera Operational DB   We would like to recognize the below community members and employees for their efforts over the last month to provide community solutions.  See all our top participants at Top Solution Authors leaderboard and all the other leaderboards on our Leaderboards and Badges page.   @smdas @MattWho @Kartik_Agarwal @rki_ @myzard @sanjaysubs @hegdemahendra @jorge_florencio    Share your expertise and answer

Here are some highlights from the month of November 206 new support questions 6 new community articles 660 new members Rank  Community Article Author Components/ Labels #1 Datagen - Data Generator tool built for CDP Francois Risch  @frisch  Apache Hadoop Apache HBase Apache Hive Apache Impala Apache Kafka Apache Kudu Apache Solr Cloudera Data Platform (CDP) Cloudera Data Platform Private Cloud (CDP-Private) Cloudera Manager #2 Connecting CML to Data Lake & CDW with R Eduard Bangga @eduardb  Apache Hive Apache Impala Apache Spark Cloudera Data Science and Engineering Cloudera Data Science Workbench (CDSW) Cloudera Machine Learning (CML) #3 CDP Private Cloud 7.16 : HUE MYSQL 8 connection error Unexpected error. Unable to verify database connection Arshadullah Khan @khanarshadazmat  Cloudera Hue   We would like to recognize the below community members and employees for their efforts over the last

Here are some highlights from the month of October 217 new support questions 15 new community articles 702 new members   Rank  Community Article Author Components/ Labels #1 Using Flink to monitor Ranger audits ‚Äì User Session Analysis William Dyson @wdyson Apache Flink Apache Ranger Cloudera Streaming Analytics (CSA) #2 Dynamic Policy Hooks in CDP Davide Vergari @dvergar  Apache Ranger #3 Understanding NiFi's "Terminate" option on running components. Matthew Clarke @MattWho  Apache NiFi #4 Parquet timestamp handling for non UTC data in CDP 7.1.7 cluster. Usman Khan @usman35  Apache Hive  Apache Spark Cloudera Data Platform (CDP) Cloudera Data Platform Private Cloud (CDP-Private) Cloudera Enterprise Data Hub #5 Override CDSW image load directory other than /var/lib/cdsw/docker-tmp Gopinath Nagarajan @Gopinath  Cloudera Data Science Workbench (CDSW)

Here are some highlights from the month of September 257 new support questions 7 new community articles 645 new members Rank  Community Article Author Components/ Labels #1 Real-time Twitter Dashboard using Cloudera Data Platform Anshul Gupta  (@Anshul_Gupta) Apache Hive Apache NiFi Cloudera Data Platform (CDP) Cloudera DataFlow (CDF) #2 Connecting DBeaver to a CDP Impala Virtual Warehouse Craig Nelson  (@cnelson2) Apache Impala Cloudera Data Platform (CDP) #3 Accelerate COVID-19 outreach programs using Cloudera Data Platform - Public Cloud Anshul Gupta (@Anshul_Gupta) Apache Atlas Apache Hive Apache NiFi Cloudera Machine Learning (CML) #4 Using Streams Messaging Manager in CDP to create a Snowflake KConnect Sink Craig Nelson ( (@cnelson2) Apache Kafka Cloudera Data Platform (CDP) Kerberos #5 Configuring Kafka Console Producer/Consumer on a Secured CDP Cluster Craig Nelson (@cnelson2) Apache Kafka Cloudera

Here are some highlights from the month of August 247 new support questions 3 new community articles 639 new members   Rank  Community Article Author Components/ Labels #1 How Cloudera Data Platform excels at hybrid use cases Anshul Gupta @Anshul_Gupta  Apache Hive Apache NiFi Apache Spark Cloudera Data Platform (CDP) Cloudera Data Platform Private Cloud (CDP-Private) #2 Using Recipes to Simplify Data Hub Setup Tasks Craig Nelson  @cnelson2  Cloudera Data Platform (CDP) Cloudera Enterprise Data Hub #3 Knox HA / Loadbalancing using Haproxy Vikas Srivastava  @cloude  Apache Knox Hortonworks Data Platform (HDP)   Congratulations Robin Kakkasery @rki_  for being the Community Spotlight member for the month!! Thanks for everything that you do!!Check out the Community Member Spotlight on Cloudera Linkedin!     We would like to recognize the below community members and employees f

Here are some highlights from the month of July 231 new support questions 8 new community articles 586 new members Rank  Community Article Author Components/ Labels #1 MySQL CDC with Kafka Connect/Debezium in CDP Public Cloud @cnelson2  Apache Kafka Cloudera Data Platform (CDP) Kerberos #2 Event driven pipelines in Azure with CDE(Cloudera Data Engineering) orchestrated by Azure Event Grid/Azure Functions @hrongali  Apache Spark Cloudera Data Engineering (CDE) Cloudera Data Platform (CDP) #3 How to configure CML's Spark Connection @peter_ableda  Cloudera Data Science Workbench (CDSW) Cloudera Machine Learning (CML) #4 HDP to CDP - Atlas backup and restore @hpasumarthi  Apache Atlas Cloudera Data Platform (CDP) Hortonworks Data Platform (HDP) #5 "kinit: Preauthentication failed while getting initial credentials" when using Active Directory or FreeIPA @araujo  Kerberos Securit

Here are some highlights from the month of June   206 new support questions 3 new community articles 646 new members     Rank  Community Article Author Components/ Labels #1 NiFi cluster sandbox on Docker @araujo  Apache NiFi #2 Decompressing nested ZIP files in NiFi @araujo  Apache NiFi #3 Cloudera Machine Learning adds ability for admins to add a static subdomain for the CML Workspace @cpv0310  Cloudera Machine Learning (CML) #4 MySQL CDC with Kafka Connect/Debezium in CDP Public Cloud  @cnelson2  Apache Kafka Cloudera Data Platform (CDP) Kerberos   Thank you to @shehbazk for supporting our community! :trophy: 👏 Check out the Community Member Spotlight on Cloudera Linkedin!     We would like to recognize the below community members and employees for their efforts over the last month to provide community solutions.    See all our top participants