Cloudera Community
DianaTorres
user rank
user rank
Community Manager

Re: Unable to connect remote Hadoop cluster using ...

by Explorer in Support Questions
‎04-24-2023 07:25 AM
‎04-24-2023 07:25 AM
Sorry for late response, I use oozie to submit a spark job ... View more

Re: how can i copy hbase data from replication set...

by New Contributor in Support Questions
‎04-21-2023 03:00 AM
‎04-21-2023 03:00 AM
i fix this issue by run command on destination cluster,i think it caused by original version is too old to support ec (hadoop-2.7.5) ... View more

Re: Hive metastore lost connection while executing...

by Frequent Visitor in Support Questions
‎04-20-2023 01:10 AM
‎04-20-2023 01:10 AM
Thank you @mszurap for you response . I tried the suggested work around already and it seems like the issue still persists .  I agree the table has lot of partitions but I am pretty sure the code times out before 5 mins .  I have also tried enforcing the hive-site.xml with the updated timeout which also did not help much.  Only thing which worked was adding spark.catalog.recoverPartitions(table) before issuing the drop partition command .  I am really not sure as why recovering the partitions in the catalog eliminated the metastore warning .  Below is the updated code which is working without any warning : spark.sql.catalog.recoverPartitions(orders) spark.sql("alter table orders drop if exists partition(year=2023)") data.write.mode('Overwrite').parquet(hdfsPath) Any help here in understanding the problem will be much appreciated . ... View more

Re: Oozie Hive Job status changes to KILLED but th...

by Guru Guru in Support Questions
‎04-19-2023 12:22 AM
‎04-19-2023 12:22 AM
Glad to hear that. 🙂 The "hive.stats.autogather" should be unrelated to this, it just controls whether Hive should gather statistics at the end of INSERT statements, disabling it just speeds up the insert query somewhat. If you see something weird or not working with that enabled, feel free to open a support case on our Support Portal. See this and all the hive configuration descriptions in the HiveConf.java source code. Cheers,  Miklos ... View more

April 2023 Community Highlights

by Community Manager Community Manager in Community Announcements
‎04-16-2023 10:05 PM
‎04-16-2023 10:05 PM
Here are some highlights from the month of March   COMING NEXT! Streaming Data Pipeline Development   Check out the FY24 Cloudera Meetup Events Calendar for upcoming & past event details!     198 new support questions 2 new community articles 592 new members Rank  Community Article Author Components/ Labels #1 Processing files within the CML EFS (better I/O performance) - Edge Case with non-tabular data Ryan Cicak  @RyanCicak   Cloudera Machine Learning (CML)   We would like to recognize the below community members and employees for their efforts over the last month to provide community solutions.    See all our top participants at Top Solution Authors leaderboard and all the other leaderboards on our Leaderboards and Badges page.     @MattWho @smdas @steven-matison @mszurap @ckumar  @cotopaul @SAMSAL @davehkd @BrianChan @jorgeoa    Share your expertise and answer some of the below open questions. Also, be sure to bookmark the unanswered question page to find additional open questions.    Unanswered Community Post  Components/ Labels Hortonworks maven repo broken? Hortonworks Data Platform (HDP) Python updates Cloudera Data Platform (CDP) Nifi - Mongo X509 auth Apache NiFi ATLAS-409-00-002: Given type xxx has references Apache Atlas value cannot be converted to a timestamp Apache NiFI NiFi Registry   ... View more

Re: How to get Processor ID in CDF

by Frequent Visitor in Support Questions
‎04-16-2023 07:15 AM
‎04-16-2023 07:15 AM
Hi @DigitalPlumber  - Yes it is Public Cloud. I use NiPyAPI on HDF where I was able to add any variable etc using that library.    In CDP, I want to get the current processor ID. It can be via expression language or by API. How can I achieve that? For example, I want to fetch all the PutS3 processors ID then how can I get that?    ... View more

Re: PutDatabaseRecord "bytes" avro data type fails...

by Visitor in Support Questions
‎04-14-2023 07:03 AM
‎04-14-2023 07:03 AM
I have also tested the same with Apache Nifi 1.15.3 (open-source/community) and it works. It did not work though when testing with Apache Nifi 1.13.2 (open-source/community) it still fails with the same error message. ... View more

Re: Not able to connect ImpalaDB from Springboot a...

by Guru Guru in Support Questions
‎04-13-2023 12:05 AM
‎04-13-2023 12:05 AM
This sounds a Spring boot specific issue, a quick googling was leading me to  https://stackoverflow.com/questions/42073194/unable-to-detect-database-type please check if the suggestions in that discussion helps. ... View more

Re: Ambari UI not loading

by Explorer in Support Questions
‎04-08-2023 06:30 PM
‎04-08-2023 06:30 PM
Thanks for the advise. I will try that ... View more

Re: Error: Cannot load main class from JAR ...... ...

by Master Collaborator Master Collaborator in Support Questions
‎04-05-2023 11:48 PM
‎04-05-2023 11:48 PM
Hi @gizelly    Have you tried above solution and its worked? If yes, please accept as Solution. It will useful to other members. ... View more
Contact Me
Online
Offline
Last Visited
‎11-07-2025 09:40 AM
Community Statistics
Member Since ‎11-17-2021 08:08 AM
Last Visited ‎11-07-2025 09:40 AM
Posts 1,108
Kudos received 231