Member since
11-17-2021
1127
Posts
256
Kudos Received
29
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2747 | 11-05-2025 10:13 AM | |
| 479 | 10-16-2025 02:45 PM | |
| 1021 | 10-06-2025 01:01 PM | |
| 813 | 09-24-2025 01:51 PM | |
| 626 | 08-04-2025 04:17 PM |
07-14-2025
06:27 AM
1 Kudo
Thank you for confirming!
... View more
07-11-2025
08:48 PM
1 Kudo
@moekraft Starting with Cloudera Runtime 7.3.x, Spark 3 is the default and integrated Spark version, and Spark 2 has been removed and is no longer supported. >> Does Spark still get installed separately or is it included with the base runtime? -- As a result, you do not need to install a separate Spark 3 parcel for CDP Private Cloud Base 7.3.x. The Spark 3 runtime is bundled within the Cloudera Runtime parcel itself so you won’t find a separate, compatible Spark 3 parcel in the support matrix or parcel repository for this version. To proceed, simply use the Spark service that comes bundled with the Cloudera Runtime 7.3.x. After initial Cloudera Runtime 7.3.x installation, you can use the Add a Spark3 Service wizard to add and configure new service instances directly via Cloudera Manager >> Apparently Spark 3 is supported by 7.3.1 and Spark 3.5 by 7.3.1 SP1. - Cloudera Runtime 7.3.1.100 CHF 1 bundled with Spark 3.4.x. Please refer the list of the official component versions for Cloudera Runtime 7.3.1.100 CHF 1 - Cloudera Runtime 7.3.1.200 SP1 and latest bundled with Spark 3.5.x. Please refer the list of the official component versions for Cloudera Runtime 7.3.1.200 SP1. >> Should the support matrix be updated to reflect support for Spark 3? - It's for CDS version support matrix, from Cloudera Runtime 7.3.x onwards you don't need CDS for Spark3, so you can refer the below release notes: https://docs.cloudera.com/cdp-private-cloud-base/7.3.1/private-release-notes/topics/rt-whats-new-spa...
... View more
07-09-2025
08:32 PM
@LSIMS As this is an older post, you would have a better chance of receiving a resolution by starting a new thread. This will also be an opportunity to provide details specific to your environment that could aid others in assisting you with a more accurate answer to your question. You can link this thread as a reference in your new post. Thanks.
... View more
07-09-2025
07:35 PM
1 Kudo
Sorry about that. I'll keep that in mind for the future. I was able to resolve the issue though. Thank you.
... View more
07-09-2025
06:10 PM
@Afridi Welcome to the Cloudera Community! To help you get the best possible solution, I have tagged our Kafka experts @rki_ @ChethanYM @paras @Babasaheb who may be able to assist you further. Please keep us updated on your post, and we hope you find a satisfactory solution to your query.
... View more
07-09-2025
06:37 AM
Hello, thank you for your help. We made progress. However, now we are running into an ERROR 500 when we try to POST the filled out template that we exported before. We verified again, that there is no problem with the json format and that there is no typo in the instantiator section. We did following command: # curl -X POST -H "Content-Type: application/json" -d @cloudera.json http://admin:admin@<IP>:7182/api/v54/cm/importClusterTemplate?addRepositories=true Warning: Couldn't read data from file "cloudera.json", this makes an Warning: empty POST. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 500 Error processing POST request. Check the system logs for more information.</title> </head> <body><h2>HTTP ERROR 500 Error processing POST request. Check the system logs for more information.</h2> <table> <tr><th>URI:</th><td>/api/v54/cm/importClusterTemplate</td></tr> <tr><th>STATUS:</th><td>500</td></tr> <tr><th>MESSAGE:</th><td>Error processing POST request. Check the system logs for more information.</td></tr> <tr><th>SERVLET:</th><td>com.cloudera.server.common.AgentAvroServlet-70ce31c3</td></tr> </table> </body> </html> and following traceback in the log: 2025-07-09 15:14:22,469 ERROR agentServer-55:com.cloudera.server.common.AgentAvroServlet: Error processing Avro request java.io.IOException: Unexpected length: -16843009, max: 10485760 at com.cloudera.enterprise.SafeAvroHttpTransceiver.checkLength(SafeAvroHttpTransceiver.java:139) at com.cloudera.enterprise.SafeAvroHttpTransceiver.readBuffers(SafeAvroHttpTransceiver.java:96) at com.cloudera.server.common.HttpConnectorServer$FunctionsImpl.read(HttpConnectorServer.java:118) at com.cloudera.server.common.HttpConnectorServer$FunctionsImpl.read(HttpConnectorServer.java:110) at com.cloudera.server.common.AgentAvroServlet.doPost(AgentAvroServlet.java:90) at javax.servlet.http.HttpServlet.service(HttpServlet.java:665) at javax.servlet.http.HttpServlet.service(HttpServlet.java:750) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:554) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:600) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1440) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:505) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1355) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:516) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at com.cloudera.server.common.MovingStats$1.get(MovingStats.java:32) at com.cloudera.server.common.MovingStats$1.get(MovingStats.java:29) at com.cloudera.server.common.MovingStats.measure(MovingStats.java:41) at com.cloudera.server.common.MovingStats.measure(MovingStats.java:29) at com.cloudera.server.common.MonitoringThreadPool$RunnableImpl.run(MonitoringThreadPool.java:135) at com.cloudera.server.common.BoundedQueuedThreadPool$2.run(BoundedQueuedThreadPool.java:94) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) at java.lang.Thread.run(Thread.java:750) We also tried the command without an "@" in front of the json file argument with following result: # curl -X POST -H "Content-Type: application/json" -d /tmp/cloudera.json http://admin:admin@<IP>:7182/api/v54/cm/importClusterTemplate?addRepositories=true <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 500 Error processing POST request. Check the system logs for more information.</title> </head> <body><h2>HTTP ERROR 500 Error processing POST request. Check the system logs for more information.</h2> <table> <tr><th>URI:</th><td>/api/v54/cm/importClusterTemplate</td></tr> <tr><th>STATUS:</th><td>500</td></tr> <tr><th>MESSAGE:</th><td>Error processing POST request. Check the system logs for more information.</td></tr> <tr><th>SERVLET:</th><td>com.cloudera.server.common.AgentAvroServlet-70ce31c3</td></tr> </table> </body> </html> and following error in the logs: 2025-07-09 14:18:12,393 ERROR agentServer-57:com.cloudera.server.common.AgentAvroServlet: Error processing Avro request java.io.IOException: Unexpected length (too long): 796159344, max:10485760 at com.cloudera.enterprise.SafeAvroHttpTransceiver.checkLength(SafeAvroHttpTransceiver.java:137) at com.cloudera.enterprise.SafeAvroHttpTransceiver.readBuffers(SafeAvroHttpTransceiver.java:96) at com.cloudera.server.common.HttpConnectorServer$FunctionsImpl.read(HttpConnectorServer.java:118) at com.cloudera.server.common.HttpConnectorServer$FunctionsImpl.read(HttpConnectorServer.java:110) at com.cloudera.server.common.AgentAvroServlet.doPost(AgentAvroServlet.java:90) at javax.servlet.http.HttpServlet.service(HttpServlet.java:665) [...] My colleague and I do not see, where we could have made a mistake. What can be the cause of this? Thanks for your help!
... View more
07-04-2025
11:19 AM
@Jackallboy Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. If you are still experiencing the issue, can you provide the information requested? Thanks.
... View more
07-02-2025
09:32 AM
Thank you very much. I have setup the timezone in my.cnf.
... View more
07-01-2025
09:19 PM
Here are some highlights from the month of June
ANALYST REPORT The Future of Enterprise AI Agents
Download the Report HERE
VIRTUAL EVENT The latest innovations in data, analytics & AI
Register Now
Check out the FY25 Cloudera Meetup Events Calendar for upcoming & past event details!
62 new support questions
1095 new members
Community Article
Author
Components/ Labels
Lighthouse FAQs - The New Support Portal (GA in June 2025)
Madhubrat Patra
Cloudera Search
From SAP S/4HANA to Lakehouse: A Practical Guide Using OData API and Apache NiFi
Zhen Zeng
Apache Iceberg Apache NiFi
ZooKeeper removal from Cruise Control
Tamas Barnabas Egyed
Apache Kafka Apache Zookeeper
Introduction to CDE Job and Resource ACLs
Paul DeFusco
Apache Airflow Apache Spark Cloudera Data ENgineering (CDE)
We would like to recognize the below community members and employees for their efforts over the last month to provide community solutions.
See all our top participants at Top Solution Authors leaderboard and all the other leaderboards on our Leaderboards and Badges page.
@MattWho @ggangadharan @haridjh @upadhyayk04 @mburgess @Rahulkavdt @Shelton @linssab @joseomjr @Lorenzo_F
Share your expertise and answer some of the below open questions. Also, be sure to bookmark the unanswered question page to find additional open questions.
Unanswered Community Post
Components/ Labels
HBase snapshot to s3 AWS
Apache HBase
NiFi 1.23.2 'Too Many Open Files' After Enabling TLS – Closed TCP Connections Persist
Apache NiFi
Groovy script to validate XML against schema (XSD) always returns a valid XML even when it is invalid
Cloudera DataFlow (CDF)
Do new data arriving into a cold storage folder on hdfs need to be moved by a mover?
Hortonworks Data Platform (HDP)
Cleaning data HDFS
HDFS
... View more
06-26-2025
01:21 PM
If you know where the CSV files are on the filesystem and the condition is simple, you may be able to start with CSV file 1 then use 2 LookupRecord processors in sequence with 2 CSVRecordLookupService controller services (each pointing at CSV file 2 and 3 respectively). If that doesn't suit your needs, check out the ForkEnrichment and JoinEnrichment processors, they may be able to do what you need.
... View more