Member since
11-17-2021
1163
Posts
261
Kudos Received
30
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 389 | 04-23-2026 02:02 PM | |
| 945 | 03-17-2026 05:26 PM | |
| 6211 | 11-05-2025 10:13 AM | |
| 1134 | 10-16-2025 02:45 PM | |
| 1901 | 10-06-2025 01:01 PM |
11-22-2024
05:29 AM
1 Kudo
The job failed with an OutOfMemoryError (OOME) at the child task attempt level, as indicated by the stacktrace. It was observed that certain mapreduce properties have been set, which may potentially overwrite the hive.tez.container.size property. SET mapreduce.map.java.opts=-Xmx3686m;
SET mapreduce.reduce.java.opts=-Xmx3686m;
SET mapred.child.java.opts=-Xmx10g; It is recommended to validate the yarn appLogs to confirm if the child task attempts were launched with 80% of the hive.tez.container.size. If not, it is advised to remove the mapreduce configurations and try re-running the job. Before re-running the query, it is suggested to collect statistics for all the source tables. This will assist the optimizer in creating a better execution plan.
... View more
11-19-2024
09:31 AM
1 Kudo
Hi, Can you provide sample of this data highlighting what the problem and how do you expect to solve? Also what kind of processor\service are you trying to use to parse this data?
... View more
11-19-2024
05:39 AM
@michalwojtowicz Mentioned error seem to be complaining about expired session which either gets terminated by client or server. Now, to answer your question driver config has SocketTimeout which controls TCP connection: "The number of seconds that the TCP socket waits for a response from the server before raising an error on the request." and default value of the same is 0(i.e the connection does not time out.) Refer: https://docs.cloudera.com/documentation/other/connectors/impala-jdbc/2-6-34/Cloudera-JDBC-Connector-for-Apache-Impala-Install-Guide.pdf However, could you confirm whether you have loadbalancer in place for impala through which you are connecting using JDBC driver? If yes, consider reviewing LB settings which should have timeout configurations allowing server to close the connection for long running queries, for instance: === timeout connect timeout client timeout server ===
... View more
11-15-2024
12:41 PM
2 Kudos
@djill Welcome to the Cloudera Community! To help you get the best possible solution, I have messaged you with next steps. Thanks!
... View more
11-13-2024
01:42 PM
1 Kudo
@repealp Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks.
... View more
11-13-2024
01:40 PM
@alex88 Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks.
... View more
11-13-2024
12:26 AM
2 Kudos
Hey, in the application logs everything looks fine. Instead of being able to click on the application name like I would normally do when the status is running, I have to go into the application logs and find the gradio app link at the bottom. When I look at the container logs, the last 3 lines are: 2024-11-13 08:22:14.557 18 INFO JupyterWSGLauncher ngh4jdz5m3ua258n Finish running startup chunks: success. data = {"user":"cdsw"} 2024-11-13 08:22:14.557 18 INFO JupyterWSGLauncher ngh4jdz5m3ua258n Proxying to livelog data = {"user":"cdsw"} 2024-11-13 08:22:14.557 18 INFO JupyterWSGTimeoutHandler ngh4jdz5m3ua258n idleTimeoutInMinutes data = {"idleTimeoutInMinutes":60,"user":"cdsw"} Suggesting everything is as expected? Edited: I found the problem. It was how I was defining the port for the application. Instead of using 'os.getenv('CDSW_APP_PORT')' I was using a manually set one. Thank you!
... View more
11-10-2024
11:22 PM
1 Kudo
Thanks yes it was version mismatch issue upgrading hive - 4.0 and tez 0.10.3 works forme
... View more
11-06-2024
05:20 PM
2 Kudos
thank you @szhou , we/team will plan for the upgrade and let you know if this has solved the issue. Thanks again, for your replies and ongoing support - including @DianaTorres as well.
... View more
11-06-2024
07:38 AM
@fisblack Has the reply helped resolve your issue? If so, please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future. Thanks.
... View more