Options
- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
configuring failure and reties
Labels:
- Labels:
-
Apache Ambari
-
Apache Spark
-
Apache YARN
Rising Star
Created ‎08-18-2020 04:17 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
i am trying to get the following flow
submit a grid app (with about 300 jobs )
sometimes jobs fails and we would like to retry them
but after 20 retries (or total 20 failures) we would like to mark the entire application as failed and stop all running\pending jobs
i have set yarn.resourcemanager.am.max-attempts=2
how i can limit the total error before marking the entire job submit as failure?
i am based spark\yarn
1 REPLY 1
Rising Star
Created ‎08-23-2020 02:29 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
anyone?
