Runtime Addon Upload Failing - "Failed saving addon content to NFS"
I'm running into an issue with custom runtime addon uploads on CML 2.0.44-h1-b4 (Kubernetes). Wondering if anyone else has seen this or can confirm my fix is safe.
**Problem:**
When uploading a runtime addon via the API endpoint `/api/v2/runtimeaddons/custom`, it shows "Initialized" in the UI, then fails after ~5 minutes with no error message. API logs show:
```
ERROR api.runtimeaddons Finish writing Custom Runtime Addon: failed.
ERROR api.runtimeaddons Finish adding new custom runtime addon failed: Failed saving addon content to NFS.
```
**What I Found:**
After digging through the deployment configs, the API pod is missing the `projects-pvc` volume mount. Other pods like `ds-vfs` and `s2i-client` have it mounted at `/projects`, but the API deployment doesn't.
```bash
# PVC shows it's used by ds-vfs and s2i-client, but NOT api
kubectl describe pvc projects-pvc
# API deployment has no projects-pvc volume
kubectl get deploy/api -o yaml | grep projects
# (returns nothing)
```
**Proposed Fix:**
Add the volume mount to the API deployment:
```bash
kubectl -n [namespace] patch deployment api --type='json' -p='[
{
"op": "add",
"path": "/spec/template/spec/volumes/-",
"value": {"name": "projects-claim", "persistentVolumeClaim": {"claimName": "projects-pvc"}}
},
{
"op": "add",
"path": "/spec/template/spec/containers/0/volumeMounts/-",
"value": {"name": "projects-claim", "mountPath": "/projects"}
}
]'
```
**Questions:**
1. Has anyone else hit this issue?
2. Is this mount supposed to be there by default?
3. Any risks to patching this in production?
4. Is this a known bug or did our installation miss something?
The addon metadata DOES save to the database, but the tarball content fails to write. My tarball and metadata.json are valid per the docs.
Any insights appreciated before I patch our production cluster!
Thanks!
