Member since
05-19-2023
5
Posts
0
Kudos Received
0
Solutions
09-11-2025
03:03 PM
I create a resource as a file, because the python-env resources are specifically for managing Python packages in requirements.txt, according to the documentation. Thanks!
... View more
09-10-2025
01:02 PM
I'm working with Airflow jobs in CDE. In my case, I have a resource that contains two files: one is the DAG file, and the other is a custom Python script that I want to import into the DAG. According to the documentation, resources in Airflow are mounted under /app/mount/<PREFIX>. However, when a job is created or updated, the DAG is validated before the resources are actually mounted in that folder, which causes the import to fail. If I encapsulate the import inside a PythonOperator, it works without issues, because at that point the resources are already available and the file can be found. The error I get during validation is always something like: "failed: invalid request: Invalid DAG: dag_import: Traceback (most recent call last): File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed File "/tmp/tmpfx_nrhlx/dag.py", line 6, in <module> from myModule import func ModuleNotFoundError: No module named 'myModule'" I’ve tried not only creating the job with the import, but also creating an empty job first (so that the /app/mount/ folder is created), and then updating the DAG file — but the error remains the same. Has anyone faced this issue and found a solution to make the import work from the beginning, without having to encapsulate it inside a function?
... View more
Labels:
07-06-2023
02:28 PM
I have a problem when I deploy a model. I run a function in a workbench that it read some files first, and it is success. Then I deploy that model in Cml and have this error: FileNotFoundError: [Errno 2] No such file or directory: 'file.parquet', with all of my files. I just probed change the path, the permissions, and it doesn't work. Some idea?
... View more
Labels:
- Labels:
-
Cloudera Machine Learning (CML)
05-23-2023
07:13 PM
Thanks for the reply. In my case the question is: I build a model and then I train the model again; How do I create a new build of the model with the same id of the model already created before? I have to have the same access key of the model. I use cmlapi. Can I do cmlapi.CreateModelBuildRequest with exiting model id? Do you understand what I mean?
... View more
05-19-2023
03:30 PM
I have a deployed model un Cloudera Machines Learning. The model is trained once a month, which I do through a pipeline (Jobs). It must be deployed after that again to take the updated model. Can the deployment be done in a way other than manual?
... View more
Labels:
- Labels:
-
Cloudera Machine Learning (CML)