question [CDSW] Package import error during model deployment in Support Questions

[CDSW] Package import error during model deployment

Hyeonseo — Fri, 10 Mar 2023 07:13:43 GMT

There is an error during cdsw model deployment where the package of code is not imported.

- CDSW version
1.9.2

- Folder Configuration
/home/cdsw
l- ex_package_one
l l- ex_package_two
l l-ex_pkg_code.py
l
l- predict
l l- predict.py

predict.py is the code used in the model deployment.

- Package import code within predict.py
....
from ex_package_one.ex_package_two import ex_pkg_code
...

- Error log
ModuleNotFoundError: No module named 'ex_package_one'

- Attempt to resolve the error
I printed it out as os.getcwd() from predict.py and it came out as /cdsw/home.

sys.path.append(os.path.dirname(os.path.abspath(os.path.dirname("__file__"))))
The path was added using the above code, but the same error occurred.

No package errors will occur if the code is transferred to /home/cdsw/predict.py.

Is there any other way to solve this problem?
Thank you for any help.

Re: [CDSW] Package import error during model deployment

ywu — Fri, 10 Mar 2023 08:55:14 GMT

Hi @Hyeonseo ,

If we print package locations from predict.py respectively:

python -c 'import site; print(site.getsitepackages())'

do you find the result is different?

If we add all the package locations is there still such issue?

Re: [CDSW] Package import error during model deployment

ZsoltH — Fri, 10 Mar 2023 10:12:49 GMT

I tried with sys.path.append("/home/cdsw") and it worked.

Re: [CDSW] Package import error during model deployment

ZsoltH — Fri, 10 Mar 2023 13:01:29 GMT

Otherwise the issue is that ipython does not always define __file__ , it is empty in a model.

(Also __file__ should be referred without quotes ", os.path.dirname(__file__) )

Re: [CDSW] Package import error during model deployment

Hyeonseo — Mon, 13 Mar 2023 05:05:01 GMT

The package locations all appeared to be the same.
(/usr/local/lib/python3.6/site-packages)

Writing code to add the "/home/cdsw/" path resolved the issue.

Thank you for suggesting a solution!

Re: [CDSW] Package import error during model deployment

Hyeonseo — Mon, 13 Mar 2023 05:09:50 GMT

I wrote a code to add the "/home/cdsw/" path, and the problem has been solved.

Thank you for your help!