Created 03-29-2023 01:26 AM
Hello,
I was trying to install feast python library for which protobuf upgraded version is required. But protobuf 3.19.4 is part of available packages in ML runtime addons, so installing protobuf upgraded version is not shown in pip list command.
Any suggestion on upgrading libraries which are part of ML runtime addons ?
Created on 04-06-2023 12:18 AM - edited 04-06-2023 12:20 AM
Preinstalled packages can be upgraded based on the business requirement.
I am curios to know what is the runtime version being used? By any chance did you test in the latest available runtime version?
Created on 06-18-2023 12:15 AM - edited 06-18-2023 12:15 AM
Thanks @Gopinath, for your reply. I have used the latest available runtime version for python 3.7, 3.8 and 3.9. There are some packages which are coming from cml runtime, not from pip install, these packages need upgradation. But honestly, it can happen many times, which is why, it is difficult to raise business requirement each time.
Created 04-11-2023 12:02 AM
@habibalsa, Has the reply helped resolve your issue? If so, can you please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future? If you are still experiencing the issue, can you provide the information @Gopinath has requested?
Regards,
Vidya Sargur,Created 06-18-2023 10:02 PM
@habibalsa subjected package [irrespective whether it is installed by user or preinstalled] can be upgraded through pip. At times the upgrade/install of packages may fail due to need root access or overlap with kernel libraries file, in those case it is recommended to have a custom image with required packages/version combinations built.
https://docs.cloudera.com/machine-learning/cloud/runtimes/topics/ml-creating-a-customized-runtimes-i...
Created 06-18-2023 10:11 PM
Hi @Gopinath, using pip I upgraded the package version before. Concern was about CMLAddons packages overriding those upgraded package.
As I am not the system admin, your provided link won't help me much.
Created 06-18-2023 10:40 PM
Thanks for your response @habibalsa
You may considering getting a custom runtime add-on created with the packages. Still you need to work with CML admin to have them added in to CML.
https://docs.cloudera.com/machine-learning/cloud/runtimes/topics/ml-custom-runtime-addons.html