protobuf is installed on ML Runtime, but needs upgradation

6 replies
4535 views
Translate All

Hello,

I was trying to install feast python library for which protobuf upgraded version is required. But protobuf 3.19.4 is part of available packages in ML runtime addons, so installing protobuf upgraded version is not shown in pip list command.

Any suggestion on upgrading libraries which are part of ML runtime addons ?

Gopinath

Gold ⭐️⭐️

Preinstalled packages can be upgraded based on the business requirement.
I am curios to know what is the runtime version being used? By any chance did you test in the latest available runtime version?

Translate

habibalsaAuthor

Silver ⭐️⭐️

Thanks @Gopinath, for your reply. I have used the latest available runtime version for python 3.7, 3.8 and 3.9. There are some packages which are coming from cml runtime, not from pip install, these packages need upgradation. But honestly, it can happen many times, which is why, it is difficult to raise business requirement each time.

Translate

VidyaSargur

Community Manager

@habibalsa, Has the reply helped resolve your issue? If so, can you please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future? If you are still experiencing the issue, can you provide the information @Gopinath has requested?

Translate

Regards, Vidya Sargur, Community Manager Was your question answered? Make sure to mark the answer as the accepted solution. If you find a reply useful, say thanks by clicking on the thumbs up button.

Gopinath

Gold ⭐️⭐️

@habibalsa subjected package [irrespective whether it is installed by user or preinstalled] can be upgraded through pip. At times the upgrade/install of packages may fail due to need root access or overlap with kernel libraries file, in those case it is recommended to have a custom image with required packages/version combinations built.
https://docs.cloudera.com/machine-learning/cloud/runtimes/topics/ml-creating-a-customized-runtimes-image.html

Translate

habibalsaAuthor

Silver ⭐️⭐️

Hi @Gopinath, using pip I upgraded the package version before. Concern was about CMLAddons packages overriding those upgraded package.

As I am not the system admin, your provided link won't help me much.

Translate

Gopinath

Gold ⭐️⭐️

Thanks for your response @habibalsa
You may considering getting a custom runtime add-on created with the packages. Still you need to work with CML admin to have them added in to CML.
https://docs.cloudera.com/machine-learning/cloud/runtimes/topics/ml-custom-runtime-addons.html

Translate

Sign up

Please use your Cloudera account.

Login to the community

Please use your Cloudera account.