Support Questions

Find answers, ask questions, and share your expertise

protobuf is installed on ML Runtime, but needs upgradation

avatar
New Contributor

Hello,

 

I was trying to install feast python library for which protobuf upgraded version is required. But protobuf 3.19.4 is part of available packages in ML runtime addons, so installing protobuf upgraded version is not shown in pip list command. 

 

Any suggestion on upgrading libraries which are part of ML runtime addons ?

6 REPLIES 6

avatar
Expert Contributor

Preinstalled packages can be upgraded based on the business requirement. 
I am curios to know what is the runtime version being used? By any chance did you test in the latest available runtime version?

avatar
New Contributor

Thanks @Gopinath, for your reply. I have used the latest available runtime version for python 3.7, 3.8 and 3.9. There are some packages which are coming from cml runtime, not from pip install, these packages need upgradation. But honestly, it can happen many times, which is why, it is difficult to raise business requirement each time.

avatar
Community Manager

@habibalsa, Has the reply helped resolve your issue? If so, can you please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future?  If you are still experiencing the issue, can you provide the information @Gopinath has requested?



Regards,

Vidya Sargur,
Community Manager


Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Learn more about the Cloudera Community:

avatar
Expert Contributor

@habibalsa subjected package [irrespective whether it is installed by user or preinstalled] can be upgraded through pip. At times the upgrade/install of packages may fail due to need root access or overlap with kernel libraries file, in those case it is recommended to have a custom image with required packages/version combinations built. 
https://docs.cloudera.com/machine-learning/cloud/runtimes/topics/ml-creating-a-customized-runtimes-i...

avatar
New Contributor

Hi @Gopinath, using pip I upgraded the package version before. Concern was about CMLAddons packages overriding those upgraded package. 

 

As I am not the system admin, your provided link won't help me much.

avatar
Expert Contributor

Thanks for your response @habibalsa 
You may considering getting a custom runtime add-on created with the packages. Still you need to work with CML admin to have them added in to CML. 
https://docs.cloudera.com/machine-learning/cloud/runtimes/topics/ml-custom-runtime-addons.html