- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
protobuf is installed on ML Runtime, but needs upgradation
Created 03-29-2023 01:26 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hello,
I was trying to install feast python library for which protobuf upgraded version is required. But protobuf 3.19.4 is part of available packages in ML runtime addons, so installing protobuf upgraded version is not shown in pip list command.
Any suggestion on upgrading libraries which are part of ML runtime addons ?
Created on 04-06-2023 12:18 AM - edited 04-06-2023 12:20 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Preinstalled packages can be upgraded based on the business requirement.
I am curios to know what is the runtime version being used? By any chance did you test in the latest available runtime version?
Created on 06-18-2023 12:15 AM - edited 06-18-2023 12:15 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thanks @Gopinath, for your reply. I have used the latest available runtime version for python 3.7, 3.8 and 3.9. There are some packages which are coming from cml runtime, not from pip install, these packages need upgradation. But honestly, it can happen many times, which is why, it is difficult to raise business requirement each time.
Created 04-11-2023 12:02 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@habibalsa, Has the reply helped resolve your issue? If so, can you please mark the appropriate reply as the solution, as it will make it easier for others to find the answer in the future? If you are still experiencing the issue, can you provide the information @Gopinath has requested?
Regards,
Vidya Sargur,Community Manager
Was your question answered? Make sure to mark the answer as the accepted solution.
If you find a reply useful, say thanks by clicking on the thumbs up button.
Learn more about the Cloudera Community:
Created 06-18-2023 10:02 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@habibalsa subjected package [irrespective whether it is installed by user or preinstalled] can be upgraded through pip. At times the upgrade/install of packages may fail due to need root access or overlap with kernel libraries file, in those case it is recommended to have a custom image with required packages/version combinations built.
https://docs.cloudera.com/machine-learning/cloud/runtimes/topics/ml-creating-a-customized-runtimes-i...
Created 06-18-2023 10:11 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi @Gopinath, using pip I upgraded the package version before. Concern was about CMLAddons packages overriding those upgraded package.
As I am not the system admin, your provided link won't help me much.
Created 06-18-2023 10:40 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thanks for your response @habibalsa
You may considering getting a custom runtime add-on created with the packages. Still you need to work with CML admin to have them added in to CML.
https://docs.cloudera.com/machine-learning/cloud/runtimes/topics/ml-custom-runtime-addons.html