Skip to main content
paulfg
paulfg
Gold ⭐️
July 30, 2024
Solved

Are LLMs built into CML or do we only access them through huggingface

We're doing a bit of research here and trying to understand if LLMs are only available by accessing them through git and huggingface or whether there are some in built LLMs accessible using CML. 

Thank you

    Mike
    MikeAnswer
    Gold ⭐️
    July 30, 2024

    Hi, you can build your own LLMs in CML, or you can access existing ones in huggingface. The HuggingFace ones can be installed as an AMP, see here: https://docs.cloudera.com/machine-learning/cloud/applied-ml-prototypes/topics/ml-huggingface.html#concept_gs1_vb4_21c

    This is the quickest way to get started. The actual model is still stored on HF so if your cluster is airgapped you will have some trouble using the AMP feature - it's possible but is kind of a pain.

    Cloudera does not SHIP any LLMs as far as I know.

    View in thread

    4 replies

    DianaTorres
    Community Manager
    DianaTorres
    Community Manager
    July 30, 2024

    @paulfg Welcome to the Cloudera Community!

    To help you get the best possible solution, I have tagged our CML experts @bbreak @cravani  who may be able to assist you further.

    Please keep us updated on your post, and we hope you find a satisfactory solution to your query.

    Translate
    Regards, Diana Torres, Senior Community Moderator
      DianaTorres
      Community Manager
      DianaTorres
      Community Manager
      July 30, 2024

      @Gopinath @Mike Do you have any insights here? Thanks!

      Translate
      Regards, Diana Torres, Senior Community Moderator
        Mike
        Gold ⭐️
        MikeAnswer
        Gold ⭐️
        July 30, 2024

        Hi, you can build your own LLMs in CML, or you can access existing ones in huggingface. The HuggingFace ones can be installed as an AMP, see here: https://docs.cloudera.com/machine-learning/cloud/applied-ml-prototypes/topics/ml-huggingface.html#concept_gs1_vb4_21c

        This is the quickest way to get started. The actual model is still stored on HF so if your cluster is airgapped you will have some trouble using the AMP feature - it's possible but is kind of a pain.

        Cloudera does not SHIP any LLMs as far as I know.

        Translate
          paulfg
          paulfgAuthor
          Gold ⭐️
          August 1, 2024

          Thanks Mike - I thought this was the case. 

          Translate
            Terms & ConditionsAccessibility statement