Distribute the Docker image manually

[#1]

Hi All,

I hope you are doing well.

I have already built a custom Docker image and would like to transfer and deploy it on our Cloudera AI cluster. However, the cluster does not have internet access, and I need your support on how to properly distribute and run this image in such an air-gapped environment.

Could you please guide me through the best method to:

• Transfer the Docker image to the Cloudera cluster.

• Load and run it without internet access.

Looking forward to your support.

Best wishes,
Salim

[#2]

Hello @SalimAlhajri 

Thank you for reaching out to cloudera community

Try referring the step 3 from the document

https://docs.cloudera.com/machine-learning/1.5.4/runtimes/topics/ml-distribute-the-runtime-image.htm...

Docker commands you can get from the below path

# /opt/cloudera/parcels/ECS/docker/docker

Docker registry information would be in /var/run/cloudera-scm-agent/process/{Latest-ECS_SERVER_DIRECTORY/registries.yaml

Let me know if you have any queries

Thank you
Kshitij Upadhyay

[#3]

Hi Kshitij Upadhyay,

many thanks for your support. can you please explain more as i can not understand?

[#4]

Hello @SalimAlhajri 

Sorry for the delay

Can you please try following the below steps and see if that helps

https://docs.cloudera.com/machine-learning/1.5.4/runtimes/topics/ml-creating-a-customized-runtimes-i...

Thank you

Kshitij Upadhyay

[#5]

Dear Kshitij Upadhyay,

Many thanks for your support.

I have followed all the steps you provided. However, as mentioned earlier, the Cloudera ecosystem I’m working in does not have internet access. I have already loaded the Docker image onto the server, but I’m unable to validate or pull it for use within the Cloudera CDSW platform.

Could you please support me with the appropriate steps to proceed in this setup?

Best wishes,
Salim

[#6]

Hello Salim,

Thank you for your update

So what kind of registry are you using? Is that an embedded one?

[#7]

Hi 

I dont now, can you tell me how can i check?