docker pull的断点续传

docker pull的断点续传

1.修改/etc/docker/daemon.json

网络上有人说docker pull --continue可以断点续传，实测无效。dockers pull 根本没有–continue参数。
最终在github上找到了答案: 链接

按照其提示的办法进行，果然牛X。

sudo gedit /etc/docker/daemon.json #添加features
{"runtimes":{"nvidia":{"args":[],"path":"nvidia-container-runtime"}},"features":{"containerd-snapshotter":true}}

关键就在添加一个features

{"features":{"containerd-snapshotter":true}}

2.重新启动docker

sudo systemctl restart docker

3.docker resume 实况

下面是我下载docker镜像的过程：

Unable to find image 'qwenllm/qwen:1.5-cu121' locally
1.5-cu121: Pulling from qwenllm/qwen
24ff69e0a1e4: Download complete
ea278ac08796: Download complete
96d54c3075c9: Download complete
35817692a87e: Download complete
e3f63d7242f5: Download complete
abb1d69f27ac: Download complete
7f2f3df7d40c: Downloading [==================================>]1.16GB/1.664GB
afa75cca3a04: Downloading [===========>]347.1MB/1.472GB
57789402a9b0: Download complete
8c35a1861813: Downloading [===============>]785.4MB/2.49GB
e0ca71d1a62f: Download complete
c994b81dcc65: Download complete
649b24b6bec3: Download complete
84b6a42e847a: Download complete
a7bc10701a5b: Download complete
34dbfe62ee6b: Download complete
76a627ca5e65: Download complete
4639b7cd68e5: Download complete
4f4fb700ef54: Download complete
e6b25515aa6b: Download complete
effb9636c5d5: Download complete
27cbf0d1b839: Download complete
48327c7f35fb: Download complete
755e535b54a3: Download complete
7d32a9230f8f: Download complete
^C

中间卡住，ctrl+c中断再来

Unable to find image 'qwenllm/qwen:1.5-cu121' locally
1.5-cu121: Pulling from qwenllm/qwen
8c35a1861813: Downloading [=============================>]1.489GB/2.49GB
34dbfe62ee6b: Already exists
4f4fb700ef54: Already exists
ea278ac08796: Already exists
effb9636c5d5: Already exists
abb1d69f27ac: Already exists
c994b81dcc65: Already exists
e3f63d7242f5: Already exists
48327c7f35fb: Already exists
27cbf0d1b839: Already exists
649b24b6bec3: Already exists
e6b25515aa6b: Already exists
57789402a9b0: Already exists
7f2f3df7d40c: Download complete
e0ca71d1a62f: Already exists
afa75cca3a04: Downloading [=================================================>]1.463GB/1.472GB
^C

又卡住，又ctrl+c中断再来

Unable to find image 'qwenllm/qwen:1.5-cu121' locally
1.5-cu121: Pulling from qwenllm/qwen
34dbfe62ee6b: Already exists
57789402a9b0: Already exists
e6b25515aa6b: Already exists
4f4fb700ef54: Already exists
27cbf0d1b839: Already exists
7f2f3df7d40c: Already exists
e3f63d7242f5: Already exists
649b24b6bec3: Already exists
ea278ac08796: Already exists
48327c7f35fb: Already exists
abb1d69f27ac: Already exists
8c35a1861813: Download complete
c994b81dcc65: Already exists
afa75cca3a04: Downloading [=================================================>]1.47GB/1.472GB
effb9636c5d5: Already exists
e0ca71d1a62f: Already exists
^C

再次卡住，再次ctrl+c中断继续

Unable to find image 'qwenllm/qwen:1.5-cu121' locally
1.5-cu121: Pulling from qwenllm/qwen
afa75cca3a04: Download complete
7f2f3df7d40c: Already exists
34dbfe62ee6b: Already exists
4f4fb700ef54: Already exists
27cbf0d1b839: Already exists
c994b81dcc65: Already exists
e0ca71d1a62f: Already exists
ea278ac08796: Already exists
57789402a9b0: Already exists
abb1d69f27ac: Already exists
e6b25515aa6b: Already exists
48327c7f35fb: Already exists
effb9636c5d5: Already exists
649b24b6bec3: Already exists
Digest: sha256:e73218ca1bf746310bca11f5456f7d1b09a0df0c58dceabcc27116cf93d96b91
Status: Downloaded newer image for qwenllm/qwen:1.5-cu121

============CUDA============CUDA Version 12.1.0

Container image Copyright(c)2016-2023,NVIDIACORPORATION&AFFILIATES. All rights reserved.

This container image and its contents are governed by the NVIDIA Deep Learning Container License.
By pulling and using the container, you accept the terms and conditions ofthislicense:https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license

A copy ofthis license is made available inthis container at /NGC-DL-CONTAINER-LICENSEfor your convenience.***************************DEPRECATIONNOTICE!***************************THISIMAGEISDEPRECATED and is scheduled forDELETION.https://gitlab.com/nvidia/container-images/cuda/blob/master/doc/support-policy.md

root@xxxxxxxxx:/data/shared/Qwen# ls
cli_demo.py  ds_config_zero2.json  ds_config_zero3.json  finetune.py  finetune.sh  web_demo.py
root@xxxxxxxxx:/data/shared/Qwen# nvcc --version
nvcc:NVIDIA(R) Cuda compiler driver
Copyright(c)2005-2023NVIDIA Corporation
Built on Mon_Apr__3_17:16:06_PDT_2023
Cuda compilation tools, release 12.1,V12.1.105
Build cuda_12.1.r12.1/compiler.32688072_0
root@xxxxxxxxx:/data/shared/Qwen# exit
exit

完美收工。