Dragonfly dragonfly对接harbor拉取镜像没有走dragonfly问题

Ⅰ. Issue Description

参考 https://github.com/dragonflyoss/Dragonfly/blob/master/docs/ecosystem/Harbor-with-Dragonfly.md 这个文档来在本地一台机器上部署了1.0.0版本的dragonfly，并搭建了harbor。可以成功拉取镜像，但是发现dfdaemon和dfclient里面没有日志。

Ⅱ. Describe what happened

Ⅲ. Describe what you expected to happen

期望拉取镜像走dragonfly。

Ⅳ. How to reproduce it (as minimally and precisely as possible)

1.启动supernode命令： docker run -d --name supernode --restart=always -p 8001:8001 -p 8002:8002 -v /home/admin/supernode:/home/admin/supernode dragonflyoss/supernode:1.0.0 --download-port=8001

启动dfclient命令： docker run -d --name dfclient --restart=always -p 65001:65001 -v /etc/dragonfly:/etc/dragonfly -v $HOME/.small-dragonfly:/root/.small-dragonfly dragonflyoss/dfclient:1.0.0

配置文件：

root@k8s:/etc/dragonfly# cat /etc/dragonfly/dfdaemon.yml 
dfget_flags: ["--node","10.1.6.200=1","-f","Expires&Signature"]
proxies:
  - regx: blobs/sha256.*
hijack_https:
  hosts:
    - regx: 10.1.6.200
      certs: []
      insecure: true

docker 配置文件：

root@k8s:/etc/dragonfly# cat /etc/docker/daemon.json
{
  "insecure-registries" : [
    "10.1.6.200"
  ]
}

docker info 信息：

root@k8s:/etc/dragonfly# docker info
Client:
 Debug Mode: false

Server:
 Containers: 11
  Running: 11
  Paused: 0
  Stopped: 0
 Images: 21
 Server Version: 19.03.8
 Storage Driver: overlay2
  Backing Filesystem: <unknown>
  Supports d_type: true
  Native Overlay Diff: true
 Logging Driver: json-file
 Cgroup Driver: cgroupfs
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
 Swarm: inactive
 Runtimes: runc
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: 7ad184331fa3e55e52b890ea95e65ba581ae3429
 runc version: dc9208a3303feef5b3839f4323d9beb36df0a9dd
 init version: fec3683
 Security Options:
  apparmor
  seccomp
   Profile: default
 Kernel Version: 4.4.0-171-generic
 Operating System: Ubuntu 16.04.6 LTS
 OSType: linux
 Architecture: x86_64
 CPUs: 80
 Total Memory: 251.6GiB
 Name: k8s
 ID: 37YA:RU3D:3GBI:DYVN:L5ZT:77GT:TRDJ:OUH2:OPB3:A24C:IFWT:R7UT
 Docker Root Dir: /var/lib/docker
 Debug Mode: false
 HTTP Proxy: http://127.0.0.1:65001
 HTTPS Proxy: http://127.0.0.1:65001
 Registry: https://index.docker.io/v1/
 Labels:
 Experimental: false
 Insecure Registries:
  10.1.6.200
  127.0.0.0/8
 Live Restore Enabled: false

WARNING: No swap limit support

尝试拉取镜像： docker pull 10.1.6.200/moyasu/nginx:latest

能拉取成功，但是dfclient和dfdaemon日志里面没有日志。

Ⅴ. Anything else we need to know?

Ⅵ. Environment:

dragonfly version: 1.0.0
OS (e.g. from /etc/os-release):

root@k8s:/etc/dragonfly# cat /etc/os-release NAME="Ubuntu" VERSION="16.04.6 LTS (Xenial Xerus)" ID=ubuntu ID_LIKE=debian PRETTY_NAME="Ubuntu 16.04.6 LTS" VERSION_ID="16.04" HOME_URL="http://www.ubuntu.com/" SUPPORT_URL="http://help.ubuntu.com/" BUG_REPORT_URL="http://bugs.launchpad.net/ubuntu/" VERSION_CODENAME=xenial UBUNTU_CODENAME=xenial

Kernel (e.g. uname -a): root@k8s:/etc/dragonfly# uname -a Linux k8s 4.4.0-171-generic #200-Ubuntu SMP Tue Dec 3 11:04:55 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Install tools:
Others:

Apr 12 '20 13:04 ghost

另外，我启动dfclient之前dfdemon的配置文件中指定了新的remote 为http：//10.1.6.200 。但是启动dfclient容器后，从dfdaemon日志中看到镜像仓库还是默认官网的镜像仓库啊

 root@k8s:~/.small-dragonfly/logs# cat /etc/dragonfly/dfdaemon.yml 
registry_mirror:
   remote: http://10.1.6.200
   insecure: true
dfget_flags: ["--node","10.1.6.200=1","-f","Expires&Signature"]
proxies:
  - regx: blobs/sha256.*
hijack_https:
  hosts:
    - regx: 10.1.6.200
      certs: []
      insecure: true


root@k8s:~/.small-dragonfly/logs# echo 11 > dfdaemon.log 
root@k8s:~/.small-dragonfly/logs# 
root@k8s:~/.small-dragonfly/logs# cat dfdaemon.log 
11
root@k8s:~/.small-dragonfly/logs# 
root@k8s:~/.small-dragonfly/logs# 
root@k8s:~/.small-dragonfly/logs# docker stop dfclient
dfclient
root@k8s:~/.small-dragonfly/logs# docker rm  dfclient
dfclient
root@k8s:~/.small-dragonfly/logs# 
root@k8s:~/.small-dragonfly/logs# 
root@k8s:~/.small-dragonfly/logs# docker run -d --name dfclient --restart=always -p 65001:65001     -v /etc/dragonfly:/etc/dragonfly     -v $HOME/.small-dragonfly:/root/.small-dragonfly     dragonflyoss/dfclient:1.0.0
36649d182c8be407e5ca27e856a421958789388a6a6ef873b6b2210ae9686360
root@k8s:~/.small-dragonfly/logs# 
root@k8s:~/.small-dragonfly/logs# 
root@k8s:~/.small-dragonfly/logs# cat dfdaemon.log 
11
2020-04-12 14:11:18.451 INFO sign:1 : use dfget version  1.0.0
  Git commit:     ac262d5
  Build date:     20191119-17:44:26
  Go version:     go1.12.10
  OS/Arch:        linux/amd64 from /opt/dragonfly/df-client/dfget
2020-04-12 14:11:18.452 INFO sign:1 : using config: {"registry_mirror":{"remote":"https://index.docker.io","certs":null,"insecure":true,"direct":false},"proxies":[{"regx":"blobs/sha256.*","use_https":false,"direct":false,"redirect":""}],"hijack_https":{"cert":"","key":"","hosts":[{"regx":"10.1.6.200","insecure":true,"certs":[]}]},"port":65001,"hostIp":"127.0.0.1","certpem":"","keypem":"","verbose":false,"maxprocs":4,"dfget_flags":["--node","10.1.6.200=1","-f","Expires\u0026Signature"],"supernodes":null,"ratelimit":"20MB","workHome":"/root/.small-dragonfly","localrepo":"/root/.small-dragonfly/dfdaemon/data","dfpath":"/opt/dragonfly/df-client/dfget","logConfig":{"maxSize":0,"maxBackups":0}}
2020-04-12 14:11:18.452 INFO sign:1 : registry mirror: https://index.docker.io
2020-04-12 14:11:18.452 INFO sign:1 : 1 proxy rules loaded
2020-04-12 14:11:18.452 INFO sign:1 : [1] proxy blobs/sha256.* with dfget 
2020-04-12 14:11:18.452 INFO sign:1 : rate limit set to 20MB
2020-04-12 14:11:18.452 INFO sign:1 : start dfdaemon http server on :65001

Apr 12 '20 14:04 ghost

提供的快启动文档，真的还能再优化一下，确实很多困惑。

Apr 15 '20 07:04 zhaowencheng1991

macOS/Ubuntu下的dockerd的代理行为跟centos的dockerd的代理行为不一致，macOS/Ubuntu下的dockerd会将容器内的请求也转发到代理dfdaemon，而dfdaemon也是容器启动的，dfdaemon在转发请求的时候又走了dockerd的代理，最终导致死循环。这个问题会跟进，解决后同步到文档中。

Apr 22 '20 15:04 lowzj

我也有相同的问题，使用的是centos7.3，内核3.10.0-1062.12.1.el7.x86_64，docker version19.03.8。 harbor：172.25.66.110 supernode：172.25.66.111-112 dfclient：172.25.66.113-116

supernode启动命令： docker run --name dragonfly-supernode --restart=always -idt -p 8001:8001 -p 8002:8002 -v /root/dragonfly/supernode:/home/admin/supernode 172.25.66.110/dragonfly/supernode:1.0.0 --advertise-ip=172.25.66.111 docker run --name dragonfly-supernode --restart=always -idt -p 8001:8001 -p 8002:8002 -v /root/dragonfly/supernode:/home/admin/supernode 172.25.66.110/dragonfly/supernode:1.0.0 --advertise-ip=172.25.66.112

dfclient启动命令： docker run --name dragonfly-dfclient -itd --restart=always -p 65001:65001 -v /root/small-dragonfly:/root/.small-dragonfly 172.25.66.110/dragonfly/dfclient:1.0.0 --node 172.25.66.111 --node 172.25.66.112 --registry=http://172.25.66.110 --ratelimit 100M

dfclient docker配置： /etc/docker/daemon.json { "insecure-registries": [ "172.25.66.110" ], "storage-driver": "overlay" }

docker proxy: Environment="HTTP_PROXY=http://127.0.0.1:65001" Environment="HTTPS_PROXY=http://127.0.0.1:65001"

拉取镜像命令： docker pull 172.25.66.110/dragonfly/img:1G

在client上pull镜像，localhost:65001上有抓到包，但是client和supernode上都没有日志刷新，data下也没有数据文件。

我尝试用二进制文件启动，也是相同的结果。打开debug，日志如下 2020-04-27 18:49:04.517 DEBU sign:19914 : Tunneling https request for 172.25.66.110:443 2020-04-27 18:49:04.520 DEBU sign:19914 : round trip directly: GET http://172.25.66.110/v2/ 2020-04-27 18:49:04.529 DEBU sign:19914 : round trip directly: GET http://172.25.66.110/service/token?account=admin&scope=repository%3Adragonfly%2Fimg%3Apull&service=harbor-registry 2020-04-27 18:49:04.558 DEBU sign:19914 : round trip directly: GET http://172.25.66.110/v2/dragonfly/img/manifests/1G 2020-04-27 18:49:04.653 DEBU sign:19914 : round trip directly: GET http://172.25.66.110/v2/dragonfly/img/blobs/sha256:482cc0370c7c888dc656ab9801e1cd257d447c5d5bacc33ee048604aa1649a83 2020-04-27 18:49:04.653 DEBU sign:19914 : round trip directly: GET http://172.25.66.110/v2/dragonfly/img/blobs/sha256:aad63a9339440e7c3e1fff2b988991b9bfb81280042fa7f39a5e327023056819 2020-04-27 18:49:04.653 DEBU sign:19914 : round trip directly: GET http://172.25.66.110/v2/dragonfly/img/blobs/sha256:97acd4fda45b91f29808af0e87de69f595bb09f866282ae21c666c473de712ab 2020-04-27 18:49:25.474 INFO sign:19914 : scan repo and clean expired files 2020-04-27 18:49:25.474 DEBU sign:19914 : ignore /root/small-dragonfly/dfdaemon/data: not a regular file

只有dfdaemon刷日志，supernode并无日志，查看发现dfdaemon与supernode之间并无连接

请问是我哪里配置有问题么

Apr 27 '20 06:04 deadjoker

@deadjoker docs: Step 2: Deploy Dragonfly Client 配置下 proxies 属性，然后容器启动时加上配置文件

Apr 27 '20 12:04 lowzj

@lowzj 启动时添加了配置文件，目前在日志里是可以看到下载信息了谢谢。

同时我发现另一个问题，虽然dfdaemon调用dfget从supernode下载了镜像，日志中能够看到相关的信息，在supernode上的repo下也可以看到文件，但client上只有pull镜像的这台data下有文件，其他client上data目录下是空的。难道不应该是client之间会同步block么？另一方面，我在同一台client上pull同一个镜像，每次pull之后，data目录下都会多出一些文件，supernode上文件不变。这个也是正常的么？看上去感觉是没有正常组成p2p网络

在dfclient日志中可以看到

2020-04-28 06:43:19.669 INFO sign:22-1588056199.667 : get cmd params:["/opt/dragonfly/df-client/dfget" "-u" "http://172.25.66.110/v2/dragonfly/img/blobs/sha256:482cc0370c7c888dc656ab9801e1cd257d447c5d5bacc33ee048604aa1649a83" "-o" "/root/.small-dragonfly/dfdaemon/data/461ea45e-af68-4d9c-89b1-b2877aa4cef4" "--node" "172.25.66.111=1" "-f" "Expires&Signature" "--dfdaemon" "-s" "100MB" "--totallimit" "100MB" "--node" "172.25.66.111" "--header" "User-Agent:docker/19.03.8 go/go1.12.17 git-commit/afacb8b kernel/3.10.0-1062.12.1.el7.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/19.03.8 \\(linux\\))" "--header" "Authorization:Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6IkdWSVI6Rk1ESTpEVFZOOjVJWlY6N1VDMzpNWkFEOkFJTFI6QUxBRzpVUk41OjIyUUM6VEtSRjpXNFdXIn0.eyJpc3MiOiJoYXJib3ItdG9rZW4taXNzdWVyIiwic3ViIjoiYWRtaW4iLCJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE1ODgwNTc5OTgsIm5iZiI6MTU4ODA1NjE5OCwiaWF0IjoxNTg4MDU2MTk4LCJqdGkiOiJ5OHdYSUR3dWdGUnExWWNDIiwiYWNjZXNzIjpbeyJ0eXBlIjoicmVwb3NpdG9yeSIsIm5hbWUiOiJkcmFnb25mbHkvaW1nIiwiYWN0aW9ucyI6WyJwdXNoIiwiKiIsInB1bGwiXX1dfQ.eBvaHvOMMN9sdd7XrhdH3sFizMvalGpgaCBssdvCKjqq2BGEOXMkxKkiZyqO6gui3FfvZoZ64I7OkraQ0D5zy7gp2KGkBwzUILhD1hDLejsJZNzH5u44xvPveACe91qMe8kiT_KJ3u415UOaNpjbcNTsnCiEOlDwz5rBPL4B7CsYSNaB6ZSMJ9lLdZx_yuH9RsIzgHuEHbsFFy0LPDXUgU3awtiWNP3VMsLFaxOuPoyz8qWln-dxhnN7WBjJVjeKvuSNJBz2dDAJEOqxizLpn4N9gl2FIFJn8asC5jb0MJT-c-GlAoWQP1yII3SENs5kDhiNNxtFggmjpQir_yfcF0Zr-QDu_387wgZXEN7f1vtSTqUtSwiM6JGHCP27kUy8eiCVpfQoQdwDj_DMe5L9gSdD9lYw8YklSCBDtlVGxBStuCZpoSgLz1VZpGteufD2mcJCq9w508ie8KmXntkGG-yxorK_OGp21n3MglPMdBn6lQdxSEeOSOrn_u9wV13Y0h6Vc_VGqV5xT9u-pZZeIo3fwwfMSkfSCkBI1y7aMMbjdafxSNoqPKrUjuYW-Kt3u2Nwr4fhCW1bkye67V4_esx08LsE894iKvRWbQlzSLxB35KMD8WDyIRd5lsqdM9aEYbsedz5eV_QCbrKoYd3XGW_dwGOkhr6vGRhrLpwne0" "--header" "Connection:close"]
2020-04-28 06:43:19.669 INFO sign:22-1588056199.667 : get init config:{"url":"http://172.25.66.110/v2/dragonfly/img/blobs/sha256:482cc0370c7c888dc656ab9801e1cd257d447c5d5bacc33ee048604aa1649a83","output":"/root/.small-dragonfly/dfdaemon/data/461ea45e-af68-4d9c-89b1-b2877aa4cef4","pattern":"p2p","filter":["Expires","Signature"],"header":["User-Agent:docker/19.03.8 go/go1.12.17 git-commit/afacb8b kernel/3.10.0-1062.12.1.el7.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/19.03.8 \\(linux\\))","Authorization:Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6IkdWSVI6Rk1ESTpEVFZOOjVJWlY6N1VDMzpNWkFEOkFJTFI6QUxBRzpVUk41OjIyUUM6VEtSRjpXNFdXIn0.eyJpc3MiOiJoYXJib3ItdG9rZW4taXNzdWVyIiwic3ViIjoiYWRtaW4iLCJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE1ODgwNTc5OTgsIm5iZiI6MTU4ODA1NjE5OCwiaWF0IjoxNTg4MDU2MTk4LCJqdGkiOiJ5OHdYSUR3dWdGUnExWWNDIiwiYWNjZXNzIjpbeyJ0eXBlIjoicmVwb3NpdG9yeSIsIm5hbWUiOiJkcmFnb25mbHkvaW1nIiwiYWN0aW9ucyI6WyJwdXNoIiwiKiIsInB1bGwiXX1dfQ.eBvaHvOMMN9sdd7XrhdH3sFizMvalGpgaCBssdvCKjqq2BGEOXMkxKkiZyqO6gui3FfvZoZ64I7OkraQ0D5zy7gp2KGkBwzUILhD1hDLejsJZNzH5u44xvPveACe91qMe8kiT_KJ3u415UOaNpjbcNTsnCiEOlDwz5rBPL4B7CsYSNaB6ZSMJ9lLdZx_yuH9RsIzgHuEHbsFFy0LPDXUgU3awtiWNP3VMsLFaxOuPoyz8qWln-dxhnN7WBjJVjeKvuSNJBz2dDAJEOqxizLpn4N9gl2FIFJn8asC5jb0MJT-c-GlAoWQP1yII3SENs5kDhiNNxtFggmjpQir_yfcF0Zr-QDu_387wgZXEN7f1vtSTqUtSwiM6JGHCP27kUy8eiCVpfQoQdwDj_DMe5L9gSdD9lYw8YklSCBDtlVGxBStuCZpoSgLz1VZpGteufD2mcJCq9w508ie8KmXntkGG-yxorK_OGp21n3MglPMdBn6lQdxSEeOSOrn_u9wV13Y0h6Vc_VGqV5xT9u-pZZeIo3fwwfMSkfSCkBI1y7aMMbjdafxSNoqPKrUjuYW-Kt3u2Nwr4fhCW1bkye67V4_esx08LsE894iKvRWbQlzSLxB35KMD8WDyIRd5lsqdM9aEYbsedz5eV_QCbrKoYd3XGW_dwGOkhr6vGRhrLpwne0","Connection:close"],"dfdaemon":true,"nodes":["172.25.66.111:8002=1"],"localLimit":"100MB","minRate":"64KB","totalLimit":"100MB","clientQueueSize":6,"workHome":"/root/.small-dragonfly","logConfig":{"maxSize":0,"maxBackups":0}}
2020-04-28 06:43:19.670 INFO sign:22-1588056199.667 : target file path:/root/.small-dragonfly/dfdaemon/data/461ea45e-af68-4d9c-89b1-b2877aa4cef4
2020-04-28 06:43:19.671 INFO sign:22-1588056199.667 : runtimeVariable: {"MetaPath":"/root/.small-dragonfly/meta/host.meta","SystemDataDir":"/root/.small-dragonfly/data","DataDir":"/root/.small-dragonfly/data","RealTarget":"/root/.small-dragonfly/dfdaemon/data/461ea45e-af68-4d9c-89b1-b2877aa4cef4","TargetDir":"/root/.small-dragonfly/dfdaemon/data","TempTarget":"/root/.small-dragonfly/dfdaemon/data/dfget-22-1588056199.667.tmp-303407981","Cid":"172.17.0.2-22-1588056199.667","TaskURL":"http://172.25.66.110/v2/dragonfly/img/blobs/sha256:482cc0370c7c888dc656ab9801e1cd257d447c5d5bacc33ee048604aa1649a83","TaskFileName":"461ea45e-af68-4d9c-89b1-b2877aa4cef4-22-1588056199.667","LocalIP":"172.17.0.2","PeerPort":0,"FileLength":-1,"DataExpireTime":180000000000,"ServerAliveTime":300000000000}
2020-04-28 06:43:19.675 INFO sign:22-1588056199.667 : local http result: err:dial tcp4 172.17.0.2:0: connect: connection refused, port:0 path:/check/
2020-04-28 06:43:19.726 INFO sign:23-1588056199.726 : get cmd params:["/opt/dragonfly/df-client/dfget" "-u" "http://172.25.66.110/v2/dragonfly/img/blobs/sha256:aad63a9339440e7c3e1fff2b988991b9bfb81280042fa7f39a5e327023056819" "-o" "/root/.small-dragonfly/dfdaemon/data/73e80b11-d473-4306-8583-755602b1f859" "--node" "172.25.66.111=1" "-f" "Expires&Signature" "--dfdaemon" "-s" "100MB" "--totallimit" "100MB" "--node" "172.25.66.111" "--header" "User-Agent:docker/19.03.8 go/go1.12.17 git-commit/afacb8b kernel/3.10.0-1062.12.1.el7.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/19.03.8 \\(linux\\))" "--header" "Authorization:Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6IkdWSVI6Rk1ESTpEVFZOOjVJWlY6N1VDMzpNWkFEOkFJTFI6QUxBRzpVUk41OjIyUUM6VEtSRjpXNFdXIn0.eyJpc3MiOiJoYXJib3ItdG9rZW4taXNzdWVyIiwic3ViIjoiYWRtaW4iLCJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE1ODgwNTc5OTgsIm5iZiI6MTU4ODA1NjE5OCwiaWF0IjoxNTg4MDU2MTk4LCJqdGkiOiJ5OHdYSUR3dWdGUnExWWNDIiwiYWNjZXNzIjpbeyJ0eXBlIjoicmVwb3NpdG9yeSIsIm5hbWUiOiJkcmFnb25mbHkvaW1nIiwiYWN0aW9ucyI6WyJwdXNoIiwiKiIsInB1bGwiXX1dfQ.eBvaHvOMMN9sdd7XrhdH3sFizMvalGpgaCBssdvCKjqq2BGEOXMkxKkiZyqO6gui3FfvZoZ64I7OkraQ0D5zy7gp2KGkBwzUILhD1hDLejsJZNzH5u44xvPveACe91qMe8kiT_KJ3u415UOaNpjbcNTsnCiEOlDwz5rBPL4B7CsYSNaB6ZSMJ9lLdZx_yuH9RsIzgHuEHbsFFy0LPDXUgU3awtiWNP3VMsLFaxOuPoyz8qWln-dxhnN7WBjJVjeKvuSNJBz2dDAJEOqxizLpn4N9gl2FIFJn8asC5jb0MJT-c-GlAoWQP1yII3SENs5kDhiNNxtFggmjpQir_yfcF0Zr-QDu_387wgZXEN7f1vtSTqUtSwiM6JGHCP27kUy8eiCVpfQoQdwDj_DMe5L9gSdD9lYw8YklSCBDtlVGxBStuCZpoSgLz1VZpGteufD2mcJCq9w508ie8KmXntkGG-yxorK_OGp21n3MglPMdBn6lQdxSEeOSOrn_u9wV13Y0h6Vc_VGqV5xT9u-pZZeIo3fwwfMSkfSCkBI1y7aMMbjdafxSNoqPKrUjuYW-Kt3u2Nwr4fhCW1bkye67V4_esx08LsE894iKvRWbQlzSLxB35KMD8WDyIRd5lsqdM9aEYbsedz5eV_QCbrKoYd3XGW_dwGOkhr6vGRhrLpwne0" "--header" "Connection:close"]
2020-04-28 06:43:19.726 INFO sign:23-1588056199.726 : get init config:{"url":"http://172.25.66.110/v2/dragonfly/img/blobs/sha256:aad63a9339440e7c3e1fff2b988991b9bfb81280042fa7f39a5e327023056819","output":"/root/.small-dragonfly/dfdaemon/data/73e80b11-d473-4306-8583-755602b1f859","pattern":"p2p","filter":["Expires","Signature"],"header":["User-Agent:docker/19.03.8 go/go1.12.17 git-commit/afacb8b kernel/3.10.0-1062.12.1.el7.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/19.03.8 \\(linux\\))","Authorization:Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6IkdWSVI6Rk1ESTpEVFZOOjVJWlY6N1VDMzpNWkFEOkFJTFI6QUxBRzpVUk41OjIyUUM6VEtSRjpXNFdXIn0.eyJpc3MiOiJoYXJib3ItdG9rZW4taXNzdWVyIiwic3ViIjoiYWRtaW4iLCJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE1ODgwNTc5OTgsIm5iZiI6MTU4ODA1NjE5OCwiaWF0IjoxNTg4MDU2MTk4LCJqdGkiOiJ5OHdYSUR3dWdGUnExWWNDIiwiYWNjZXNzIjpbeyJ0eXBlIjoicmVwb3NpdG9yeSIsIm5hbWUiOiJkcmFnb25mbHkvaW1nIiwiYWN0aW9ucyI6WyJwdXNoIiwiKiIsInB1bGwiXX1dfQ.eBvaHvOMMN9sdd7XrhdH3sFizMvalGpgaCBssdvCKjqq2BGEOXMkxKkiZyqO6gui3FfvZoZ64I7OkraQ0D5zy7gp2KGkBwzUILhD1hDLejsJZNzH5u44xvPveACe91qMe8kiT_KJ3u415UOaNpjbcNTsnCiEOlDwz5rBPL4B7CsYSNaB6ZSMJ9lLdZx_yuH9RsIzgHuEHbsFFy0LPDXUgU3awtiWNP3VMsLFaxOuPoyz8qWln-dxhnN7WBjJVjeKvuSNJBz2dDAJEOqxizLpn4N9gl2FIFJn8asC5jb0MJT-c-GlAoWQP1yII3SENs5kDhiNNxtFggmjpQir_yfcF0Zr-QDu_387wgZXEN7f1vtSTqUtSwiM6JGHCP27kUy8eiCVpfQoQdwDj_DMe5L9gSdD9lYw8YklSCBDtlVGxBStuCZpoSgLz1VZpGteufD2mcJCq9w508ie8KmXntkGG-yxorK_OGp21n3MglPMdBn6lQdxSEeOSOrn_u9wV13Y0h6Vc_VGqV5xT9u-pZZeIo3fwwfMSkfSCkBI1y7aMMbjdafxSNoqPKrUjuYW-Kt3u2Nwr4fhCW1bkye67V4_esx08LsE894iKvRWbQlzSLxB35KMD8WDyIRd5lsqdM9aEYbsedz5eV_QCbrKoYd3XGW_dwGOkhr6vGRhrLpwne0","Connection:close"],"dfdaemon":true,"nodes":["172.25.66.111:8002=1"],"localLimit":"100MB","minRate":"64KB","totalLimit":"100MB","clientQueueSize":6,"workHome":"/root/.small-dragonfly","logConfig":{"maxSize":0,"maxBackups":0}}
2020-04-28 06:43:19.726 INFO sign:23-1588056199.726 : target file path:/root/.small-dragonfly/dfdaemon/data/73e80b11-d473-4306-8583-755602b1f859
2020-04-28 06:43:19.727 INFO sign:25-1588056199.727 : get cmd params:["/opt/dragonfly/df-client/dfget" "-u" "http://172.25.66.110/v2/dragonfly/img/blobs/sha256:97acd4fda45b91f29808af0e87de69f595bb09f866282ae21c666c473de712ab" "-o" "/root/.small-dragonfly/dfdaemon/data/aaf91c86-66e7-4a33-b983-331c3d346281" "--node" "172.25.66.111=1" "-f" "Expires&Signature" "--dfdaemon" "-s" "100MB" "--totallimit" "100MB" "--node" "172.25.66.111" "--header" "User-Agent:docker/19.03.8 go/go1.12.17 git-commit/afacb8b kernel/3.10.0-1062.12.1.el7.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/19.03.8 \\(linux\\))" "--header" "Authorization:Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6IkdWSVI6Rk1ESTpEVFZOOjVJWlY6N1VDMzpNWkFEOkFJTFI6QUxBRzpVUk41OjIyUUM6VEtSRjpXNFdXIn0.eyJpc3MiOiJoYXJib3ItdG9rZW4taXNzdWVyIiwic3ViIjoiYWRtaW4iLCJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE1ODgwNTc5OTgsIm5iZiI6MTU4ODA1NjE5OCwiaWF0IjoxNTg4MDU2MTk4LCJqdGkiOiJ5OHdYSUR3dWdGUnExWWNDIiwiYWNjZXNzIjpbeyJ0eXBlIjoicmVwb3NpdG9yeSIsIm5hbWUiOiJkcmFnb25mbHkvaW1nIiwiYWN0aW9ucyI6WyJwdXNoIiwiKiIsInB1bGwiXX1dfQ.eBvaHvOMMN9sdd7XrhdH3sFizMvalGpgaCBssdvCKjqq2BGEOXMkxKkiZyqO6gui3FfvZoZ64I7OkraQ0D5zy7gp2KGkBwzUILhD1hDLejsJZNzH5u44xvPveACe91qMe8kiT_KJ3u415UOaNpjbcNTsnCiEOlDwz5rBPL4B7CsYSNaB6ZSMJ9lLdZx_yuH9RsIzgHuEHbsFFy0LPDXUgU3awtiWNP3VMsLFaxOuPoyz8qWln-dxhnN7WBjJVjeKvuSNJBz2dDAJEOqxizLpn4N9gl2FIFJn8asC5jb0MJT-c-GlAoWQP1yII3SENs5kDhiNNxtFggmjpQir_yfcF0Zr-QDu_387wgZXEN7f1vtSTqUtSwiM6JGHCP27kUy8eiCVpfQoQdwDj_DMe5L9gSdD9lYw8YklSCBDtlVGxBStuCZpoSgLz1VZpGteufD2mcJCq9w508ie8KmXntkGG-yxorK_OGp21n3MglPMdBn6lQdxSEeOSOrn_u9wV13Y0h6Vc_VGqV5xT9u-pZZeIo3fwwfMSkfSCkBI1y7aMMbjdafxSNoqPKrUjuYW-Kt3u2Nwr4fhCW1bkye67V4_esx08LsE894iKvRWbQlzSLxB35KMD8WDyIRd5lsqdM9aEYbsedz5eV_QCbrKoYd3XGW_dwGOkhr6vGRhrLpwne0" "--header" "Connection:close"]
2020-04-28 06:43:19.728 INFO sign:25-1588056199.727 : get init config:{"url":"http://172.25.66.110/v2/dragonfly/img/blobs/sha256:97acd4fda45b91f29808af0e87de69f595bb09f866282ae21c666c473de712ab","output":"/root/.small-dragonfly/dfdaemon/data/aaf91c86-66e7-4a33-b983-331c3d346281","pattern":"p2p","filter":["Expires","Signature"],"header":["User-Agent:docker/19.03.8 go/go1.12.17 git-commit/afacb8b kernel/3.10.0-1062.12.1.el7.x86_64 os/linux arch/amd64 UpstreamClient(Docker-Client/19.03.8 \\(linux\\))","Authorization:Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6IkdWSVI6Rk1ESTpEVFZOOjVJWlY6N1VDMzpNWkFEOkFJTFI6QUxBRzpVUk41OjIyUUM6VEtSRjpXNFdXIn0.eyJpc3MiOiJoYXJib3ItdG9rZW4taXNzdWVyIiwic3ViIjoiYWRtaW4iLCJhdWQiOiJoYXJib3ItcmVnaXN0cnkiLCJleHAiOjE1ODgwNTc5OTgsIm5iZiI6MTU4ODA1NjE5OCwiaWF0IjoxNTg4MDU2MTk4LCJqdGkiOiJ5OHdYSUR3dWdGUnExWWNDIiwiYWNjZXNzIjpbeyJ0eXBlIjoicmVwb3NpdG9yeSIsIm5hbWUiOiJkcmFnb25mbHkvaW1nIiwiYWN0aW9ucyI6WyJwdXNoIiwiKiIsInB1bGwiXX1dfQ.eBvaHvOMMN9sdd7XrhdH3sFizMvalGpgaCBssdvCKjqq2BGEOXMkxKkiZyqO6gui3FfvZoZ64I7OkraQ0D5zy7gp2KGkBwzUILhD1hDLejsJZNzH5u44xvPveACe91qMe8kiT_KJ3u415UOaNpjbcNTsnCiEOlDwz5rBPL4B7CsYSNaB6ZSMJ9lLdZx_yuH9RsIzgHuEHbsFFy0LPDXUgU3awtiWNP3VMsLFaxOuPoyz8qWln-dxhnN7WBjJVjeKvuSNJBz2dDAJEOqxizLpn4N9gl2FIFJn8asC5jb0MJT-c-GlAoWQP1yII3SENs5kDhiNNxtFggmjpQir_yfcF0Zr-QDu_387wgZXEN7f1vtSTqUtSwiM6JGHCP27kUy8eiCVpfQoQdwDj_DMe5L9gSdD9lYw8YklSCBDtlVGxBStuCZpoSgLz1VZpGteufD2mcJCq9w508ie8KmXntkGG-yxorK_OGp21n3MglPMdBn6lQdxSEeOSOrn_u9wV13Y0h6Vc_VGqV5xT9u-pZZeIo3fwwfMSkfSCkBI1y7aMMbjdafxSNoqPKrUjuYW-Kt3u2Nwr4fhCW1bkye67V4_esx08LsE894iKvRWbQlzSLxB35KMD8WDyIRd5lsqdM9aEYbsedz5eV_QCbrKoYd3XGW_dwGOkhr6vGRhrLpwne0","Connection:close"],"dfdaemon":true,"nodes":["172.25.66.111:8002=1"],"localLimit":"100MB","minRate":"64KB","totalLimit":"100MB","clientQueueSize":6,"workHome":"/root/.small-dragonfly","logConfig":{"maxSize":0,"maxBackups":0}}
2020-04-28 06:43:19.728 INFO sign:25-1588056199.727 : target file path:/root/.small-dragonfly/dfdaemon/data/aaf91c86-66e7-4a33-b983-331c3d346281
2020-04-28 06:43:19.728 INFO sign:23-1588056199.726 : runtimeVariable: {"MetaPath":"/root/.small-dragonfly/meta/host.meta","SystemDataDir":"/root/.small-dragonfly/data","DataDir":"/root/.small-dragonfly/data","RealTarget":"/root/.small-dragonfly/dfdaemon/data/73e80b11-d473-4306-8583-755602b1f859","TargetDir":"/root/.small-dragonfly/dfdaemon/data","TempTarget":"/root/.small-dragonfly/dfdaemon/data/dfget-23-1588056199.726.tmp-851871739","Cid":"172.17.0.2-23-1588056199.726","TaskURL":"http://172.25.66.110/v2/dragonfly/img/blobs/sha256:aad63a9339440e7c3e1fff2b988991b9bfb81280042fa7f39a5e327023056819","TaskFileName":"73e80b11-d473-4306-8583-755602b1f859-23-1588056199.726","LocalIP":"172.17.0.2","PeerPort":0,"FileLength":-1,"DataExpireTime":180000000000,"ServerAliveTime":300000000000}
2020-04-28 06:43:19.728 INFO sign:23-1588056199.726 : local http result: err:dial tcp4 172.17.0.2:0: connect: connection refused, port:0 path:/check/
2020-04-28 06:43:19.728 INFO sign:25-1588056199.727 : runtimeVariable: {"MetaPath":"/root/.small-dragonfly/meta/host.meta","SystemDataDir":"/root/.small-dragonfly/data","DataDir":"/root/.small-dragonfly/data","RealTarget":"/root/.small-dragonfly/dfdaemon/data/aaf91c86-66e7-4a33-b983-331c3d346281","TargetDir":"/root/.small-dragonfly/dfdaemon/data","TempTarget":"/root/.small-dragonfly/dfdaemon/data/dfget-25-1588056199.727.tmp-737472291","Cid":"172.17.0.2-25-1588056199.727","TaskURL":"http://172.25.66.110/v2/dragonfly/img/blobs/sha256:97acd4fda45b91f29808af0e87de69f595bb09f866282ae21c666c473de712ab","TaskFileName":"aaf91c86-66e7-4a33-b983-331c3d346281-25-1588056199.727","LocalIP":"172.17.0.2","PeerPort":0,"FileLength":-1,"DataExpireTime":180000000000,"ServerAliveTime":300000000000}
2020-04-28 06:43:19.728 INFO sign:25-1588056199.727 : local http result: err:dial tcp4 172.17.0.2:0: connect: connection refused, port:0 path:/check/
2020-04-28 06:43:19.839 INFO sign:22-1588056199.667 : local http result:461ea45e-af68-4d9c-89b1-b2877aa4cef4-22-1588056199.667 err:<nil>, port:58520 path:/check/
2020-04-28 06:43:19.839 INFO sign:22-1588056199.667 : use peer server on port:58520
2020-04-28 06:43:19.839 INFO sign:22-1588056199.667 : do register to one of [172.25.66.111:8002 172.25.66.111:8002]
2020-04-28 06:43:19.872 INFO sign:22-1588056199.667 : do register to 172.25.66.111:8002, res:{"code":200,"msg":"success","data":{"taskId":"0e0e2514115973347fc84dc7ef0667dfd79f573982246c11371e032be2ae8fc2","fileLength":1785,"pieceSize":4194304}} error:<nil>
2020-04-28 06:43:19.872 INFO sign:22-1588056199.667 : do register result:{"code":200,"msg":"success","data":{"taskId":"0e0e2514115973347fc84dc7ef0667dfd79f573982246c11371e032be2ae8fc2","fileLength":1785,"pieceSize":4194304}} and cost:0.033s
2020-04-28 06:43:19.872 INFO sign:22-1588056199.667 : downloading piece:{"taskID":"0e0e2514115973347fc84dc7ef0667dfd79f573982246c11371e032be2ae8fc2","superNode":"172.25.66.111:8002","dstCid":"","range":"","result":502,"status":700,"pieceSize":0,"pieceNum":0}
2020-04-28 06:43:19.873 INFO sign:22-1588056199.667 : pull piece task({"taskID":"0e0e2514115973347fc84dc7ef0667dfd79f573982246c11371e032be2ae8fc2","superNode":"172.25.66.111:8002","dstCid":"","range":"","result":502,"status":700,"pieceSize":0,"pieceNum":0}) result:{"code":602,"msg":"clientSucCount:0,cdnSucCount:0: {\"Code\":9,\"Msg\":\"peer should wait\"}"} and sleep 0.096s
2020-04-28 06:43:19.889 INFO sign:25-1588056199.727 : local http result:aaf91c86-66e7-4a33-b983-331c3d346281-25-1588056199.727 err:<nil>, port:58520 path:/check/
2020-04-28 06:43:19.889 INFO sign:25-1588056199.727 : use peer server on port:58520
2020-04-28 06:43:19.889 INFO sign:25-1588056199.727 : do register to one of [172.25.66.111:8002 172.25.66.111:8002]
2020-04-28 06:43:19.930 INFO sign:25-1588056199.727 : do register to 172.25.66.111:8002, res:{"code":200,"msg":"success","data":{"taskId":"32592bb75d28a781b23dd2010f9ccb33c670ce85ec16fda2b568b81875b25c1d","fileLength":1074069681,"pieceSize":12582912}} error:<nil>
2020-04-28 06:43:19.930 INFO sign:25-1588056199.727 : do register result:{"code":200,"msg":"success","data":{"taskId":"32592bb75d28a781b23dd2010f9ccb33c670ce85ec16fda2b568b81875b25c1d","fileLength":1074069681,"pieceSize":12582912}} and cost:0.041s
2020-04-28 06:43:19.931 INFO sign:25-1588056199.727 : downloading piece:{"taskID":"32592bb75d28a781b23dd2010f9ccb33c670ce85ec16fda2b568b81875b25c1d","superNode":"172.25.66.111:8002","dstCid":"","range":"","result":502,"status":700,"pieceSize":0,"pieceNum":0}
2020-04-28 06:43:19.931 INFO sign:25-1588056199.727 : pull piece task({"taskID":"32592bb75d28a781b23dd2010f9ccb33c670ce85ec16fda2b568b81875b25c1d","superNode":"172.25.66.111:8002","dstCid":"","range":"","result":502,"status":700,"pieceSize":0,"pieceNum":0}) result:{"code":602,"msg":"clientSucCount:0,cdnSucCount:0: {\"Code\":9,\"Msg\":\"peer should wait\"}"} and sleep 0.084s
2020-04-28 06:43:19.936 INFO sign:23-1588056199.726 : local http result:73e80b11-d473-4306-8583-755602b1f859-23-1588056199.726 err:<nil>, port:58520 path:/check/
2020-04-28 06:43:19.936 INFO sign:23-1588056199.726 : use peer server on port:58520
2020-04-28 06:43:19.937 INFO sign:23-1588056199.726 : do register to one of [172.25.66.111:8002 172.25.66.111:8002]
2020-04-28 06:43:19.971 INFO sign:22-1588056199.667 : pull rate result:104857600 cost:400.672µs
2020-04-28 06:43:19.974 INFO sign:22-1588056199.667 : downloading piece:{"taskID":"0e0e2514115973347fc84dc7ef0667dfd79f573982246c11371e032be2ae8fc2","superNode":"172.25.66.111:8002","dstCid":"cdnnode:172.25.66.111~0e0e2514115973347fc84dc7ef0667dfd79f573982246c11371e032be2ae8fc2","range":"0-4194303","result":503,"status":701,"pieceSize":4194304,"pieceNum":0}
2020-04-28 06:43:19.975 INFO sign:22-1588056199.667 : remaining piece to be written count:0
2020-04-28 06:43:19.978 INFO sign:22-1588056199.667 : wait client writer finish cost:0.003,main qu size:0,client qu size:0
2020-04-28 06:43:19.978 INFO sign:22-1588056199.667 : move src:/root/.small-dragonfly/data/461ea45e-af68-4d9c-89b1-b2877aa4cef4-22-1588056199.667 to dst:/root/.small-dragonfly/dfdaemon/data/461ea45e-af68-4d9c-89b1-b2877aa4cef4 result:true cost:0.000
2020-04-28 06:43:19.978 INFO sign:22-1588056199.667 : download successfully from dragonfly
2020-04-28 06:43:19.979 INFO sign:22-1588056199.667 : download SUCCESS from supernode [172.25.66.111:8002] cost:0.312s length:1785
2020-04-28 06:43:19.980 INFO sign:23-1588056199.726 : do register to 172.25.66.111:8002, res:{"code":200,"msg":"success","data":{"taskId":"b569bdc724005f622a4004bb3bd7b7271e8e81a935e582af7feb26578974ce3e","fileLength":2803255,"pieceSize":4194304}} error:<nil>
2020-04-28 06:43:19.980 INFO sign:23-1588056199.726 : do register result:{"code":200,"msg":"success","data":{"taskId":"b569bdc724005f622a4004bb3bd7b7271e8e81a935e582af7feb26578974ce3e","fileLength":2803255,"pieceSize":4194304}} and cost:0.043s
2020-04-28 06:43:19.981 INFO sign:23-1588056199.726 : downloading piece:{"taskID":"b569bdc724005f622a4004bb3bd7b7271e8e81a935e582af7feb26578974ce3e","superNode":"172.25.66.111:8002","dstCid":"","range":"","result":502,"status":700,"pieceSize":0,"pieceNum":0}
2020-04-28 06:43:19.982 INFO sign:23-1588056199.726 : pull piece task({"taskID":"b569bdc724005f622a4004bb3bd7b7271e8e81a935e582af7feb26578974ce3e","superNode":"172.25.66.111:8002","dstCid":"","range":"","result":502,"status":700,"pieceSize":0,"pieceNum":0}) result:{"code":602,"msg":"clientSucCount:0,cdnSucCount:0: {\"Code\":9,\"Msg\":\"peer should wait\"}"} and sleep 0.050s
2020-04-28 06:43:20.016 INFO sign:25-1588056199.727 : pull piece task({"taskID":"32592bb75d28a781b23dd2010f9ccb33c670ce85ec16fda2b568b81875b25c1d","superNode":"172.25.66.111:8002","dstCid":"","range":"","result":502,"status":700,"pieceSize":0,"pieceNum":0}) result:{"code":602,"msg":"clientSucCount:0,cdnSucCount:0: {\"Code\":9,\"Msg\":\"peer should wait\"}"} and sleep 0.148s
2020-04-28 06:43:20.032 INFO sign:23-1588056199.726 : pull piece task({"taskID":"b569bdc724005f622a4004bb3bd7b7271e8e81a935e582af7feb26578974ce3e","superNode":"172.25.66.111:8002","dstCid":"","range":"","result":502,"status":700,"pieceSize":0,"pieceNum":0}) result:{"code":602,"msg":"clientSucCount:0,cdnSucCount:0: {\"Code\":9,\"Msg\":\"peer should wait\"}"} and sleep 0.121s
2020-04-28 06:43:20.154 INFO sign:23-1588056199.726 : pull piece task({"taskID":"b569bdc724005f622a4004bb3bd7b7271e8e81a935e582af7feb26578974ce3e","superNode":"172.25.66.111:8002","dstCid":"","range":"","result":502,"status":700,"pieceSize":0,"pieceNum":0}) result:{"code":602,"msg":"clientSucCount:0,cdnSucCount:0: {\"Code\":9,\"Msg\":\"peer should wait\"}"} and sleep 0.394s
2020-04-28 06:43:20.165 INFO sign:25-1588056199.727 : pull rate result:104857600 cost:254.268µs
2020-04-28 06:43:20.224 INFO sign:25-1588056199.727 : downloading piece:{"taskID":"32592bb75d28a781b23dd2010f9ccb33c670ce85ec16fda2b568b81875b25c1d","superNode":"172.25.66.111:8002","dstCid":"cdnnode:172.25.66.111~32592bb75d28a781b23dd2010f9ccb33c670ce85ec16fda2b568b81875b25c1d","range":"0-12582911","result":503,"status":701,"pieceSize":12582912,"pieceNum":0}
2020-04-28 06:43:20.227 INFO sign:25-1588056199.727 : pull piece task({"taskID":"32592bb75d28a781b23dd2010f9ccb33c670ce85ec16fda2b568b81875b25c1d","superNode":"172.25.66.111:8002","dstCid":"cdnnode:172.25.66.111~32592bb75d28a781b23dd2010f9ccb33c670ce85ec16fda2b568b81875b25c1d","range":"0-12582911","result":503,"status":701,"pieceSize":12582912,"pieceNum":0}) result:{"code":602,"msg":"clientSucCount:1,cdnSucCount:1: {\"Code\":9,\"Msg\":\"peer should wait\"}"} and sleep 0.302s
2020-04-28 06:43:20.530 INFO sign:25-1588056199.727 : pull piece task({"taskID":"32592bb75d28a781b23dd2010f9ccb33c670ce85ec16fda2b568b81875b25c1d","superNode":"172.25.66.111:8002","dstCid":"cdnnode:172.25.66.111~32592bb75d28a781b23dd2010f9ccb33c670ce85ec16fda2b568b81875b25c1d","range":"0-12582911","result":503,"status":701,"pieceSize":12582912,"pieceNum":0}) result:{"code":602,"msg":"clientSucCount:1,cdnSucCount:1: {\"Code\":9,\"Msg\":\"peer should wait\"}"} and sleep 0.623s
2020-04-28 06:43:20.554 INFO sign:23-1588056199.726 : pull rate result:52428800 cost:307.986µs
2020-04-28 06:43:20.581 INFO sign:23-1588056199.726 : downloading piece:{"taskID":"b569bdc724005f622a4004bb3bd7b7271e8e81a935e582af7feb26578974ce3e","superNode":"172.25.66.111:8002","dstCid":"cdnnode:172.25.66.111~b569bdc724005f622a4004bb3bd7b7271e8e81a935e582af7feb26578974ce3e","range":"0-4194303","result":503,"status":701,"pieceSize":4194304,"pieceNum":0}
2020-04-28 06:43:20.586 INFO sign:23-1588056199.726 : remaining piece to be written count:0
2020-04-28 06:43:20.611 INFO sign:23-1588056199.726 : wait client writer finish cost:0.025,main qu size:0,client qu size:0
2020-04-28 06:43:20.612 INFO sign:23-1588056199.726 : move src:/root/.small-dragonfly/data/73e80b11-d473-4306-8583-755602b1f859-23-1588056199.726 to dst:/root/.small-dragonfly/dfdaemon/data/73e80b11-d473-4306-8583-755602b1f859 result:true cost:0.000
2020-04-28 06:43:20.612 INFO sign:23-1588056199.726 : download successfully from dragonfly
2020-04-28 06:43:20.613 INFO sign:23-1588056199.726 : download SUCCESS from supernode [172.25.66.111:8002] cost:0.887s length:2803255
2020-04-28 06:43:21.155 INFO sign:25-1588056199.727 : pull piece task({"taskID":"32592bb75d28a781b23dd2010f9ccb33c670ce85ec16fda2b568b81875b25c1d","superNode":"172.25.66.111:8002","dstCid":"cdnnode:172.25.66.111~32592bb75d28a781b23dd2010f9ccb33c670ce85ec16fda2b568b81875b25c1d","range":"0-12582911","result":503,"status":701,"pieceSize":12582912,"pieceNum":0}) result:{"code":602,"msg":"clientSucCount:1,cdnSucCount:1: {\"Code\":9,\"Msg\":\"peer should wait\"}"} and sleep 1.388s
2020-04-28 06:43:22.661 INFO sign:25-1588056199.727 : downloading piece:{"taskID":"32592bb75d28a781b23dd2010f9ccb33c670ce85ec16fda2b568b81875b25c1d","superNode":"172.25.66.111:8002","dstCid":"cdnnode:172.25.66.111~32592bb75d28a781b23dd2010f9ccb33c670ce85ec16fda2b568b81875b25c1d","range":"25165824-37748735","result":503,"status":701,"pieceSize":12582912,"pieceNum":2}
2020-04-28 06:43:22.738 INFO sign:25-1588056199.727 : downloading piece:{"taskID":"32592bb75d28a781b23dd2010f9ccb33c670ce85ec16fda2b568b81875b25c1d","superNode":"172.25.66.111:8002","dstCid":"cdnnode:172.25.66.111~32592bb75d28a781b23dd2010f9ccb33c670ce85ec16fda2b568b81875b25c1d","range":"75497472-88080383","result":503,"status":701,"pieceSize":12582912,"pieceNum":6}
2020-04-28 06:43:22.739 INFO sign:25-1588056199.727 : pull piece task({"taskID":"32592bb75d28a781b23dd2010f9ccb33c670ce85ec16fda2b568b81875b25c1d","superNode":"172.25.66.111:8002","dstCid":"cdnnode:172.25.66.111~32592bb75d28a781b23dd2010f9ccb33c670ce85ec16fda2b568b81875b25c1d","range":"75497472-88080383","result":503,"status":701,"pieceSize":12582912,"pieceNum":6}) result:{"code":602,"msg":"{\"Code\":9,\"Msg\":\"peer should wait\"}"} and sleep 0.850s
2020-04-28 06:43:23.590 INFO sign:25-1588056199.727 : pull rate result:104857600 cost:319.994µs
......

为了方便测试，supernode只留下172.25.66.111 /etc/dragonfly/dfdaemon.yml

dfget_flags: ["--node","172.25.66.111=1","-f","Expires&Signature"]
proxies:
  - regx: blobs/sha256.*

Apr 28 '20 07:04 deadjoker

Dragonfly 是动态组建p2p网络，由客户端主动触发下载任务。客户端peer节点是临时的，也可以通过 dfget 的参数 --alivetime和--expiretime来调整生存时间或者常驻。客户端dfdaemon/data目录下的数据是临时的，传给dockerd之后会清理掉。 supernode节点本地缓存，如果源数据无变化，本地缓存也不会变，缓存容量达到阈值会触发清理操作。

Apr 28 '20 11:04 lowzj

客户端peer节点是临时的

所以日志里显示use peer server on port:58520 local http result:461ea45e-af68-4d9c-89b1-b2877aa4cef4-22-1588056199.667 err:<nil>, port:58520 path:/check/这个是正常的？

客户端dfdaemon/data目录下的数据是临时的，传给dockerd之后会清理掉。

在一个节点pull镜像时，我观察了下其他client节点，并没有临时数据。我pull 1G的镜像，这个数据只有在supernode和pull镜像的client上出现了，总大小为1G。supernode上多了9个文件，client上多了3个文件，而其他client上并没有出现临时文件。而且我连续在这台client上pull镜像，每次pull都会多出3个新文件（supernode文件数量不变）