host/calico/overlay简单性能测试

目标

对比一下docker overlay、calico和host网络的带宽，延迟。

测试环境硬件

• 千兆网卡 BCM5719
• CPU E5-2630 0 @ 2.30GHz

测试环境软件

• kernel 3.10.0-327
• docker 1.12.3
• calico 0.23.0

测试的compose

1. calico compose

netperf1:
image: netperf:1.0
net: vnet
restart: always
mem_limit: 20480M
labels:
- "com.alipay.proj=netperf"
environment:
- "affinity:container!=*netperf*"
- "constraint:node==*test1*"
command: /sbin/init
netperf2:
image: netperf:1.0
net: vnet
restart: always
mem_limit: 20480M
labels:
- "com.alipay.proj=netperf"
environment:
- "affinity:container!=*netperf*"
- "constraint:node==*test2*"
command: /sbin/init

2. overlay compose

netperf1:
image: netperf:1.0
net: vxlan
restart: always
mem_limit: 20480M
labels:
- "com.alipay.proj=netperf"
environment:
- "affinity:container!=*netperf*"
- "constraint:node==*test1*"
command: /sbin/init
netperf2:
image: netperf:1.0
net: vxlan
restart: always
mem_limit: 20480M
labels:
- "com.alipay.proj=netperf"
environment:
- "affinity:container!=*netperf*"
- "constraint:node==*test2*"
command: /sbin/init

3. host compose

netperf1:
image: netperf:1.0
net: host
restart: always
mem_limit: 20480M
labels:
- "com.alipay.proj=netperf"
environment:
- "affinity:container!=*netperf*"
- "constraint:node==*test1*"
command: /sbin/init
netperf2:
image: netperf:1.0
net: host
restart: always
mem_limit: 20480M
labels:
- "com.alipay.proj=netperf"
environment:
- "affinity:container!=*netperf*"
- "constraint:node==*test2*"
command: /sbin/init

测试结果

1. host

[root@satest1 /]# time qperf netperf_netperf2_1 –time 20  tcp_bw tcp_lat  udp_lat

tcp_bw:
bw  =  118 MB/sec
tcp_lat:
latency  =  48.2 us
udp_lat:
latency  =  46.1 us

2. calico

[root@55fd7810562d /]# time qperf netperf_netperf2_1 –time 20  tcp_bw tcp_lat  udp_lat

tcp_bw:
bw  =  118 MB/sec
tcp_lat:
latency  =  54.1 us
udp_lat:
latency  =  50.3 us

3. vxlan

[root@1472d4ce9a24 /]# time qperf netperf_netperf2_1 –time 20  tcp_bw tcp_lat  udp_lat

tcp_bw:
bw  =  114 MB/sec
tcp_lat:
latency  =  63.5 us
udp_lat:
latency  =  58.5 us