ndt-server ndt7: some tests give significantly lower results

ndt7: some tests give significantly lower results

Open robertodauria opened this issue 5 years ago • 5 comments

This is a pattern I've consistently noticed by running tests from my FTTH Internet connection (~300Mbit/s DL, ~100Mbit/s UL).

The vast majority of tests will run just fine, giving the expected results. Then, occasionally, a download test will begin at a much lower speed than usual, and the speed further lowers during the test. Counter-flow messages are much sparser than usual when this happens.

An example:

$ ./libndt-client -ndt7 -download ndt-iupui-mlab3-mil04.measurement-lab.org
will run the download sub-test
will use the ndt7 protocol
will use this NDT server: ndt-iupui-mlab3-mil04.measurement-lab.org
trying to connect to ndt-iupui-mlab3-mil04.measurement-lab.org
using the ndt7 protocol
ndt7: WebSocket connection established
  - [ndt7] download: {"ConnectionInfo":{"Client":"109.234.56.210:33676","Server":"213.242.77.165:443","UUID":"ndt-55bgx_1566037366_000000000001CB5D"},"BBRInfo":{"ElapsedTime":16,"MaxBandwidth":0,"MinRTT":21503},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":1,"RTO":222000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":7,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":16,"LastAckRecv":16,"PMTU":1500,"RcvSsThresh":31104,"RTT":21656,"RTTVar":8371,"SndSsThresh":2147483647,"SndCwnd":10,"AdvMSS":1448,"Reordering":3,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":0,"PacingRate":1988780,"MaxPacingRate":-1,"BytesAcked":6429,"BytesReceived":779,"SegsOut":15,"SegsIn":6,"NotsentBytes":108,"MinRTT":21503,"DataSegsIn":3,"DataSegsOut":12,"DeliveryRate":316720,"BusyTime":23000,"RWndLimited":0,"SndBufLimited":0,"Delivered":6,"DeliveredCE":0,"BytesSent":14785,"BytesRetrans":0,"DSackDups":0,"ReordSeen":0,"ElapsedTime":16}}
  [ 2%] elapsed:  0.275 s; test_id: 4; num_flows: 1; speed:   99.1 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":321363,"MaxBandwidth":66688728,"MinRTT":20987},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":225000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":937,"Sacked":583,"Lost":19,"Retrans":19,"Fackets":0,"LastDataSent":19,"LastAckSent":0,"LastDataRecv":273,"LastAckRecv":19,"PMTU":1500,"RcvSsThresh":31104,"RTT":24898,"RTTVar":1664,"SndSsThresh":2147483647,"SndCwnd":1999,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":3845,"PacingRate":199463410,"MaxPacingRate":-1,"BytesAcked":4899265,"BytesReceived":826,"SegsOut":8324,"SegsIn":414,"NotsentBytes":2592000,"MinRTT":20987,"DataSegsIn":4,"DataSegsOut":8321,"DeliveryRate":8708688,"BusyTime":344000,"RWndLimited":55000,"SndBufLimited":0,"Delivered":3991,"DeliveredCE":0,"BytesSent":11975585,"BytesRetrans":5535520,"DSackDups":3,"ReordSeen":3,"ElapsedTime":321363}}
  [ 4%] elapsed:  0.534 s; test_id: 4; num_flows: 1; speed:    144 Mbit/s
  [ 6%] elapsed:  0.792 s; test_id: 4; num_flows: 1; speed:    113 Mbit/s
  [ 8%] elapsed:  1.080 s; test_id: 4; num_flows: 1; speed:   86.9 Mbit/s
  [10%] elapsed:  1.377 s; test_id: 4; num_flows: 1; speed:   69.7 Mbit/s
  [12%] elapsed:  1.650 s; test_id: 4; num_flows: 1; speed:   59.1 Mbit/s
  [14%] elapsed:  1.918 s; test_id: 4; num_flows: 1; speed:   51.7 Mbit/s
  [16%] elapsed:  2.196 s; test_id: 4; num_flows: 1; speed:   45.8 Mbit/s
  [18%] elapsed:  2.463 s; test_id: 4; num_flows: 1; speed:   41.5 Mbit/s
  [20%] elapsed:  2.746 s; test_id: 4; num_flows: 1; speed:   37.8 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":611212,"MaxBandwidth":21027488,"MinRTT":2052},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":224000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":103,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":125,"LastAckRecv":0,"PMTU":1500,"RcvSsThresh":31104,"RTT":23398,"RTTVar":1209,"SndSsThresh":1108,"SndCwnd":104,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":3858,"PacingRate":21786814,"MaxPacingRate":-1,"BytesAcked":10090465,"BytesReceived":873,"SegsOut":11110,"SegsIn":658,"NotsentBytes":2810880,"MinRTT":2052,"DataSegsIn":5,"DataSegsOut":11107,"DeliveryRate":5868319,"BusyTime":634000,"RWndLimited":55000,"SndBufLimited":0,"Delivered":7018,"DeliveredCE":0,"BytesSent":15987425,"BytesRetrans":5554240,"DSackDups":6,"ReordSeen":3,"ElapsedTime":611212}}
  [22%] elapsed:  3.035 s; test_id: 4; num_flows: 1; speed:   34.7 Mbit/s
  [24%] elapsed:  3.320 s; test_id: 4; num_flows: 1; speed:   32.2 Mbit/s
  [26%] elapsed:  3.599 s; test_id: 4; num_flows: 1; speed:   30.2 Mbit/s
  [28%] elapsed:  3.880 s; test_id: 4; num_flows: 1; speed:   28.4 Mbit/s
  [30%] elapsed:  4.171 s; test_id: 4; num_flows: 1; speed:   26.8 Mbit/s
  [32%] elapsed:  4.449 s; test_id: 4; num_flows: 1; speed:   25.5 Mbit/s
  [34%] elapsed:  4.734 s; test_id: 4; num_flows: 1; speed:   24.3 Mbit/s
  [36%] elapsed:  4.995 s; test_id: 4; num_flows: 1; speed:   23.3 Mbit/s
  [38%] elapsed:  5.272 s; test_id: 4; num_flows: 1; speed:   22.4 Mbit/s
  [40%] elapsed:  5.551 s; test_id: 4; num_flows: 1; speed:   21.5 Mbit/s
  [42%] elapsed:  5.836 s; test_id: 4; num_flows: 1; speed:   20.8 Mbit/s
  [44%] elapsed:  6.122 s; test_id: 4; num_flows: 1; speed:     20 Mbit/s
  [46%] elapsed:  6.406 s; test_id: 4; num_flows: 1; speed:   19.4 Mbit/s
  [48%] elapsed:  6.687 s; test_id: 4; num_flows: 1; speed:   18.8 Mbit/s
  [50%] elapsed:  6.962 s; test_id: 4; num_flows: 1; speed:   18.3 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":1181617,"MaxBandwidth":2746152,"MinRTT":2052},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":225000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":16,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":13,"LastAckSent":0,"LastDataRecv":695,"LastAckRecv":13,"PMTU":1500,"RcvSsThresh":31104,"RTT":24842,"RTTVar":3041,"SndSsThresh":1108,"SndCwnd":16,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":3858,"PacingRate":2845319,"MaxPacingRate":-1,"BytesAcked":11829985,"BytesReceived":873,"SegsOut":12231,"SegsIn":909,"NotsentBytes":4047840,"MinRTT":2052,"DataSegsIn":5,"DataSegsOut":12228,"DeliveryRate":1047748,"BusyTime":1204000,"RWndLimited":55000,"SndBufLimited":0,"Delivered":8226,"DeliveredCE":0,"BytesSent":17601665,"BytesRetrans":5554240,"DSackDups":6,"ReordSeen":3,"ElapsedTime":1181617}}
  [52%] elapsed:  7.241 s; test_id: 4; num_flows: 1; speed:   17.8 Mbit/s
  [54%] elapsed:  7.520 s; test_id: 4; num_flows: 1; speed:   17.4 Mbit/s
  [56%] elapsed:  7.804 s; test_id: 4; num_flows: 1; speed:   16.9 Mbit/s
  [58%] elapsed:  8.088 s; test_id: 4; num_flows: 1; speed:   16.5 Mbit/s
  [60%] elapsed:  8.369 s; test_id: 4; num_flows: 1; speed:   16.2 Mbit/s
  [62%] elapsed:  8.652 s; test_id: 4; num_flows: 1; speed:   15.8 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":3039164,"MaxBandwidth":785179,"MinRTT":2052},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":226000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":12,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":173,"LastAckRecv":1,"PMTU":1500,"RcvSsThresh":31104,"RTT":25451,"RTTVar":1901,"SndSsThresh":1108,"SndCwnd":12,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":3858,"PacingRate":813532,"MaxPacingRate":-1,"BytesAcked":13193665,"BytesReceived":920,"SegsOut":13174,"SegsIn":1369,"NotsentBytes":3985920,"MinRTT":2052,"DataSegsIn":6,"DataSegsOut":13171,"DeliveryRate":734506,"BusyTime":3062000,"RWndLimited":55000,"SndBufLimited":0,"Delivered":9173,"DeliveredCE":0,"BytesSent":18959585,"BytesRetrans":5554240,"DSackDups":6,"ReordSeen":3,"ElapsedTime":3039164}}
  [64%] elapsed:  8.937 s; test_id: 4; num_flows: 1; speed:   15.5 Mbit/s
  [66%] elapsed:  9.226 s; test_id: 4; num_flows: 1; speed:   15.2 Mbit/s
  [68%] elapsed:  9.517 s; test_id: 4; num_flows: 1; speed:   14.9 Mbit/s
  [70%] elapsed:  9.813 s; test_id: 4; num_flows: 1; speed:   14.6 Mbit/s
  [72%] elapsed: 10.098 s; test_id: 4; num_flows: 1; speed:   14.3 Mbit/s
  [75%] elapsed: 10.470 s; test_id: 4; num_flows: 1; speed:     14 Mbit/s
  [77%] elapsed: 10.730 s; test_id: 4; num_flows: 1; speed:   13.8 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":5467369,"MaxBandwidth":787239,"MinRTT":2052},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":224000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":12,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":2601,"LastAckRecv":0,"PMTU":1500,"RcvSsThresh":31104,"RTT":23494,"RTTVar":1210,"SndSsThresh":1108,"SndCwnd":12,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":3858,"PacingRate":815667,"MaxPacingRate":-1,"BytesAcked":14904385,"BytesReceived":920,"SegsOut":14362,"SegsIn":1948,"NotsentBytes":3700800,"MinRTT":2052,"DataSegsIn":6,"DataSegsOut":14359,"DeliveryRate":663951,"BusyTime":5490000,"RWndLimited":55000,"SndBufLimited":0,"Delivered":10361,"DeliveredCE":0,"BytesSent":20670305,"BytesRetrans":5554240,"DSackDups":6,"ReordSeen":3,"ElapsedTime":5467369}}
  [78%] elapsed: 10.980 s; test_id: 4; num_flows: 1; speed:   14.4 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":7067257,"MaxBandwidth":803031,"MinRTT":2052},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":223000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":11,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":83,"LastAckRecv":0,"PMTU":1500,"RcvSsThresh":31104,"RTT":22564,"RTTVar":590,"SndSsThresh":1108,"SndCwnd":12,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":3858,"PacingRate":832030,"MaxPacingRate":-1,"BytesAcked":16026145,"BytesReceived":967,"SegsOut":15140,"SegsIn":2334,"NotsentBytes":4070880,"MinRTT":2052,"DataSegsIn":7,"DataSegsOut":15137,"DeliveryRate":767897,"BusyTime":7090000,"RWndLimited":55000,"SndBufLimited":0,"Delivered":11140,"DeliveredCE":0,"BytesSent":21790625,"BytesRetrans":5554240,"DSackDups":6,"ReordSeen":3,"ElapsedTime":7067257}}
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":9227270,"MaxBandwidth":786123,"MinRTT":2052},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":224000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":11,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":465,"LastAckRecv":1,"PMTU":1500,"RcvSsThresh":31104,"RTT":23948,"RTTVar":1336,"SndSsThresh":1108,"SndCwnd":12,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":3858,"PacingRate":814511,"MaxPacingRate":-1,"BytesAcked":17528065,"BytesReceived":1014,"SegsOut":16183,"SegsIn":2851,"NotsentBytes":3800160,"MinRTT":2052,"DataSegsIn":8,"DataSegsOut":16180,"DeliveryRate":601729,"BusyTime":9250000,"RWndLimited":55000,"SndBufLimited":0,"Delivered":12183,"DeliveredCE":0,"BytesSent":23292545,"BytesRetrans":5554240,"DSackDups":6,"ReordSeen":3,"ElapsedTime":9227270}}
ndt7: test complete

This seems to happen with different ndt7 servers and with different clients (I have tested with libndt-client and the web interface at /static/ndt7.html).

The fact that the test happening immediately before the "cursed" one and immediately afterwards show the expected results even using the same server makes me think this might be a bug in the protocol implementation. Feel free to close this issue if that's not the case. I am available for further testing if needed.

Sep 30 '19 10:09 robertodauria

From the spec:

BytesSent and BytesRetrans can be used to compute the percentage of bytes overall that have been retransmitted.

From the last TCPInfo sample:

{"BytesSent": 23292545, "BytesRetrans": 5554240}

This gives us the figure that 24% of the bytes have been retransmitted.

Also from TCPInfo (same sample):

{"RTT": 23948, "RTTVar": 1336, "MinRTT": 2052}

This is surprising me. The MinRTT is unreasonable low (2 ms). You have a large RTT (24 ms). So there must be queue going on, which is consistent with what we see from other TCPInfo fields.

Can I see the TCPInfo of a good expriment?

I sincerely wonder whether in this experiment there is end-to-end connectivity.

Sep 30 '19 10:09 bassosimone

Here is the output for a "good" experiment:

$ ./libndt-client -ndt7 -download ndt-iupui-mlab3-mil04.measurement-lab.org
will run the download sub-test
will use the ndt7 protocol
will use this NDT server: ndt-iupui-mlab3-mil04.measurement-lab.org
trying to connect to ndt-iupui-mlab3-mil04.measurement-lab.org
using the ndt7 protocol
ndt7: WebSocket connection established
  - [ndt7] download: {"ConnectionInfo":{"Client":"109.234.56.210:35310","Server":"213.242.77.165:443","UUID":"ndt-55bgx_1566037366_000000000001DD9A"},"BBRInfo":{"ElapsedTime":16,"MaxBandwidth":0,"MinRTT":22134},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":1,"RTO":223000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":15,"LastAckRecv":15,"PMTU":1500,"RcvSsThresh":31104,"RTT":22870,"RTTVar":8807,"SndSsThresh":2147483647,"SndCwnd":10,"AdvMSS":1448,"Reordering":3,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":0,"PacingRate":1883013,"MaxPacingRate":-1,"BytesAcked":6429,"BytesReceived":779,"SegsOut":9,"SegsIn":6,"NotsentBytes":0,"MinRTT":22134,"DataSegsIn":3,"DataSegsOut":6,"DeliveryRate":324485,"BusyTime":23000,"RWndLimited":0,"SndBufLimited":0,"Delivered":6,"DeliveredCE":0,"BytesSent":6631,"BytesRetrans":0,"DSackDups":0,"ReordSeen":0,"ElapsedTime":16}}
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":27945,"MaxBandwidth":567684,"MinRTT":22016},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":1,"RTO":223000,"ATO":58000,"SndMSS":1440,"RcvMSS":536,"Unacked":13,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":5,"LastAckRecv":5,"PMTU":1500,"RcvSsThresh":31104,"RTT":22756,"RTTVar":5179,"SndSsThresh":2147483647,"SndCwnd":19,"AdvMSS":1448,"Reordering":3,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":0,"PacingRate":1883013,"MaxPacingRate":-1,"BytesAcked":15342,"BytesReceived":826,"SegsOut":30,"SegsIn":9,"NotsentBytes":120960,"MinRTT":22016,"DataSegsIn":4,"DataSegsOut":27,"DeliveryRate":567723,"BusyTime":51000,"RWndLimited":0,"SndBufLimited":0,"Delivered":15,"DeliveredCE":0,"BytesSent":33216,"BytesRetrans":0,"DSackDups":0,"ReordSeen":0,"ElapsedTime":27945}}
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":56273,"MaxBandwidth":699434,"MinRTT":21472},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":226000,"ATO":58000,"SndMSS":1440,"RcvMSS":536,"Unacked":25,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":33,"LastAckRecv":0,"PMTU":1500,"RcvSsThresh":31104,"RTT":25617,"RTTVar":2184,"SndSsThresh":2147483647,"SndCwnd":35,"AdvMSS":1448,"Reordering":3,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":0,"PacingRate":2091980,"MaxPacingRate":-1,"BytesAcked":37536,"BytesReceived":826,"SegsOut":58,"SegsIn":17,"NotsentBytes":175680,"MinRTT":21472,"DataSegsIn":4,"DataSegsOut":55,"DeliveryRate":699453,"BusyTime":79000,"RWndLimited":0,"SndBufLimited":0,"Delivered":31,"DeliveredCE":0,"BytesSent":73536,"BytesRetrans":0,"DSackDups":0,"ReordSeen":0,"ElapsedTime":56273}}
  [ 2%] elapsed:  0.250 s; test_id: 4; num_flows: 1; speed:   75.6 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":361447,"MaxBandwidth":68500785,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":224000,"ATO":52000,"SndMSS":1440,"RcvMSS":536,"Unacked":1128,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":233,"LastAckRecv":5,"PMTU":1500,"RcvSsThresh":31104,"RTT":23086,"RTTVar":877,"SndSsThresh":840,"SndCwnd":1771,"AdvMSS":1448,"Reordering":3,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":1334,"PacingRate":88718031,"MaxPacingRate":-1,"BytesAcked":7799136,"BytesReceived":920,"SegsOut":7886,"SegsIn":535,"NotsentBytes":1231200,"MinRTT":20000,"DataSegsIn":6,"DataSegsOut":7883,"DeliveryRate":39262892,"BusyTime":385000,"RWndLimited":58000,"SndBufLimited":0,"Delivered":5423,"DeliveredCE":0,"BytesSent":11344416,"BytesRetrans":1920960,"DSackDups":1,"ReordSeen":0,"ElapsedTime":361447}}
  [ 4%] elapsed:  0.503 s; test_id: 4; num_flows: 1; speed:    195 Mbit/s
  [ 5%] elapsed:  0.764 s; test_id: 4; num_flows: 1; speed:    192 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":900992,"MaxBandwidth":49406719,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":225000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1226,"Sacked":1199,"Lost":27,"Retrans":27,"Fackets":0,"LastDataSent":6,"LastAckSent":0,"LastDataRecv":419,"LastAckRecv":3,"PMTU":1500,"RcvSsThresh":31104,"RTT":24368,"RTTVar":711,"SndSsThresh":840,"SndCwnd":1478,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":4233,"PacingRate":51190850,"MaxPacingRate":-1,"BytesAcked":21050846,"BytesReceived":967,"SegsOut":20095,"SegsIn":1519,"NotsentBytes":1135648,"MinRTT":20000,"DataSegsIn":7,"DataSegsOut":20092,"DeliveryRate":25516589,"BusyTime":924000,"RWndLimited":262000,"SndBufLimited":51000,"Delivered":15834,"DeliveredCE":0,"BytesSent":28906718,"BytesRetrans":6091360,"DSackDups":1,"ReordSeen":117,"ElapsedTime":900992}}
  [ 7%] elapsed:  1.028 s; test_id: 4; num_flows: 1; speed:    196 Mbit/s
  [ 9%] elapsed:  1.306 s; test_id: 4; num_flows: 1; speed:    203 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":1447765,"MaxBandwidth":47690448,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":224000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1871,"Sacked":1127,"Lost":168,"Retrans":168,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":494,"LastAckRecv":1,"PMTU":1500,"RcvSsThresh":31104,"RTT":23364,"RTTVar":328,"SndSsThresh":840,"SndCwnd":903,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":5638,"PacingRate":61765754,"MaxPacingRate":-1,"BytesAcked":37566206,"BytesReceived":1014,"SegsOut":33620,"SegsIn":2450,"NotsentBytes":70560,"MinRTT":20000,"DataSegsIn":8,"DataSegsOut":33617,"DeliveryRate":38375799,"BusyTime":1471000,"RWndLimited":383000,"SndBufLimited":84000,"Delivered":27238,"DeliveredCE":0,"BytesSent":48374782,"BytesRetrans":8114336,"DSackDups":2,"ReordSeen":119,"ElapsedTime":1447765}}
  [11%] elapsed:  1.573 s; test_id: 4; num_flows: 1; speed:    212 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":1518472,"MaxBandwidth":47690448,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":224000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1212,"Sacked":751,"Lost":4,"Retrans":4,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":565,"LastAckRecv":5,"PMTU":1500,"RcvSsThresh":31104,"RTT":23445,"RTTVar":732,"SndSsThresh":840,"SndCwnd":1426,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":5736,"PacingRate":49412603,"MaxPacingRate":-1,"BytesAcked":39390686,"BytesReceived":1014,"SegsOut":34326,"SegsIn":2515,"NotsentBytes":1896480,"MinRTT":20000,"DataSegsIn":8,"DataSegsOut":34323,"DeliveryRate":7923612,"BusyTime":1542000,"RWndLimited":405000,"SndBufLimited":118000,"Delivered":28129,"DeliveredCE":0,"BytesSent":49388991,"BytesRetrans":8255456,"DSackDups":2,"ReordSeen":121,"ElapsedTime":1518472}}
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":1654481,"MaxBandwidth":47046804,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":224000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1354,"Sacked":1284,"Lost":70,"Retrans":70,"Fackets":0,"LastDataSent":6,"LastAckSent":0,"LastDataRecv":123,"LastAckRecv":6,"PMTU":1500,"RcvSsThresh":31104,"RTT":23417,"RTTVar":851,"SndSsThresh":840,"SndCwnd":1387,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":5968,"PacingRate":48745716,"MaxPacingRate":-1,"BytesAcked":42916255,"BytesReceived":1061,"SegsOut":37151,"SegsIn":2689,"NotsentBytes":1728832,"MinRTT":20000,"DataSegsIn":9,"DataSegsOut":37148,"DeliveryRate":6208569,"BusyTime":1678000,"RWndLimited":458000,"SndBufLimited":118000,"Delivered":31113,"DeliveredCE":0,"BytesSent":53454719,"BytesRetrans":8589536,"DSackDups":2,"ReordSeen":121,"ElapsedTime":1654481}}
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":1698662,"MaxBandwidth":47046804,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":225000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1042,"Sacked":245,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":37,"LastAckRecv":0,"PMTU":1500,"RcvSsThresh":31104,"RTT":24283,"RTTVar":412,"SndSsThresh":840,"SndCwnd":1408,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":5968,"PacingRate":48745716,"MaxPacingRate":-1,"BytesAcked":45141055,"BytesReceived":1108,"SegsOut":38387,"SegsIn":2740,"NotsentBytes":2350080,"MinRTT":20000,"DataSegsIn":10,"DataSegsOut":38384,"DeliveryRate":22170162,"BusyTime":1722000,"RWndLimited":464000,"SndBufLimited":118000,"Delivered":31622,"DeliveredCE":0,"BytesSent":55231071,"BytesRetrans":8589536,"DSackDups":2,"ReordSeen":121,"ElapsedTime":1698662}}
  [13%] elapsed:  1.824 s; test_id: 4; num_flows: 1; speed:    217 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":1835762,"MaxBandwidth":47046804,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":224000,"ATO":59000,"SndMSS":1440,"RcvMSS":536,"Unacked":760,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":3,"LastAckRecv":1,"PMTU":1500,"RcvSsThresh":31104,"RTT":23402,"RTTVar":409,"SndSsThresh":840,"SndCwnd":1408,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":6307,"PacingRate":48745716,"MaxPacingRate":-1,"BytesAcked":49175935,"BytesReceived":1202,"SegsOut":41247,"SegsIn":2954,"NotsentBytes":2933280,"MinRTT":20000,"DataSegsIn":12,"DataSegsOut":41244,"DeliveryRate":24157549,"BusyTime":1859000,"RWndLimited":516000,"SndBufLimited":118000,"Delivered":34180,"DeliveredCE":0,"BytesSent":59348031,"BytesRetrans":9077696,"DSackDups":2,"ReordSeen":121,"ElapsedTime":1835762}}
  [15%] elapsed:  2.093 s; test_id: 4; num_flows: 1; speed:    209 Mbit/s
  [17%] elapsed:  2.343 s; test_id: 4; num_flows: 1; speed:    205 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":2363165,"MaxBandwidth":48238821,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":223000,"ATO":59000,"SndMSS":1440,"RcvMSS":536,"Unacked":83,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":337,"LastAckRecv":1,"PMTU":1500,"RcvSsThresh":31104,"RTT":22989,"RTTVar":703,"SndSsThresh":840,"SndCwnd":1442,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":7879,"PacingRate":49980778,"MaxPacingRate":-1,"BytesAcked":61200522,"BytesReceived":1249,"SegsOut":50497,"SegsIn":3766,"NotsentBytes":1957118,"MinRTT":20000,"DataSegsIn":13,"DataSegsOut":50494,"DeliveryRate":3195073,"BusyTime":2386000,"RWndLimited":715000,"SndBufLimited":191000,"Delivered":42536,"DeliveredCE":0,"BytesSent":72660906,"BytesRetrans":11341376,"DSackDups":3,"ReordSeen":142,"ElapsedTime":2363165}}
  [19%] elapsed:  2.629 s; test_id: 4; num_flows: 1; speed:    203 Mbit/s
  [21%] elapsed:  2.879 s; test_id: 4; num_flows: 1; speed:    206 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":2988295,"MaxBandwidth":45162220,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":224000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1833,"Sacked":1809,"Lost":24,"Retrans":24,"Fackets":0,"LastDataSent":3,"LastAckSent":0,"LastDataRecv":477,"LastAckRecv":3,"PMTU":1500,"RcvSsThresh":31104,"RTT":23139,"RTTVar":1193,"SndSsThresh":840,"SndCwnd":1350,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":9795,"PacingRate":46793077,"MaxPacingRate":-1,"BytesAcked":74589454,"BytesReceived":1296,"SegsOut":63467,"SegsIn":4762,"NotsentBytes":1360800,"MinRTT":20000,"DataSegsIn":14,"DataSegsOut":63464,"DeliveryRate":13390282,"BusyTime":3012000,"RWndLimited":855000,"SndBufLimited":302000,"Delivered":53651,"DeliveredCE":0,"BytesSent":91327470,"BytesRetrans":14100416,"DSackDups":5,"ReordSeen":143,"ElapsedTime":2988295}}
  [22%] elapsed:  3.135 s; test_id: 4; num_flows: 1; speed:    201 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":3144342,"MaxBandwidth":24326047,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":224000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1782,"Sacked":1625,"Lost":156,"Retrans":156,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":41,"LastAckRecv":1,"PMTU":1500,"RcvSsThresh":31104,"RTT":23820,"RTTVar":793,"SndSsThresh":840,"SndCwnd":730,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":10233,"PacingRate":25204488,"MaxPacingRate":-1,"BytesAcked":78717454,"BytesReceived":1343,"SegsOut":66722,"SegsIn":4959,"NotsentBytes":1323136,"MinRTT":20000,"DataSegsIn":15,"DataSegsOut":66719,"DeliveryRate":18242891,"BusyTime":3168000,"RWndLimited":895000,"SndBufLimited":321000,"Delivered":56335,"DeliveredCE":0,"BytesSent":96013454,"BytesRetrans":14731136,"DSackDups":5,"ReordSeen":143,"ElapsedTime":3144342}}
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":3214676,"MaxBandwidth":24326047,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":225000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":630,"Sacked":231,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":111,"LastAckRecv":1,"PMTU":1500,"RcvSsThresh":31104,"RTT":24136,"RTTVar":1218,"SndSsThresh":840,"SndCwnd":730,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":10243,"PacingRate":25204488,"MaxPacingRate":-1,"BytesAcked":81568654,"BytesReceived":1343,"SegsOut":67561,"SegsIn":5020,"NotsentBytes":2008800,"MinRTT":20000,"DataSegsIn":15,"DataSegsOut":67558,"DeliveryRate":22578296,"BusyTime":3238000,"RWndLimited":916000,"SndBufLimited":321000,"Delivered":56922,"DeliveredCE":0,"BytesSent":97221390,"BytesRetrans":14745536,"DSackDups":5,"ReordSeen":166,"ElapsedTime":3214676}}
  [24%] elapsed:  3.395 s; test_id: 4; num_flows: 1; speed:    201 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":3290890,"MaxBandwidth":24326047,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":223000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1070,"Sacked":695,"Lost":25,"Retrans":25,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":0,"LastAckRecv":0,"PMTU":1500,"RcvSsThresh":31104,"RTT":22690,"RTTVar":522,"SndSsThresh":840,"SndCwnd":730,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":10314,"PacingRate":25204488,"MaxPacingRate":-1,"BytesAcked":82668814,"BytesReceived":1390,"SegsOut":68836,"SegsIn":5133,"NotsentBytes":2050689,"MinRTT":20000,"DataSegsIn":16,"DataSegsOut":68833,"DeliveryRate":22152925,"BusyTime":3314000,"RWndLimited":916000,"SndBufLimited":321000,"Delivered":58150,"DeliveredCE":0,"BytesSent":99057390,"BytesRetrans":14847776,"DSackDups":5,"ReordSeen":258,"ElapsedTime":3290890}}
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":3379939,"MaxBandwidth":24326047,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":225000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":854,"Sacked":439,"Lost":2,"Retrans":2,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":18,"LastAckRecv":1,"PMTU":1500,"RcvSsThresh":31104,"RTT":24197,"RTTVar":473,"SndSsThresh":840,"SndCwnd":430,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":10319,"PacingRate":25204488,"MaxPacingRate":-1,"BytesAcked":85099534,"BytesReceived":1437,"SegsOut":70313,"SegsIn":5219,"NotsentBytes":2885760,"MinRTT":20000,"DataSegsIn":17,"DataSegsOut":70310,"DeliveryRate":22594718,"BusyTime":3403000,"RWndLimited":916000,"SndBufLimited":321000,"Delivered":59582,"DeliveredCE":0,"BytesSent":101184270,"BytesRetrans":14854976,"DSackDups":5,"ReordSeen":333,"ElapsedTime":3379939}}
  [26%] elapsed:  3.701 s; test_id: 4; num_flows: 1; speed:    198 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":3639456,"MaxBandwidth":24326047,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":1,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":225000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":623,"Sacked":159,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":66,"LastAckRecv":2,"PMTU":1500,"RcvSsThresh":31104,"RTT":24190,"RTTVar":775,"SndSsThresh":840,"SndCwnd":730,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":10389,"PacingRate":25204488,"MaxPacingRate":-1,"BytesAcked":91517614,"BytesReceived":1531,"SegsOut":74609,"SegsIn":5567,"NotsentBytes":1919520,"MinRTT":20000,"DataSegsIn":19,"DataSegsOut":74606,"DeliveryRate":20694047,"BusyTime":3663000,"RWndLimited":916000,"SndBufLimited":321000,"Delivered":63759,"DeliveredCE":0,"BytesSent":107370510,"BytesRetrans":14955776,"DSackDups":5,"ReordSeen":517,"ElapsedTime":3639456}}
  [28%] elapsed:  3.956 s; test_id: 4; num_flows: 1; speed:    197 Mbit/s
  [30%] elapsed:  4.206 s; test_id: 4; num_flows: 1; speed:    196 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":4078347,"MaxBandwidth":24326047,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":224000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":381,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":280,"LastAckRecv":1,"PMTU":1500,"RcvSsThresh":31104,"RTT":23349,"RTTVar":346,"SndSsThresh":840,"SndCwnd":730,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":10659,"PacingRate":25204488,"MaxPacingRate":-1,"BytesAcked":101036014,"BytesReceived":1578,"SegsOut":81248,"SegsIn":6253,"NotsentBytes":2931840,"MinRTT":20000,"DataSegsIn":20,"DataSegsOut":81245,"DeliveryRate":23767326,"BusyTime":4102000,"RWndLimited":954000,"SndBufLimited":321000,"Delivered":70212,"DeliveredCE":0,"BytesSent":116929230,"BytesRetrans":15344576,"DSackDups":6,"ReordSeen":517,"ElapsedTime":4078347}}
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":4265583,"MaxBandwidth":24326047,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":224000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":975,"Sacked":593,"Lost":17,"Retrans":17,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":467,"LastAckRecv":1,"PMTU":1500,"RcvSsThresh":31104,"RTT":23479,"RTTVar":697,"SndSsThresh":840,"SndCwnd":730,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":10761,"PacingRate":25204488,"MaxPacingRate":-1,"BytesAcked":104457454,"BytesReceived":1578,"SegsOut":84320,"SegsIn":6492,"NotsentBytes":2737440,"MinRTT":20000,"DataSegsIn":20,"DataSegsOut":84317,"DeliveryRate":25267369,"BusyTime":4289000,"RWndLimited":954000,"SndBufLimited":321000,"Delivered":73181,"DeliveredCE":0,"BytesSent":121352910,"BytesRetrans":15491456,"DSackDups":6,"ReordSeen":517,"ElapsedTime":4265583}}
  [32%] elapsed:  4.457 s; test_id: 4; num_flows: 1; speed:    198 Mbit/s
  [34%] elapsed:  4.718 s; test_id: 4; num_flows: 1; speed:    195 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":4558979,"MaxBandwidth":30629539,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":226000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1175,"Sacked":545,"Lost":1,"Retrans":1,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":157,"LastAckRecv":0,"PMTU":1500,"RcvSsThresh":31104,"RTT":25142,"RTTVar":664,"SndSsThresh":840,"SndCwnd":652,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":10763,"PacingRate":23801704,"MaxPacingRate":-1,"BytesAcked":112340014,"BytesReceived":1672,"SegsOut":89996,"SegsIn":7026,"NotsentBytes":1565280,"MinRTT":20000,"DataSegsIn":22,"DataSegsOut":89993,"DeliveryRate":28330673,"BusyTime":4582000,"RWndLimited":954000,"SndBufLimited":321000,"Delivered":78607,"DeliveredCE":0,"BytesSent":129526350,"BytesRetrans":15494336,"DSackDups":6,"ReordSeen":517,"ElapsedTime":4558979}}
  [35%] elapsed:  4.969 s; test_id: 4; num_flows: 1; speed:    196 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":4882007,"MaxBandwidth":37291975,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":1,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":224000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":620,"Sacked":6,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":141,"LastAckRecv":2,"PMTU":1500,"RcvSsThresh":31104,"RTT":23557,"RTTVar":496,"SndSsThresh":840,"SndCwnd":1116,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":10901,"PacingRate":38638629,"MaxPacingRate":-1,"BytesAcked":121443694,"BytesReceived":1719,"SegsOut":95910,"SegsIn":7488,"NotsentBytes":3240000,"MinRTT":20000,"DataSegsIn":23,"DataSegsOut":95907,"DeliveryRate":37292056,"BusyTime":4905000,"RWndLimited":1029000,"SndBufLimited":321000,"Delivered":84399,"DeliveredCE":0,"BytesSent":138029550,"BytesRetrans":15693056,"DSackDups":6,"ReordSeen":517,"ElapsedTime":4882007}}
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":5022020,"MaxBandwidth":37291975,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":225000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":649,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":281,"LastAckRecv":2,"PMTU":1500,"RcvSsThresh":31104,"RTT":24181,"RTTVar":717,"SndSsThresh":840,"SndCwnd":1116,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":11110,"PacingRate":38638629,"MaxPacingRate":-1,"BytesAcked":124771534,"BytesReceived":1719,"SegsOut":98460,"SegsIn":7681,"NotsentBytes":2008800,"MinRTT":20000,"DataSegsIn":23,"DataSegsOut":98457,"DeliveryRate":12327127,"BusyTime":5045000,"RWndLimited":1069000,"SndBufLimited":321000,"Delivered":86705,"DeliveredCE":0,"BytesSent":141700110,"BytesRetrans":15994016,"DSackDups":6,"ReordSeen":530,"ElapsedTime":5022020}}
  [38%] elapsed:  5.256 s; test_id: 4; num_flows: 1; speed:    197 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":5175893,"MaxBandwidth":34776105,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":224000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1151,"Sacked":879,"Lost":42,"Retrans":42,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":40,"LastAckRecv":3,"PMTU":1500,"RcvSsThresh":31104,"RTT":23095,"RTTVar":684,"SndSsThresh":840,"SndCwnd":1042,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":11417,"PacingRate":36031909,"MaxPacingRate":-1,"BytesAcked":127130254,"BytesReceived":1766,"SegsOut":100907,"SegsIn":7897,"NotsentBytes":1909440,"MinRTT":20000,"DataSegsIn":24,"DataSegsOut":100904,"DeliveryRate":1352002,"BusyTime":5199000,"RWndLimited":1128000,"SndBufLimited":321000,"Delivered":89222,"DeliveredCE":0,"BytesSent":145222350,"BytesRetrans":16436096,"DSackDups":6,"ReordSeen":530,"ElapsedTime":5175893}}
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":5414079,"MaxBandwidth":38734874,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":224000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1545,"Sacked":852,"Lost":167,"Retrans":167,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":113,"LastAckRecv":1,"PMTU":1500,"RcvSsThresh":31104,"RTT":23684,"RTTVar":299,"SndSsThresh":840,"SndCwnd":1138,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":11654,"PacingRate":30100225,"MaxPacingRate":-1,"BytesAcked":134230894,"BytesReceived":1860,"SegsOut":106471,"SegsIn":8219,"NotsentBytes":1044000,"MinRTT":20000,"DataSegsIn":26,"DataSegsOut":106468,"DeliveryRate":31300510,"BusyTime":5437000,"RWndLimited":1139000,"SndBufLimited":321000,"Delivered":94128,"DeliveredCE":0,"BytesSent":153233070,"BytesRetrans":16777376,"DSackDups":6,"ReordSeen":530,"ElapsedTime":5414079}}
  [39%] elapsed:  5.507 s; test_id: 4; num_flows: 1; speed:    200 Mbit/s
  [41%] elapsed:  5.760 s; test_id: 4; num_flows: 1; speed:    199 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":5922989,"MaxBandwidth":39398431,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":224000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1768,"Sacked":1035,"Lost":216,"Retrans":216,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":404,"LastAckRecv":2,"PMTU":1500,"RcvSsThresh":31104,"RTT":23111,"RTTVar":449,"SndSsThresh":840,"SndCwnd":736,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":12868,"PacingRate":40821152,"MaxPacingRate":-1,"BytesAcked":147045454,"BytesReceived":1907,"SegsOut":116812,"SegsIn":9066,"NotsentBytes":544320,"MinRTT":20000,"DataSegsIn":27,"DataSegsOut":116809,"DeliveryRate":21459937,"BusyTime":5946000,"RWndLimited":1262000,"SndBufLimited":321000,"Delivered":103219,"DeliveredCE":0,"BytesSent":168116910,"BytesRetrans":18525536,"DSackDups":10,"ReordSeen":530,"ElapsedTime":5922989}}
  [43%] elapsed:  6.010 s; test_id: 4; num_flows: 1; speed:    200 Mbit/s
  [45%] elapsed:  6.262 s; test_id: 4; num_flows: 1; speed:    202 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":6238930,"MaxBandwidth":44573421,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":224000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":554,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":215,"LastAckRecv":0,"PMTU":1500,"RcvSsThresh":31104,"RTT":23586,"RTTVar":781,"SndSsThresh":840,"SndCwnd":1334,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":13419,"PacingRate":46183017,"MaxPacingRate":-1,"BytesAcked":157070126,"BytesReceived":1954,"SegsOut":123114,"SegsIn":9625,"NotsentBytes":2158560,"MinRTT":20000,"DataSegsIn":28,"DataSegsOut":123111,"DeliveryRate":44314738,"BusyTime":6262000,"RWndLimited":1344000,"SndBufLimited":332000,"Delivered":109149,"DeliveredCE":0,"BytesSent":177186862,"BytesRetrans":19318976,"DSackDups":10,"ReordSeen":530,"ElapsedTime":6238930}}
  [47%] elapsed:  6.543 s; test_id: 4; num_flows: 1; speed:    201 Mbit/s
  [49%] elapsed:  6.805 s; test_id: 4; num_flows: 1; speed:    205 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":6822461,"MaxBandwidth":45766811,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":225000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1622,"Sacked":906,"Lost":32,"Retrans":32,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":440,"LastAckRecv":1,"PMTU":1500,"RcvSsThresh":31104,"RTT":24158,"RTTVar":546,"SndSsThresh":840,"SndCwnd":716,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":14213,"PacingRate":59274377,"MaxPacingRate":-1,"BytesAcked":174301166,"BytesReceived":2001,"SegsOut":136953,"SegsIn":10594,"NotsentBytes":820800,"MinRTT":20000,"DataSegsIn":29,"DataSegsOut":136950,"DeliveryRate":33679108,"BusyTime":6846000,"RWndLimited":1482000,"SndBufLimited":332000,"Delivered":122034,"DeliveredCE":0,"BytesSent":197099022,"BytesRetrans":20462176,"DSackDups":12,"ReordSeen":530,"ElapsedTime":6822461}}
  [50%] elapsed:  7.055 s; test_id: 4; num_flows: 1; speed:    204 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":6966608,"MaxBandwidth":45886974,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":224000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1269,"Sacked":453,"Lost":19,"Retrans":19,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":42,"LastAckRecv":2,"PMTU":1500,"RcvSsThresh":31104,"RTT":23757,"RTTVar":651,"SndSsThresh":840,"SndCwnd":816,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":14548,"PacingRate":47544003,"MaxPacingRate":-1,"BytesAcked":178636910,"BytesReceived":2048,"SegsOut":139947,"SegsIn":10845,"NotsentBytes":1238400,"MinRTT":20000,"DataSegsIn":30,"DataSegsOut":139944,"DeliveryRate":38870017,"BusyTime":6990000,"RWndLimited":1534000,"SndBufLimited":332000,"Delivered":124593,"DeliveredCE":0,"BytesSent":201408846,"BytesRetrans":20944576,"DSackDups":12,"ReordSeen":530,"ElapsedTime":6966608}}
  [52%] elapsed:  7.330 s; test_id: 4; num_flows: 1; speed:    204 Mbit/s
  [55%] elapsed:  7.643 s; test_id: 4; num_flows: 1; speed:    204 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":7591713,"MaxBandwidth":44406051,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":1,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":225000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":922,"Sacked":132,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":514,"LastAckRecv":2,"PMTU":1500,"RcvSsThresh":31104,"RTT":24483,"RTTVar":862,"SndSsThresh":840,"SndCwnd":1330,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":16114,"PacingRate":46009603,"MaxPacingRate":-1,"BytesAcked":194813582,"BytesReceived":2095,"SegsOut":152409,"SegsIn":11803,"NotsentBytes":2482560,"MinRTT":20000,"DataSegsIn":31,"DataSegsOut":152406,"DeliveryRate":14068124,"BusyTime":7615000,"RWndLimited":1737000,"SndBufLimited":359000,"Delivered":135515,"DeliveredCE":0,"BytesSent":219340878,"BytesRetrans":23199616,"DSackDups":12,"ReordSeen":535,"ElapsedTime":7591713}}
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":7799167,"MaxBandwidth":43616666,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":226000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":2022,"Sacked":1286,"Lost":49,"Retrans":49,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":68,"LastAckRecv":0,"PMTU":1500,"RcvSsThresh":31104,"RTT":25121,"RTTVar":902,"SndSsThresh":840,"SndCwnd":1133,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":16447,"PacingRate":45191713,"MaxPacingRate":-1,"BytesAcked":199513742,"BytesReceived":2142,"SegsOut":157108,"SegsIn":12104,"NotsentBytes":345600,"MinRTT":20000,"DataSegsIn":32,"DataSegsOut":157105,"DeliveryRate":36679300,"BusyTime":7822000,"RWndLimited":1787000,"SndBufLimited":359000,"Delivered":139935,"DeliveredCE":0,"BytesSent":226104558,"BytesRetrans":23679136,"DSackDups":12,"ReordSeen":535,"ElapsedTime":7799167}}
  [56%] elapsed:  7.894 s; test_id: 4; num_flows: 1; speed:    208 Mbit/s
  [58%] elapsed:  8.169 s; test_id: 4; num_flows: 1; speed:    209 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":8184410,"MaxBandwidth":59745626,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":224000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1620,"Sacked":1416,"Lost":133,"Retrans":133,"Fackets":0,"LastDataSent":2,"LastAckSent":0,"LastDataRecv":324,"LastAckRecv":2,"PMTU":1500,"RcvSsThresh":31104,"RTT":23475,"RTTVar":644,"SndSsThresh":840,"SndCwnd":1687,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":17190,"PacingRate":61903107,"MaxPacingRate":-1,"BytesAcked":213324782,"BytesReceived":2189,"SegsOut":167042,"SegsIn":12848,"NotsentBytes":786752,"MinRTT":20000,"DataSegsIn":33,"DataSegsOut":167039,"DeliveryRate":42178293,"BusyTime":8208000,"RWndLimited":1880000,"SndBufLimited":359000,"Delivered":149658,"DeliveredCE":0,"BytesSent":240406126,"BytesRetrans":24749056,"DSackDups":12,"ReordSeen":535,"ElapsedTime":8184410}}
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":8250989,"MaxBandwidth":59745626,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":226000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1522,"Sacked":423,"Lost":50,"Retrans":32,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":16,"LastAckRecv":0,"PMTU":1500,"RcvSsThresh":31104,"RTT":25315,"RTTVar":844,"SndSsThresh":840,"SndCwnd":1156,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":17287,"PacingRate":46427330,"MaxPacingRate":-1,"BytesAcked":216642542,"BytesReceived":2236,"SegsOut":169354,"SegsIn":12967,"NotsentBytes":1821600,"MinRTT":20000,"DataSegsIn":34,"DataSegsOut":169351,"DeliveryRate":44549188,"BusyTime":8274000,"RWndLimited":1898000,"SndBufLimited":359000,"Delivered":150978,"DeliveredCE":0,"BytesSent":243722446,"BytesRetrans":24888224,"DSackDups":12,"ReordSeen":535,"ElapsedTime":8250989}}
  [60%] elapsed:  8.427 s; test_id: 4; num_flows: 1; speed:    210 Mbit/s
  [62%] elapsed:  8.677 s; test_id: 4; num_flows: 1; speed:    211 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":8619795,"MaxBandwidth":57620286,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":225000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1133,"Sacked":139,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":244,"LastAckRecv":2,"PMTU":1500,"RcvSsThresh":31104,"RTT":24148,"RTTVar":1212,"SndSsThresh":840,"SndCwnd":1724,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":18855,"PacingRate":59701019,"MaxPacingRate":-1,"BytesAcked":228286382,"BytesReceived":2283,"SegsOut":178626,"SegsIn":13657,"NotsentBytes":2469600,"MinRTT":20000,"DataSegsIn":35,"DataSegsOut":178623,"DeliveryRate":17383414,"BusyTime":8643000,"RWndLimited":2034000,"SndBufLimited":359000,"Delivered":158791,"DeliveredCE":0,"BytesSent":257061166,"BytesRetrans":27146144,"DSackDups":16,"ReordSeen":535,"ElapsedTime":8619795}}
  [64%] elapsed:  8.972 s; test_id: 4; num_flows: 1; speed:    211 Mbit/s
  [66%] elapsed:  9.223 s; test_id: 4; num_flows: 1; speed:    213 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":9244917,"MaxBandwidth":53103446,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":223000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1607,"Sacked":1483,"Lost":96,"Retrans":96,"Fackets":0,"LastDataSent":2,"LastAckSent":0,"LastDataRecv":507,"LastAckRecv":1,"PMTU":1500,"RcvSsThresh":31104,"RTT":22610,"RTTVar":749,"SndSsThresh":840,"SndCwnd":1590,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":21080,"PacingRate":55021071,"MaxPacingRate":-1,"BytesAcked":246246062,"BytesReceived":2330,"SegsOut":193804,"SegsIn":14800,"NotsentBytes":1555200,"MinRTT":20000,"DataSegsIn":36,"DataSegsOut":193801,"DeliveryRate":25492510,"BusyTime":9268000,"RWndLimited":2252000,"SndBufLimited":388000,"Delivered":172614,"DeliveredCE":0,"BytesSent":278909294,"BytesRetrans":30350144,"DSackDups":16,"ReordSeen":535,"ElapsedTime":9244917}}
  [68%] elapsed:  9.476 s; test_id: 4; num_flows: 1; speed:    215 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":9401917,"MaxBandwidth":52233638,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":225000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1517,"Sacked":1433,"Lost":83,"Retrans":83,"Fackets":0,"LastDataSent":3,"LastAckSent":0,"LastDataRecv":86,"LastAckRecv":3,"PMTU":1500,"RcvSsThresh":31104,"RTT":24115,"RTTVar":1644,"SndSsThresh":840,"SndCwnd":1550,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":21347,"PacingRate":54119853,"MaxPacingRate":-1,"BytesAcked":251656590,"BytesReceived":2377,"SegsOut":197740,"SegsIn":15093,"NotsentBytes":1910976,"MinRTT":20000,"DataSegsIn":37,"DataSegsOut":197737,"DeliveryRate":25249666,"BusyTime":9425000,"RWndLimited":2300000,"SndBufLimited":388000,"Delivered":176323,"DeliveredCE":0,"BytesSent":284575598,"BytesRetrans":30734624,"DSackDups":16,"ReordSeen":536,"ElapsedTime":9401917}}
  [69%] elapsed:  9.727 s; test_id: 4; num_flows: 1; speed:    218 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":9683892,"MaxBandwidth":53594226,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":225000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1587,"Sacked":961,"Lost":23,"Retrans":23,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":181,"LastAckRecv":1,"PMTU":1500,"RcvSsThresh":31104,"RTT":24085,"RTTVar":562,"SndSsThresh":840,"SndCwnd":1626,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":21803,"PacingRate":69411967,"MaxPacingRate":-1,"BytesAcked":262102350,"BytesReceived":2424,"SegsOut":205523,"SegsIn":15674,"NotsentBytes":1426080,"MinRTT":20000,"DataSegsIn":38,"DataSegsOut":205520,"DeliveryRate":45901585,"BusyTime":9707000,"RWndLimited":2372000,"SndBufLimited":388000,"Delivered":183108,"DeliveredCE":0,"BytesSent":295761134,"BytesRetrans":31391264,"DSackDups":16,"ReordSeen":536,"ElapsedTime":9683892}}
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":9829457,"MaxBandwidth":53594226,"MinRTT":20000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":225000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":2076,"Sacked":1797,"Lost":202,"Retrans":202,"Fackets":0,"LastDataSent":2,"LastAckSent":0,"LastDataRecv":327,"LastAckRecv":2,"PMTU":1500,"RcvSsThresh":31104,"RTT":24269,"RTTVar":615,"SndSsThresh":840,"SndCwnd":1442,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":22477,"PacingRate":69411967,"MaxPacingRate":-1,"BytesAcked":265568430,"BytesReceived":2424,"SegsOut":209106,"SegsIn":15973,"NotsentBytes":803360,"MinRTT":20000,"DataSegsIn":38,"DataSegsOut":209103,"DeliveryRate":34152168,"BusyTime":9853000,"RWndLimited":2423000,"SndBufLimited":388000,"Delivered":186364,"DeliveredCE":0,"BytesSent":300915086,"BytesRetrans":32358496,"DSackDups":16,"ReordSeen":536,"ElapsedTime":9829457}}
  [71%] elapsed:  9.981 s; test_id: 4; num_flows: 1; speed:    217 Mbit/s
ndt7: test complete

Sep 30 '19 11:09 robertodauria

Another data point, bad results:

$ ./libndt-client -ndt7 -download ndt-iupui-mlab3-mil04.measurement-lab.org | grep PMTU
will run the download sub-test
will use the ndt7 protocol
will use this NDT server: ndt-iupui-mlab3-mil04.measurement-lab.org
trying to connect to ndt-iupui-mlab3-mil04.measurement-lab.org
using the ndt7 protocol
ndt7: WebSocket connection established
  - [ndt7] download: {"ConnectionInfo":{"Client":"93.188.102.213:36420","Server":"213.242.77.165:443","UUID":"ndt-55bgx_1566037366_000000000001E4AA"},"BBRInfo":{"ElapsedTime":9,"MaxBandwidth":0,"MinRTT":23617},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":1,"RTO":225000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":9,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":9,"LastAckRecv":9,"PMTU":1500,"RcvSsThresh":31104,"RTT":24120,"RTTVar":7117,"SndSsThresh":2147483647,"SndCwnd":10,"AdvMSS":1448,"Reordering":3,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":0,"PacingRate":1785461,"MaxPacingRate":-1,"BytesAcked":6429,"BytesReceived":779,"SegsOut":17,"SegsIn":7,"NotsentBytes":33120,"MinRTT":23617,"DataSegsIn":3,"DataSegsOut":14,"DeliveryRate":286864,"BusyTime":26000,"RWndLimited":0,"SndBufLimited":0,"Delivered":6,"DeliveredCE":0,"BytesSent":17665,"BytesRetrans":0,"DSackDups":0,"ReordSeen":0,"ElapsedTime":9}}
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":94433,"MaxBandwidth":1255617,"MinRTT":23617},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":229000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":60,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":15,"LastAckRecv":3,"PMTU":1500,"RcvSsThresh":31104,"RTT":28586,"RTTVar":909,"SndSsThresh":2147483647,"SndCwnd":63,"AdvMSS":1448,"Reordering":3,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":0,"PacingRate":3755502,"MaxPacingRate":-1,"BytesAcked":81025,"BytesReceived":826,"SegsOut":121,"SegsIn":30,"NotsentBytes":246240,"MinRTT":23617,"DataSegsIn":4,"DataSegsOut":118,"DeliveryRate":1255692,"BusyTime":120000,"RWndLimited":0,"SndBufLimited":0,"Delivered":59,"DeliveredCE":0,"BytesSent":167425,"BytesRetrans":0,"DSackDups":0,"ReordSeen":0,"ElapsedTime":94433}}
  [ 2%] elapsed:  0.268 s; test_id: 4; num_flows: 1; speed:    121 Mbit/s
  [ 4%] elapsed:  0.519 s; test_id: 4; num_flows: 1; speed:    170 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":392843,"MaxBandwidth":66207304,"MinRTT":6002},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":223000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":452,"Sacked":46,"Lost":8,"Retrans":8,"Fackets":0,"LastDataSent":18,"LastAckSent":0,"LastDataRecv":237,"LastAckRecv":19,"PMTU":1500,"RcvSsThresh":31104,"RTT":22876,"RTTVar":2677,"SndSsThresh":1208,"SndCwnd":406,"AdvMSS":1448,"Reordering":220,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":484,"PacingRate":85747654,"MaxPacingRate":-1,"BytesAcked":7402113,"BytesReceived":873,"SegsOut":6716,"SegsIn":597,"NotsentBytes":3252960,"MinRTT":6002,"DataSegsIn":5,"DataSegsOut":6713,"DeliveryRate":11386861,"BusyTime":419000,"RWndLimited":83000,"SndBufLimited":0,"Delivered":5226,"DeliveredCE":0,"BytesSent":9655009,"BytesRetrans":696256,"DSackDups":31,"ReordSeen":4,"ElapsedTime":392843}}
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":552076,"MaxBandwidth":66207304,"MinRTT":6002},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":231000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":570,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":2,"LastAckRecv":2,"PMTU":1500,"RcvSsThresh":31104,"RTT":30522,"RTTVar":1127,"SndSsThresh":1208,"SndCwnd":690,"AdvMSS":1448,"Reordering":220,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":484,"PacingRate":68598123,"MaxPacingRate":-1,"BytesAcked":11392353,"BytesReceived":920,"SegsOut":9605,"SegsIn":811,"NotsentBytes":3304800,"MinRTT":6002,"DataSegsIn":6,"DataSegsOut":9602,"DeliveryRate":30042535,"BusyTime":578000,"RWndLimited":83000,"SndBufLimited":0,"Delivered":7955,"DeliveredCE":0,"BytesSent":13815169,"BytesRetrans":696256,"DSackDups":35,"ReordSeen":4,"ElapsedTime":552076}}
  [ 5%] elapsed:  0.770 s; test_id: 4; num_flows: 1; speed:    170 Mbit/s
  [ 7%] elapsed:  1.028 s; test_id: 4; num_flows: 1; speed:    155 Mbit/s
  [ 9%] elapsed:  1.286 s; test_id: 4; num_flows: 1; speed:    139 Mbit/s
  [11%] elapsed:  1.541 s; test_id: 4; num_flows: 1; speed:    124 Mbit/s
  [13%] elapsed:  1.796 s; test_id: 4; num_flows: 1; speed:    111 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":1177201,"MaxBandwidth":13473358,"MinRTT":6002},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":226000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":138,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":4,"LastAckSent":0,"LastDataRecv":418,"LastAckRecv":5,"PMTU":1500,"RcvSsThresh":31104,"RTT":25677,"RTTVar":822,"SndSsThresh":1208,"SndCwnd":142,"AdvMSS":1448,"Reordering":220,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":485,"PacingRate":13959896,"MaxPacingRate":-1,"BytesAcked":21319713,"BytesReceived":967,"SegsOut":16068,"SegsIn":1574,"NotsentBytes":3913920,"MinRTT":6002,"DataSegsIn":7,"DataSegsOut":16065,"DeliveryRate":9634909,"BusyTime":1203000,"RWndLimited":83000,"SndBufLimited":0,"Delivered":14849,"DeliveredCE":0,"BytesSent":23121889,"BytesRetrans":697696,"DSackDups":35,"ReordSeen":4,"ElapsedTime":1177201}}
  [15%] elapsed:  2.049 s; test_id: 4; num_flows: 1; speed:    100 Mbit/s
  [17%] elapsed:  2.324 s; test_id: 4; num_flows: 1; speed:     90 Mbit/s
  [19%] elapsed:  2.591 s; test_id: 4; num_flows: 1; speed:     82 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":1449471,"MaxBandwidth":8337850,"MinRTT":6002},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":225000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":84,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":690,"LastAckRecv":0,"PMTU":1500,"RcvSsThresh":31104,"RTT":24806,"RTTVar":666,"SndSsThresh":1208,"SndCwnd":84,"AdvMSS":1448,"Reordering":220,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":485,"PacingRate":6479204,"MaxPacingRate":-1,"BytesAcked":23384673,"BytesReceived":967,"SegsOut":17448,"SegsIn":1920,"NotsentBytes":3352320,"MinRTT":6002,"DataSegsIn":7,"DataSegsOut":17445,"DeliveryRate":5849035,"BusyTime":1475000,"RWndLimited":83000,"SndBufLimited":0,"Delivered":16283,"DeliveredCE":0,"BytesSent":25109089,"BytesRetrans":697696,"DSackDups":35,"ReordSeen":4,"ElapsedTime":1449471}}
  [20%] elapsed:  2.857 s; test_id: 4; num_flows: 1; speed:   75.3 Mbit/s
  [23%] elapsed:  3.168 s; test_id: 4; num_flows: 1; speed:   68.7 Mbit/s
  [25%] elapsed:  3.442 s; test_id: 4; num_flows: 1; speed:   63.8 Mbit/s
  [27%] elapsed:  3.735 s; test_id: 4; num_flows: 1; speed:   59.4 Mbit/s
  [29%] elapsed:  4.005 s; test_id: 4; num_flows: 1; speed:   55.9 Mbit/s
  [31%] elapsed:  4.284 s; test_id: 4; num_flows: 1; speed:   52.8 Mbit/s
  [33%] elapsed:  4.553 s; test_id: 4; num_flows: 1; speed:   50.1 Mbit/s
  [34%] elapsed:  4.826 s; test_id: 4; num_flows: 1; speed:   47.7 Mbit/s
  [37%] elapsed:  5.112 s; test_id: 4; num_flows: 1; speed:   45.4 Mbit/s
  [39%] elapsed:  5.394 s; test_id: 4; num_flows: 1; speed:   43.5 Mbit/s
  [40%] elapsed:  5.663 s; test_id: 4; num_flows: 1; speed:   41.8 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":2074599,"MaxBandwidth":3595876,"MinRTT":6002},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":225000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":37,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":83,"LastAckRecv":1,"PMTU":1500,"RcvSsThresh":31104,"RTT":24887,"RTTVar":951,"SndSsThresh":1208,"SndCwnd":38,"AdvMSS":1448,"Reordering":220,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":485,"PacingRate":3725727,"MaxPacingRate":-1,"BytesAcked":25687233,"BytesReceived":1014,"SegsOut":19000,"SegsIn":2394,"NotsentBytes":3903840,"MinRTT":6002,"DataSegsIn":8,"DataSegsOut":18997,"DeliveryRate":2105182,"BusyTime":2100000,"RWndLimited":83000,"SndBufLimited":0,"Delivered":17882,"DeliveredCE":0,"BytesSent":27343969,"BytesRetrans":697696,"DSackDups":35,"ReordSeen":4,"ElapsedTime":2074599}}
  [42%] elapsed:  5.933 s; test_id: 4; num_flows: 1; speed:   40.2 Mbit/s
  [44%] elapsed:  6.199 s; test_id: 4; num_flows: 1; speed:   38.8 Mbit/s
  [46%] elapsed:  6.481 s; test_id: 4; num_flows: 1; speed:   37.5 Mbit/s
  [48%] elapsed:  6.750 s; test_id: 4; num_flows: 1; speed:   36.3 Mbit/s
  [50%] elapsed:  7.021 s; test_id: 4; num_flows: 1; speed:   35.2 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":2863861,"MaxBandwidth":1379470,"MinRTT":6002},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":227000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":20,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":5,"LastAckSent":0,"LastDataRecv":41,"LastAckRecv":5,"PMTU":1500,"RcvSsThresh":31104,"RTT":26997,"RTTVar":1298,"SndSsThresh":1208,"SndCwnd":20,"AdvMSS":1448,"Reordering":220,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":485,"PacingRate":1429285,"MaxPacingRate":-1,"BytesAcked":26911233,"BytesReceived":1061,"SegsOut":19833,"SegsIn":2765,"NotsentBytes":4065120,"MinRTT":6002,"DataSegsIn":9,"DataSegsOut":19830,"DeliveryRate":1151079,"BusyTime":2890000,"RWndLimited":83000,"SndBufLimited":0,"Delivered":18732,"DeliveredCE":0,"BytesSent":28543489,"BytesRetrans":697696,"DSackDups":35,"ReordSeen":4,"ElapsedTime":2863861}}
  [52%] elapsed:  7.306 s; test_id: 4; num_flows: 1; speed:   34.1 Mbit/s
  [54%] elapsed:  7.579 s; test_id: 4; num_flows: 1; speed:   33.1 Mbit/s
  [56%] elapsed:  7.854 s; test_id: 4; num_flows: 1; speed:   32.2 Mbit/s
  [58%] elapsed:  8.127 s; test_id: 4; num_flows: 1; speed:   31.4 Mbit/s
  [60%] elapsed:  8.418 s; test_id: 4; num_flows: 1; speed:   30.6 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":4309686,"MaxBandwidth":1080350,"MinRTT":6002},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":226000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":18,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":1486,"LastAckRecv":1,"PMTU":1500,"RcvSsThresh":31104,"RTT":25350,"RTTVar":574,"SndSsThresh":1208,"SndCwnd":18,"AdvMSS":1448,"Reordering":220,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":485,"PacingRate":1119363,"MaxPacingRate":-1,"BytesAcked":28312353,"BytesReceived":1061,"SegsOut":20804,"SegsIn":3229,"NotsentBytes":4092480,"MinRTT":6002,"DataSegsIn":9,"DataSegsOut":20801,"DeliveryRate":1016311,"BusyTime":4335000,"RWndLimited":83000,"SndBufLimited":0,"Delivered":19705,"DeliveredCE":0,"BytesSent":29941729,"BytesRetrans":697696,"DSackDups":35,"ReordSeen":4,"ElapsedTime":4309686}}
  [62%] elapsed:  8.692 s; test_id: 4; num_flows: 1; speed:   29.9 Mbit/s
  [64%] elapsed:  8.966 s; test_id: 4; num_flows: 1; speed:   29.2 Mbit/s
  [66%] elapsed:  9.240 s; test_id: 4; num_flows: 1; speed:   28.5 Mbit/s
  [68%] elapsed:  9.514 s; test_id: 4; num_flows: 1; speed:   27.9 Mbit/s
  [70%] elapsed:  9.780 s; test_id: 4; num_flows: 1; speed:   27.4 Mbit/s
  [72%] elapsed: 10.058 s; test_id: 4; num_flows: 1; speed:   26.9 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":5864367,"MaxBandwidth":1079750,"MinRTT":6002},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":226000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":18,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":3,"LastAckSent":0,"LastDataRecv":106,"LastAckRecv":3,"PMTU":1500,"RcvSsThresh":31104,"RTT":25739,"RTTVar":823,"SndSsThresh":1208,"SndCwnd":18,"AdvMSS":1448,"Reordering":220,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":486,"PacingRate":1398426,"MaxPacingRate":-1,"BytesAcked":29799873,"BytesReceived":1108,"SegsOut":21838,"SegsIn":3735,"NotsentBytes":4030560,"MinRTT":6002,"DataSegsIn":10,"DataSegsOut":21835,"DeliveryRate":1036136,"BusyTime":5890000,"RWndLimited":83000,"SndBufLimited":0,"Delivered":20738,"DeliveredCE":0,"BytesSent":31430689,"BytesRetrans":699136,"DSackDups":35,"ReordSeen":4,"ElapsedTime":5864367}}
  [74%] elapsed: 10.329 s; test_id: 4; num_flows: 1; speed:   26.4 Mbit/s
  [76%] elapsed: 10.632 s; test_id: 4; num_flows: 1; speed:   25.7 Mbit/s
  [78%] elapsed: 10.914 s; test_id: 4; num_flows: 1; speed:   25.3 Mbit/s
  [80%] elapsed: 11.179 s; test_id: 4; num_flows: 1; speed:   25.1 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":7191859,"MaxBandwidth":1102752,"MinRTT":6002},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":228000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":18,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":4,"LastAckSent":0,"LastDataRecv":4,"LastAckRecv":4,"PMTU":1500,"RcvSsThresh":31104,"RTT":27796,"RTTVar":2081,"SndSsThresh":1208,"SndCwnd":18,"AdvMSS":1448,"Reordering":220,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":486,"PacingRate":1142574,"MaxPacingRate":-1,"BytesAcked":31072833,"BytesReceived":1155,"SegsOut":22722,"SegsIn":4144,"NotsentBytes":4118400,"MinRTT":6002,"DataSegsIn":11,"DataSegsOut":22719,"DeliveryRate":941140,"BusyTime":7218000,"RWndLimited":83000,"SndBufLimited":0,"Delivered":21622,"DeliveredCE":0,"BytesSent":32703649,"BytesRetrans":699136,"DSackDups":35,"ReordSeen":4,"ElapsedTime":7191859}}
  [82%] elapsed: 11.439 s; test_id: 4; num_flows: 1; speed:   25.2 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":8669426,"MaxBandwidth":1019239,"MinRTT":6002},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":228000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":18,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":21,"LastAckRecv":0,"PMTU":1500,"RcvSsThresh":31104,"RTT":27522,"RTTVar":1161,"SndSsThresh":1208,"SndCwnd":18,"AdvMSS":1448,"Reordering":220,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":486,"PacingRate":1056045,"MaxPacingRate":-1,"BytesAcked":32472513,"BytesReceived":1202,"SegsOut":23694,"SegsIn":4610,"NotsentBytes":4079520,"MinRTT":6002,"DataSegsIn":12,"DataSegsOut":23691,"DeliveryRate":940331,"BusyTime":8695000,"RWndLimited":83000,"SndBufLimited":0,"Delivered":22594,"DeliveredCE":0,"BytesSent":34103329,"BytesRetrans":699136,"DSackDups":35,"ReordSeen":4,"ElapsedTime":8669426}}

...and good results immediately afterwards, same server:

$ ./libndt-client -ndt7 -download ndt-iupui-mlab3-mil04.measurement-lab.org | grep PMTU
will run the download sub-test
will use the ndt7 protocol
will use this NDT server: ndt-iupui-mlab3-mil04.measurement-lab.org
trying to connect to ndt-iupui-mlab3-mil04.measurement-lab.org
using the ndt7 protocol
ndt7: WebSocket connection established
  - [ndt7] download: {"ConnectionInfo":{"Client":"93.188.102.213:36450","Server":"213.242.77.165:443","UUID":"ndt-55bgx_1566037366_000000000001E4BE"},"BBRInfo":{"ElapsedTime":12,"MaxBandwidth":0,"MinRTT":23843},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":1,"RTO":224000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":9,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":10,"LastAckRecv":10,"PMTU":1500,"RcvSsThresh":31104,"RTT":23994,"RTTVar":9034,"SndSsThresh":2147483647,"SndCwnd":10,"AdvMSS":1448,"Reordering":220,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":0,"PacingRate":1794960,"MaxPacingRate":-1,"BytesAcked":6429,"BytesReceived":779,"SegsOut":17,"SegsIn":6,"NotsentBytes":5468,"MinRTT":23843,"DataSegsIn":3,"DataSegsOut":14,"DeliveryRate":301419,"BusyTime":25000,"RWndLimited":0,"SndBufLimited":0,"Delivered":6,"DeliveredCE":0,"BytesSent":17665,"BytesRetrans":0,"DSackDups":0,"ReordSeen":0,"ElapsedTime":12}}
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":58018,"MaxBandwidth":566654,"MinRTT":23843},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":228000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":21,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":2,"LastAckSent":0,"LastDataRecv":2,"LastAckRecv":2,"PMTU":1500,"RcvSsThresh":31104,"RTT":27632,"RTTVar":4306,"SndSsThresh":2147483647,"SndCwnd":31,"AdvMSS":1448,"Reordering":220,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":0,"PacingRate":1794960,"MaxPacingRate":-1,"BytesAcked":34945,"BytesReceived":826,"SegsOut":50,"SegsIn":13,"NotsentBytes":1440000,"MinRTT":23843,"DataSegsIn":4,"DataSegsOut":47,"DeliveryRate":566724,"BusyTime":83000,"RWndLimited":0,"SndBufLimited":0,"Delivered":27,"DeliveredCE":0,"BytesSent":65185,"BytesRetrans":0,"DSackDups":0,"ReordSeen":0,"ElapsedTime":58018}}
  [ 2%] elapsed:  0.259 s; test_id: 4; num_flows: 1; speed:   64.8 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":236211,"MaxBandwidth":45589399,"MinRTT":22692},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":229000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1886,"Sacked":477,"Lost":134,"Retrans":134,"Fackets":0,"LastDataSent":2,"LastAckSent":0,"LastDataRecv":30,"LastAckRecv":2,"PMTU":1500,"RcvSsThresh":31104,"RTT":28010,"RTTVar":921,"SndSsThresh":2147483647,"SndCwnd":1409,"AdvMSS":1448,"Reordering":220,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":134,"PacingRate":136356132,"MaxPacingRate":-1,"BytesAcked":2062465,"BytesReceived":873,"SegsOut":3457,"SegsIn":299,"NotsentBytes":959040,"MinRTT":22692,"DataSegsIn":5,"DataSegsOut":3454,"DeliveryRate":45589463,"BusyTime":261000,"RWndLimited":0,"SndBufLimited":0,"Delivered":1912,"DeliveredCE":0,"BytesSent":4971265,"BytesRetrans":192960,"DSackDups":0,"ReordSeen":0,"ElapsedTime":236211}}
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":424215,"MaxBandwidth":50469045,"MinRTT":22692},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":229000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":2165,"Sacked":1301,"Lost":130,"Retrans":130,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":43,"LastAckRecv":2,"PMTU":1500,"RcvSsThresh":31104,"RTT":28865,"RTTVar":1168,"SndSsThresh":932,"SndCwnd":1028,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":12950,"PacingRate":52291538,"MaxPacingRate":-1,"BytesAcked":6104545,"BytesReceived":920,"SegsOut":19360,"SegsIn":586,"NotsentBytes":856800,"MinRTT":22692,"DataSegsIn":6,"DataSegsOut":19357,"DeliveryRate":49434266,"BusyTime":449000,"RWndLimited":64000,"SndBufLimited":0,"Delivered":5564,"DeliveredCE":0,"BytesSent":27870145,"BytesRetrans":18648000,"DSackDups":20,"ReordSeen":20,"ElapsedTime":424215}}
  [ 4%] elapsed:  0.553 s; test_id: 4; num_flows: 1; speed:    160 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":644005,"MaxBandwidth":62007865,"MinRTT":22692},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":229000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1270,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":128,"LastAckRecv":3,"PMTU":1500,"RcvSsThresh":31104,"RTT":28111,"RTTVar":636,"SndSsThresh":932,"SndCwnd":2081,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":13017,"PacingRate":64247038,"MaxPacingRate":-1,"BytesAcked":14986465,"BytesReceived":967,"SegsOut":24704,"SegsIn":902,"NotsentBytes":2011680,"MinRTT":22692,"DataSegsIn":7,"DataSegsOut":24701,"DeliveryRate":26099211,"BusyTime":669000,"RWndLimited":146000,"SndBufLimited":0,"Delivered":10435,"DeliveredCE":0,"BytesSent":35559745,"BytesRetrans":18744480,"DSackDups":20,"ReordSeen":20,"ElapsedTime":644005}}
  [ 6%] elapsed:  0.815 s; test_id: 4; num_flows: 1; speed:    198 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":750851,"MaxBandwidth":62007865,"MinRTT":22692},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":226000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":264,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":235,"LastAckRecv":3,"PMTU":1500,"RcvSsThresh":31104,"RTT":25301,"RTTVar":1025,"SndSsThresh":932,"SndCwnd":1575,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":13575,"PacingRate":64247038,"MaxPacingRate":-1,"BytesAcked":18826945,"BytesReceived":967,"SegsOut":26923,"SegsIn":1157,"NotsentBytes":3761280,"MinRTT":22692,"DataSegsIn":7,"DataSegsOut":26920,"DeliveryRate":10292553,"BusyTime":776000,"RWndLimited":146000,"SndBufLimited":61000,"Delivered":13102,"DeliveredCE":0,"BytesSent":38751577,"BytesRetrans":19548000,"DSackDups":20,"ReordSeen":20,"ElapsedTime":750851}}
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":929461,"MaxBandwidth":58350362,"MinRTT":22692},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":231000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1110,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":36,"LastAckRecv":0,"PMTU":1500,"RcvSsThresh":31104,"RTT":30864,"RTTVar":628,"SndSsThresh":932,"SndCwnd":1932,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":14082,"PacingRate":45343094,"MaxPacingRate":-1,"BytesAcked":24140505,"BytesReceived":1061,"SegsOut":31972,"SegsIn":1453,"NotsentBytes":1447200,"MinRTT":22692,"DataSegsIn":9,"DataSegsOut":31969,"DeliveryRate":26851691,"BusyTime":954000,"RWndLimited":149000,"SndBufLimited":130000,"Delivered":16798,"DeliveredCE":0,"BytesSent":46016961,"BytesRetrans":20278056,"DSackDups":20,"ReordSeen":20,"ElapsedTime":929461}}
  [ 8%] elapsed:  1.094 s; test_id: 4; num_flows: 1; speed:    212 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":1026924,"MaxBandwidth":64602870,"MinRTT":22692},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":225000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1436,"Sacked":440,"Lost":82,"Retrans":82,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":134,"LastAckRecv":12,"PMTU":1500,"RcvSsThresh":31104,"RTT":24932,"RTTVar":496,"SndSsThresh":932,"SndCwnd":1476,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":14395,"PacingRate":66935752,"MaxPacingRate":-1,"BytesAcked":26998905,"BytesReceived":1061,"SegsOut":34596,"SegsIn":1609,"NotsentBytes":1166400,"MinRTT":22692,"DataSegsIn":9,"DataSegsOut":34593,"DeliveryRate":13037416,"BusyTime":1052000,"RWndLimited":192000,"SndBufLimited":130000,"Delivered":19223,"DeliveredCE":0,"BytesSent":49794081,"BytesRetrans":20728776,"DSackDups":20,"ReordSeen":20,"ElapsedTime":1026924}}
  [10%] elapsed:  1.352 s; test_id: 4; num_flows: 1; speed:    228 Mbit/s
  [11%] elapsed:  1.604 s; test_id: 4; num_flows: 1; speed:    236 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":1652060,"MaxBandwidth":53966388,"MinRTT":22692},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":225000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1304,"Sacked":1036,"Lost":238,"Retrans":238,"Fackets":0,"LastDataSent":2,"LastAckSent":0,"LastDataRecv":523,"LastAckRecv":2,"PMTU":1500,"RcvSsThresh":31104,"RTT":24740,"RTTVar":559,"SndSsThresh":932,"SndCwnd":1126,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":16522,"PacingRate":55915174,"MaxPacingRate":-1,"BytesAcked":48665145,"BytesReceived":1155,"SegsOut":51655,"SegsIn":3067,"NotsentBytes":2112544,"MinRTT":22692,"DataSegsIn":11,"DataSegsOut":51652,"DeliveryRate":22826203,"BusyTime":1677000,"RWndLimited":444000,"SndBufLimited":130000,"Delivered":34888,"DeliveredCE":0,"BytesSent":74331617,"BytesRetrans":23791656,"DSackDups":25,"ReordSeen":39,"ElapsedTime":1652060}}
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":1786988,"MaxBandwidth":56248197,"MinRTT":22692},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":227000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1932,"Sacked":1783,"Lost":149,"Retrans":149,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":658,"LastAckRecv":1,"PMTU":1500,"RcvSsThresh":31104,"RTT":26913,"RTTVar":483,"SndSsThresh":932,"SndCwnd":1845,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":16812,"PacingRate":58279382,"MaxPacingRate":-1,"BytesAcked":52255065,"BytesReceived":1155,"SegsOut":55070,"SegsIn":3331,"NotsentBytes":661408,"MinRTT":22692,"DataSegsIn":11,"DataSegsOut":55067,"DeliveryRate":7532743,"BusyTime":1812000,"RWndLimited":496000,"SndBufLimited":130000,"Delivered":38132,"DeliveredCE":0,"BytesSent":79245953,"BytesRetrans":24209256,"DSackDups":25,"ReordSeen":39,"ElapsedTime":1786988}}
  [14%] elapsed:  1.898 s; test_id: 4; num_flows: 1; speed:    237 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":2001480,"MaxBandwidth":56248197,"MinRTT":22692},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":227000,"ATO":59000,"SndMSS":1440,"RcvMSS":536,"Unacked":1218,"Sacked":704,"Lost":4,"Retrans":4,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":148,"LastAckRecv":12,"PMTU":1500,"RcvSsThresh":31104,"RTT":26868,"RTTVar":1348,"SndSsThresh":932,"SndCwnd":1400,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":17518,"PacingRate":58279382,"MaxPacingRate":-1,"BytesAcked":58278585,"BytesReceived":1249,"SegsOut":59246,"SegsIn":3641,"NotsentBytes":2406240,"MinRTT":22692,"DataSegsIn":13,"DataSegsOut":59243,"DeliveryRate":6653811,"BusyTime":2026000,"RWndLimited":628000,"SndBufLimited":130000,"Delivered":41237,"DeliveredCE":0,"BytesSent":85256961,"BytesRetrans":25225896,"DSackDups":25,"ReordSeen":40,"ElapsedTime":2001480}}
  [15%] elapsed:  2.148 s; test_id: 4; num_flows: 1; speed:    238 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":2071551,"MaxBandwidth":56248197,"MinRTT":22692},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":231000,"ATO":59000,"SndMSS":1440,"RcvMSS":536,"Unacked":2172,"Sacked":1151,"Lost":71,"Retrans":71,"Fackets":0,"LastDataSent":5,"LastAckSent":0,"LastDataRecv":218,"LastAckRecv":2,"PMTU":1500,"RcvSsThresh":31104,"RTT":30961,"RTTVar":840,"SndSsThresh":932,"SndCwnd":1347,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":17589,"PacingRate":72849228,"MaxPacingRate":-1,"BytesAcked":59925945,"BytesReceived":1249,"SegsOut":61416,"SegsIn":3711,"NotsentBytes":1005856,"MinRTT":22692,"DataSegsIn":13,"DataSegsOut":61413,"DeliveryRate":44094362,"BusyTime":2096000,"RWndLimited":645000,"SndBufLimited":130000,"Delivered":42829,"DeliveredCE":0,"BytesSent":88379585,"BytesRetrans":25328136,"DSackDups":25,"ReordSeen":46,"ElapsedTime":2071551}}
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":2216173,"MaxBandwidth":25536518,"MinRTT":22013},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":227000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":453,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":39,"LastAckRecv":1,"PMTU":1500,"RcvSsThresh":31104,"RTT":26708,"RTTVar":756,"SndSsThresh":932,"SndCwnd":834,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":17914,"PacingRate":26458670,"MaxPacingRate":-1,"BytesAcked":65073945,"BytesReceived":1343,"SegsOut":63599,"SegsIn":4045,"NotsentBytes":2543040,"MinRTT":22013,"DataSegsIn":15,"DataSegsOut":63596,"DeliveryRate":25212911,"BusyTime":2241000,"RWndLimited":684000,"SndBufLimited":130000,"Delivered":45259,"DeliveredCE":0,"BytesSent":91522401,"BytesRetrans":25796136,"DSackDups":29,"ReordSeen":47,"ElapsedTime":2216173}}
  [17%] elapsed:  2.407 s; test_id: 4; num_flows: 1; speed:    229 Mbit/s
  [19%] elapsed:  2.660 s; test_id: 4; num_flows: 1; speed:    227 Mbit/s
  [21%] elapsed:  2.911 s; test_id: 4; num_flows: 1; speed:    225 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":2902582,"MaxBandwidth":25536518,"MinRTT":22013},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":228000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1262,"Sacked":764,"Lost":1,"Retrans":1,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":501,"LastAckRecv":1,"PMTU":1500,"RcvSsThresh":31104,"RTT":27683,"RTTVar":1061,"SndSsThresh":932,"SndCwnd":516,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":18125,"PacingRate":26458670,"MaxPacingRate":-1,"BytesAcked":79890105,"BytesReceived":1390,"SegsOut":74911,"SegsIn":5175,"NotsentBytes":1077120,"MinRTT":22013,"DataSegsIn":16,"DataSegsOut":74908,"DeliveryRate":23394151,"BusyTime":2927000,"RWndLimited":730000,"SndBufLimited":130000,"Delivered":56315,"DeliveredCE":0,"BytesSent":107807361,"BytesRetrans":26099976,"DSackDups":29,"ReordSeen":53,"ElapsedTime":2902582}}
  [23%] elapsed:  3.164 s; test_id: 4; num_flows: 1; speed:    219 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":3157151,"MaxBandwidth":25536518,"MinRTT":22013},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":227000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1195,"Sacked":757,"Lost":44,"Retrans":39,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":144,"LastAckRecv":1,"PMTU":1500,"RcvSsThresh":31104,"RTT":26005,"RTTVar":1027,"SndSsThresh":932,"SndCwnd":715,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":18291,"PacingRate":26458670,"MaxPacingRate":-1,"BytesAcked":86142585,"BytesReceived":1437,"SegsOut":79352,"SegsIn":5605,"NotsentBytes":1465920,"MinRTT":22013,"DataSegsIn":17,"DataSegsOut":79349,"DeliveryRate":24774076,"BusyTime":3182000,"RWndLimited":730000,"SndBufLimited":130000,"Delivered":60650,"DeliveredCE":0,"BytesSent":114202401,"BytesRetrans":26339016,"DSackDups":29,"ReordSeen":53,"ElapsedTime":3157151}}
  [24%] elapsed:  3.419 s; test_id: 4; num_flows: 1; speed:    217 Mbit/s
  [26%] elapsed:  3.700 s; test_id: 4; num_flows: 1; speed:    214 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":3782295,"MaxBandwidth":32840452,"MinRTT":22013},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":226000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":595,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":483,"LastAckRecv":2,"PMTU":1500,"RcvSsThresh":31104,"RTT":25236,"RTTVar":802,"SndSsThresh":932,"SndCwnd":1076,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":18649,"PacingRate":34026357,"MaxPacingRate":-1,"BytesAcked":102372825,"BytesReceived":1484,"SegsOut":90383,"SegsIn":6514,"NotsentBytes":3012480,"MinRTT":22013,"DataSegsIn":18,"DataSegsOut":90380,"DeliveryRate":9211310,"BusyTime":3807000,"RWndLimited":803000,"SndBufLimited":130000,"Delivered":71166,"DeliveredCE":0,"BytesSent":130084161,"BytesRetrans":26854536,"DSackDups":29,"ReordSeen":53,"ElapsedTime":3782295}}
  [28%] elapsed:  3.951 s; test_id: 4; num_flows: 1; speed:    217 Mbit/s
  [30%] elapsed:  4.202 s; test_id: 4; num_flows: 1; speed:    221 Mbit/s
  [32%] elapsed:  4.453 s; test_id: 4; num_flows: 1; speed:    222 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":4407428,"MaxBandwidth":48827018,"MinRTT":22013},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":231000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":624,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":476,"LastAckRecv":16,"PMTU":1500,"RcvSsThresh":31104,"RTT":30651,"RTTVar":1084,"SndSsThresh":932,"SndCwnd":1598,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":18740,"PacingRate":50590216,"MaxPacingRate":-1,"BytesAcked":122511225,"BytesReceived":1531,"SegsOut":104492,"SegsIn":7438,"NotsentBytes":3255840,"MinRTT":22013,"DataSegsIn":19,"DataSegsOut":104489,"DeliveryRate":42072767,"BusyTime":4432000,"RWndLimited":874000,"SndBufLimited":130000,"Delivered":85155,"DeliveredCE":0,"BytesSent":150394209,"BytesRetrans":26985576,"DSackDups":29,"ReordSeen":53,"ElapsedTime":4407428}}
  [34%] elapsed:  4.705 s; test_id: 4; num_flows: 1; speed:    227 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":4895918,"MaxBandwidth":51923618,"MinRTT":22013},"TCPInfo":{"State":1,"CAState":1,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":232000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1685,"Sacked":363,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":348,"LastAckRecv":6,"PMTU":1500,"RcvSsThresh":31104,"RTT":31129,"RTTVar":1630,"SndSsThresh":932,"SndCwnd":1698,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":19543,"PacingRate":53798637,"MaxPacingRate":-1,"BytesAcked":138591936,"BytesReceived":1578,"SegsOut":117534,"SegsIn":8235,"NotsentBytes":401760,"MinRTT":22013,"DataSegsIn":20,"DataSegsOut":117531,"DeliveryRate":28842036,"BusyTime":4921000,"RWndLimited":952000,"SndBufLimited":160000,"Delivered":96701,"DeliveredCE":0,"BytesSent":169160232,"BytesRetrans":28141896,"DSackDups":34,"ReordSeen":53,"ElapsedTime":4895918}}
  [35%] elapsed:  4.956 s; test_id: 4; num_flows: 1; speed:    229 Mbit/s
  [37%] elapsed:  5.206 s; test_id: 4; num_flows: 1; speed:    236 Mbit/s
  [39%] elapsed:  5.456 s; test_id: 4; num_flows: 1; speed:    238 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":5520974,"MaxBandwidth":65399637,"MinRTT":22013},"TCPInfo":{"State":1,"CAState":1,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":235000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1597,"Sacked":115,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":559,"LastAckRecv":1,"PMTU":1500,"RcvSsThresh":31104,"RTT":34729,"RTTVar":498,"SndSsThresh":932,"SndCwnd":2138,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":20031,"PacingRate":67761290,"MaxPacingRate":-1,"BytesAcked":165196146,"BytesReceived":1625,"SegsOut":136424,"SegsIn":9533,"NotsentBytes":1425600,"MinRTT":22013,"DataSegsIn":21,"DataSegsOut":136421,"DeliveryRate":45219605,"BusyTime":5546000,"RWndLimited":1018000,"SndBufLimited":249000,"Delivered":114943,"DeliveredCE":0,"BytesSent":196339834,"BytesRetrans":28844008,"DSackDups":34,"ReordSeen":53,"ElapsedTime":5520974}}
  [41%] elapsed:  5.706 s; test_id: 4; num_flows: 1; speed:    242 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":5731737,"MaxBandwidth":65649061,"MinRTT":22013},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":226000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":598,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":99,"LastAckRecv":2,"PMTU":1500,"RcvSsThresh":31104,"RTT":25176,"RTTVar":1407,"SndSsThresh":932,"SndCwnd":2146,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":20624,"PacingRate":85024652,"MaxPacingRate":-1,"BytesAcked":173392626,"BytesReceived":1672,"SegsOut":141715,"SegsIn":9918,"NotsentBytes":3304800,"MinRTT":22013,"DataSegsIn":22,"DataSegsOut":141712,"DeliveryRate":13078609,"BusyTime":5756000,"RWndLimited":1077000,"SndBufLimited":308000,"Delivered":120525,"DeliveredCE":0,"BytesSent":203948580,"BytesRetrans":29697928,"DSackDups":34,"ReordSeen":53,"ElapsedTime":5731737}}
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":5831169,"MaxBandwidth":65649061,"MinRTT":22013},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":227000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1620,"Sacked":1278,"Lost":124,"Retrans":124,"Fackets":0,"LastDataSent":10,"LastAckSent":0,"LastDataRecv":199,"LastAckRecv":4,"PMTU":1500,"RcvSsThresh":31104,"RTT":26929,"RTTVar":416,"SndSsThresh":932,"SndCwnd":1496,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":20912,"PacingRate":68019721,"MaxPacingRate":-1,"BytesAcked":175536572,"BytesReceived":1672,"SegsOut":144516,"SegsIn":10096,"NotsentBytes":1235713,"MinRTT":22013,"DataSegsIn":22,"DataSegsOut":144513,"DeliveryRate":27693262,"BusyTime":5856000,"RWndLimited":1098000,"SndBufLimited":326000,"Delivered":123294,"DeliveredCE":0,"BytesSent":207977732,"BytesRetrans":30112648,"DSackDups":34,"ReordSeen":53,"ElapsedTime":5831169}}
  [43%] elapsed:  5.956 s; test_id: 4; num_flows: 1; speed:    242 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":5856295,"MaxBandwidth":65649061,"MinRTT":22000},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":225000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":679,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":9,"LastAckRecv":9,"PMTU":1500,"RcvSsThresh":31104,"RTT":24907,"RTTVar":1301,"SndSsThresh":932,"SndCwnd":2144,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":20912,"PacingRate":68019721,"MaxPacingRate":-1,"BytesAcked":177865084,"BytesReceived":1719,"SegsOut":145195,"SegsIn":10123,"NotsentBytes":3175200,"MinRTT":22000,"DataSegsIn":23,"DataSegsOut":145192,"DeliveryRate":21494252,"BusyTime":5881000,"RWndLimited":1110000,"SndBufLimited":326000,"Delivered":123636,"DeliveredCE":0,"BytesSent":208954245,"BytesRetrans":30112648,"DSackDups":34,"ReordSeen":53,"ElapsedTime":5856295}}
  [44%] elapsed:  6.206 s; test_id: 4; num_flows: 1; speed:    244 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":6177581,"MaxBandwidth":61821012,"MinRTT":22000},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":230000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1335,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":140,"LastAckRecv":4,"PMTU":1500,"RcvSsThresh":31104,"RTT":29836,"RTTVar":807,"SndSsThresh":932,"SndCwnd":1988,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":21680,"PacingRate":48040078,"MaxPacingRate":-1,"BytesAcked":188348897,"BytesReceived":1813,"SegsOut":153906,"SegsIn":10565,"NotsentBytes":1573920,"MinRTT":22000,"DataSegsIn":25,"DataSegsOut":153903,"DeliveryRate":29973944,"BusyTime":6202000,"RWndLimited":1222000,"SndBufLimited":326000,"Delivered":130923,"DeliveredCE":0,"BytesSent":221489865,"BytesRetrans":31218568,"DSackDups":34,"ReordSeen":53,"ElapsedTime":6177581}}
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":6391039,"MaxBandwidth":59312696,"MinRTT":22000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":229000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":2170,"Sacked":2095,"Lost":64,"Retrans":64,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":128,"LastAckRecv":0,"PMTU":1500,"RcvSsThresh":31104,"RTT":28833,"RTTVar":1375,"SndSsThresh":932,"SndCwnd":1909,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":22032,"PacingRate":61454543,"MaxPacingRate":-1,"BytesAcked":195442401,"BytesReceived":1860,"SegsOut":160021,"SegsIn":11010,"NotsentBytes":578560,"MinRTT":22000,"DataSegsIn":26,"DataSegsOut":160018,"DeliveryRate":39924351,"BusyTime":6416000,"RWndLimited":1258000,"SndBufLimited":350000,"Delivered":137946,"DeliveredCE":0,"BytesSent":230291529,"BytesRetrans":31725448,"DSackDups":34,"ReordSeen":53,"ElapsedTime":6391039}}
  [46%] elapsed:  6.482 s; test_id: 4; num_flows: 1; speed:    247 Mbit/s
  [48%] elapsed:  6.733 s; test_id: 4; num_flows: 1; speed:    249 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":6840228,"MaxBandwidth":58863801,"MinRTT":22000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":236000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":2164,"Sacked":919,"Lost":52,"Retrans":52,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":410,"LastAckRecv":1,"PMTU":1500,"RcvSsThresh":31104,"RTT":35953,"RTTVar":1368,"SndSsThresh":932,"SndCwnd":1924,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":23034,"PacingRate":60989439,"MaxPacingRate":-1,"BytesAcked":213017914,"BytesReceived":1907,"SegsOut":173237,"SegsIn":11819,"NotsentBytes":438720,"MinRTT":22000,"DataSegsIn":27,"DataSegsOut":173234,"DeliveryRate":40494188,"BusyTime":6865000,"RWndLimited":1373000,"SndBufLimited":370000,"Delivered":148998,"DeliveredCE":0,"BytesSent":249298562,"BytesRetrans":33168328,"DSackDups":42,"ReordSeen":55,"ElapsedTime":6840228}}
  [50%] elapsed:  7.012 s; test_id: 4; num_flows: 1; speed:    248 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":6911021,"MaxBandwidth":56475219,"MinRTT":22000},"TCPInfo":{"State":1,"CAState":0,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":241000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":164,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":0,"LastAckSent":0,"LastDataRecv":481,"LastAckRecv":3,"PMTU":1500,"RcvSsThresh":31104,"RTT":40611,"RTTVar":4037,"SndSsThresh":932,"SndCwnd":1846,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":23197,"PacingRate":58514602,"MaxPacingRate":-1,"BytesAcked":216130234,"BytesReceived":1907,"SegsOut":173564,"SegsIn":11898,"NotsentBytes":3679807,"MinRTT":22000,"DataSegsIn":27,"DataSegsOut":173561,"DeliveryRate":6145749,"BusyTime":6936000,"RWndLimited":1441000,"SndBufLimited":370000,"Delivered":150243,"DeliveredCE":0,"BytesSent":249768962,"BytesRetrans":33403048,"DSackDups":42,"ReordSeen":55,"ElapsedTime":6911021}}
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":7000010,"MaxBandwidth":55311698,"MinRTT":22000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":227000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1882,"Sacked":1235,"Lost":348,"Retrans":348,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":48,"LastAckRecv":1,"PMTU":1500,"RcvSsThresh":31104,"RTT":26685,"RTTVar":782,"SndSsThresh":932,"SndCwnd":1158,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":23548,"PacingRate":57309065,"MaxPacingRate":-1,"BytesAcked":217477594,"BytesReceived":1954,"SegsOut":176569,"SegsIn":12012,"NotsentBytes":982080,"MinRTT":22000,"DataSegsIn":28,"DataSegsOut":176566,"DeliveryRate":41292023,"BusyTime":7025000,"RWndLimited":1455000,"SndBufLimited":370000,"Delivered":152414,"DeliveredCE":0,"BytesSent":254096162,"BytesRetrans":33908488,"DSackDups":42,"ReordSeen":55,"ElapsedTime":7000010}}
  [52%] elapsed:  7.296 s; test_id: 4; num_flows: 1; speed:    249 Mbit/s
  [54%] elapsed:  7.548 s; test_id: 4; num_flows: 1; speed:    250 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":7625118,"MaxBandwidth":61901264,"MinRTT":22000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":227000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1163,"Sacked":0,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":525,"LastAckRecv":2,"PMTU":1500,"RcvSsThresh":31104,"RTT":26546,"RTTVar":652,"SndSsThresh":932,"SndCwnd":1990,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":24641,"PacingRate":64136587,"MaxPacingRate":-1,"BytesAcked":239928877,"BytesReceived":2048,"SegsOut":192547,"SegsIn":13087,"NotsentBytes":1039680,"MinRTT":22000,"DataSegsIn":30,"DataSegsOut":192544,"DeliveryRate":26523110,"BusyTime":7650000,"RWndLimited":1636000,"SndBufLimited":427000,"Delivered":166783,"DeliveredCE":0,"BytesSent":277084565,"BytesRetrans":35482408,"DSackDups":42,"ReordSeen":56,"ElapsedTime":7625118}}
  [56%] elapsed:  7.801 s; test_id: 4; num_flows: 1; speed:    251 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":7866388,"MaxBandwidth":57507247,"MinRTT":22000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":227000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1415,"Sacked":1393,"Lost":22,"Retrans":22,"Fackets":0,"LastDataSent":20,"LastAckSent":0,"LastDataRecv":128,"LastAckRecv":3,"PMTU":1500,"RcvSsThresh":31104,"RTT":26767,"RTTVar":1362,"SndSsThresh":932,"SndCwnd":1673,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":25342,"PacingRate":59583898,"MaxPacingRate":-1,"BytesAcked":246169837,"BytesReceived":2095,"SegsOut":197836,"SegsIn":13469,"NotsentBytes":1360800,"MinRTT":22000,"DataSegsIn":31,"DataSegsOut":197833,"DeliveryRate":12578472,"BusyTime":7891000,"RWndLimited":1743000,"SndBufLimited":445000,"Delivered":172512,"DeliveredCE":0,"BytesSent":284697141,"BytesRetrans":36491848,"DSackDups":42,"ReordSeen":56,"ElapsedTime":7866388}}
  [58%] elapsed:  8.051 s; test_id: 4; num_flows: 1; speed:    252 Mbit/s
  [59%] elapsed:  8.309 s; test_id: 4; num_flows: 1; speed:    249 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":8233197,"MaxBandwidth":61213417,"MinRTT":22000},"TCPInfo":{"State":1,"CAState":1,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":231000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1271,"Sacked":124,"Lost":0,"Retrans":0,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":307,"LastAckRecv":1,"PMTU":1500,"RcvSsThresh":31104,"RTT":30240,"RTTVar":854,"SndSsThresh":932,"SndCwnd":2002,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":25871,"PacingRate":63423901,"MaxPacingRate":-1,"BytesAcked":258933624,"BytesReceived":2142,"SegsOut":207091,"SegsIn":14015,"NotsentBytes":2159312,"MinRTT":22000,"DataSegsIn":32,"DataSegsOut":207088,"DeliveryRate":34304738,"BusyTime":8258000,"RWndLimited":1837000,"SndBufLimited":445000,"Delivered":180113,"DeliveredCE":0,"BytesSent":298017472,"BytesRetrans":37253608,"DSackDups":42,"ReordSeen":61,"ElapsedTime":8233197}}
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":8283744,"MaxBandwidth":61213417,"MinRTT":22000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":229000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":2149,"Sacked":1487,"Lost":394,"Retrans":394,"Fackets":0,"LastDataSent":5,"LastAckSent":0,"LastDataRecv":357,"LastAckRecv":5,"PMTU":1500,"RcvSsThresh":31104,"RTT":28730,"RTTVar":1486,"SndSsThresh":932,"SndCwnd":1262,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":26369,"PacingRate":63423901,"MaxPacingRate":-1,"BytesAcked":258933624,"BytesReceived":2142,"SegsOut":208467,"SegsIn":14106,"NotsentBytes":1007872,"MinRTT":22000,"DataSegsIn":32,"DataSegsOut":208464,"DeliveryRate":41024498,"BusyTime":8308000,"RWndLimited":1851000,"SndBufLimited":445000,"Delivered":181476,"DeliveredCE":0,"BytesSent":299997600,"BytesRetrans":37970728,"DSackDups":42,"ReordSeen":61,"ElapsedTime":8283744}}
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":8461485,"MaxBandwidth":52136735,"MinRTT":22000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":225000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":1184,"Sacked":847,"Lost":38,"Retrans":38,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":17,"LastAckRecv":2,"PMTU":1500,"RcvSsThresh":31104,"RTT":24435,"RTTVar":578,"SndSsThresh":932,"SndCwnd":1704,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":26984,"PacingRate":54019451,"MaxPacingRate":-1,"BytesAcked":264752664,"BytesReceived":2189,"SegsOut":212159,"SegsIn":14424,"NotsentBytes":2410560,"MinRTT":22000,"DataSegsIn":33,"DataSegsOut":212156,"DeliveryRate":19540391,"BusyTime":8486000,"RWndLimited":1938000,"SndBufLimited":445000,"Delivered":184878,"DeliveredCE":0,"BytesSent":305312288,"BytesRetrans":38856104,"DSackDups":42,"ReordSeen":61,"ElapsedTime":8461485}}
  [61%] elapsed:  8.562 s; test_id: 4; num_flows: 1; speed:    251 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":8724008,"MaxBandwidth":51793756,"MinRTT":22000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":233000,"ATO":47000,"SndMSS":1440,"RcvMSS":536,"Unacked":2026,"Sacked":983,"Lost":4,"Retrans":4,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":154,"LastAckRecv":2,"PMTU":1500,"RcvSsThresh":31104,"RTT":32729,"RTTVar":1812,"SndSsThresh":932,"SndCwnd":1275,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":27163,"PacingRate":40248064,"MaxPacingRate":-1,"BytesAcked":274152984,"BytesReceived":2283,"SegsOut":219712,"SegsIn":14812,"NotsentBytes":220320,"MinRTT":22000,"DataSegsIn":35,"DataSegsOut":219709,"DeliveryRate":48710109,"BusyTime":8749000,"RWndLimited":1995000,"SndBufLimited":445000,"Delivered":191546,"DeliveredCE":0,"BytesSent":316184288,"BytesRetrans":39113864,"DSackDups":42,"ReordSeen":61,"ElapsedTime":8724008}}
  [63%] elapsed:  8.812 s; test_id: 4; num_flows: 1; speed:    254 Mbit/s
  [65%] elapsed:  9.076 s; test_id: 4; num_flows: 1; speed:    255 Mbit/s
  [67%] elapsed:  9.327 s; test_id: 4; num_flows: 1; speed:    258 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":9349154,"MaxBandwidth":63836574,"MinRTT":22000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":226000,"ATO":47000,"SndMSS":1440,"RcvMSS":536,"Unacked":1303,"Sacked":873,"Lost":76,"Retrans":76,"Fackets":0,"LastDataSent":1,"LastAckSent":0,"LastDataRecv":554,"LastAckRecv":5,"PMTU":1500,"RcvSsThresh":31104,"RTT":25652,"RTTVar":2124,"SndSsThresh":932,"SndCwnd":1846,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":27818,"PacingRate":66141784,"MaxPacingRate":-1,"BytesAcked":301521720,"BytesReceived":2330,"SegsOut":238660,"SegsIn":15928,"NotsentBytes":1686240,"MinRTT":22000,"DataSegsIn":36,"DataSegsOut":238657,"DeliveryRate":28538625,"BusyTime":9374000,"RWndLimited":2170000,"SndBufLimited":445000,"Delivered":210452,"DeliveredCE":0,"BytesSent":343452224,"BytesRetrans":40057064,"DSackDups":42,"ReordSeen":61,"ElapsedTime":9349154}}
  [68%] elapsed:  9.578 s; test_id: 4; num_flows: 1; speed:    259 Mbit/s
  [70%] elapsed:  9.834 s; test_id: 4; num_flows: 1; speed:    259 Mbit/s
  [72%] elapsed: 10.084 s; test_id: 4; num_flows: 1; speed:    258 Mbit/s
  - [ndt7] download: {"BBRInfo":{"ElapsedTime":9974288,"MaxBandwidth":58895559,"MinRTT":22000},"TCPInfo":{"State":1,"CAState":3,"Retransmits":0,"Probes":0,"Backoff":0,"Options":7,"WScale":119,"AppLimited":0,"RTO":232000,"ATO":40000,"SndMSS":1440,"RcvMSS":536,"Unacked":2033,"Sacked":1652,"Lost":158,"Retrans":158,"Fackets":0,"LastDataSent":7,"LastAckSent":0,"LastDataRecv":516,"LastAckRecv":4,"PMTU":1500,"RcvSsThresh":31104,"RTT":31181,"RTTVar":1036,"SndSsThresh":932,"SndCwnd":1671,"AdvMSS":1448,"Reordering":300,"RcvRTT":0,"RcvSpace":28960,"TotalRetrans":29574,"PacingRate":61022343,"MaxPacingRate":-1,"BytesAcked":322567373,"BytesReceived":2377,"SegsOut":255772,"SegsIn":17012,"NotsentBytes":1139128,"MinRTT":22000,"DataSegsIn":37,"DataSegsOut":255769,"DeliveryRate":33434494,"BusyTime":9999000,"RWndLimited":2331000,"SndBufLimited":526000,"Delivered":225859,"DeliveredCE":0,"BytesSent":368080053,"BytesRetrans":42585704,"DSackDups":44,"ReordSeen":61,"ElapsedTime":9974288}}
ndt7: test complete

Sep 30 '19 12:09 robertodauria

The pattern is clearly indicating there is an unreasonable MinRTT when it goes bad. There is something in the middle that is confusing BBR to believe that the MinRTT is much lower than expected.

Sep 30 '19 13:09 bassosimone

What's more, the first BBR sample of MinRTT looks reasonable. After a while, instead, we see that the MinRTT is dropping to a value that is clearly unreasonable. (Where reasonable and unreasonable are defined as the typical ping seen by @robertodauria towards destinations.)

Sep 30 '19 15:09 bassosimone

ndt-server ndt-server copied to clipboard

ndt7: some tests give significantly lower results

ndt-server
ndt-server copied to clipboard