NetworkLoad Tests v1.3 Test with 10 MPI ranks (10 nodes) 2 nodes running Network Tests 8 nodes running Congestion Tests (min 100 nodes per congestor) Legend RR = random ring communication pattern Lat = latency BW = bandwidth BW+Sync = bandwidth with barrier +------------------------------------------------------------------------------------------------------------------------------------------+ | Isolated Network Tests | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ | Name | Min | Max | Avg | Avg(Worst) | 99% | 99.9% | Units | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ | RR Two-sided Lat (8 B) | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | usec | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ | RR Two-sided BW+Sync (131072 B) | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | MiB/s/rank | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ | Multiple Allreduce (8 B) | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | usec | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ +------------------------------------------------------------------------------------------------------------------------------------------+ | Isolated Congestion Tests | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ | Name | Min | Max | Avg | Avg(Worst) | 99% | 99.9% | Units | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ | Alltoall (4096 B) | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | MiB/s/rank | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ | Two-sided Incast (4096 B) | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | MiB/s/rank | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ | Put Incast (4096 B) | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | MiB/s/rank | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ | Get Bcast (4096 B) | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | MiB/s/rank | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ +------------------------------------------------------------------------------------------------------------------------------------------+ | Network Tests running with Congestion Tests ( RR Two-sided Lat Network Test) | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ | Name | Min | Max | Avg | Avg(Worst) | 99% | 99.9% | Units | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ | RR Two-sided Lat (8 B) | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | usec | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ | Alltoall (4096 B) | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | MiB/s/rank | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ | Two-sided Incast (4096 B) | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | MiB/s/rank | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ | Put Incast (4096 B) | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | MiB/s/rank | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ | Get Bcast (4096 B) | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | MiB/s/rank | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ +------------------------------------------------------------------------------------------------------------------------------------------+ | Network Tests running with Congestion Tests (RR Two-sided BW+Sync Network Test) | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ | Name | Min | Max | Avg | Avg(Worst) | 99% | 99.9% | Units | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ | RR Two-sided BW+Sync (131072 B) | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | MiB/s/rank | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ | Alltoall (4096 B) | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | MiB/s/rank | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ | Two-sided Incast (4096 B) | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | MiB/s/rank | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ | Put Incast (4096 B) | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | MiB/s/rank | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ | Get Bcast (4096 B) | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | MiB/s/rank | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ +------------------------------------------------------------------------------------------------------------------------------------------+ | Network Tests running with Congestion Tests ( Multiple Allreduce Network Test) | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ | Name | Min | Max | Avg | Avg(Worst) | 99% | 99.9% | Units | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ | Multiple Allreduce (8 B) | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | usec | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ | Alltoall (4096 B) | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | MiB/s/rank | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ | Two-sided Incast (4096 B) | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | MiB/s/rank | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ | Put Incast (4096 B) | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | MiB/s/rank | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ | Get Bcast (4096 B) | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | 10000.0 | MiB/s/rank | +---------------------------------+--------------+--------------+--------------+--------------+--------------+--------------+--------------+ +------------------------------------------------------------------------------+ | Network Tests running with Congestion Tests - Key Results | +---------------------------------+--------------------------------------------+ | Name | Congestion Impact Factor | +---------------------------------+----------------------+---------------------+ | | Avg | 99% | +---------------------------------+----------------------+---------------------+ | RR Two-sided Lat (8 B) | 0.0X | 0.0X | +---------------------------------+----------------------+---------------------+ | RR Two-sided BW+Sync (131072 B) | 0.0X | 0.0X | +---------------------------------+----------------------+---------------------+ | Multiple Allreduce (8 B) | 0.0X | 0.0X | +---------------------------------+----------------------+---------------------+