Bandwidth-Aware Page Placement in NUMA

Abstract

Page placement is a critical problem for memory-intensive applications running on a shared-memory multiprocessor with a non-uniform memory access (NUMA) architecture. State-of-the-art page placement mechanisms interleave pages evenly across NUMA nodes. However, this approach fails to maximize memory throughput in modern NUMA systems, characterized by asymmetric bandwidths and latencies, and sensitive to memory contention and interconnect congestion phenomena. We propose BWAP, a novel page placement mechanism based on asymmetric weighted page interleaving. BWAP combines an analytical performance model of the target NUMA system with on-line iterative tuning of page distribution for a given memory-intensive application. Our experimental evaluation with representative memory-intensive workloads shows that BWAP performs up to 66% better than state-of-the-art techniques. These gains are particularly relevant when multiple co-located applications run in disjoint partitions of a large NUMA machine or when applications do not scale up to the total number of cores.

David Gureya, João Neto, Reza Karimi, João Barreto, Pramod Bhatotia, Vivien Quema, Rodrigo Rodrigues, Paolo Romano, and Vladimir Vlassov. 2020. Bandwidth-Aware Page Placement in NUMA. In 34th IEEE International Parallel and Distributed Processing Symposium (IPDPS).

D. Gureya et al., "Bandwidth-Aware Page Placement in NUMA," in 34th IEEE International Parallel and Distributed Processing Symposium (IPDPS), 2020.

Gureya, D., Neto, J., Karimi, R., Barreto, J., Bhatotia, P., Quema, V., Rodrigues, R., Romano, P., & Vlassov, V. (2020). Bandwidth-Aware Page Placement in NUMA. In 34th IEEE International Parallel and Distributed Processing Symposium (IPDPS).

@inproceedings{2020-IPDPS,
  author        = {Gureya, David and Neto, Jo{\~a}o and Karimi, Reza and Barreto, Jo{\~a}o and Bhatotia, Pramod and Quema, Vivien and Rodrigues, Rodrigo and Romano, Paolo and Vlassov, Vladimir},
  title         = {Bandwidth-Aware Page Placement in NUMA},
  booktitle     = {34th IEEE International Parallel and Distributed Processing Symposium (IPDPS)},
  year          = {2020},
  eprint        = {2003.03304},
  archivePrefix = {arXiv},
  primaryClass  = {cs.DC},
  url           = {https://www.researchgate.net/publication/339787024_Bandwidth-Aware_Page_Placement_in_NUMA},
}