skip to main content
research-article
Public Access

A Manifold View of Connectivity in the Private Backbone Networks of Hyperscalers

Published: 25 July 2023 Publication History

Abstract

As hyperscalers such as Google, Microsoft, and Amazon play an increasingly important role in today's Internet, they are also capable of manipulating probe packets that traverse their privately owned and operated backbones. As a result, standard traceroute-based measurement techniques are no longer a reliable means for assessing network connectivity in these global-scale cloud provider infrastructures. In response to these developments, we present a new empirical approach for elucidating connectivity in these private backbone networks. Our approach relies on using only "lightweight" (i.e., simple, easily interpretable, and readily available) measurements, but requires applying "heavyweight" mathematical techniques for analyzing these measurements. In particular, we describe a new method that uses network latency measurements and relies on concepts from Riemannian geometry (i.e., Ricci curvature) to assess the characteristics of the connectivity fabric of a given network infrastructure. We complement this method with a visualization tool that generates a novel manifold view of a network's delay space. We demonstrate our approach by utilizing latency measurements from available vantage points and virtual machines running in datacenters of three large cloud providers to study different aspects of connectivity in their private backbones and show how our generated manifold views enable us to expose and visualize critical aspects of this connectivity.

References

[1]
Reliance Communication plans undersea cable to meet data demands of Asia, Europe, 2018. https://tinyurl.com/ybjv7mdp.
[2]
Arnold, T., He, J., Jiang, W., Calder, M., Cunha, I., Giotsas V., et al. Cloud provider connectivity in the flat internet. In Proc. ACM IMC'20 (2020), 230--246.
[3]
Augustin, B., Cuvellier, X., Orgogozo, B., Viger, F., Friedman, T., Latapy, M., et al. Avoiding traceroute anomalies with paris traceroute. In Proceedings of the 6th ACM SIGCOMM Conference on Internet Measurement, IMC'06 (New York, NY, USA, 2006), ACM, NY, 153--158.
[4]
AWS. AWS Global Cloud Infrstructure, 2020. https://www.infrastructure.aws.
[5]
Beverly, R. Yarrp'ing the internet: Randomized high-speed active topology discovery. In Proceedings of Internet Measurement Conference (Santa Monica, USA, 2016), 413--420.
[6]
Bhattacherjee, D., Jyothi, S.A., Bozkurt, I.N., Tirmazi, M., Aqeel, W., Aguirre, A., et al. cISP: A speed-of-light internet service provider. arXiv, (1809.10897), 2018.
[7]
Detal, G., Hesmans, B., Bonaventure, O., Vanaubel, Y., Donnet, B. Revealing middlebox interference with tracebox. In Proc. ACM IMC'13 (Barcelona, Spain, 2013), 1--8.
[8]
Gill, P., Ganjali, Y., Wong, B., Lie, D. Dude, where's that IP?: Circumventing measurement-based IP geolocation. In Proceedings of the USENIX Security Symposium (USENIX Security 10) (Washington, DC, USA, 2010).
[9]
Hong, C.-Y., Kandula, S., Mahajan, R., Zhang, M., Gill, V., Nanduri, M., et al. Achieving high utilization with software-driven WAN. In Proceedings of the ACM SIGCOMM Conference on SIGCOMM (Hong Kong, China, 2013), 15--26.
[10]
Jacobson, V. Traceroute, 1989. ftp://ftp.ee.lbl.gov/traceroute.tar.gz.
[11]
Jain, S., Kumar, A., Mandal, S., Ong, J., Poutievski, L., Singh, A., et al. B4: Experience with a globally-deployed software defined WAN. ACM SIGCOMM Comput. Commun. Rev. 43, 4 (2013), 3--14.
[12]
Jimenez, M., Kwok, H. Building express backbone: Facebook's new long-haul network, 2017. https://engineering.fb.com/data-center-engineering/building-express-backbone-facebook-s-new-long-haul-network/.
[13]
Kaufmann, C. ICN---Akamai's Backbone, 2018. https://www.linx.net/wp-content/uploads/LINX101-Akamai-ICN-ChristianKaufmann.pdf.
[14]
Li, L., Alderson, D., Willinger, W., Doyle, J. A first-principles approach to understanding the internet's router-level topology. ACM SIGCOMM Comput. Commun. Rev. 34, 4 (2004), 3--14.
[15]
Microsoft. Azure Microsoft Global Network Map, 2020. https://docs.microsoft.com/en-us/azure/networking/microsoft-global-network.
[16]
Microsoft. Azure Virtual Network frequently asked questions (FAQ), 2021. https://learn.microsoft.com/en-us/azure/virtual-network/virtual-networks-faq.
[17]
Motamedi, R., Rejaie, R., Willinger, W. A survey of techniques for internet topology discovery. IEEE Commun. Surv. Tutorials 17, 2 (2014), 1044--1065.
[18]
Ni, C., Lin, Y., Luo, F., Gao, J. Community detection on networks with ricci flow. Sci. Rep. 9, 1 (2019), 1--12.
[19]
Ollivier, Y. Ricci curvature of Markov chains on metric spaces. J. Funct. Anal. 256, 3 (2009), 810--864.
[20]
Ollivier, Y. A visual introduction to riemannian curvatures and some discrete generalizations. In Analysis and Geometry of Metric Measure Spaces: Lecture Notes of the 50th Seminaire de Mathematiques Superieures (SMS) (Montréal, 2011), 56.
[21]
Putzier, K. Property investors see fiber-optic cables as 'Railroads of the Future', 2020.
[22]
RIPE. RIPE Atlas, 2020. https://atlas.ripe.net.
[23]
Spring, N., Mahajan, R., Wetherall, D. Measuring ISP topologies with rocketfuel. ACM SIGCOMM Comput. Commun. Rev. 32, 4 (2002), 133--145.
[24]
Vahdat, A., Clark, D., Rexford, J. A purpose-built global network: Google's move to SDN: A discussion with Amin Vahdat, David Clark, and Jennifer Rexford. ACM Queue 13, 8 (2015), 100--125.
[25]
Willinger, W., Alderson, D., Doyle, J. C. Mathematics and the internet: A source of enormous confusion and great potential. Not. Am. Math. Soc. 56, 5 (2009), 586--599.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Communications of the ACM
Communications of the ACM  Volume 66, Issue 8
August 2023
106 pages
ISSN:0001-0782
EISSN:1557-7317
DOI:10.1145/3610954
  • Editor:
  • James Larus
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 July 2023
Published in CACM Volume 66, Issue 8

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Research-article

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 722
    Total Downloads
  • Downloads (Last 12 months)532
  • Downloads (Last 6 weeks)55
Reflects downloads up to 10 Nov 2024

Other Metrics

Citations

Cited By

View all

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Digital Edition

View this article in digital edition.

Digital Edition

Magazine Site

View this article on the magazine site (external)

Magazine Site

Get Access

Login options

Full Access

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media