Optimal Sharding Strategy for Larger Websites

[georgeaf99]

Larger websites should be sharded into multiple torrents such that the files grouped in an individual torrent have high locality relative to each other. This makes it likely that a user visiting a specific portion of the website will need files from a torrent that has already been downloaded.

If we view the website as a graph, with files corresponding to nodes and links to edges, this optimization corresponds to finding the minimally connected subgraphs larger than some size.