Code and data for arewedecentralizedyet.online and related projects
Update README
+14
-4
+14
-4
README.md
+14
-4
README.md
···
1
1
# Distributed Social Networks
2
2
3
-
Simple code and data to measure how distributed various social networks are in practice.
3
+
Simple code and data to measure how distributed various networks are in practice.
4
4
5
5
This is used to feed https://arewedecentralizedyet.online/ .
6
6
7
-
* `hhi.py <file.csv>`: Computes [Herfindahl–Hirschman index](https://en.wikipedia.org/wiki/Herfindahl%E2%80%93Hirschman_index) - values closer to 0 indicate competitive ecosystems, closer to 1 indicate monopolies
7
+
* `hhi.py <file.csv>`: Computes [Herfindahl–Hirschman index](https://en.wikipedia.org/wiki/Herfindahl%E2%80%93Hirschman_index) and other statistics
8
8
* `fetch-bsky.py`: Scrapes PDS list and user counts from the main bluesky relay
9
9
* `fetch-fedilist.py`: Scrapes host data from the HTML version of fedlist
10
-
* `fedilist.csv`: Contains user data for the fediverse (ActivityPub), from https://fedilist.com/instance
11
-
* `atproto-bsky-relay.csv`: Contains user data for the atmosphere (AT Protocol), scraped by `fetch-bsky.py` from the main bluesky relay
10
+
* `fetch-sh.py`: Scrapes git hosting data from the HTML version of Software Heritage's coverage page
11
+
* `fedilist-fromhtml.csv`: Contains user data for the fediverse (ActivityPub), from https://fedilist.com/instance
12
+
* `atproto-bsky-relay.csv`: Contains user data for the atmosphere (AT Protocol)
13
+
* `sh-fromhtml.csv`: Contains repository data scraped from Software Heritage
14
+
* `worldwide.csv`: Contains hosting data pulled from Internet Yellow Pages for the top 100M websites worldwide
15
+
* `dns-byid.csv`: Data from the Habib et al. 2025 paper, processed by AS ID
16
+
* `cert-byid.csv`: Data from the Habib et al. 2025 paper, processed by AS ID
12
17
* `www/`: Simple dashboard to display indices
13
18
* `BIndex.md`: A proposal for a way of measuring blockability on distributed social networks
19
+
20
+
TODO:
21
+
* Add email hosting, get data from https://dl.acm.org/doi/10.1145/3487552.3487820
22
+
* Add matrix, see https://codeberg.org/ricci/are-we-decentralized-yet/issues/2
23
+