very fast at protocol indexer with flexible filtering, xrpc queries, cursor-backed event stream, and more, built on fjall
rust
fjall
at-protocol
atproto
indexer
[docs] clarify 'see below' in crawler sources
+4
-3
+4
-3
README.md
+4
-3
README.md
···
89
89
each source maintains its own cursor so restarts resume mid-pass.
90
90
91
91
sources can also be added and removed at runtime via the `/crawler/sources` API
92
-
(see below). dynamically added sources are persisted to the database and survive
93
-
restarts. `CRAWLER_URLS` sources are startup-only: they are not written to the
94
-
database and will always reappear after a restart regardless of runtime changes.
92
+
(see [here](#crawler-management)). dynamically added sources are persisted to the
93
+
database and survive restarts. `CRAWLER_URLS` sources are startup-only: they are
94
+
not written to the database and will always reappear after a restart regardless of
95
+
runtime changes (unless you change the config of course).
95
96
96
97
## configuration
97
98