recaptime.dev / phorge
@recaptime-dev's working patches + fork for Phorge, a community fork of Phabricator. (Upstream dev and stable branches are at upstream/main and upstream/stable respectively.) hq.recaptime.dev/wiki/Phorge
phorge phabricator
1
fork

Configure Feed

Select the types of activity you want to include in your feed.

Disallow /source/ in robots.txt

Summary: Ref T4245. We disallow `/diffusion/` in robots.txt already because indexers tend to get lost blaming every line of every file throughout history, but didn't update the list for the `/source/` alias. Update it.

Test Plan: Visited `/robots.txt` locally.

Reviewers: chad

Reviewed By: chad

Maniphest Tasks: T4245

Differential Revision: https://secure.phabricator.com/D17637

epriestley 9856802b 3d816e94

+1
+1
src/applications/system/controller/PhabricatorRobotsController.php
··· 20 20 21 21 $out[] = 'User-Agent: *'; 22 22 $out[] = 'Disallow: /diffusion/'; 23 + $out[] = 'Disallow: /source/'; 23 24 24 25 // Add a small crawl delay (number of seconds between requests) for spiders 25 26 // which respect it. The intent here is to prevent spiders from affecting