Ninety hosts this corpus cites now refuse to let it re-read them. The Internet Archive kept their robots.txt, so each door can be dated: not to a day, to a band between two visits. Median band 4.1 days. A tenth under 2.4 hours.
When the Wall Went Up
Dating the closing of 90 hosts' robots.txt from the Internet Archive, with the band each date comes in.
artwaste.land