Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
ornornor
on June 8, 2021
|
parent
|
context
|
favorite
| on:
Fastly Outage
Try “site:old.Reddit.com”
oefrha
on June 8, 2021
[–]
That's not going to work.
$ curl https://old.reddit.com/robots.txt User-Agent: * Disallow: /
Also, even if search engines are allowed, old.reddit.com pages are not canonical (<link rel="canonical"> points to the www.reddit.com version, which is actually reasonable behavior), so pages there would not be crawled as often or at all.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: