New top story on Hacker News: Robots.txt for the NYT has a specific exclusion for an 1996 news article

Bitefire March 28, 2021

Robots.txt for the NYT has a specific exclusion for an 1996 news article
23 by mikeortman | 2 comments on Hacker News.

Post a Comment

0 Comments