Last.fm's robots.txt include's Asimov's three laws of robotics as URIs

User-Agent: Bingbot User-Agent: Yandexbot User-Agent: *

Disallow: /music/+noredirect/ Disallow: /de/music/+noredirect/ Disallow: /es/music/+noredirect/ Disallow: /fr/music/+noredirect/ Disallow: /it/music/+noredirect/ Disallow: /ja/music/+noredirect/ Disallow: /pl/music/+noredirect/ Disallow: /pt/music/+noredirect/ Disallow: /ru/music/+noredirect/ Disallow: /sv/music/+noredirect/ Disallow: /tr/music/+noredirect/ Disallow: /zh/music/+noredirect/

# Disallow user profiles in entirety Disallow: /user/* Disallow: /de/user/* Disallow: /es/user/* Disallow: /fr/user/* Disallow: /it/user/* Disallow: /ja/user/* Disallow: /pl/user/* Disallow: /pt/user/* Disallow: /ru/user/* Disallow: /sv/user/* Disallow: /tr/user/* Disallow: /zh/user/*

Disallow: /search* Disallow: /de/search* Disallow: /es/search* Disallow: /fr/search* Disallow: /it/search* Disallow: /ja/search* Disallow: /pl/search* Disallow: /pt/search* Disallow: /ru/search* Disallow: /sv/search* Disallow: /tr/search* Disallow: /zh/search*

# Old pages Disallow: /forum* Disallow: /de/forum* Disallow: /es/forum* Disallow: /fr/forum* Disallow: /it/forum* Disallow: /ja/forum* Disallow: /pl/forum* Disallow: /pt/forum* Disallow: /ru/forum* Disallow: /sv/forum* Disallow: /tr/forum* Disallow: /zh/forum*

Disallow: /label* Disallow: /de/label* Disallow: /es/label* Disallow: /fr/label* Disallow: /it/label* Disallow: /ja/label* Disallow: /pl/label* Disallow: /pt/label* Disallow: /ru/label* Disallow: /sv/label* Disallow: /tr/label* Disallow: /zh/label*

Disallow: /group* Disallow: /de/group* Disallow: /es/group* Disallow: /fr/group* Disallow: /it/group* Disallow: /ja/group* Disallow: /pl/group* Disallow: /pt/group* Disallow: /ru/group* Disallow: /sv/group* Disallow: /tr/group* Disallow: /zh/group*

# Shouts Disallow: /event/*/shoutbox? Disallow: /de/event/*/shoutbox? Disallow: /es/event/*/shoutbox? Disallow: /fr/event/*/shoutbox? Disallow: /it/event/*/shoutbox? Disallow: /ja/event/*/shoutbox? Disallow: /pl/event/*/shoutbox? Disallow: /pt/event/*/shoutbox? Disallow: /ru/event/*/shoutbox? Disallow: /sv/event/*/shoutbox? Disallow: /tr/event/*/shoutbox? Disallow: /zh/event/*/shoutbox?

Disallow: /event/*/shoutbox* Disallow: /de/event/*/shoutbox* Disallow: /es/event/*/shoutbox* Disallow: /fr/event/*/shoutbox* Disallow: /it/event/*/shoutbox* Disallow: /ja/event/*/shoutbox* Disallow: /pl/event/*/shoutbox* Disallow: /pt/event/*/shoutbox* Disallow: /ru/event/*/shoutbox* Disallow: /sv/event/*/shoutbox* Disallow: /tr/event/*/shoutbox* Disallow: /zh/event/*/shoutbox*

Disallow: /festival/*/shoutbox* Disallow: /de/festival/*/shoutbox* Disallow: /es/festival/*/shoutbox* Disallow: /fr/festival/*/shoutbox* Disallow: /it/festival/*/shoutbox* Disallow: /ja/festival/*/shoutbox* Disallow: /pl/festival/*/shoutbox* Disallow: /pt/festival/*/shoutbox* Disallow: /ru/festival/*/shoutbox* Disallow: /sv/festival/*/shoutbox* Disallow: /tr/festival/*/shoutbox* Disallow: /zh/festival/*/shoutbox*

Disallow: /tag/* Disallow: /de/tag/* Disallow: /es/tag/* Disallow: /fr/tag/* Disallow: /it/tag/* Disallow: /ja/tag/* Disallow: /pl/tag/* Disallow: /pt/tag/* Disallow: /ru/tag/* Disallow: /sv/tag/* Disallow: /tr/tag/* Disallow: /zh/tag/*

Disallow: /music/*? Disallow: /de/music/*? Disallow: /es/music/*? Disallow: /fr/music/*? Disallow: /it/music/*? Disallow: /ja/music/*? Disallow: /pl/music/*? Disallow: /pt/music/*? Disallow: /ru/music/*? Disallow: /sv/music/*? Disallow: /tr/music/*? Disallow: /zh/music/*?

Disallow: /music/*/+tags* Disallow: /de/music/*/+tags* Disallow: /es/music/*/+tags* Disallow: /fr/music/*/+tags* Disallow: /it/music/*/+tags* Disallow: /ja/music/*/+tags* Disallow: /pl/music/*/+tags* Disallow: /pt/music/*/+tags* Disallow: /ru/music/*/+tags* Disallow: /sv/music/*/+tags* Disallow: /tr/music/*/+tags* Disallow: /zh/music/*/+tags*

Disallow: /music/*/+shoutbox? Disallow: /de/music/*/+shoutbox? Disallow: /es/music/*/+shoutbox? Disallow: /fr/music/*/+shoutbox? Disallow: /it/music/*/+shoutbox? Disallow: /ja/music/*/+shoutbox? Disallow: /pl/music/*/+shoutbox? Disallow: /pt/music/*/+shoutbox? Disallow: /ru/music/*/+shoutbox? Disallow: /sv/music/*/+shoutbox? Disallow: /tr/music/*/+shoutbox? Disallow: /zh/music/*/+shoutbox?

Disallow: /music/*/+shoutbox* Disallow: /de/music/*/+shoutbox* Disallow: /es/music/*/+shoutbox* Disallow: /fr/music/*/+shoutbox* Disallow: /it/music/*/+shoutbox* Disallow: /ja/music/*/+shoutbox* Disallow: /pl/music/*/+shoutbox* Disallow: /pt/music/*/+shoutbox* Disallow: /ru/music/*/+shoutbox* Disallow: /sv/music/*/+shoutbox* Disallow: /tr/music/*/+shoutbox* Disallow: /zh/music/*/+shoutbox*

# N.B: these are not covered by the above /music/ rule # (shoutbox vs +shoutbox) Disallow: /music/*/+images/*/shoutbox? Disallow: /de/music/*/+images/*/shoutbox? Disallow: /es/music/*/+images/*/shoutbox? Disallow: /fr/music/*/+images/*/shoutbox? Disallow: /it/music/*/+images/*/shoutbox? Disallow: /ja/music/*/+images/*/shoutbox? Disallow: /pl/music/*/+images/*/shoutbox? Disallow:...

Last.fm's robots.txt include's Asimov's three laws of robotics as URIs

Related Articles

The Newest Instagram "Exploit" Is the Goofiest I've Seen

It's Not Just X. It's Y

Amazon, Facebook, FBI have access to a private intelligence-sharing network

Show HN: GoPeek – open links in live mini browser windows without new tabs

Agent Memory: An Anatomy