El robots.txt de Last.fm es poesía geek pura:

Notar al final las tres leyes de Asimov, a mi parecer falta la ley cero: Disallow: /harming/humankind

User-Agent: \*
Disallow: /music?
Disallow: /widgets/radio?
Disallow: /show_ads.php

Disallow: /affiliate/
Disallow: /affiliate_redirect.php
Disallow: /affiliate_sendto.php
Disallow: /affiliatelink.php
Disallow: /campaignlink.php
Disallow: /delivery.php

Disallow: /music/+noredirect/

Disallow: /harming/humans
Disallow: /ignoring/human/orders
Disallow: /harm/to/self

Allow: /

Fuente: [alt1040]