El robots.txt de Last.fm es poesía geek pura:

Notar al final las tres leyes de Asimov, a mi parecer falta la ley cero: Disallow: /harming/humankind

User-Agent: \*
 Disallow: /music?
 Disallow: /widgets/radio?
 Disallow: /show_ads.php

Disallow: /affiliate/
 Disallow: /affiliate_redirect.php
 Disallow: /affiliate_sendto.php
 Disallow: /affiliatelink.php
 Disallow: /campaignlink.php
 Disallow: /delivery.php

Disallow: /music/+noredirect/

Disallow: /harming/humans
 Disallow: /ignoring/human/orders
 Disallow: /harm/to/self

Allow: /

Fuente: [alt1040]