User-agent: *

Disallow: /links
Disallow: /tweets
Disallow: /tweeters