# msnbot is obnoxious, connecting many times a day. No. User-agent: msnbot Disallow: / #This one is doing ridiculous amounts of probing of non-existent php stuff, # despite getting 404 errors on every single attempt, and repeating the effort # day after day. Forget about it. User-agent: Twiceler Disallow: / #and this one is pretty obnoxious, too: User-agent: Steeler Disallow: / User-agent: * Disallow: /nmsarsu-bin/ Disallow: /images/ Disallow: /documents/ Disallow: /membersonly/