# robots.txt for http://www.p-labs-potsdam.de/ User-agent: wget User-agent: webzip User-agent: webmirror User-agent: webcopy User-agent: psbot # MS-Image User-agent: Googlebot-Image Disallow: / User-agent: twiceler User-agent: Googlebot Disallow: /feedback/ # obsolete, might become redirected Disallow: *.gif$ Disallow: *.jpg$ Disallow: *.txt$ Disallow: *.mpg$ User-agent: * # all robots are allowed to index all...exept of: Disallow: /feedback/ # obsolete, might become redirected Disallow: *.gif$ Disallow: *.jpg$ Disallow: *.txt$ Disallow: *.mpg$