This is a description of the Szukacz bot which identifies as Szukacz/1.5.
Szukacz is a search engine at http://www.szukacz.pl.
Szukacz specializes in searching for documents written in Polish. However, it also runs searches against "The Best of the World" collection (we call it simply "World", that is "Swiat" in Polish).
As far as we have tested, our crawler follows all the robots.txt and the robot metatag rules.
Our crawler archives and indexes both static and dynamic pages.
You can inform our crawler not to enter your website or specific directories on your website by creating an appropriate robots.txt file in the root directory of your website. The simplest robots.txt file may go as follows (it forbids Szukacz to enter your site):
User-agent: szukacz
Disallow: /
More detailed descritpion of the robots.txt protocol can be found elsewhere, for example at: http://www.robotstxt.org/wc/norobots.html
You can also include the robot metatag in specific pages of your website:
<meta name="robots" content="noindex, nofollow, noarchive">
Finally, you may contact us by email: info@szukacz.pl. If you supply the name of your website, we would enter it on the list of websites not to be crawled and indexed.
If our crawler caused any problem to your site, we deeply apologize for it. It has never been our intention to cause problems to websites we crawl.