# Robots.txt file from http://blog.sarion.info # # All robots will spider the domain User-agent: * Disallow: /cgi-bin User-agent: Yandex Disallow: /2007/06/02/doski_objavlenijj_forumy_katalogi.html