# robots.txt file from http://www.captainsoft.com.au/ # All robots will spider the domain User-agent: * Disallow: /bin Disallow: /js