User-agent: *
Disallow:



This file allows or disallows search engines from reading a particular page. 

Currently, the top code enables all robots complete access to this site. 

There are instructions at www.robotstxt.org that provide the code for disallowing content to be read and drafted onto the google or yahoo or bing or other search engines for disallowing search engines to look at pages on your site.

Everything else not explicitly disallowed is considered fair game to retrieve.