# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file Sitemap: http://www.rapleaf.com/sitemap.xml User-agent: * Disallow: /dir/ Disallow: /pub/ Disallow: /profile/ Disallow: /np/ Disallow: /nr/ Disallow: /ratings/ Disallow: /offers/ Disallow: /p?h=*