Respect the robots.txt and don’t do it?