Robots are limited to the first 10 pages for server stability.