As being a search engine crawler may continue to keep a cached copy of the file, it could every now and then crawl pages a webmaster does not want crawled. Pages usually prevented from currently being crawled consist of login specific pages which include shopping carts and person-specific content http://remingtonyzaad.ka-blogs.com/22161674/seo-organic-keywords-fundamentals-explained