To stay away from undesirable material during the look for indexes, webmasters can instruct spiders to not crawl specified documents or directories in the standard robots.txt file in the root directory on the area. Also, a web page could be explicitly excluded from a online search engine's databases by using https://news.rafeeg.ae