To stop unwanted material during the lookup indexes, site owners can instruct spiders not to crawl selected documents or directories throughout the conventional robots.txt file in the basis Listing of your domain. Also, a webpage could be explicitly excluded from a search engine's databases by utilizing a meta tag precise https://news.rafeeg.ae