Microsoft confirms Reddit blocked Bing Search – Search Engine Land
Reddit has updated its robots.txt file, preventing Bing and many other search engines from crawling the site. “Bing stopped crawling Reddit after they implemented their updated robots.txt file on July 1, which prohibits all crawling of their site,” a Microsoft representative told Search Engine Land.
What happened. On July 1, 2024, Reddit updated its robots.txt file preventing many search engines and AI tools from crawling the site. Reddit did not prevent Google from crawling the site, despite what some people may have thought earlier this month. But Reddit did prevent most other crawlers from crawling the site.
Earlier this morning, Mark Williams-Cook notified me that Reddit results were dropping out of the Bing Search index. Then several media outlets began covering the news. I wanted to confirm that Bing’s crawlers were indeed blocked, because Reddit was using IP detection to show search engines one version of its robots.txt file and humans another version of the robots.txt file –…
The post Microsoft confirms Reddit blocked Bing Search – Search Engine Land first appeared on One SEO Company News.
source: https://news.oneseocompany.com/2024/07/24/microsoft-confirms-reddit-blocked-bing-search-search-engine-land_2024072457496.html
Your content is great. However, if any of the content contained herein violates any rights of yours, including those of copyright, please contact us immediately by e-mail at media[@]kissrpr.com.