Meta Takes Step To Replace Google Index In AI Search – Search Engine Journal
Meta is reportedly developing a search engine index for its AI chatbot to reduce reliance on Google for AI-generated summaries of current events. Meta AI appears to be evolving to the next stage of becoming a fully independent AI search engine.
Meta-ExternalAgent
Meta has been crawling the Internet since at least this past summer from a user agent called, Meta-ExternalAgent. There have been multiple reports in various forums about excessive amounts of crawling with one person on Hacker News reporting having received 50,000 hits by the bot. A post in the WebmasterWorld bot crawling forum notes that although the documentation for Meta-ExternalAgent says it respects robots.txt it wouldn’t have made a difference because the bot never visited the file.
It may be that the bot wasn’t fully ready earlier this year and that it’s poor behavior has settled down.
The purpose of the bot is to summarize search results and according to the results it’s to reduce reliance on Google and Bing for…
The post Meta Takes Step To Replace Google Index In AI Search – Search Engine Journal first appeared on One SEO Company News.
source: https://news.oneseocompany.com/2024/10/30/meta-takes-step-to-replace-google-index-in-ai-search-search-engine-journal_2024103058786.html
Your content is great. However, if any of the content contained herein violates any rights of yours, including those of copyright, please contact us immediately by e-mail at media[@]kissrpr.com.