noun
search robot; web crawler
Computing term for an automated program that browses the web to index content, often used in the context of search engines.
検索ロボットがウェブサイトを巡回して情報を集めます。
Search robots crawl websites to collect information.
クローラー is a more general term for a crawler, while 検索ロボット specifically emphasizes its role in search indexing.
Compound of 検索 (search) and ロボット (robot), a direct calque from English 'search robot'.