Computing term for a program that systematically browses the web to index content.
A web crawler visits websites and collects information.
Compound of ロボット (robot) + 検索 (search) + エンジン (engine), a calque from English 'robot search engine' or 'web crawler'.