When he was young, he traveled all over Japan as a wanderer.
あの渡り者は、いつも次の町へと去っていく。
That drifter always moves on to the next town.
Compound of 渡り (wandering) and 者 (person). The exact historical derivation is uncertain, but the word has been used since at least the Edo period to describe itinerant workers or wanderers.