He is known as the town ruffian.
あの無頼漢には近づかないほうがいい。
You'd better stay away from that scoundrel.
Compound of 無頼 (lawless, unruly) and 漢 (man). The exact historical derivation is uncertain, but the term has been used since at least the Edo period to describe a rough or villainous man.