next door but one; two doors down
Refers to the house or building that is one removed from the immediate neighbor; literally 'the neighbor with one house in between'.
He lives two doors down.
The house next door but one caught fire.
隣 means the immediate next-door neighbor, while 一軒置いて隣 skips one house.
向かい means across the street or opposite, not along the same side.
Compound of 一軒 (one house), 置いて (having placed/left), and 隣 (neighbor), literally 'the neighbor with one house placed in between'.