Refers to a physical barrier, such as a garden fence, chain-link fence, or safety fence. Used in the same broad way as English 'fence'.
We put up a wooden fence in the garden.
The home run ball went over the fence.
A fence has been set up around the construction site.
I walked along the fence in the park.
We put up a new fence in the yard.
The batted ball hit the fence and bounced back.
塀 is a solid wall (often concrete or stone) enclosing a property, whereas フェンス is usually a see-through structure of wire, chain-link, or bars.
Loanword from English 'fence', adopted into Japanese with the same meaning.