Refers to heavy material placed in the bottom of a ship to improve stability. Also used figuratively for something that provides stability or weight.
The ship was stabilized by loading ballast.
His experience served as ballast for the team.
Compound of 底 (そこ, bottom) and 荷 (に, cargo/load), literally 'bottom load'.