Refers to the tree itself, not the blossoms. Common in everyday contexts.
There is a big cherry tree in the park.
Let's have a cherry blossom viewing party under the cherry tree.
Compound of 桜 (さくら, 'cherry') + の (possessive particle) + 木 (き, 'tree').