experimental novel
A novel that experiments with narrative techniques, style, or structure, often associated with literary modernism.
His latest work is an experimental novel and may not appeal to all readers.
Compound of 実験 (experiment) and 小説 (novel).