Used to introduce a simplified summary or rephrasing of a previous statement. Common in both spoken and written Japanese.
Simply put, this plan was a failure.
His explanation was long, but in short, it means 'no'.
A set phrase composed of 簡単に (simply) + 言えば (conditional form of 言う, 'to say'), literally 'if one says it simply'.