こわごわ also means fearfully or nervously, but often implies cautiousness due to fear, whereas おずおず highlights diffidence and hesitation.
Etymology
Reduplication of the root おず, which is related to fear (cf. 怖じる). The exact historical derivation is uncertain, but the form is a mimetic adverb expressing timidity.