She shouldn't be annoyed. She is the one that's missing out. You told her you would call, and you did. A couple of times. So if you don't call back. She will think, well, maybe I better call him now otherwise he won't like me.
On the other hand, something could have happend. You never know...