Hi InThis - I do think at the end of the day that if you choose to sleep or 'sleep' with your H, then you will have very good reasons for doing so.
None of us would take our spouses back lightly after this treatment. And it no doubt stems from your D not wanting you to get hurt again, and she is no doubt trying to protect both herself and you from that potential.
You must do what is right for you.