A very deep and insightful post, SD, and something I think about a lot. Yes, there is a reason why we attract that type of partner. In my case, my father shares a lot of the same characteristics as my H, and some I swore I would avoid at all costs.
There are things about us that they need. Like you, if I thought I was getting a confident and intelligent man, he thought he was getting a happy, intelligent woman. I was full of fun and outgoing, like his sister (who married someone even more controlling and introverted than her brother). I want really as happy and confident as he thought, and although my H really was my rock for many years, until he crumbled. I needed that rock. Like my father, he's a very introverted rock, mistrustful of people, but with solid values.
The point is, once we've seen ourselves in the mirror, it's up to us to change ourselves, grow, become more adult, calmer, more understanding, yet more detached, with clearer boundaries.
That's long, hard work.