June. I love your attitude about not being that special!
Of course you aren't the worst person on earth. Just think about what he's telling you:
he can't enjoy the holidays because he knows you want him home. It's all about him, him, and him.
We do get through these holidays. I'm on my second Christmas (he moved out Thanksgiving day, at my request) and as each holiday passes, I get stronger. Today I miss some of the traditions, but since D22 lives 1000 miles away, most of our traditions would have been delayed, anyway, whether he was here or not. When you can learn to look forward and not focus overly much on the past, it really helps.