I completely agree and my year of smoking after BD illustrates it.
I used it for comfort and 'me time'. I only crave them when hurt or angry recently.
It's exactly the same with comfort food. After the initial huge weight loss, I now eat nonsense in the evenings when bored or lonely. When I am busy or looking forward to something, I eat healthily.
Food, cigarettes, alcohol and even coffee act like surrogate friends to me!