I only count calories very rarely. And when I do it's only when it's convenient for me. Like when I have the boxes handy, I never worry about the calories in something home-cooked.
Which is odd, since numbers in other contexts I find irresistible. Like waist measurement, weight, graphs illustrating gain, etc. I even find weighing scales (for your body, not food), tape measures, calipers, etc, erotic objects. But calorie counting has never turned me on at all.