Questions:

Do you take offense at turns of phrase, such as....

"Bless your heart" (in the sense that a person feels bad about something you're dealing with, not the sense that they are calling you dumb)

"Good lord! (In a fit of frustration)

"Jesus fucking christ!" (Frustration, naturally)

"Oh my god." (In the throws of passion... or frustration.... take your pick)

"Bless you." (when someone sneezes)

I think it's interesting when atheists take offense at turns of phrase. I cannot relate. I have no interest in changing someone's vernacular. Acceptance of people's quirks, makes for a much easier and satisfying life. Their turns of phrase have no bearing on me. To each their own. Most especially in a relationship with a fellow atheist. They are just turns of phrase that became common place, as leftovers from former religious adherence as a child, no doubt. Feeling the need to criticize your partner, and be critical of it, seems extreme. The phrases do not imply belief in the magic fairy in the sky.