I once dated a wonderful woman who was a bit too trusting. She needed some cement work done at her home and after doing a bit of research decided on one contractor.
When she told me that she had made a decision on a contractor she showed me his website and I immediately advised her to not choose him: on his website he stated Jesus Christ was the actual owner of his business (yes, she knew that I was an atheist before we started dating).
She ignored my opinion (and my advice not to pay him 100% until the job was complete - he only required 50% to start the job & the other 50% upon completion to the satisfaction of the customer).
She listened to his sob story about needing the other 50% to complete the job when it was about 90% done... She gave him the money and he left before finalizing the job (cement speckles all over the exterior of her house and windows, not clearing away construction debris, not smoothing out the surface in several areas, etc). He left the job soon after getting the rest of the money.
He stopped answering his cellphone and business phone... I tried to warn her that if someone claims Jesus Christ is the owner of their business if things go wrong it is going to be awfully hard to sue Him and get Him to resolve problems.
She had to hire another contractor to complete the job.
Hopefully, you now know not to date religious wing nuts.
I will bend over backwards to find any alternative to a contractor who so much as has a little Christian fish symbol in the corner of their ad. As you point out, it's invariably designed to set you up to feel like a shit for "persecuting" the poor well-meaning Christian when they don't follow through.