What is inherently wrong with swearing?

It depends on the context of the swearing. Are you trying to offend someone by it or not? I don't think it's "wrong" unless it is meant to offend someone. At the same time, it's something that's frowned upon by many. It's best to just get used to it even as a religious person who is taught not to use the language.