I sometimes feel badly when I answer a question rudely...?

It means you have a conscience, which is a good thing to have. There should be more people like you in this world. Kudos to you.