You don't have to fight. It's not for everyone. Keeping in mind that defending ones self and those you care about is not the same thing. If you're able to be safe in the end is what is important. Follow your own way. If non violence is your path, then walk it. I don't know if you practice gongfu or not, but remember always that your wushu is yours and yours alone, and you are free to do with yourself as you wish.
For whoso comes amongst many shall one day find that no one man is by so far the mightiest of all.