Vegetarians: Why is eating vegetable not unethical for you?

Many of you say it is because vegetables don't feel pain. But that's a faulty reason - would it be okay for me to make fun of a mentally retarded kid because he can't know that my insults are supposed to be hurtful?