I've been a vegetarian my whole life, but I have been overweight my whole life?

Honestly it could just be your genetics if you're just a little heavy but not obese. You say you don't exercise and that can definitely make you a little heavier. If you want to be thinner I think you need to try and make time for exercise instead of fretting over your diet. Diet can only do so much if you're not moving.