As a vegan are you guilty of killing animals by association?

I just read an article about the safety of eggs. Comments on the article got into a debate about meat eaters being killers and one meat eater responded by saying that vegans where delusional. The comment was about how they are guilty by eating vegatables that are picked by meat eaters who need the energy meat gives them to work a farm. So basically guilt by association.
At first I thought it was hogwash, but then I thought about terrorists. If you fund a terrorist group and even if you suspect that they do terrorist things than you are guilty by association.
The person who commented said the only way for them to be truly vegan is to grow their own crops and hire only other vegans.
Do you think they have a valid point?
PETA won’t hire people who eat meat and yet they take money from people who do eat meat? Does that make them guilty as well?