Answering one of those "how did our employee do" web surveys - how honest should I be?

I was on the phone this afternoon with one of the big hotel chains to make a multi-room reservation and use my points. (Something that you really need to talk to a human for if it’s the least bit complex.)

The woman at <hotel chain> was clearly not a native English speaker. She did accomplish what I asked her to do, but at least four times I had to ask her to repeat what she was saying and say it more clearly.

About 20 minutes after I got off the call, I received one of those surveys “How was your interaction with <name>? Can you rate your experience?” – I get these from the bank, even from the pizza place sometimes.

I answered the survey – 4 stars out of 5 – and in the comments area I made the point that having clear English speakers would be a benefit to customer service and satisfaction. I wasn’t rude, didn’t complain, just commented.

My question:

Was I out of line? Am I being rude to non-native speakers by commenting on their inability to be understood? Or am I doing what the company wants – they ask questions about their service and I reply honestly.

I’m sort of torn down the middle on this. What’s your take?