Is it rude to take your own food to someone else's house if you are invited to dinner?

By this I mean, should you only drink fizzy water and rather than be fussy and make a scene about it, just go prepared and have your own?
Or say you like certain condiments with your food, you take them? Or say for example, you are vegan and the host has no idea of this and rather than make them feel uncomfortable you provide a dish, just in case.

I know some of you will say, that a good host will already prepare for their guests and know that they are vegan,vegetarian, or in tolerant to something, but sometimes it’s not possible to know, especially if it’s a last minute arrival.

Is it considered rude to do this?