Does sugar slow or stop muscle gain?

For 3 months I was working out 3 times a week trying to gain some muscle… at the end I didn’t even gain a pound =[

Lately, I haven’t worked out at all, but I have done a little exercise (walks, rollerblading, moving my uncles house) and I’ve been on a “Diet”. Basically, I cut out all crap food, try to eat 3 meals a day, and then binge on Sundays after eating a high protein breakfast (although, I can hardly eat more than a donate and a piece of cake now, haha).

It’s been about a month and I’ve gained 5–10 pounds (I doubt it’s fat because I hardly eat sweets.. well, hopefully it isn’t, haha.)

So, do you think sugars can slow down muscle gain? Sorry this isn’t very descriptive, I’m just looking for your opinions =P

-ben