Am I being inhumane towards my goldfish?

I just got a goldfish (named Tom Felton by the way) and I feel like I am being cruel to him. He just hovers at the bottom of the bowl all day. I feed him his special food, he has a nice floor with shells on the bottom, a nice view in my room and out my window but I feel like I am killing him. What should I do?