If you eat the right amount of calories, can you lose weight no matter what kind of food you're eating?

I am using a calorie calculator that tells you how many calories you need to maintain your weight, and if you take away 500 calories from that number you have a daily calorie goal that you can lose weight with.

So far I have lost about 3 pounds over two weeks of doing this, so it is working. But I am wondering, with all the stuff written about what combination of carbs, fiber, protien, ect. is good for weight loss, do I need to get more specific in my eating restrictions to keep losing, or is counting calories enough. Obviously if I ate just sugar or fat for my 1500 calories, that wouldn’t work. But I mean if I’m just eating normal food.