Am I losing weight too quickly?

I am a sedentary parapleghic trying to lose some weight. I started a week ahead of my diet on green coffee bean extract and then started a paleo diet this week. I have already lost 4 pounds. This is averaging my weight over the course of the day. Is there a threshold of weight where it is unhealthy to lose more than? I feel pretty good,and the only thing I basically gave up was grains. The wife unit is wailing and Gnashing teeth because she loves her breads. I’m not telling here how much I lost because she didn’t. I have to stay on this diet til she hits her goal so may be too slender by the time this is all over.