I've always supported the double negative rule in the English language, but why?

I get really annoyed when I hear people unknowingly using double-negatives and I have been taught to think that two negatives resolve to a positive but I have just asked myself “where is the logic in this’? as mathematically (-1)+(-1)=(-2) ?
Scientifically speaking a double negative remains a negative.