Another way to think of it...air is a fluid. Like all Newtonian fluids, if you put it under pressure, it begins to behave more like a solid. When you travel through a fluid fast enough, you place the fluid in front of you under pressure. Its why water stops bullets.
Down force as a design is to redirect that pressure onto specifics spots on the car. Unless you can redirect that pressure to being behind you pushing forward (physically impossible), this creates drag.
Imagine I sit on the hood of your car. I weight 240 lbs. But imagine I get heavier the faster you go. 80 mph, I weight 320 lbs. 100 mph, I weight 400 lbs. 150 mph, I now weight 600 lbs. The force increases in magnitude as speed increases.
Eventually, I weight so much, your engine is no longer capable of pushing.
That's down force.