I had a problem like this that kept getting worse until the whole vacumm hose broke off from the back of the intake. Make sure you do not have a small leak in the main vacumm line, it's the one pretty much dead center on the back of the intake. I hope it's this easy for you.
