I usually just restart my computer and it goes away. I'm not really sure what causes it but I noticed if I touch anything that plugs into my sound card it causes errors unless I restart.
Well I opened the setup in ventrilo and the "Line Volume" was on 0 and then I increased it to 10 and then it went away... tip if anyone gets in the future