If you’re using pf to control how your bandwidth is used, you may want to look at the recent fairq updates from Matthew Dillon.  It should perform better now in situations where one traffic group is saturating its available bandwidth.  Here’s a handy link that explains this sort of problem, yoinked from IRC.