Why do you need to close your torrent downloads with you use
VoIP? Why can you not do both simultaneously? You have enough bandwidth to do so.
Why are you stopping the torrents manually instead of letting them fail -- if indeed they do fail?
What torrent client are you currently using?
What network hardware are you currently using? I am wondering if we should be talking about
QoS.