I guess your ISP has blocks placed that are limiting your download speeds while using torrents. I faced a similar a while back and when I asked my ISP, they totally denied it (obviously). The way around for me was with a VPN but it was difficult to find one that allowed torrents. However, it did reveal that my ISP was limiting my speeds.