Page 1 of 1

Conflict wth NZBGet

Posted: Sat Apr 22, 2017 6:43 pm
by xeddog
I have been running qbittorrent and nzbget together for quite a while, but lately I have run into a little problem.  My use net provider is UseNetServer and I have recently taken advantage of their free VPN.  These were still working together for a few weeks, but things have changed recently.  So to start, here is my hardware, etc.

I have an Intel I7-4770K cpu, 16GB ram, and a Seagate 1TB Black hd.  Not a barn burner, but a good machine.  I am running Ubuntu 16.04 Linux and using the OpenVPN client software.  My main applications are nzbget, Sonarr (which requires Mono), CouchPotatoServer, and sometimes qbittorrent.  There are some odds-and-ends that are also run, but these are the ones that are almost always running. 

Everything was playing nicely together prior to implementing the VPN, and even a couple of weeks after that.  About a week ago we had a power outage.  I THINK this is when the trouble started, but it might just be when I noticed it.  I don't see how it could be related, but there it is.

So here is what happens.  I boot the machine and start nzbget, Sonarr, and CPS.  the all run perfectly fine and I get download speeds in nzbget approaching my 100mpbs internet connection speed.  Then I can start qbtitorrent.  My nzbget download speeds immediately tanks from say 8MB/s down to around 200KB/s or less.  During this time, qbittorrent is using at most around 1MB/s and only downloading maybe 2 or three things so there should be plenty of bandwidth and computer resources left for nzbget.  If I shut qbittorrent down, or even just pause all downloads, nzbget speeds shoot back up to normal. 

Lastly, If I leave both qbittorrent and nzbget running and downloading, I can close the VPN and they play together nicely again.  I have contacted UseNetServer and they were unable to help.

So to simplify all of this, qbittorrent kills nzbget when using an OpenVPN session.

Does anyne have any ideas where I should be looking to get this fixed???


Thanks, and sorry for the long winded explanation.


Wayne

Re: Conflict wth NZBGet

Posted: Sun Apr 23, 2017 1:09 am
by Switeck
What's happening on the upload side?
How close to your connection's limits is upload?

Are you limiting qBitTorrent's use of half open connections and global max connections?
There might be other qBT settings that are wrecking havoc...I don't know what you're trying to do in/with qBT.

Re: Conflict wth NZBGet

Posted: Sun Apr 23, 2017 6:50 pm
by xeddog
Thanks for your reply.

As for the upload side, nzbget is all download so the only uploading would be via qbittorrent which would be very limited.  And even though I have 100mbps download speed, upload is around 5mbps so uploads shouldn’t have much of an impact anyway. 

Now, about connections.  I have used almost all defaults in the qbittorrent settings, so max number of half open connections is set at 50.  Global connections was set at 500 (I think that was the default), and I have played around with lowering that number down to 100 so far.  I have also played around with the Max connections per torrent lowering that value to currently 50.  So far, nothing has had any effect on the problem.  Add to that, when not running the OpenVPN session, qbittorrent and nzbget play quite nicely together so I don't think it is a problem with the connections unless the VPN makes some restrictions somehow.

I don't use qbitttorrent very much, but what I do use it for is pretty simple.  I try to use nzbget for everything, but if there is something I cannot find on usenet I will give qbittorrent a shot.     

Wayne

Re: Conflict wth NZBGet

Posted: Sun Apr 23, 2017 10:44 pm
by Switeck
"How close to your connection's limits is upload?"

If qBitTorrent is trying to upload at >500 KB/sec, everything else using the internet may grind to a halt. And that can happen with a single connected peer if it's fast enough and qBT's max upload speed isn't limited to 500 KB/sec or less.

"max number of half open connections is set at 50."

It may be how fast qBT is trying to make new connections due to this that could also be a problem for NZBGet...try reducing max half open connections to only 10.

Re: Conflict wth NZBGet

Posted: Sun Apr 23, 2017 11:53 pm
by xeddog
A little new information.  The network here consists of two separate subnets, one for each of two households.  Whatever the problem here is, it only affects this one machine.  The other household, which happens to be my sons house, appears to be totally unaffected when this happens.  I checked with them once, and they were streaming Netflix at the time with no apparent degradation in their service.  The other machines on my home network which consists of four or five other computers plus cell phones, also appear to be unaffected.  It is only this machine, only when the OpenVPN session is activated and only when qbittorrent and nzbget are both running.  I can either:  1) run qbittorrent and nzbget without the VPN session, or 2) run EITHER qbittorrent or nzbget with the VPN. Or 3) Run the VPN and nzbget and qbittorrent and simply pause qbittorrent when nzbget is downloading.

But with the connections in mind, I still reduced the number of max global connections to as low as 4, with 2 per torrent.  And set max half-open connections to as low as 5.  With those numbers, qBit download speed was  <100 KB/s and upload was 0KB/s.  It still just killed nzbget but it still managed about 1.5MB/s after reaching over 4.5 MB/s and climbing.  I paused the one qbit file that was downloading and nzbget speed quickly went back up.


Thanks,

Wayne

Re: Conflict wth NZBGet

Posted: Mon Apr 24, 2017 1:52 am
by Switeck
Only other non-qBT caused problem is UDP packets badly hose the VPN.
So that means DHT, udp trackers, and uTP. (And under special circumstances, LPD/LSD.)

Maybe NZBGet forum people might offer some help and ideas?

Re: Conflict wth NZBGet

Posted: Mon Apr 24, 2017 10:38 pm
by xeddog
Well here is something for the "For What It's Worth" department.  I switched from nzbget to SABnzbd+ for a download client, and SAB will not download AT ALL with the VPN session active.  Even without qBittorrent.  Shutdown the VPN and SAB hauls butt, maybe as much as half again faster than nzbget.

Wayne

Re: Conflict wth NZBGet

Posted: Tue Apr 25, 2017 7:51 am
by Switeck
Is your VPN handling multicast, UDP, and IPv6 packets correctly?!

Re: Conflict wth NZBGet

Posted: Tue Apr 25, 2017 9:36 pm
by xeddog
I have no idea.  :-\

Re: Conflict wth NZBGet

Posted: Sat Apr 07, 2018 7:13 am
by quintin89
[quote="xeddog"]
I checked with them once, and they were streaming Netflix at the time with no apparent degradation in their service.
[/quote]

I do have issues with streaming Netflix when I use a VPN. Does it matter if i use OpenVPN or would this be different with IPSec? I consider subscribing to a service such as VPN for Netflix to see if that solves the problem.