This happens without any change in router settings or restart of any sort, I'm using latest qbitV4.5.4. Initially got the orange icon and configured my ports to be opened time and I'm not using a VPN, this is how it looks in case I wasn't clear as English isn't my 1st language:

Obviously if it were just a display bug I wouldn't mind but my seeding is affected quite severely at those times, it reduces up speeds to around 100-200KBps per leech and no more than ~1.5MBps (MiBps/KiBps but too similar to make a diff) per torrent upload while download speeds aren't affected at all and I get the usual ~40MBps with seeded torrents. Opposingly to ~12MBps usual upload when icon is green.
As for client settings I got no limit on dl/up speed and 128 upload slots/torrent along with a larger amount in the other slots so it's not something like that as well.
Any ideas as to what might be the cause would be really appreciated as I want to be able to share to my fullest system's potential.