Looking for ideas with file transfers over the VPN to our remote sites.

The roles of "Server A" and "Server B" can be done by any server in the main datacenter, physical install or VM doesn't matter. Server and client roles have been tested on Server 2012, 2016 and a couple of different flavors of Linux all with the same / similar results. The remote site file transfer results are best case, right now before anyone's in. Typically during the day I'm getting 500K against Server A
Looped in vendor support for the firewalls and they aren't seeing any drops, errors or issues with the VPN connection.
I'm seriously at my wit's end on this one..... I've tried with and without flow control on the server side of things with no change, tried playing with driver settings for the servers on the windows side of things all for nothing.
The 10G NICs are Intel x520 if it makes a difference. From server to server across the fiber links we're able to get approx 500MB/s during business hours, didn't connect over the weekend to do any baselines with mother's day and having done OT the last 2 weekends on our VDI servers.