I just tried the same configuration on a Poweredge R510 with a Mellanox Connect-X3 NIC and there everything worked as expected.
I’m a little bit out of my league to debug this on my own, but I’m happy to test things and provide you with any information I can if you want to dig deeper into this.