We have the same issue and didnt fiind any solution to solve this.
We only restrict the ssh to be pointed to one ip and changed the port of the ssh but still getting brute force to it and even when i login true ssh me and my colegs the ram get crazy.