No matter how much memory I have, the farm takes it all,

This is not the case, it is a Windows reporting bug, already answered before a few times, including here: Large Farm Optimizations - #2 by nazar-pc
Just check Processes tab, you’ll see farmer doesn’t use nearly as much RAM. And if you open some apps they will not crash either.