When things go awry, RAM is the usual suspect.
32 GB isn't bad, of course. It's just everything else in your rig is absurdly high. Eight-core i9 possibly running at 5 GHz + 8 TB of SSD + UAD DSP accelerator... I was curious why did you suddenly go modest with one of the most important components of the computer: memory.
A six-core i5 from the same generation with higher memory can perform better than your computer in certain situations, but you might or might not hit that bottleneck, depending on the usage.
I have plans to leave sample libraries altogether. With recorded instruments and outboard synths triggered by MIDI, I can work on a potato.