Memory seems like an easy win, but it's really about what are you currently limited by?
So in your most used application, or game, what is your current bottleneck?
Is your memory mostly used? Is your CPU high? Are you getting thermally throttled? Is your disc thrashing?
Profiling your main use case, will let you know what you want to improve, give you the easy wins. Cuz you could easily upgrade anything in your system right now, but you may not notice any improvement depending on your use case
You don't list your storage here, I don't know what you're currently using, but if NVMe make sense for you, that might improve load times