Here is the issue with neural processes: they suck, they really do, on any reasonable real-world problem beyond the simple examples with tons of training data in relatively simple domains. Source: a frustrated grad student who spent hours making conditional neural processes work on a real-world problem.
It's weird that so many folks in the comments worked with GPs and NNs and never heard of neural processes. They were a big deal until a few years ago: https://yanndubs.github.io/Neural-Process-Family/text/Intro.html
Here is the issue with neural processes: they suck, they really do, on any reasonable real-world problem beyond the simple examples with tons of training data in relatively simple domains. Source: a frustrated grad student who spent hours making conditional neural processes work on a real-world problem.