You could take a look here: https://sparsezoo.neuralmagic.com/?modelSet=natural_language_processing&size=10727959%2C64684665&sort=Size%3Aasc
Smallest model there is 10MB
I think it's still the case that it has to run on x86, though I think there was talk of an arm runtime.
Also, spending on your exact needs, there might be licensing issues. Still probably worth a look though
You could take a look here: https://sparsezoo.neuralmagic.com/?modelSet=natural_language_processing&size=10727959%2C64684665&sort=Size%3Aasc
Smallest model there is 10MB
I think it's still the case that it has to run on x86, though I think there was talk of an arm runtime.
Also, spending on your exact needs, there might be licensing issues. Still probably worth a look though