If you want something lightweight, you can also use KanIDM instead of Authelia + LLDAP. It supports LDAP, OAuth and RADIUS.
And, like LLDAP, KanIDM is written in Rust. Projects like Authelia and Zitadel are also fast but they still use a garbage collector that kicks in every now and then.
If you're looking for alternatives of Calibre and Jellyfin then storage of container image won't be an issue for you. Whatever you want to access with Jellyfin will be likely much larger than all of the container images that you're looking for combined.