Conda environments, containers and portability > in-depth Linux distro configuration. You really want to keep the distro configuration to a minimum, ultimately it is a distraction (“cattle not pets”).
cyril1991
joined 10 months ago
The H100 is more recent and beefier. It is also more interesting to use it for the multi-instance GPU (MIG) feature where you “split it” for use on different workloads, so you could run multiple LLMs in parallel. The A100 has the same feature, but less memory/compute to split.
Conda environments, containers and portability > in-depth Linux distro configuration. You really want to keep the distro configuration to a minimum, ultimately it is a distraction (“cattle not pets”).