Please read the rules of the subreddit
r/learnmachinelearning
Please read the rules of the subreddit
r/learnmachinelearning
You go from "trying stuff on your own" to "waiting for others to try". How lazy
You can check out HuggingFace transformers, xformers, Lucidrains implementations. For benchmarking, just test on GLUE.
r/learnmachinelearning
r/learnmachinelearning
r/learnmachinelearning
r/learnprogramming
r/learnmachinelearning
Paste your model name in this HF space, https://huggingface.co/spaces/Vokturz/can-it-run-llm
https://imgur.com/a/Ednemii (the result)
It seems you need less than 32 GiBs vram
r/learnmachinelearning
r/LanguageTechnology
I suggest you to read the subreddit rules before making any further comments.