I find it comical it took this long to get a proper dissection of what these settings meant and to no surprise it spikes to 387 upvotes in 13 hours.
ReMeDyIII
joined 1 year ago
Plus, isn't GPT-3.5-Turbo multimodal? There's no way a 7B can outperform that.
Every time I went on Horde, it's typically models people could run on an RTX 4090 or 3090. The problem is I too own an RTX 4090, so I don't see why someone should gain credits when there's no 70B models to spend their credits on.
If I were to attempt to fit this on a Runpod $0.79/hr (A6000 48GB VRAM, 50GB RAM, 8vCPU ), what's my best option? Is it even possible?
Did we used to spell "we" as "wee?"
lol I had to look up what EOY meant. Thought it was some kind of tech convention.