Goliath is a masterpiece so far. Running it on 4x4090, speed is OK, but not the best still.
For my taste it writes stories better than GPT4 itself, immersing deeper and avoiding useless watery poetic shit GPT4 is full of.
Just give the thing 16k context and with a 16x4096 setup it'll be divine lol
16k context is awesome. Now we need Goliath 120b with 16k context and I'm done with OpenAI
Goliath is a masterpiece so far. Running it on 4x4090, speed is OK, but not the best still.
For my taste it writes stories better than GPT4 itself, immersing deeper and avoiding useless watery poetic shit GPT4 is full of.
Just give the thing 16k context and with a 16x4096 setup it'll be divine lol