this post was submitted on 14 Nov 2023
1 points (100.0% liked)

LocalLLaMA

3 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago
MODERATORS
communick@poweruser.forum
1
Training on the rephrased test set is all you need: 13B models can reach GPT-4 performance in benchmarks with no contamination detectable by traditional methods (lmsys.org)
submitted 1 year ago by Covid-Plannedemic_@alien.top to c/localllama@poweruser.forum
10 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] DreamGenX@alien.top 1 points 1 year ago

It's inevitable people will game the system when it's so easy, and the payoff can be huge. Not so long ago people could still get huge VC checks for showing off GitHub stars or benchmark numbers.