this post was submitted on 14 Nov 2023
1 points (100.0% liked)

LocalLLaMA

1 readers
1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 10 months ago
MODERATORS
communick@poweruser.forum
1
Training on the rephrased test set is all you need: 13B models can reach GPT-4 performance in benchmarks with no contamination detectable by traditional methods (lmsys.org)
submitted 10 months ago by Covid-Plannedemic_@alien.top to c/localllama@poweruser.forum
10 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] DreamGenX@alien.top 1 points 10 months ago

It's inevitable people will game the system when it's so easy, and the payoff can be huge. Not so long ago people could still get huge VC checks for showing off GitHub stars or benchmark numbers.