this post was submitted on 11 Apr 2024
23 points (87.1% liked)

Rust

5949 readers
1 users here now

Welcome to the Rust community! This is a place to discuss about the Rust programming language.

Wormhole

!performance@programming.dev

Credits

  • The icon is a modified version of the official rust logo (changing the colors to a gradient and black background)

founded 1 year ago
MODERATORS
snowe@programming.dev
Ategon@programming.dev
EdTheLegendary@programming.dev
kahnclusions@programming.dev
torcherist@programming.dev
23
How can Rust be so fast in the TechEmpower Web Framework Benchmarks? (kerkour.com)
submitted 6 months ago by snaggen@programming.dev to c/rust@programming.dev
11 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] anlumo@feddit.de 8 points 6 months ago (1 children)

What’s the error bar on that statement of yours?

[–] UnfortunateShort@lemmy.world 1 points 6 months ago

I don't know and I won't pretend it does have any statistical significance. I will just say that I have read dozens of papers and anecdotally, the results were questionable in almost all cases. And not because of the possibility that they might have missed something, but because of basic shortcomings. Some don't even state how often they repeated their experiments, software versions, whether they accounted for caching effects, (system) temperature, hardware characteristics, you name it.

That's why I wouldn't name papers a prime example for clean benchmarking. The quality on YT news outlets like Gamers Nexus or Hardware Unboxed is higher than most of them by far.