rs137

joined 1 year ago
[–] rs137@lemmy.world 1 points 9 months ago

Llama 2 70B with 8b quantization takes around 80GB VRAM if I remember correctly. I’ve tested it a while ago.

[–] rs137@lemmy.world 2 points 9 months ago

I think it was around 7.5k EUR. But because I bought and sold Apple shares with this in mind I’ve paid around 500 EUR for that thing.

[–] rs137@lemmy.world 2 points 9 months ago (3 children)

And what exactly is wrong with that?

My MacBook Pro was 128 GB of memory is so desperate to fill it up that it gives the applications insane amounts of memory. That only took around 30 GB of memory, so the Mac also loaded the entire file system to the memory which takes around 80 GB. The whole system is super fast because it doesn’t have to read the files from a slow SSD, but from a fast memory.

It’s just a matter of how you look at it. The empty memory = wasted memory.

[–] rs137@lemmy.world 4 points 9 months ago (1 children)

Get fucked for what? That I’m from the EU? That I send donations to the country at war? That I have a gf?

[–] rs137@lemmy.world 11 points 9 months ago (3 children)

Not everyone! I’m one of those. From time to time some American reminds me but my brain filters out as a completely useless information and I forget it.

[–] rs137@lemmy.world 2 points 10 months ago* (last edited 10 months ago)

It’s the sense of speed and degree of realism is higher than in Forza games. GT Sophy AI is also amazing. It adds personalities to the AI cars so they no longer follow predefined lines but they block, attack, crash or spin from too much throttle.

[–] rs137@lemmy.world 3 points 10 months ago (2 children)

I’m addicted to Grand Turismo 7 right now. I don’t play anything else which is rare with me. I even got to the point where I bought PS VR2 just for this game.