Infamous_Charge2666

joined 1 year ago
sorted by: new top controversial old
1
Getting 1 billion evaluation for LLama2 clone (Chinese start up 01.ai with Yi-34B) (alien.top)
 

Since this reddit doesnt allow cross posting I'll quote

"

You might have read news last week that the Chinese startup 01.ai behind Yi-34B has topped the LLM leaderboard in hugging face. Besides the company is now valued at 1Bil USD. Lee Kai-F has announced this model and their accomplishment on LinkedIn, and then calling it their own open sourced model.

Well, it turns out that Yi-34B is simply a copy of Llama2 with 2 tensors renamed as highlighted by another user on hugging face.

Honestly I feel this is a huge disgrace by leveraging on opensourced to raise billions and calling it their own innovation."

https://huggingface.co/01-ai/Yi-34B/discussions/11

What exactly is pulling 100-110W when running local LLM? in c/localllama@poweruser.forum
[–] Infamous_Charge2666@alien.top 0 points 11 months ago (1 children)

Training models on a laptop is counter intuitive. It will eventually kill your battery and damage the laptop. A laptop doesnt have the airflow to allow intensive project run for long periods of time. Apple runs cooler but you'll eventually realize you are better off building a server and use the laptop to log in to remotely train/ running inference or buy online pods.

Anyone spend a bunch of $$ on a computer for LLM and regret it? in c/localllama@poweruser.forum
[–] Infamous_Charge2666@alien.top 1 points 1 year ago

lol i have just finished identical system just a tad stronger..x299x mobo, i9- 10980 XE, 2 x 3090TI, 256gb. 72TB HDD (WD reds) + 4TB Samsung 990 Pro for 3.5k

2
what power conditioner or surge protector or power backup conditioner are you using? (alien.top)
 

Everyone talks about servers and routers and racks but I dont see many posts about how you protect your electronics against power outages, power surges or brown outs

I'm using :

Panamax M5300-PM

APC J25B Line Conditioner with 3 hours back up battery for redundancy ( main server /router/ modem connects to this)

APC H15 x 2 Power conditioner

I lost a couple of motherboards because of sudden power surges before deciding to invest into some protection.

​

Why are you running local models? What are you doing with them? in c/localllama@poweruser.forum
[–] Infamous_Charge2666@alien.top 1 points 1 year ago

to tax deduct anything you have to earn. and most users here are students ( undergrads/phd's/ masters) that make less to deduct 10k in pc hardware.

Best way is to ask your program "( phd) for sponsoring, or if undergrad to apply to scholarships