overview for HeronAI

1

Black Friday Post For The Best Software & Service Deals For Entrepreneurs (alien.top)

submitted 11 months ago by HeronAI_com@alien.top to c/entrepreneur@indiehackers.space

6 comments fedilink

Just thought we should get one of these going, feel free to comment the best software, SaaS or service deals for entrepreneurs on black friday.

Something like marketing, AI, outreach, email etc. tools.

Emotionless at $25k MRR in c/entrepreneur@indiehackers.space

[–] HeronAI_com@alien.top 1 points 11 months ago

What is your SaaS?

fastchat-t5 cheapest hosting? in c/localllama@poweruser.forum

[–] HeronAI_com@alien.top 1 points 11 months ago

Wow thanks, thats really an in-depth comment I will try what you say!

1

fastchat-t5 cheapest hosting? (alien.top)

submitted 11 months ago by HeronAI_com@alien.top to c/localllama@poweruser.forum

3 comments fedilink

I already tried to set up fastchat-t5 on a digitalocean virtual server with 32 GB Ram and 4 vCPUs for $160/month with CPU interference. The performance was horrible. Answers took about 5 seconds for the first token and then 1 word per second.

Any ideas how to host a small LLM like fastchat-t5 economically?