HeronAI_com

joined 1 year ago
 

Just thought we should get one of these going, feel free to comment the best software, SaaS or service deals for entrepreneurs on black friday.

Something like marketing, AI, outreach, email etc. tools.

[โ€“] HeronAI_com@alien.top 1 points 11 months ago

What is your SaaS?

[โ€“] HeronAI_com@alien.top 1 points 1 year ago

Wow thanks, thats really an in-depth comment I will try what you say!

 

I already tried to set up fastchat-t5 on a digitalocean virtual server with 32 GB Ram and 4 vCPUs for $160/month with CPU interference. The performance was horrible. Answers took about 5 seconds for the first token and then 1 word per second.

Any ideas how to host a small LLM like fastchat-t5 economically?