Homelab

2137 readers

1 users here now

Rules

Be Civil.
Post about your homelab, discussion of your homelab, questions you may have, or general discussion about transition your skill from the homelab to the workplace.
No memes or potato images.
We love detailed homelab builds, especially network diagrams!
Report any posts that you feel should be brought to our attention.
Please no shitposting or blogspam.
No Referral Linking.
Keep piracy discussion off of this community

founded 2 years ago

MODERATORS

communick@selfhosted.forum

rglullis

Am I getting ripped off? (sh.itjust.works)

submitted 4 days ago by appauled@sh.itjust.works to c/homelab@selfhosted.forum

23 comments fedilink hide all child comments

Hi everyone! I've got a question about some guys at work who are pitching that we need a server. This is mostly a sanity check, but I'm pretty sure they're full of shit

The law firm I work for uses a CRM that doesn't have an open API. This is important. You can access a daily updated copy of your data from an S3 bucket with an API, but it's essentially read-only for that reason.

They said they want to set up a server for the firm for " automation" using n8n. We can't use n8n because it doesn't have a native integration with our CRM. They also set up Dropbox for the firm (prior to my time starting) and the firm pays for OneDrive with Microsoft suite already...

Then they said they want local ai for automation so they'll

"Just put a 5070ti in there" For an ai agent for the entire 15-20 person firm. They also never specified what said ai would do. I also think it's completely not viable

Then they said all 3 locations can just use tailscale to access the server simultaneously. All of these people minus me and one other are completely non-technical. I help them restart Excel once a week non-technical.

I cannot possibly think of a viable use case for what they're describing. Am I cinical or are they just looking to make some cash off whatever project they don't know anything about?

you are viewing a single comment's thread
view the rest of the comments

[–] lexiw@lemmy.world 6 points 3 days ago* (last edited 3 days ago)

If it’s for a single low frequency workflow that GPU is enough, but you will be limited to small models which are mostly useless unless fine-tuned for your use case. If it’s serving users for the entire company with a big enough model to be useful you would need 192-384GB of VRAM. So a server between $20k and $40k.

The server will require maintenance, and somebody will have to develop the workflow and integration with your data.

It’s also important to know what they want to do, a basic embedding model for semantic search would work, agents not so much.