LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

2x Teslas in an OEM system (alien.top)

submitted 11 months ago by ConcaveTriangle5761@alien.top to c/localllama@poweruser.forum

3 comments fedilink hide all child comments

I have a Dell T7610 and I got 2x P40s for running LLMs. However, nno matter what I do, I can't get both of my P40s to work on the system. Both of them work by themselves in either PCIE slot, but when both of them are plugged in, the one on the first PCIE slot always returns an error in device manager. Does anyone have any experience with setting up these cards in a system like this?

https://preview.redd.it/2lr98mwkvo0c1.png?width=282&format=png&auto=webp&s=f28b7752e55bedbbcabd314d558fb7c515fe858a

https://preview.redd.it/72usylwkvo0c1.png?width=419&format=png&auto=webp&s=a78daeaf94cab6e8c7beed12b0ed9ee6775b2175

https://preview.redd.it/vrj71pwkvo0c1.png?width=402&format=png&auto=webp&s=708c713e55904d066eecdb496eb7dd363b2a0ff6

https://preview.redd.it/i46ojnwkvo0c1.png?width=393&format=png&auto=webp&s=553564fd91ea4b5797d6b2ad2c78e02ec5646758

you are viewing a single comment's thread
view the rest of the comments

[–] tshmihy@alien.top 1 points 11 months ago

I have a T7600 with 3x Quadro M6000 and I can use all 3 GPUs simultaneously without issue. At one point I did try to install a P40 but I couldn't get even a single one working. That said, since you are able to get 1 of them working, I see no reason that 2 can't work.

Do you have 2 CPUs installed? 2 of the PCIe x16 slots will only work with a second CPU installed.