beigeoat

joined 1 year ago
[–] beigeoat@110010.win 16 points 1 year ago (3 children)

For some reason they just don't want to give up.

A lot of places still use it, they don't know about LibreOffice. They also don't understand that it's not being updated.

[–] beigeoat@110010.win -4 points 1 year ago* (last edited 1 year ago) (1 children)

Sorry, should've read them.

For future reference, can I copy paste all content and reference link to my site at the bottom of post, or just the content itself?

[–] beigeoat@110010.win 2 points 1 year ago (1 children)

A course in college had an assignment which required Ada, this was 3 years ago.

[–] beigeoat@110010.win 18 points 1 year ago (4 children)

AMD is getting better for ML/scientific computing very fast for the regular consumer GPUs. I have seen the pytorch performance more than double on my 6700xt in 6 months to the point that it has better performance than a 3060(not ti).

[–] beigeoat@110010.win 6 points 1 year ago

Please no, this is incredibly dangerous. They didn't stop at giving people AI which gave developers incredibly untrusted and deceptive code. Now they want to run this code without oversight.

People are going to be rm -rf /* by the AI and will only then understand how stupid of an idea this is.

[–] beigeoat@110010.win 1 points 1 year ago

If going for an inverter try a sin wave one if it's in your budget.

[–] beigeoat@110010.win 2 points 1 year ago

You go to install the debian live install on another usb and point installation to the desired usb? I think that should do it and you will have a persistent debian install.

If you are planning to use this for the long term there maybe a few better options, because the usb will die very quickly if you use it to run your os.

  • Use an external ssd, you can get a case for m.2 ssd use that with a m.2 ssd. They are the most compact after a usb drive.

  • Use external HDD, while slower it's also an option.

  • WSL? This is something.

  • Assuming by drivers you mean drive, backup all data on your drive, format drive, ensure drive no longer encrypted, install windows and Linux.

[–] beigeoat@110010.win 2 points 1 year ago

I have used it mainly for dreambooth, textual inversion and hypernetworks, just using it for stable diffusion. For models i have used the base stable diffusion models, waifu diffusion, dreamshaper, Anything v3 and a few others.

The 0.79 USD is charged only for the time you use it, if you turn off the container you are charged for storage only. So, it is not run 24/7, only when you use it. Also, have you seen the price of those GPUs? That 568$/month is a bargain if the GPU won't be in continuous use for a period of years.

Another important distinction is that LLMs are a whole different beast, running them even when renting isn't justifiable unless you have a large number of paying users. For the really good versions of LLM with large number of parameters you need a lot of things than just a good GPU, you need at least 10 of the NVIDIA A100 80GB (Meta's needs 16 https://blog.apnic.net/2023/08/10/large-language-models-the-hardware-connection/) running for the model to work. This is where the price to pirate and run yourself cannot be justified. It would be cheaper to pay for a closed LLM than to run a pirated instance.

[–] beigeoat@110010.win 1 points 1 year ago (2 children)

The point about GPU's is pretty dumb, you can rent a stack of A100 pretty cheaply for a few hours. I have done it a few times now, on runpod it's 0.79 USD per HR per A100.

On the other hand the freely available models are really great and there hasn't been a need for the closed source ones for me personally.

[–] beigeoat@110010.win 1 points 1 year ago (1 children)

You can get pretty sleek mini-pc in the price but, there performance is sub-par compared to the price they are asking for.

While itx for factor is very expensive, m-atx is cheaper and there are quite few sleek cases for them.

If you are looking for prebuilt mini pc, asustor flashtor is pretty sleek if you only want m.2 storage.

[–] beigeoat@110010.win 3 points 1 year ago (3 children)

Why not build a new PC or buy an old pc? One with ryzen 5 5600G, 8gb Ram, 250GB ssd should cost ~250USD whether you buy new/old, i recently checked the prices, cause I needed one and they were similar. This should take you a long way. As for storage just pick a case with enough ssd/harddisk slots.

You can also go much cheaper depending on what you get.

The advantage is you can add a GPU like the intel A380 for av1 encoding of video if you feel like you need it.

For OS depending on what you are doing there are a few choices:

  • True nas: mid difficulty
  • debian: i just use this with docker, does the job
  • alma linux/Rocky linux
  • ubuntu
  • yunohost: if you would be interested in hosting activitypub apps, easy
  • casaos: easy
view more: next ›