Merchant_Lawrence

joined 10 months ago
 

this third time i try rewrite this introduction on this thread, while i am not sure why i need do this i feel is important to make good introduction. So hello everyone good night from here i hope you enjoy your holiday or thanksgiving.

Uncensored Local Ai model is love by everyone and championed like golden kid in some case (mistral for example) because it just good compare it align version of it. So there thinking that uncensored model are fully uncensored is completely bias and not true.

Some model are creation of various model that being merged to create new model that not align but retain it capability and value, such as Mistral-Orca 7b, other are just being lora or fine tune with dataset that uncensored but still the based model are still not uncensored but align one, make it stil generate output advising or lecturing user instead give straightforward answer.

model can be called truly uncensored when it not given user advice and act faithfully generate user desire output.

thats my thought for this time, i hope everyone enjoy your thanskgiving.

[–] Merchant_Lawrence@alien.top 1 points 10 months ago (6 children)

Another freindly reminder to not just host you model on single host, this bit worrying but nevertless backup your favorite model if you model have to much sensitive stuff.

note : HF reportedly block in china

[–] Merchant_Lawrence@alien.top 1 points 10 months ago (2 children)

nice just waiting someone quantized it

[–] Merchant_Lawrence@alien.top 1 points 10 months ago

Koboldcpp because that only one that work for me right now.

 

Finaly i finish my thesis defense and got chance for upgrade my laptop ram to 20 gb, that so far best thing i can do, i currently run 7b mistral with it with koboldcpp but speed is.. kinda slow 0.3 token per second sometime it at peak 0.8 what wrong here ? or should i try ooboga instead or gpt4free ?

[–] Merchant_Lawrence@alien.top 1 points 10 months ago

I wonder what is look like in argument case later (if happen) it either 1st amadement and The Fourteenth Amendment's Equal Protection Clause , cause there definelty "exception" made such as "defense company" or medical company etc to develop "Unrestricted" Ai for national security and medical learning and advancement.

[–] Merchant_Lawrence@alien.top 1 points 10 months ago

is GGML supported ?