OC2608

joined 10 months ago
sorted by: new top controversial old
Starling-RM-7B-alpha: New RLAIF Finetuned 7b Model beats Openchat 3.5 and comes close to GPT-4 in c/localllama@poweruser.forum
[โ€“] OC2608@alien.top 1 points 9 months ago (1 children)

How to earn VC money 101: "Beats GPT-4!"

And voila! you're rich now.

1
What do you think about GPT-isms polluting datasets? Do you consider them a problem? If so, how big of a problem do you think it is? (alien.top)
 

It's no secret that many language models and fine-tunes are trained using datasets, many of them are made using GPT models. The problem arises when many "GPT-isms" end up in the dataset. And I am not only referring to the typical expressions like "however, it's important to...", "I understand your desire to...", but I am also referring to the structure of the outputs in the model's responses. ChatGPT (GPT models in general) tend to have a very predictable structure when in its "soulless assistant" mode, which makes it very easy to say "this is very GPT-like".

What do you think about this? Oh, and by the way, forgive my English.

What UI do you use and why? in c/localllama@poweruser.forum
[โ€“] OC2608@alien.top 1 points 10 months ago

I used to use Text Generation Web UI, but I changed to KoboldCpp because it's more lightweight. Besides, I realized I didn't use all the features of the textgen UI. KoboldCpp as the backend and SillyTavern as the frontend when I want to chat. KoboldCpp alone when I want to play with models by creating stories or something.