this post was submitted on 30 Nov 2023
1 points (100.0% liked)

LocalLLaMA

11 readers
4 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 2 years ago
MODERATORS
communick@poweruser.forum
1
The overthinker (alien.top)
submitted 2 years ago by Delicious-Farmer-234@alien.top to c/localllama@poweruser.forum
5 comments fedilink hide all child comments
 

I overfitted the Phi 1.5 model on a riddle dataset found here:

https://huggingface.co/datasets/Ermarrero/riddles_v1

I just wanted to see how it behaves and I gotta say the output is interesting since it thinks everything is a riddle and tries to break it down logically.

It's weird but it is kind of refreshing to see a model overthink it and dig too deep into things. I dunno, what do you guys think?

if you want to play around with the model I can upload it to hugginface.

https://preview.redd.it/poxet1xqdj3c1.png?width=1318&format=png&auto=webp&s=433ec4a7ce51e578182d35a97525a7b0f95f4745

https://preview.redd.it/au4617xqdj3c1.png?width=1279&format=png&auto=webp&s=76d00f416fdcf8785f84500c50a0115976dd3b97

https://preview.redd.it/ktyo25xqdj3c1.png?width=1305&format=png&auto=webp&s=2518c63ebf43b1b95955ef7846e464a76c175e7d

https://preview.redd.it/riygz6xqdj3c1.png?width=2130&format=png&auto=webp&s=b895fde3b7aff260268957dcdb1082f18ce55959

https://preview.redd.it/wjpha9xqdj3c1.png?width=1300&format=png&auto=webp&s=0523c754b17d05d09e194d10afe93236a5b3830f

top 5 comments
sorted by: hot top controversial new old
[–] Dry_Long3157@alien.top 1 points 2 years ago

May I know the LoRA parameters, if you used q/LoRA?

[–] richinseattle@alien.top 1 points 2 years ago

This is hilarious on its own and may serve as a good phase of tuning a small model before feeding it more domain specific data, love it.

[–] FPham@alien.top 0 points 2 years ago (2 children)

The ridle json + sydney actually makes the model far more lucid than normally. I applied it on Mythomax and the answers are really good.

​

https://preview.redd.it/gmisu6ac0l3c1.png?width=925&format=png&auto=webp&s=4d6fcf5bd5b89a6e6bd8ec86def35b19514473b1

[–] Feztopia@alien.top 1 points 2 years ago

To bad that the last sentence is incorrect. For example, Singapore is the capital of Singapore.

[–] liquiddandruff@alien.top 1 points 2 years ago

dang, that's actually very impressive