I just wanted to see how it behaves and I gotta say the output is interesting since it thinks everything is a riddle and tries to break it down logically.
It's weird but it is kind of refreshing to see a model overthink it and dig too deep into things. I dunno, what do you guys think?
if you want to play around with the model I can upload it to hugginface.
Fine tuning doesnt take much, I've used like 100 human-made Q&A pairs, and worked just fine