LocalLLaMA

3 readers

1 users here now

Community to discuss about Llama, the family of large language models created by Meta AI.

founded 1 year ago

MODERATORS

communick@poweruser.forum

Generalized Tree-of-Thought Capability in SynthIA Models (alien.top)

submitted 11 months ago by migtissera@alien.top to c/localllama@poweruser.forum

5 comments fedilink hide all child comments

Here's how I managed to bootstrap generalized Tree-of-Thought capability in my AIs.

This was the secret sauce to SynthIA.

Generate your dataset with this, plus the Orca system prompts.

Open Source FTW. LFG!

https://preview.redd.it/45uyzynlen0c1.png?width=1744&format=png&auto=webp&s=694e69603c0656efbbea9a9e8b18d02a10c8633e

you are viewing a single comment's thread
view the rest of the comments

[–] FutureIsMine@alien.top 1 points 11 months ago

What model was used with that prompt for bootstrapping the data for a training set? Did you then take all that data and fine-tune it on the model used to bootstrap the initial dataset?