Today I released Akins 3B.
Akins 3B is StableLM 3B 4E1T(Licensed under CC BY-SA 4.0.) instruction tuned on Claude Multiround Chat 1K for 2 epochs with QLoRA(2305.14314).
Prompt template:
USER: {prompt}
ASSISTANT:
From my current limited testing, this model is really impressive for a 3B. Example output:
Turbodurp, the wind-blown,
With hair as wild as the sea,
He walks the land with a swagger,
And a smile that could cheer you.
Turbodurp, the wise one,
Who sees the world with wonder,
He sees beauty in everything,
And joy in a simple sparrow.
Turbodurp, the joker,
Who laughs at the world's foibles,
He sees the humor in life's journey,
And finds joy in a simple toad.
Turbodurp, the dreamer,
Who sees the world in a dream,
He sees possibilities everywhere,
And hopes for a better scheme.
Turbodurp, the lover of life,
Who lives each day to the fullest,
He laughs at the world's troubles,
And finds joy in a simple cup of tea.
Turbodurp, the friend of all,
Who sees the good in everyone,
He lifts your spirits with his laughter,
And shares his dreams with you.
Turbodurp, the joyful one,
Who finds joy in simple things,
He sees the beauty in nature,
And finds joy in a simple ring.
Turbodurp, the one who loves,
Who loves with a heart of gold,
He loves with a love that endures,
And finds joy in a simple fold.
Subjectively, how much better do you think this is than Marx-3B, since you're the creator of both?