U-Amethyst-20B is very good, it takes a few tries to get something unworldly good. Like a 1 in 3 chance to get something amazing. I am still trying out prompts to make it more consistent.
Was wondering if anyone had guide or some code to get started on Lora training. I want to get started on creating a customized Llama2 model with a small dataset that I created. Was wondering if anyone had a good starting point.
U-Amethyst-20B is very good, it takes a few tries to get something unworldly good. Like a 1 in 3 chance to get something amazing. I am still trying out prompts to make it more consistent.