I don't code but I've been working with the apis (oobabooga/text-generation-webui) using chatgpt for coding, for text I have no problems but for images it's been a big struggle for me. So for your tutorial (and as a clue for me), maybe a script that takes screenshots periodically and describes what it sees, could be a desktop screenshot or a camera feed or something, using a llava model.
I don't code but I've been working with the apis (oobabooga/text-generation-webui) using chatgpt for coding, for text I have no problems but for images it's been a big struggle for me. So for your tutorial (and as a clue for me), maybe a script that takes screenshots periodically and describes what it sees, could be a desktop screenshot or a camera feed or something, using a llava model.