(I only lurk here so apologies for any mistakes or dumb ideas) Anyway I spent some time trying to get some text-based fanfiction Disco Elysium setting game working in GPT4 when it was still only 8k (?) tokens. I got it to keep track of the sympathy level between Harry and Kim, and have the voices in Harry's head as well as NPCs speak a) in dialect (Scouse, Cockney,...) and style fitting their character, and b) reproduce to some extent the Martinaise Créole spoken in the game by having x% of words (nouns primarily) replaced permanently with their German, Romanian, French, ... translation. After an instruction phase I had the game first think up the story and then transform it into a branching narrative. It worked at some point pretty well until it would start forgetting things and hallucinate about prior events. Thus I never got to finish the first day or judge the narrative. Then it felt like GPT4 was taking a dive, the dialects where verbalized poorly (lots of 'h' in Cockney) or at some point it would just write "(Received Pronunciation)" or similar in front and print the answer in standard English.
I tried to implement a stripped down version of a safegame, have GPT4 use a compression algorithm and hand that over from round to round when I lost interest/realized I needed a better understanding of the fundamentals.
Could you elaborate on the Perl part, if possible? I don't mind learning as much Python as necessary as I go along, but I'd much rather be doing all that is convenient in Perl.