Had the same issue, tried cleaning them off the leaves (didn't have insecticidal soap though) which helped a bit, but they eventually came back (Metro Van, so slightly different conditions).
Kept killing them by hand regularly, which allowed the pepper to survive but no new leaves would make it as they were instantly attacked by the bugs and dried out.
In the end, I just had to chuck the pepper after getting 1 little habanero off it ๐ I haven't come across a silver bullet solution when searching, so hopefully someone with positive experience can chime in.
Damn Wendell actually got me thinking of CachyOS with his shameless plugs ๐.
I would mostly do gaming but there are those occasional times where I just need some random functionality which I perhaps may miss with Bazzite.