A few thousand parameters is very little. I would have a look at models like LeNet, which are extremely small but have been proven effective.
Maybe start by copying the architecture and then drop the number of filters until you reach your desired parameter number.
A few thousand parameters is very little. I would have a look at models like LeNet, which are extremely small but have been proven effective. Maybe start by copying the architecture and then drop the number of filters until you reach your desired parameter number.