Well the point is that you have control over your work. You can ditch a client if you don't like working there.. you can have gaps between gigs without the need to tell anyone, etc.
Maybe you should consider working on short-term projects or part-time.
Well instead of sitting writing this question on Reddit.. you could be working on your project. Or are you doing it during business time?