In my experience, it honestly depends on what you're trying to have the models learn and the task at hand.
- Spend lots of time cleaning up your data and doing feature engineering. Regulated industries like insurance spend significantly more time in feature engineering than tuning fancy models, for example.
- I would recommend trying regression and random forest models first, or even xgboost