I don't think so necessarily, look at the Vikings. Sure, they would pillage towns to survive, but even though they discovered America way before Columbus, they didn't go in and invaded and killed almost every native there like Columbus did. I think the colonization is more of an ideology that came upon some groups that happened to be led by sociopaths (i. e. The Romans, The Greek, and The Mongols).

Hell, look historically at the Incas, the Chinese empire, and the mongols under Ghengis Kahn, none of them weren't white but they where all colonizers as well, just small fry to the Romans who then turned to the English, Spanish, and I think Dutch.

The other factor is religion, Christianity was a common factor in all these white colonizers who came to America. Buy the real reason was to find gold to fund their expansions. If Columbus wouldn't have seen any gold jewelry on the chief of that first village and found no other precious metals, who knows what would have happened, maybe other Europeans might have visited later again, but it could have been with a much less colonizer mentality and more of simply exploration.