How to make up optimal solution to highly Kolmogorov-complex problems. This is nearest thing I would call "human intelligence" and what I would want for massive AI breakthrough.
https://arxiv.org/abs/1911.01547 - Chollett's Abstraction and Reasoning corpus is good example of it - it is tremendously hard to solve for the AI to this day.
https://www.researchgate.net/publication/2472570_A_Formal_Definition_of_Intelligence_Based_on_an_Intensional_Variant_of_Algorithmic_Complexity - here's theoretical work elaborating on importance of this concept.
It is important for current LLM revolution as well, as it is one of ways to differentiate actual congnitive skills from glorified look-up table
Maybe papers from Pangu-Sigma or other large scale MoE models can be helpfulhttps://arxiv.org/abs/2303.10845