At the heart of modern data science, there is a division. On one hand, machine learning is in a race for scale. On the other hand and less loudly, a revolution is taking place in the backward direction: these are quantized models, edge inference, TinyML, and architectures that will survive on very limited resources.
Source: Silicon Darwinism: Why Scarcity Is the Source of True Intelligence | Towards Data Science