Over the last couple of years, AI capabilities have grown substantially to the point where if you were to show someone from ten years ago even a lower tier AI like GPT 3.5, it would seem like magic or scifi to them. The current limitations however of such AI systems is that they require significant storage and computing power to run even a single model which could take up an entire floor akin to early computers. So this got me thinking, just how long before we start to miniaturize AIs? Why can't AIs for example be able to fit into a several GB or TB file? In other words, if an AI can be made standalone and be able to fit into a computer or phone, this would be a game changer. Looking at the history of computers, cellphones and data storage devices, the trend seems to be about making items smaller that are more efficient than previous generations.