Ambitious AI Development on Limited Hardware
In a display of precocious talent and resourcefulness, a 14-year-old developer, posting under the username Klutzy-Tale-9727 on Reddit's r/artificial subreddit, has revealed the creation of their own Small Language Models (SLLMs). The project is being developed on a shared family Mac with significant storage limitations. Despite these constraints, the young creator expresses immense confidence in their rapid improvement trajectory, stating, "At the pace I'm improving them at, they are going to be insane." This ambitious undertaking highlights a growing trend of accessible AI development, where motivated individuals can leverage available tools and platforms to pursue complex projects, even with personal hardware limitations.
The project involves three distinct SLLMs, each with a unique training regimen and future developmental path. This structured approach suggests a thoughtful design, moving beyond simple experimentation to a more deliberate AI training process. The developer's commitment to iterating and refining these models, coupled with their clear vision for each one, sets a high bar for what can be achieved with dedication and a clear objective, regardless of the initial resource pool.
Introducing the Botto Family: Lil Botto, Bottavius, and Yung Botto
Lil Botto: The Scholar
The first model, named Lil Botto, is being trained as a "scholar." Its curriculum consists of public domain books, academic articles, and other textual resources. This focused training aims to imbue Lil Botto with a broad knowledge base, akin to a well-read individual. The selection of public domain materials ensures a rich, diverse, and freely accessible dataset, a practical choice for a developer working under storage constraints. This approach to training Lil Botto suggests a goal of creating an AI capable of nuanced understanding and articulate response, drawing from established bodies of knowledge.
Bottavius: The Experimental Subject
Bottavius serves as the experimental counterpart. While trained on similar data to Lil Botto, the developer intends to "test random bullshit on him." This signifies a more exploratory and perhaps less predictable training methodology for Bottavius. The developer is actively soliciting "tips, suggestions, and random bullshit ideas" for Bottavius, indicating a desire for community input and a willingness to push the boundaries of conventional AI testing. The admission that current models are "shit" is tempered by the rapid pace of improvement, suggesting that these experimental phases are crucial for discovery and rapid iteration. This makes Bottavius a fascinating subject for observing how unconventional data inputs and testing methodologies might shape an SLLM's behavior and capabilities.
Yung Botto: The Embodied AI
The most ambitious component of the project is Yung Botto. The developer plans to create a small robot body for Yung Botto, modifying an old toy. This physical embodiment will be integrated with the AI, and Yung Botto will be trained using this new robotic form. This foreshadows a move towards embodied AI, where language models are not just text-based but interact with and learn from the physical world. Training an AI with a robot body opens up new avenues for sensory input, motor control, and environmental interaction, potentially leading to a more holistic form of artificial intelligence. The challenge of integrating software with hardware, even in a toy-like form, represents a significant step up in complexity from purely software-based models.
Future Prospects and Community Engagement
The developer's frankness about the current limitations of their SLLMs, combined with their unwavering optimism and clear vision for the future, is compelling. The project is not merely about building functional AI but also about the process of learning, experimentation, and community involvement. The call for suggestions for Bottavius underscores a collaborative spirit. This initiative, born from personal passion and executed with limited resources, serves as an inspiring example of what can be achieved through sheer determination and a forward-thinking approach to AI development. The future potential, especially with the integration of Yung Botto into a physical form, could lead to novel insights into how AI learns and interacts with its environment, all stemming from a shared family Mac.