Sep 22 2024 23 mins
What is Soylent Culture? Whether it is in the mass media, the new media, or the media consumed by the current crop of generative AI tools, it is culture that has been fed on itself. But of course, there's more. Have a listen to find out how Soylent Culture is driving the potential for "Model Collapse" with our AI tools, and what that might mean.
Bibliography
McLuhan, M. (1964). Understanding Media: The Extensions of Man. The New American Library.
Shumailov, I., Shumaylov, Z., Zhao, Y., Gal, Y., Papernot, N., & Anderson, R. (2024). The Curse of Recursion: Training on Generated Data Makes Models Forget (No. arXiv:2305.17493). arXiv. https://doi.org/10.48550/arXiv.2305.17493
Shumailov, I., Shumaylov, Z., Zhao, Y., Papernot, N., Anderson, R., & Gal, Y. (2024). AI models collapse when trained on recursively generated data. Nature, 631(8022), 755–759. https://doi.org/10.1038/s41586-024-07566-y
Snoswell, A. J. (2024, August 19). What is ‘model collapse’? An expert explains the rumours about an impending AI doom. The Conversation. http://theconversation.com/what-is-model-collapse-an-expert-explains-the-rumours-about-an-impending-ai-doom-236415
https://en.wikipedia.org/wiki/Low-background_steel