Few AI experiments constitute meaningful tests of hypotheses. As a branch of machine learning research, AI science has concentrated on black box investigation of training time phenomena. The best of this work is has been scientifically excellent. However, the hypotheses tested are mainly irrelevant to user and societal concerns.
https://betterwithout.ai/AI-as-science
This chapter references Chapman's essay, "How should we evaluate progress in AI?" https://metarationality.com/artificial-intelligence-progress
"Troubling Trends in Machine Learning Scholarship", Zachary C. Lipton and Jacob Steinhardt: https://arxiv.org/abs/1807.03341
You can support the podcast and get episodes a week early, by supporting the Patreon:
https://www.patreon.com/m/fluidityaudiobooks
If you like the show, consider buying me a coffee: https://www.buymeacoffee.com/mattarnold
Original music by Kevin MacLeod.
This podcast is under a Creative Commons Attribution Non-Commercial International 4.0 License.