May 24 2024 52 mins 9
Dev Rishi is the founder and CEO of Predibase, the company behind Ludwig and LoRAX. Predibase just released LoRA Land, a technical report showing 310 models that can outcompete GPT-4 on specific tasks through fine-tuning. In this episode, Dev tries (pretty successfully) to convince me that fine-tuning is the future, while answering a bunch of interesting questions, like:
- Is fine-tuning hard?
- If LoRAX is a competitive advantage for you, why open-source it?
- Is model hosting becoming commoditized? If so, how can anyone compete?
- What are people actually fine-tuning language models for?
- How worried are you about OpenAI eating your lunch?
I had a ton of fun with Dev on this one. Also, check out Predibase’s newsletter called fine-tuned (great name!) and LoRA Land.
