Ep063: Building Generative AI for Speed and Cost Efficiency with Druva


Episode Artwork
1.0x
0% played 00:00 00:00
Nov 11 2024 30 mins   4

David Gildea of Druva shares their approach to building cost-effective, fast generative AI applications, focusing on cybersecurity, data protection, and the innovative use of LLMs for simplified, natural language threat detection.

Topics Include:

  • Introduction by Dave Gildea, VP of Product at Druva.
  • Focus on building generative AI applications.
  • Emphasis on cost and speed optimization.
  • Mention of Amazon's Matt Wood keynote.
  • AI experience with kids using "Party Rock."
  • Prediction: GenAI as future workplace standard.
  • Overview of Druva's data security platform.
  • Three key Druva components: protection, response, and compliance.
  • Druva's autonomous, rapid, and guaranteed recovery.
  • Benefits of Druva’s 100% SaaS platform.
  • Handling 7 billion backups annually.
  • Managing 450 petabytes across 20 global regions.
  • Druva’s high NPS score of 89.
  • Introduction to Dru Investigate AI platform.
  • Generative AI for cybersecurity and threat analysis.
  • Support for backup and security admins.
  • Simplified cybersecurity threat detection.
  • AI-based natural language query interpretation.
  • Historical analogy with Charles Babbage’s steam engine.
  • "Fail upwards" model for LLM optimization.
  • Using small models first, escalating to larger ones.
  • API security and customer data protection.
  • Amazon Bedrock and security guardrails.
  • Testing LLMs with Amazon’s new prompt evaluation tool.
  • Speculation on $100 billion future model costs.
  • Session wrap up


Participants:

·        David Gildea - VP Product Generative AI, GM of CloudRanger, Druva

See how Amazon Web Services gives you the freedom to migrate, innovate, and scale your software company at https://aws.amazon/isv/