2 min listen
Building Production Workflows for AI Applications
FromAI + a16z
ratings:
Length:
44 minutes
Released:
Jun 14, 2024
Format:
Podcast episode
Description
In this episode, Inngest cofounder and CEO Tony Holdstock-Brown joins a16z partner Yoko Li, as well as Derrick Harris, to discuss the reality and complexity of running AI agents and other multistep AI workflows in production. Tony also why developer tools for generative AI — and their founders — might look very similar to previous generations of these products, and where there are opportunities for improvement.Here's a sample of the discussion, where Tony shares some advice for engineers looking to build for AI:"We almost have two parallel tracks right now as, as engineers. We've got the CPU track in which we're all like, 'Oh yeah, CPU-bound, big O notation. What are we doing on the application-level side?' And then we've got the GPU side, in which people are doing like crazy things in order to make numbers faster, in order to make differentiation better and smoother, in order to do gradient descent in a nicer and more powerful way. The two disciplines right now are working together, but are also very, very, very different from an engineering point of view. "This is one interesting part to think about for like new engineers, people that are just thinking about what to do if they want to go into the engineering field overall. Do you want to be on the side using AI, in which you take all of these models, do all of this stuff, build the application-level stuff, and chain things together to build products? Or do you want to be on the math side of things, in which you do really low-level things in order to make compilers work better, so that your AI things can run faster and more efficiently? Both are engineering, just completely different applications of it."Learn more:The Modern Transactional StackThe LLM App StackFollow everyone on X:Tony Holdstock-BrownYoko LiDerrick Harris
Check out everything a16z is doing with artificial intelligence here, including articles, projects, and more podcasts.
Check out everything a16z is doing with artificial intelligence here, including articles, projects, and more podcasts.
Released:
Jun 14, 2024
Format:
Podcast episode
Titles in the series (14)
Welcome to the AI + a16z podcast: The AI + a16z podcast captures our thinking on AI across a broad swath of areas, from the infrastructure that powers today’s foundation models to how specific tools, like LLMs, are reshaping the hiring process. Looking forward, you can expect to hear about a list of topics that includes the latest advances in generative AI, cybersecurity, and the emerging stack of tools for building and running LLMs. by AI + a16z