Three AI engineers share what they're building, the technical challenges they're solving, and real lessons from shipping AI in production.
⏱️ Timestamps:
00:00 Introduction
01:40 Technical Challenges: Authentication and Tool Execution
02:08 Challenge 1: Authentication (OAuth)
03:50 Challenge 2: Tool Execution
05:08 Tool Execution Challenges: Context Management (Token Costs)
06:14 Tool Execution Challenges: Speed (Tool Batching)
06:58 Internal Evaluation (Eval) Results
07:34 Demo: Debugging Agent
10:56 Opportunities Unlocked: Cookbooks and Connector Marketplace
11:40 Solution for Open API Specs
12:00 Summary and Call to Action
12:32 Q&A: Agent Cost Management
13:43 Introduction to Browser Automation
15:01 Adaptive Browser Automation with AI
15:19 Challenges in Traditional Web Automation
20:45 Web Automation Fundamentals
21:38 Foundations for Modern Web Automation: Playwright and Puppeteer
22:45 Custom CDP Extensions
23:16 The Intelligent Layer
23:45 Example System Prompt for Website Login
25:54 Stealth and Anti-Detection Browsers
27:09 Solutions for Stealth Browsers
29:16 Conclusion and Contact Information
29:37 Q&A: Undetect and Captcha Solving
31:20 Introduction to Building Agents for Data Engineering
31:47 Presentation Topics: UX, Dynamic Context, and Generative Recommender Systems
32:15 Nexla and Express Overview
33:50 Why Express was Built
35:04 Agent UX Does Not Have to "Suck" (Generative UI Layers)
35:55 Data Exploration Should Be Interactive
37:03 Generative UI Framework
37:35 Generative UI Examples (Forms, Choices, and Visualizations)
39:41 Generative UI Mechanism (XML to React UI)
41:14 Dynamic Context Systems (Knowing, Learning, and Forgetting)
41:57 Progressive Context Loading
42:45 Intelligent Context Compaction and Relearning
43:32 Multi-Agent Workflows
45:09 Software Engineering and Tool Use
46:14 Generative Recommender Systems
46:48 Generative Recommender System Examples
49:49 Contact Information
50:05 Demo: Express Chat
52:42 Q&A: Streaming UI with XML and Component Logic
📚 Related Topics:
#AIEngineering #MachineLearning #LLMs #ProductionML #MLOps #SoftwareEngineering #LLMApplications #AIInfrastructure #FoundationModels #SanFrancisco
💡 About SF AI Engineers:
A monthly tech talk series in San Francisco focused exclusively on AI engineering. Each month, three engineers present 10-minute deep dives into real projects, the challenges, solutions, and what they'd do differently. It's designed for engineers by engineers: high signal, zero sales pitches.
Audience: 100+ software developers, ML engineers, data scientists, and technical founders building the future of AI applications.
📅 Upcoming Events:
January 2025 - Featuring Pavan Trinath Vutukur (Member of Technical Staff @ Robinhood) + more speakers TBA
👉 Register:
https://www.meetup.com/san-francisco-ai-engineers/events/312250932/?eventOrigin=group_upcoming_events🔔 Subscribe to catch every talk and join the SF AI engineering community.
Connect:
🌐 Events:
https://fonzi.ai/community/events💼 LinkedIn:
https://www.linkedin.com/company/fonziai/📧 Newsletter:
https://fonzi.ai/community/Presented by Fonzi AI - Connecting companies with elite AI engineering talent.