AI BENCHMARK CLUB
Side-event to Open Source AI Week, the AI Benchmark Club brings together industry leaders for insightful technical discussions on AI system performance, cost, accuracy, and hardware utilization. Attendees will have the opportunity to network with peers and delve into the latest advancements in AI benchmarking.
Community sentiment:
Start Date
Wednesday, October 22, 2025
5:30 PM
Location
San Francisco
Event Types
MeetupTechnical TalkNetworking EventConference Side Event
Links & Social
Event Page
What do you think?
Rate this event:
🔥
👍
💩
Event Details
Date & Time
Wednesday, October 22, 2025 at 5:30 PM
to Wednesday, October 22, 2025 at 7:30 PM
Timezone: America/Los_Angeles
Location
San Francisco, California
Additional Information
Registration Approval Required: Your registration is subject to approval by the host. You will be asked to verify token ownership with your wallet.
Speakers & Talks:
- Mark Saroufim (GPU Mode / Meta): BackendBench, evaluating LLM-generated kernels with a focus on correctness.
- George Cameron (Artificial Analysis): Industry-shaping work in evaluating frontier models across many dimensions.
- Daniel Kim (Cerebras): Measuring the effects of different approaches of quantization on model accuracy.
Agenda:
- 5:30 - 6:00 PM: Arrival, Food, Networking
- 6:00 - 7:00 PM: Technical Talks, Q&A
- 7:00 - 7:30 PM: Post Talk Networking
Location: SF, near Moscone West. Food and drinks provided. This event is part of Open Source AI Week, right next to the PyTorch Conference venue. Hosted By: Natalie Serrino, Pete Warden.
Suggested Events