When ADBC launched, the pitch was compelling: zero-copy columnar data movement, vendor neutrality, Arrow-native performance. But then production happened. Turns out creating a new connectivity standard was the easy part! The hard part is observability for queries mysteriously failing, type mappings that work for 90% of schemas but explode on that one user’s TIMESTAMP WITH TIMEZONE, driver discovery and so on. This talk shares what we’ve learned from ADBC getting used in production environments. We’ll explore the maturation of the ADBC ecosystem: Driver manifests for discovery, connection profiles, type support evolution, and more. Expect war stories, concrete adoption guidance, and honestly admitting where there are still gaps.
Hailing from the faraway land of Brentwood, NY and currently residing in the rolling hills of Connecticut, Matt Topol has always been passionate about software. Matt has worked in infrastructure and application development, has lead development teams, and architected large-scale distributed systems for processing analytics on financial data. Matt is a PMC member for the Apache Arrow project, frequently enhancing the Golang library among other enhancements and helping to grow the Arrow Community. He wrote the first book on Apache Arrow “In-Memory Analytics with Apache Arrow” and spent the last couple years working on the Apache Arrow libraries full time and growing the Arrow Golang community. Matt is now a member of the ASF and also a PMC member of Apache Iceberg. Finally, Matt and two colleagues co-founded Columnar, focusing on data connectivity using Arrow Database Connectivity (ADBC). In his spare time, Matt likes to bash his head against a keyboard, develop/run delightfully demented games of fantasy for his victims–er–friends, and share his knowledge with anyone interested who’ll listen to his rants.