There's the speed of shipping new features, iterating, and managing release cycles.
Both speed and quality are important.
When you talk about latency, it's easy to say you want to reduce it, but at the same time, you’re constantly adding new capabilities.
The capability frontier keeps advancing, so you have to find the right balance between speed and expanding functionality.
Teams now have specific latency budgets, even down to the millisecond.
If you ship something that shaves off three milliseconds, you might get credit for 1.5 milliseconds in your latency budget, while the other 1.5 milliseconds goes directly to the user.
Humans usually notice latency changes in the low hundreds of milliseconds.
We've actually improved search latency by 30% over the last five years.
Flash models are about 90% as capable as pro models but are much faster and more effective to serve.
With every shift in search technology, we’re able to do more.