… The evaluations we report above were constructed by physicians to mirror a range of their real-world evidence needs, formulating questions from hypothetical scenarios for rigorously evaluating AI’s capabilities. …
… Most safety evaluations analyze models in isolation. …
… We have been deeply inspired by the scientists who have built up our understanding of the world today. …
… We continued to expand the world’s largest corpus of atypical speech recordings to 1M utterances in Project Euphonia , which enabled us to train a Universal Speech Model to better recognize atypical speech by 37% on real-world benchmarks. …