.Nature Medicine, Released online: 26 July 2024 doi:10.1038/ s41591-024-03181-6Although large foreign language versions (LLMs) reveal commitment in measured setups, a research study now exposes their constraints in real-world clinical treatments as well as directs the means towards durable evaluation and benchmarking prior to clinical make use of.