Python 3.15 goes global with UTF-8 support

Python 3.15, the latest version of the popular programming language, has been rolled out with a host of new features. These include a revamped profiler, an experimental just-in-time compiler, a refined dictionary structure, and a time-saving Lazy Import option. However, the most significant addition for many users may be the default UTF-8 support across all platforms.

This update is particularly important for Windows users, who have long struggled with non-ASCII characters corrupting or crashing their programs due to the language's default encoding of the host system's locale.

Traditionally, earlier versions of Python defaulted to the host system's locale encoding, which led to numerous issues for Windows developers. This was especially problematic when dealing with UTF-8-encoded data sets, where non-ASCII characters such as smart quotes or fancy apostrophes could cause problems. To address this issue, Python Enhancement Proposal 681 was proposed in 2022 to make UTF-8 the preferred encoding.

Despite this, Python was still lagging behind other major languages like Java and Ruby, which had already adopted UTF-8 by 2020.

The new default UTF-8 support in Python 3.15 eliminates the need for programmers to manually include flags in their code to specify the encoding. This change is particularly beneficial for data wranglers, who use Python for processing and analyzing data. According to various Python Software Foundation surveys, about half of all Python developers use the language for this purpose, and approximately 58 percent of Python users build on Windows.

By adopting UTF-8 as the default encoding, Python aims to ensure seamless data sharing and configuration format compatibility across all platforms, including Windows, macOS, and Linux.