X open sources its ranking algorithm, letting users see if they’ve been ‘shadowbanned’

X, formerly known as Twitter, is significantly increasing its open source codebase, which includes its "For You" algorithm and core ranking engine, and introducing a feature that will allow users to determine if their account or posts have been affected by any of its ranking systems, the company announced on Thursday.

The social network has made the source code for its "For You" timeline, the default feed users see when they open the app, available on GitHub under the Apache v2 license. Additionally, X is expanding its open source efforts by adding more detail, including the model configuration, filter, and core ranking system details. This expansion has roughly increased the codebase in size by 10 to 15 times.

Keith Coleman, X's VP of Product, stated during an interview with TechCrunch that the company is releasing the core ranking code that pulls posts, ranks them for any given user, and assembles the feed. Users can also access systems that filter out potentially problematic or rule-violating content and, in some cases, even run these systems outside the company.

A new transparency tool, rolled out under the "Under the Hood" page in the app's settings, lets users who have posted at least 10 times in the past month download their aggregate stats as a JSON file. This file will display any labels applied to their account or posts in the past calendar month. Non-technical users can use this information by dropping it into a large language model (LLM) of their choice and asking for an interpretation.

This transparency initiative comes after continuing concerns about how X's algorithm influences politics, elections, and the spread of misinformation. The platform has been a home for political figures and high-profile individuals for years and is now owned by a billionaire who played a significant role in helping President Trump get elected.

However, X has faced criticism for its lack of transparency in the past, including allegations that the platform leaned too far left and that it "shadowbanned" posts of certain political figures without their knowledge.

Despite pushing for more transparency around its code and other features, such as its crowdsourced fact-checking system, Community Notes, X has arguably become less transparent overall under Musk, as it is no longer required to report to the SEC and is less forthcoming in other areas, like user metrics, growth, revenue, or government takedown requests.