METAL for iPhone

Read AI news in the METAL app.

Download METAL and discover fresh AI stories every day.

Download on the App Store

For iPhone · Free download

Search for METAL AI Magazine in the App Store on your iPhone.

METAL

AI GlossaryㅇSafety and controversy

dual-use risk

The risk that the same knowledge or technology can be used for legitimate research as well as dangerous purposes like weapons development

In plain words

Dual-use risk means that a piece of knowledge or a tool can be used for both good and bad purposes. It's similar to how a kitchen knife can be used for cooking but can also become a weapon. You can't get rid of the knife itself, so instead you reduce the risk by controlling how it's sold or the context in which it's used.

The same goes for AI models. The biology knowledge needed to develop new drugs can just as easily be used to create dangerous pathogens. That's why AI companies open their doors to legitimate researchers while drawing a line by blocking certain questions or requests outright. If access is open to everyone, dangerous actors get in too; if it's all blocked, researchers who actually need it can't use it either — that's the dilemma.

So in practice, rather than lowering the model's overall performance, companies filter out specific questions in specific fields. They'll answer general biology questions but block specialized, specific queries that could lead to weapons development.

How it shows up in the news

In the article, Anthropic opens up Claude for free to scientists while explaining that "the latest model, Claude for Life Sciences [Fable], continues to block specialized biology and drug-development queries because of dual-use risk." A point that's easy to misunderstand is that this isn't about distrusting a particular user — it's a safeguard because the content of the question itself could lead to dangerous knowledge. That's why Anthropic is expanding access while also preparing a separate program that lets only verified experts use the more advanced model.

See also

Stories using this term

Browse every entry