Next steps for treaty on killer robots laid out in UN Secretary-General report

In the report, the Secretary-General observes that the numerous views submitted by states and other stakeholders demonstrate “widespread concern that [autonomous] weapons systems have the potential to change warfare significantly and may strain or even erode existing legal frameworks.” The report reflects that existing international law is insufficient to deal with the challenges raised by autonomous weapons systems. Reiterating his call for the conclusion, by 2026, of a legally binding instrument to prohibit and regulate autonomous weapons systems, the Secretary-General clearly states in the report that “the autonomous targeting of humans by machines is a moral line that must not be crossed.”

The report reasserts widespread and established recognition of the “deleterious effects” of autonomous weapons systems and urges States to “act urgently to preserve human control over the use of force.” It shines much needed light on concerns related to autonomous weapons held by a number of States that have not been reflected in the ongoing talks at the Convention on Conventional Weapons (CCW) GGE on lethal autonomous weapons systems, due to the lack of universality of the forum and limited scope of work of the group. In their submissions to the report, several States “expressed regret at the slow pace of progress” at the GGE, and “called upon the group to avoid further delay and achieve tangible results” before 2026, illustrating the lack of a credible outcome after years of deliberations.

The Stop Killer Robots campaign welcomes the deep reflection in the report on the fundamental humanitarian, environmental, ethical, human rights and other concerns raised by autonomous weapons systems. The report notes that several States found the targeting of humans by autonomous weapons, and in particular the “delegation of the decision to take a human life by machines,” to be unethical. According to the report, the use of autonomous weapons systems “could lead to the loss of dignity and dehumanisation, which could result in unjustified violence and civilian casualties.” States recommended a legally binding instrument on autonomous weapons systems should “address issues related to the targeting of humans,” a view that is shared by the Stop Killer Robots campaign. States also expressed concern regarding algorithmic bias in autonomous weapons systems, which exacerbate existing power imbalances and disproportionately affect marginalised groups and vulnerable populations.

The report also lays groundwork in considering whether autonomous weapons systems could comply with international human rights law (IHRL). In particular, views in the report reflected that a requirement of human control is key to compliance with human rights law, and that use of autonomous weapons systems by domestic law enforcement officials raises specific concerns.

But if there is one key takeaway from the report, it is the Secretary-General’s findings that: “time is running out for the international community to take preventive action on this issue.” After ten years of international discussions, a legally binding instrument is the only effective way to start to address the humanitarian, legal, security, technological and ethical challenges and concerns raised by autonomous weapons systems. States have the opportunity to take decisive and confident action at the UN General Assembly, which opens in September. The UN General Assembly provides a forum which, as the report notes, has near universal membership, wide substantive scope, and is a venue for inclusive discussions with all concerned stakeholders.

Relying on existing law alone will not be sufficient. The contributions of States and non-governmental experts to diplomatic discussions and this report have categorically demonstrated this. Specific rules and legal clarity are needed to protect humanity. It is vital that States negotiate a treaty on autonomous weapons systems to start drawing clear lines now.

*Co-sponsoring States: Antigua and Barbuda, Austria, Bahamas, Barbados, Belgium, Belize, Bulgaria, Cabo Verde, Costa Rica, Croatia, Cyprus, Czechia, Denmark, Dominican Republic, Ecuador, Fiji, Germany, Guatemala, Honduras, Hungary, Iceland, Ireland, Italy, Kazakhstan, Kiribati, Liechtenstein, Luxembourg, Maldives, Malta, Mexico, Montenegro, Netherlands, New Zealand, North Macedonia, Norway, Philippines, Republic of Moldova, San Marino, Sierra Leone, Slovenia, Sri Lanka, Switzerland, Trinidad and Tobago

**See UN Office for Disarmament Affairs Document Library, replies received pursuant to resolution 78/241: https://library.unoda.org?filter=eyJmaWx0ZXIiOnt9LCJzdWJmaWx0ZXIiOnsiZmllbGQiOiJkb2N1bWVudF90aXRsZSIsImZpbHRlciI6Imljb250YWlucyIsInZhbHVlIjoiNzgvMjQxIn0sInF1ZXJ5RG9jdW1lbnRBcmdzIjp7ImZpcnN0IjoxMCwiYWZ0ZXIiOiJZWEp5WVhsamIyNXVaV04wYVc5dU9qaz0iLCJvcmRlciI6WyItc3VibWl0X2RhdGUiXX19

***Views received by 25 May 2024 are reflected in the Secretary-General’s report. Views received after that date are posted on the website of the UN Office for Disarmament Affairs in the original language of submission and are not reflected in the report.