Given the rapid pace of development of armed tele-operated and autonomous robotic systems, we call upon the international community to commence a discussion about the pressing dangers that these systems pose to peace and international security and to civilians, who continue to suffer most in armed conflict.
Armed tele-operated and autonomous systems have the potential to accelerate the pace and tempo of warfare, to undermine existing arms controls and regulations, to exacerbate the dangers of asymmetric warfare, and to destabilize regional and global security. In particular, autonomous systems may further the indiscriminate and disproportionate use of force and obscure the moral and legal responsibility for war crimes.
- That the long-term risks posed by the proliferation and further development of these weapon systems outweigh whatever short-term benefits they may appear to have. - That it is unacceptable for machines to control, determine, or decide upon the application of force or violence in conflict or war.
* In all cases where such a decision must be made, at least one human being must be held personally responsible and legally accountable for the decision and its foreseeable consequences.
- That the currently accelerating pace and tempo of warfare is further escalated by these systems and undermines the capacity of human beings to make responsible decisions during military operations.
- That the asymmetry of forces that these systems make possible encourages states, and non-state actors, to pursue forms of warfare that reduce the security of citizens of possessing states.
- That the fact that a vehicle is uninhabited does not confer a right to violate the sovereignty of states.
There is, therefore, an urgent need to bring into existence an arms control regime to regulate the development, acquisition, deployment, and use of armed tele-operated and autonomous robotic weapons. We hold that this regime should prohibit:
- Further development, acquisition, deployment, and use of armed autonomous robot weapons.
- Arming new kinds of autonomous or tele-operated systems with nuclear weapons.
- The development, deployment, and use of robotic space weapons.
We hold that this regime should restrict:- The range and payload of armed tele-operated uninhabited vehicles. - The number, by class and capability, of armed tele-operated uninhabited systems fielded by any state.
- The endurance of these systems.
- The development, acquisition, and deployment of weaponised uninhabited systems below a minimum size.
* The decisions to which this principle should be applied include:
- The decision to kill or use lethal force against a human being.
- The decision to use injurious or incapacitating force against a human being.
- The decision to initiate combat or violent engagement between military units.
- The decision to initiate war or warfare between states or against non-state actors.
It is understood that in the application of this principle, rigorous and specific definitions will need to be negotiated as terms of a global convention, and that certain exceptions may be made where the use of automation in weapons and security systems has long been customary, or where a compelling case may be made for the necessity of automation in order to protect human life from immediate threats.
However, the world community should categorically reject the claim that military necessity will require robots to be capable of autonomous decision-making in the use of violent force in order to defend themselves and to ensure their prevailing over opponents.
To the extent that this principle may, in the longer term, limit the effectiveness of armed robots in combat, particularly against each other, it is to be welcomed, as a concrete, equitable, verifiable and enforceable arms control measure, which may help to prevent the nightmare, so often foretold, of the loss of human control over the maintenance of security, the use of lethal force and the conduct of war, and of its surrender to an armed, autonomous technology.