Safeguarded AI

The first solicitation for this programme focused on TA1.1 Theory, where we sought R&D Creators – individuals and teams that ARIA will fund and support – to research and construct computationally practicable mathematical representations and formal semantics to support world-models, specifications about state-trajectories, neural systems, proofs that neural outputs validate specifications, and “version control” (incremental updates or “patches”) thereof.

The second funding call sought potential individuals or organisations interested in using our gatekeeper AI to build safeguarded products for domain-specific applications, such as optimising energy networks, clinical trials and telecommunication networks.

Safeguarded AI's success will depend on showing that our gatekeeper AI actually works in a safety-critical domain. The research teams selected for TA3 will work with our other programme teams, global AI experts, academics and entrepreneurs, in setting the groundwork to deploy Safeguarded AI in one or more areas.

In this first phase of TA3 funding, we intend to allocate an initial £5.4m aimed at eliciting requirements, sourcing datasets, and establishing evaluations benchmarks for relevant cyber-physical domains.

The third solicitation of this programme sought teams from the economic, social, legal and political sciences to consider the sound socio-technical integration of Safeguarded AI systems. 

These teams will work on problems that are plausibly critical to ensuring that the technologies developed as part of the programme will be used in the best interest of humanity at large, and that they are designed in a way that enables their governability through representative processes of collective deliberation and decision making.