“Assessment of fairness of NGI AI-based future interactive technologies”


Artificial Intelligence (AI) is experiencing a fast process of commodification, reaching the society at large. The scope of AMNESIA is to explore and assess the technical feasibility and commercial potential of measuring algorithmic unfairness of AI-based tools and models made available by FAAMG (Facebook, Amazon, Apple, Microsoft, Google) that are at the basis of Future Interactive Technologies (FIT) solutions (chatbots, ranking tools, etc.): ensuring that sensitive information (e.g., gender, race, sexual or political orientation) does not unfairly influence the learning process and the predictions of data-driven models. 

Our Approach

In AMNESIA the algorithmic unfairness assessment problem will be faced by:

  • Building a complete picture of the state-of-the-art of fairness metrics;
  • Selecting, generalising, extending, and improving the identified metrics;
  • Suggest ways to mitigate the unfair behaviour of the AI-based tools and models;
  • Developing a fairness assessment Proof-of-Concept (PoC) and validating it using available
  • FAAMG tools and public domain datasets;
  • Assessing the commercial viability of the proposed solutions.

Specifically, AMNESIA will first review the notions of fairness and the families of methods able to impose these notions by listing their advantages and disadvantages. Then, new fairness notions able to generalize and extend the current ones to a wider framework will be proposed: in fact, most of the approaches are not able to deal with different problem categories like, for example, Machine Learning supervised and unsupervised problems or different data types like, for example, categorical and continuous sensitive features. Moreover, AMNESIA will develop a methodology and related tool at TRL 3 able to both semi-automatically select and exploit the best metrics for assessing the fairness of the specific AI-based FIT and to suggest actions to mitigate the unfair behaviour. Finally, AMNESIA will assess the commercial viability of the proposed approach. AMNESIA is coordinated by ZenaByte that is also in charge of developing the AMNESIA approach.ettings.

This project has received funding under the European Union’s Horizon 2020 research and innovation programme under grant agreement No 825618