Subject :

Why AI

Date :

19.10.22

Services : 

Healthcare and Medtech

AI-Regulations

Do bias monitoring and mitigation techniques reduce accuracy?

In our workshop at WeTechTogether, Tanya and Anastasia showed that this does not always have to be the case.

Do bias monitoring and mitigation techniques reduce accuracy?

In our workshop at WeTechTogether, Tanya Golubev and Anastasia Stamatouli showed that this does not always have to be the case.

Unfortunately, the market still focuses too much on this accuracy aspect and is wrongly used as an indication of a robust AI system.

The workshop showed that if you don’t do anything with the data (e.g. leave it full of gender and race bias) or implement 3 approaches to mitigate it, the accuracy remains the same.

Of course, this is a toy example, an AI model based on publicly available data, but it shows how misleading this aspect of accuracy is. Clearly, the quality of the data to which the mitigation measures are applied is much higher and leads to less discrimination.

But is mitigating bias technically sufficient to ensure fairness? Obviously not.

The recent AI tax scandal in the Netherlands shows that it is essential for company or institution to be aware not only of the capabilities and limitations of the technical solution being used, but also of the capabilities and limitations of the people using it. Clear procedures and proper training are crucial, because a human in the loop is not a mitigation measure per se if that human does not check or question the results of the AI system.

There is a need to go a step further.

Therefore, companies and institutions need to have many discussions about different ethical aspects. Realise trustworthy AI means, among other things, making the decision-making process transparent, establishing accountability, and providing the ability to contest and effectively challenge decisions made by AI systems and the humans who operate them.

Companies and institutions that are not prepared to address both dimensions of fairness (the technological and the procedural) run the risk of doing significant damage that would also destroy any trust in these amazing technologies.

Prevention is better than cure. That is nothing new.

Similar talks

We build a bridge between AI providers and users

Tages Anzeiger – AI Legal & Strategy Consulting supports companies overcome the challenges related in developing, implementing and using AI.

Introducing AI into everyday business life

Some concrete examples of what is currently implemented with AI to identify possible opportunities for your company.

What’s all the fuss about trust and reliable AI?

Laws and ethics labels do not solve the issue of trust. However, by requiring trustworthy AI, they promote accountability and the proper functioning of society.