Theory of Knowledge - Course Companion for Students Marija Uzunova Dang Arvin Singh Uzunov Dang

scientist Joy Buolamwini has shown that
MIT
systems sold by companies such as IBM,
AI
and Amazon are systematically more
Microsoft
in predicting the gender of men than
accurate
recognition is used in an increasing
Facial
of applications, and a bias in the
number
Snow of the American Civil Liberties
Jacob
(ACLU) has argued that a new real-time
Union
recognition technology called Rekognition,
facial
by Amazon and being sold to police,
created
more likely to match people of colour to
is
who have been arrested for a crime. This
people
exacerbate a situation where people of
would
are already more likely to be targeted
colour
police. In a political stunt conducted by the
by
faces of US Congress members were run
ACLU,
Rekognition, which falsely identified
through
as having a criminal record. Of those
28members
as criminals, 40% were people of
misidentified
even though only 20% of US Congress
colour,
are people of colour. Civil rights
members
interpreted the results as evidence that
workers
IV. Ethics
IV. Ethics
[t]he blind application of machine learning runs the
risk of amplifying biases present in data. . . .
[E]ven word embeddings trained on Google News
articles exhibit female/male gender stereotypes to a
disturbing extent.
(Bolukbasi et al 2016)
women and have a white bias.
technology can affect people’s lives. For example,
the technology was discriminatory.
Figure 3.12
Gender Shades Press Kit (Buolamwini, MIT)
83