Theory of Knowledge - Course Companion for Students Marija Uzunova Dang Arvin Singh Uzunov Dang

16 hours because it began posting inflammatory
just
racist tweets. Apparently, the bot learned these
and
from being attacked by, and responding
views
other Twitter users. This very rapid change is
to,
Rust, the Head of Cambridge University
John
Centre, once said that all AI
Psychometric
a “a bit like a psychopath … adept at
is
emotions, but underdeveloped
manipulating
(quoted in Lapowsky 2018). Indeed,
morally”
important area of enquiry is how moral
an
happens in AI. According to
development
Iyad Rahwan, Director of the Max
Professor
is a growing belief that machine behaviour
there
be something you can study in the same way
can
you study human behaviour. We are teaching
as
in the same way as we teach human
algorithms
. . When I see an answer from an algorithm,
beings.
need to know who made that algorithm.
I
fascinating case is Norman, an AI developed
A
Rahwan as part of a research project to
by
AI morality. Specifically, Norman
investigate
trained to interpret Rorschach-style
was
called Xiaoice that had “more than 40million
bot
apparently without major incident”
conversations
2016). Tay’s experience raised questions
(Bright
the extent to which technology is a mirror of
about
images and describe in text what it
inkblot
Norman has an experimental control
“sees”.
that is identical, except that Norman was
twin
using gruesome images found on the
trained
while its twin was trained on images
internet,
everyday life. As a result, Norman “sees”
of
very differently. When presented the
things
abstract image, the control algorithm
same
people standing next to each other,
described
Norman saw a man jumping from a
whereas
“Norman’s view was unremittingly
window.
saw dead bodies, blood and
bleak—it
in every image” (Rahwan quoted in
destruction
2018), whereas its twin responded far
Wakefield
positively. This result has implications for
more
behaviour as well, such as the extent to
human
we regulate and censor content found in
which
media. At least in machines, Rahwan
popular
matters more than the algorithm … . The
Data
we use to train AI is reected in the way the AI
data
IV. Ethics
IV. Ethics
noteworthy because Tay was similar to another
human inputs, literally and metaphorically.
Box 3.1: Technology as our offspring, mirror or something else entirely
Potentially triggering content:
violence
Planck Center for Humans and Machines:
suggests, nurture matters more than nature.
(Rahwan quoted in Wakeeld 2018)
perceives the world and how it behaves.
(Rahwan quoted in Wakeeld 2018)
Figure 3.14b
Regular AI saw “a person is holding an
Regular AI saw “a black and white photo of a small
Figure 3.14a
umbrella in the air”. Norman saw “man is shot dead in front
bird”. Norman saw “man gets pulled into dough machine”.
of his screaming wife”.
85