Machine Learning, Functions and Goals Cover Image

Machine Learning, Functions and Goals
Machine Learning, Functions and Goals

Author(s): Patrick Butlin
Subject(s): Epistemology, Contemporary Philosophy, Philosophy of Mind, Philosophy of Language
Published by: KruZak
Keywords: Agency; machine learning; reinforcement learning; artificial intelligence; Dretske;

Summary/Abstract: Machine learning researchers distinguish between reinforcement learning and supervised learning and refer to reinforcement learning systems as “agents”. This paper vindicates the claim that systems trained by reinforcement learning are agents while those trained by supervised learning are not. Systems of both kinds satisfy Dretske’s criteria for agency, because they both learn to produce outputs selectively in response to inputs. However, reinforcement learning is sensitive to the instrumental value of outputs, giving rise to systems which exploit the effects of outputs on subsequent inputs to achieve good performance over episodes of interaction with their environments. Supervised learning systems, in contrast, merely learn to produce better outputs in response to individual inputs.

  • Issue Year: XXII/2022
  • Issue No: 66
  • Page Range: 351-370
  • Page Count: 20
  • Language: English