A Loosely Wittgensteinian Conception of the Linguistic Understanding of Large Language Models like BERT, GPT-3, and ChatGPT

Grazer Philosophische Studien 99 (4):485-523 (2023)
  Copy   BIBTEX

Abstract

In this article, I develop a loosely Wittgensteinian conception of what it takes for a being, including an AI system, to understand language, and I suggest that current state of the art systems are closer to fulfilling these requirements than one might think. Developing and defending this claim has both empirical and conceptual aspects. The conceptual aspects concern the criteria that are reasonably applied when judging whether some being understands language; the empirical aspects concern the question whether a given being fulfills these criteria. On the conceptual side, the article builds on Glock’s concept of intelligence, Taylor’s conception of intrinsic rightness as well as Wittgenstein’s rule-following considerations. On the empirical side, it is argued that current transformer-based NNLP models, such as BERT and GPT-3 come close to fulfilling these criteria.

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 92,283

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

Davidson and the language of new media.Dana Riesenfeld - 2019 - Empedocles European Journal for the Philosophy of Communication 10 (2):139-149.
ChatGPT: Temptations of Progress.Rushabh H. Doshi, Simar S. Bajaj & Harlan M. Krumholz - 2023 - American Journal of Bioethics 23 (4):6-8.
Querying linguistic trees.Catherine Lai & Steven Bird - 2010 - Journal of Logic, Language and Information 19 (1):53-73.
The Internal and the External in Linguistic Explanation.Brian Epstein - 2008 - Croatian Journal of Philosophy 8 (22):77-111.
Is Wittgenstein a Contextualist?Alberto Voltolini - 2010 - Essays in Philosophy 11 (2):150-167.
Philosophy of Language.Martin Davies - unknown - In Nicholas Bunnin & E. P. Tsui‐James (eds.), The Blackwell Companion to Philosophy. Oxford, UK: Blackwell. pp. 90–146.
ChatGPT.Andrej Poleev - 2023 - Enzymes 21.
Theological Models of Lindbeck and Phillips: A Comparison.Seyed Amirreza Mazari & Jahangir Massoudi - 2018 - پژوهشنامه فلسفه دین 16 (1):211-224.
Could Competent Speakers Really Be Ignorant of Their Language?Robert J. Matthews - 2006 - Croatian Journal of Philosophy 6 (3):457-467.

Analytics

Added to PP
2023-04-20

Downloads
142 (#132,138)

6 months
57 (#82,449)

Historical graph of downloads
How can I increase my downloads?

Author's Profile

Reto Gubelmann
University of Zürich

References found in this work

What is it like to be a bat?Thomas Nagel - 1974 - Philosophical Review 83 (October):435-50.
Minds, brains, and programs.John Searle - 1980 - Behavioral and Brain Sciences 3 (3):417-57.
Computing machinery and intelligence.Alan M. Turing - 1950 - Mind 59 (October):433-60.
Word and Object.Willard Van Orman Quine - 1960 - Les Etudes Philosophiques 17 (2):278-279.

View all 17 references / Add more references