Artificial Intelligence, Linguistic Theory and Large Language Models
LINGUIST 124FS
General purpose models of natural language processing provides new opportunities for linguistic theoretical approaches to provide disciplinary perspectives to the toolbox of these models, linguistic theories in generating and utilization of text, narrative & dialogue in accessible open source AI. Linguistic theories inform AI modeling includes generative grammar, cognitive linguistic theory, empirical language models, code & meaning. Foundations of NLP will be explored. Encoder only, decoder only and encoder-decoder models (including BARD, Llama 2, BERT, Chat GPT, GPT-NEO) will be used in examining LLMs. The role of humans in labeling the data, understanding domains, how to formulate strong prompts and prompt engineering and how to strengthen the multilingual development of LLMs.