Evaluating Chat-Optimized Language Models - Einzelansicht

The course will be based on implementing new games using the Clembench framework: https://github.com/clembench/clembench

Then compare various language models on the implemented games to check their instruction following and other game related capabilities such as reasoning, syntax, semantics, world knowledge etc.