Skip to content
/ CoPE Public

CoPE evaluates how LLMs use context vs. parametric knowledge. Includes MultiWikiAtomic for multilingual analysis.

Notifications You must be signed in to change notification settings

PortNLP/CoPE

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 

Repository files navigation

CoPE

CoPE (Context vs. Parametric Evaluation) is a framework for analyzing how large language models use contextual input versus parametric knowledge when answering open-ended questions. It provides tools and evaluation setups for testing knowledge reliance in multilingual settings.

The repository includes the MultiWikiAtomic dataset, which breaks down Wikipedia articles in English, Spanish and Danish into atomic knowledge statements for controlled evaluation.

The CoPE framework and dataset will be available soon.

About

CoPE evaluates how LLMs use context vs. parametric knowledge. Includes MultiWikiAtomic for multilingual analysis.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published