primeqa

The prime repository for state-of-the-art Multilingual and Multimedia Question Answering research and development.

Build Status LICENSE|Apache2.0 sphinx-doc-build Hits

PrimeQA is a public open source repository that enables researchers and developers to train state-of-the-art models for question answering (QA). By using PrimeQA, a researcher can replicate the experiments outlined in a paper published in the latest NLP conference while also enjoying the capability to download pre-trained models (from an online repository) and run them on their own custom data. PrimeQA is built on top of the Transformers toolkit and uses datasets and models that are directly downloadable.

The models within PrimeQA supports End-to-end Question Answering. PrimeQA answers questions via

Some examples of models (applicable on benchmark datasets) supported are :

🏅 Top of the Leaderboard#

PrimeQA is at the top of several leaderboards: XOR-TyDi, TyDiQA-main, OTT-QA and HybridQA.

XOR-TyDi#

TyDiQA-main#

OTT-QA#

HybridQA#

Getting Started#

Installation

New to PrimeQA? Check out the getting started guide.

Development

Saw a typo in the documentation? Want to improve existing functionalities? The contributing guidelines will guide you through the process of improving PrimeQA.

Testing

Our goal is that every module and package should have a thorough set of unit tests. These tests should exercise the full functionality as well as its robustness to erroneous or unexpected input argument.

Learn more#

Section

Description

Quick tour: Entry Points for PrimeQA

Different entry points for PrimeQA: Information Retrieval, Reading Comprehension, TableQA and Question Generation

Tutorials: Jupyter Notebooks

Notebooks to get started on QA tasks

Examples: Applying PrimeQA on various QA tasks

Example scripts for fine-tuning PrimeQA models on a range of QA tasks

Model sharing and uploading

Upload and share your fine-tuned models with the community

Pull Request

PrimeQA Pull Request

Generate Documentation

How Documentation works

Orchestrator Service REST Microservice

Proof-of-concept code for PrimeQA Orchestrator microservice

Tooling UI

Demo UI

PrimeQA collaborators include#

card-img-top
Stanford NLP
card-img-top
University of Illinois
card-img-top
University of Stuttgart
card-img-top
Ohio State University
card-img-top
Carnegie Mellon University
card-img-top
University of Massachusetts
card-img-top
University of Notre Dame