SQuARE: Software for Question Answering Research
Have you ever wanted to try Question Answering (QA) models but felt restrained because you needed to write some code to set them up? Have you ever wanted to compare QA models, but a Jupyter Notebook is too inconvenient to compare them? Have you ever wanted to use explainability methods such as saliency maps to explain the outputs, but you don’t even know where to start? You are not alone! We have been there too! That’s why we built SQuARE: Software for Question Answering Research!
SQuARE is a web platform for QA research. It allows you to deploy, run, compare, and analyze QA models without writing a single line of code. With SQuARE, you can inspect the outputs of multiple models in parallel to understand their behaviors, their strengths, and weaknesses. It also includes multiple explainability methods such as saliency maps, behavioral tests, and even graph visualizations for graph-based models. All these features make SQuARE the entry point for QA research.
SQuARE is created for academia and industry. If you are a researcher who wants to make a qualitative study of QA models, SQuARE will save you a lot of time thanks to its user-friendly interface. You can also use out-of-the-box explainability tools to make a study from different angles. If you are working in the industry and want to use QA models on your product, you can use SQuARE to analyze and compare QA models to identify the best model for your use case. Moreover, the explainability tools of SQuARE will help your company to comply with the future EU regulations on explainability AI!
In conclusion, SQuARE is a web platform that offers QA-as-a-service. It is flexible enough to support extractive, multiple-choice, generative, and graph-based models. It is also compatible with HuggingFace’s models and Adapter’s models and offers a diverse set of tools to analyze and compare models such as explainability and adversarial attacks. You can use SQuARE for free at:
SQuARE is also open-source; you can check the code at:
GitHub - UKP-SQuARE/square-core: SQuARE: Software for question answering research.
Flexible and Extensible Question Answering Platform SQuARE is a flexible and extensible Question Answering (QA)…
More information in our publications:
UKP-SQUARE: An Online Platform for Question Answering Research
Tim Baumgärtner, Kexin Wang, Rachneet Sachdeva, Gregor Geigle, Max Eichler, Clifton Poth, Hannah Sterz, Haritz Puerto…