ILLUMINATION
Published in

ILLUMINATION

Language models in the biomedical and clinical tasks

Exploring the use cases and limitations

imaginary image representing the language models as a growing brain — generate by author using Midjourney

Biomedical and clinical tasks as language models

For conclusions and proposed research area you can navigate to “solutions and research area” section.

Review and results

language models types — image by author

Pretrained Language Models for Biomedical and Clinical Tasks: Understanding and Extending the State-of-the-Art

Table 1 — Mean (M) of results for evaluated tasks.

Medically Aware GPT-3 as a Data Generator

Table 2 — dialogue summarization results.

Improving language models by retrieving from trillions of tokens

Proposed solutions and research area

Retrievals with specialised models mixer — image by author
Few-shot learners with fine-tuned models
mixer — image by author

References

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Albarqawi

Solution designer and a master’s data science scholar at Illinois Urbana-Champaign. ahmadai.com