Mastering the Art of Systematic Literature Reviews: A Step-by-Step Guide

Loay Aladib, Ph.D.
Higher Degree Research Insights
6 min readMay 27, 2024
Photo by Scott Graham on Unsplash

It feels like going on a new research journey in an entirely new field without any compass. Is this what it feels like for you too? But what if I tell you there’s always a way out? Especially if you don’t know where to start…

How many times I’ve come across the question, after reading tens of research papers on a topic, taking notes on what I read, and so on:

Where should I even begin?

Is this where the real work begins?

Should I follow a way to ensure I’m making some meaningful progress or reaching some milestones, and be able to finish the literature review on time before eventually aiming for a smooth process of publication in a high-quality journal?

Whether you’re an experienced researcher or a junior academic who is new to conducting studies, knowing how to do a systematic review is not an option, it is a ‘must,’ and requires you to be patient.

In this post, I’ll walk you through the basic parcel of key elements and how systematic reviews differ from other types of reviews, then focus on the systematic review methods and illustrate the step-by-step process of conducting a systematic review, from defining research questions to searching for literature, appraising its quality, interpreting and presenting your results.

Why Systematic Literature Review is so important?

Let’s start with the basic step: why it is important and why many researchers nowadays want to emphasize conducting systematic literature reviews.

Understanding the benefits and significance is very important. Before we learn how to do it, we need to understand why to do it.

It can easily map the existing literature we are facing, which is why we started the research. Discussing any problem in research is new for us, and we believe that we are all on the same page regarding this point.

When we decide on a new topic, area, or problem, it means the solution needs to be new. We need to understand what has been used in the past in this area and how we can proceed further.

There is no point in doing things that have already been done in the past and repeating ourselves, right? Sometimes we face a problem and find the solution in the literature because it has already been addressed.

It is important to follow a simple and effective method. This means when we apply any method to a challenge or issue, the solution will be the same.

The literature review done by me will be the same as another person doing the same review. We consider it relevant and quick to establish from the research databases.

Finally, it is easy to publish and formulate a good one. It will be accepted by good research journals with highly cited paper, which will accept your literature review.

Key Elements and Distinctions of Systematic Reviews

A systematic review is an excavation approach intended to discover, evaluate, and combine all available sources and evidence for a given research question. Taking into account the right procedures for searching the literature and screening for the appropriate keywords, evaluating the quality of studies, and concluding the results to enable us to make informed decisions and summaries about the research topic of interest.

A systematic review is considered secondary research because it uses research by others and does not involve data collection for a new research study.

The purpose of a systematic review is different from that of a traditional literature review.

Traditional Literature Review (Narrative)

  1. Review past research to identify gaps or discrepancies and establish a need for new research.
  2. Provides a foundation that the researcher uses to position their new research.
  3. Selects and evaluates relevant studies about the research topic.
  4. Is not required to disclose the search and selection process and criteria.

Systematic Literature Review

  1. Uses the best available evidence in a body of literature to conclude.
  2. Provides a foundation from which the researcher(s) can make recommendations.
  3. Involves an articulated search process and selection criteria for the literature, which are closely examined before being included in the review.
  4. Uses a search and selection procedure that is transparent and can be replicated.

A systematic review involves several methodical stages. Here’s a step by step guide of the process:

Step 1: Formulating the Research Question

At the heart of every systematic review lies a well-defined research question.

Start by identifying a specific topic or research problem and formulate a clear, concise research question that guides the rest of the review process.

Consider the PICO framework (Population, Intervention, Comparison, Outcome) to structure your question effectively.

Keep in mind that the research questions might change during the entire process till you finalise them according to your research scope at the end.

Step 2: Define Review Protocol (PRISMA Framework)

Before you even start the review, coming up with a detailed protocol before you even start the review is important to ensure the transparency of your systematic review.

Outlines your objectives, methods, inclusion and exclusion criteria, search strategy, analytical techniques, data extraction and analysis plan.

This is an important step to discuss with your supervisor to have a clear vision and whether you want to register your protocol with any recognized database to avoid and prevent duplication of efforts.

Step 3: Conducting Literature Search

A comprehensive literature search is the foundation of a successful systematic review. Identify relevant databases and grey literature sources, develop a robust search strategy using appropriate keywords and filters, and document your search process meticulously.

Remember to include both published and unpublished studies to minimize bias.

Step 4: Study Selection

Screening the search results involves a systematic process of evaluating the eligibility of each study based on predefined inclusion and exclusion criteria.

Start with title and abstract screening, followed by a full-text review, and resolve discrepancies through consensus or by involving a third reviewer.

Transparency and reproducibility are key throughout this stage.

Step 5: Data Extraction and Management

Develop a standardized data extraction form to systematically capture relevant information from included studies.

Extract data on study characteristics, methodology, outcomes, and key findings, ensuring accuracy and consistency.

Utilize multiple reviewers and pilot test the extraction form to enhance reliability.

Step 6: Quality Assessment

Evaluate the methodological quality of included studies using appropriate tools such as the Cochrane Risk of Bias tool or the Newcastle-Ottawa Scale.

Consider factors like risk of bias, study limitations, and applicability of findings while interpreting the results.

Transparency in quality assessment enhances the credibility of your review.

Step 7: Data Synthesis

Determine the appropriate method for synthesizing the data based on the nature of the included studies.

Whether it’s meta-analysis or narrative synthesis, ensure clarity and transparency in presenting the findings.

Conduct subgroup analyses or sensitivity analyses to explore heterogeneity and assess the robustness of your conclusions.

Step 8: Interpretation of Findings

Summarize the main findings of your systematic review concerning the research question.

Discuss the implications of the findings, including their relevance to practice, policy, or future research directions.

Acknowledge the limitations of your review and potential sources of bias.

Conclusion

Mastering the art of systematic reviews requires dedication, attention to detail, and a methodical approach. By following this step-by-step guide, you’ll be equipped with the knowledge and skills to conduct rigorous and impactful systematic reviews that contribute to the advancement of knowledge in your field.

Do not forget to acknowledge any contributions or support received during the development of the guide and provide your list of references for further reading and citation.

Thank you for reading! If you enjoyed this article and want to receive more insightful content delivered straight to your inbox, don’t forget to subscribe to my newsletter. Stay updated with the latest articles, research insights, and more. Simply click here to subscribe now.

--

--

Loay Aladib, Ph.D.
Higher Degree Research Insights

Passionate HDR Candidate & Lead Developer | Published Author | Exploring the Intersection of Technology and Academia at UOW