• Digital Manufacturing
• Smart Factory
Clearly defined research question(s) are the key elements which set the focus for study identification and data extraction [21] . These questions are formulated based on the PICOC criteria as presented in the example in Table 2 (PICOC keywords are underlined).
Research questions examples.
Research Questions examples |
---|
• : What are the current challenges of context-aware systems that support the decision-making of business processes in smart manufacturing? • : Which technique is most appropriate to support decision-making for business process management in smart factories? • : In which scenarios are semantic web and machine learning used to provide context-awareness in business process management for smart manufacturing? |
The validity of a study will depend on the proper selection of a database since it must adequately cover the area under investigation [19] . The Web of Science (WoS) is an international and multidisciplinary tool for accessing literature in science, technology, biomedicine, and other disciplines. Scopus is a database that today indexes 40,562 peer-reviewed journals, compared to 24,831 for WoS. Thus, Scopus is currently the largest existing multidisciplinary database. However, it may also be necessary to include sources relevant to computer science, such as EI Compendex, IEEE Xplore, and ACM. Table 3 compares the area of expertise of a selection of databases.
Planning Step 3 “Select digital libraries”. Description of digital libraries in computer science and software engineering.
Database | Description | URL | Area | Advanced Search Y/N |
---|---|---|---|---|
Scopus | From Elsevier. sOne of the largest databases. Very user-friendly interface | Interdisciplinary | Y | |
Web of Science | From Clarivate. Multidisciplinary database with wide ranging content. | Interdisciplinary | Y | |
EI Compendex | From Elsevier. Focused on engineering literature. | Engineering | Y (Query view not available) | |
IEEE Digital Library | Contains scientific and technical articles published by IEEE and its publishing partners. | Engineering and Technology | Y | |
ACM Digital Library | Complete collection of ACM publications. | Computing and information technology | Y |
Authors should define the inclusion and exclusion criteria before conducting the review to prevent bias, although these can be adjusted later, if necessary. The selection of primary studies will depend on these criteria. Articles are included or excluded in this first selection based on abstract and primary bibliographic data. When unsure, the article is skimmed to further decide the relevance for the review. Table 4 sets out some criteria types with descriptions and examples.
Planning Step 4 “Define inclusion and exclusion criteria”. Examples of criteria type.
Criteria Type | Description | Example |
---|---|---|
Period | Articles can be selected based on the time period to review, e.g., reviewing the technology under study from the year it emerged, or reviewing progress in the field since the publication of a prior literature review. | : From 2015 to 2021 Articles prior 2015 |
Language | Articles can be excluded based on language. | : Articles not in English |
Type of Literature | Articles can be excluded if they are fall into the category of grey literature. | Reports, policy literature, working papers, newsletters, government documents, speeches |
Type of source | Articles can be included or excluded by the type of origin, i.e., conference or journal articles or books. | : Articles from Conferences or Journals Articles from books |
Impact Source | Articles can be excluded if the author limits the impact factor or quartile of the source. | Articles from Q1, and Q2 sources : Articles with a Journal Impact Score (JIS) lower than |
Accessibility | Not accessible in specific databases. | : Not accessible |
Relevance to research questions | Articles can be excluded if they are not relevant to a particular question or to “ ” number of research questions. | Not relevant to at least 2 research questions |
Assessing the quality of an article requires an artifact which describes how to perform a detailed assessment. A typical quality assessment is a checklist that contains multiple factors to evaluate. A numerical scale is used to assess the criteria and quantify the QA [22] . Zhou et al. [25] presented a detailed description of assessment criteria in software engineering, classified into four main aspects of study quality: Reporting, Rigor, Credibility, and Relevance. Each of these criteria can be evaluated using, for instance, a Likert-type scale [17] , as shown in Table 5 . It is essential to select the same scale for all criteria established on the quality assessment.
Planning Step 5 “Define QA assessment checklist”. Examples of QA scales and questions.
Do the researchers discuss any problems (limitations, threats) with the validity of their results (reliability)? | 1 – No, and not considered (Score: 0) 2 – Partially (Score: 0.5) 3 – Yes (Score: 1) |
Is there a clear definition/ description/ statement of the aims/ goals/ purposes/ motivations/ objectives/ questions of the research? | 1 – Disagree (Score: 1) 2 – Somewhat disagree (Score: 2) 3 – Neither agree nor disagree (Score: 3) 4 – Somewhat agree (Score: 4) 5 – Agree (Score: 5) |
The data extraction form represents the information necessary to answer the research questions established for the review. Synthesizing the articles is a crucial step when conducting research. Ramesh et al. [15] presented a classification scheme for computer science research, based on topics, research methods, and levels of analysis that can be used to categorize the articles selected. Classification methods and fields to consider when conducting a review are presented in Table 6 .
Planning Step 6 “Define data extraction form”. Examples of fields.
Classification and fields to consider for data extraction | Description and examples |
---|---|
Research type | • focuses on abstract ideas, concepts, and theories built on literature reviews . • uses scientific data or case studies for explorative, descriptive, explanatory, or measurable findings . an SLR on context-awareness for S-PSS and categorized the articles in theoretical and empirical research. |
By process phases, stages | When analyzing a process or series of processes, an effective way to structure the data is to find a well-established framework of reference or architecture. : • an SLR on self-adaptive systems uses the MAPE-K model to understand how the authors tackle each module stage. • presented a context-awareness survey using the stages of context-aware lifecycle to review different methods. |
By technology, framework, or platform | When analyzing a computer science topic, it is important to know the technology currently employed to understand trends, benefits, or limitations. : • an SLR on the big data ecosystem in the manufacturing field that includes frameworks, tools, and platforms for each stage of the big data ecosystem. |
By application field and/or industry domain | If the review is not limited to a specific “Context” or “Population" (industry domain), it can be useful to identify the field of application : • an SLR on adaptive training using virtual reality (VR). The review presents an extensive description of multiple application domains and examines related work. |
Gaps and challenges | Identifying gaps and challenges is important in reviews to determine the research needs and further establish research directions that can help scholars act on the topic. |
Findings in research | Research in computer science can deliver multiple types of findings, e.g.: |
Evaluation method | Case studies, experiments, surveys, mathematical demonstrations, and performance indicators. |
The data extraction must be relevant to the research questions, and the relationship to each of the questions should be included in the form. Kitchenham & Charters [6] presented more pertinent data that can be captured, such as conclusions, recommendations, strengths, and weaknesses. Although the data extraction form can be updated if more information is needed, this should be treated with caution since it can be time-consuming. It can therefore be helpful to first have a general background in the research topic to determine better data extraction criteria.
After defining the protocol, conducting the review requires following each of the steps previously described. Using tools can help simplify the performance of this task. Standard tools such as Excel or Google sheets allow multiple researchers to work collaboratively. Another online tool specifically designed for performing SLRs is Parsif.al 1 . This tool allows researchers, especially in the context of software engineering, to define goals and objectives, import articles using BibTeX files, eliminate duplicates, define selection criteria, and generate reports.
Search strings are built considering the PICOC elements and synonyms to execute the search in each database library. A search string should separate the synonyms with the boolean operator OR. In comparison, the PICOC elements are separated with parentheses and the boolean operator AND. An example is presented next:
(“Smart Manufacturing” OR “Digital Manufacturing” OR “Smart Factory”) AND (“Business Process Management” OR “BPEL” OR “BPM” OR “BPMN”) AND (“Semantic Web” OR “Ontology” OR “Semantic” OR “Semantic Web Service”) AND (“Framework” OR “Extension” OR “Plugin” OR “Tool”
Databases that feature advanced searches enable researchers to perform search queries based on titles, abstracts, and keywords, as well as for years or areas of research. Fig. 1 presents the example of an advanced search in Scopus, using titles, abstracts, and keywords (TITLE-ABS-KEY). Most of the databases allow the use of logical operators (i.e., AND, OR). In the example, the search is for “BIG DATA” and “USER EXPERIENCE” or “UX” as a synonym.
Example of Advanced search on Scopus.
In general, bibliometric data of articles can be exported from the databases as a comma-separated-value file (CSV) or BibTeX file, which is helpful for data extraction and quantitative and qualitative analysis. In addition, researchers should take advantage of reference-management software such as Zotero, Mendeley, Endnote, or Jabref, which import bibliographic information onto the software easily.
The first step in this stage is to identify any duplicates that appear in the different searches in the selected databases. Some automatic procedures, tools like Excel formulas, or programming languages (i.e., Python) can be convenient here.
In the second step, articles are included or excluded according to the selection criteria, mainly by reading titles and abstracts. Finally, the quality is assessed using the predefined scale. Fig. 2 shows an example of an article QA evaluation in Parsif.al, using a simple scale. In this scenario, the scoring procedure is the following YES= 1, PARTIALLY= 0.5, and NO or UNKNOWN = 0 . A cut-off score should be defined to filter those articles that do not pass the QA. The QA will require a light review of the full text of the article.
Performing quality assessment (QA) in Parsif.al.
Those articles that pass the study selection are then thoroughly and critically read. Next, the researcher completes the information required using the “data extraction” form, as illustrated in Fig. 3 , in this scenario using Parsif.al tool.
Example of data extraction form using Parsif.al.
The information required (study characteristics and findings) from each included study must be acquired and documented through careful reading. Data extraction is valuable, especially if the data requires manipulation or assumptions and inferences. Thus, information can be synthesized from the extracted data for qualitative or quantitative analysis [16] . This documentation supports clarity, precise reporting, and the ability to scrutinize and replicate the examination.
The analysis phase examines the synthesized data and extracts meaningful information from the selected articles [10] . There are two main goals in this phase.
The first goal is to analyze the literature in terms of leading authors, journals, countries, and organizations. Furthermore, it helps identify correlations among topic s . Even when not mandatory, this activity can be constructive for researchers to position their work, find trends, and find collaboration opportunities. Next, data from the selected articles can be analyzed using bibliometric analysis (BA). BA summarizes large amounts of bibliometric data to present the state of intellectual structure and emerging trends in a topic or field of research [4] . Table 7 sets out some of the most common bibliometric analysis representations.
Techniques for bibliometric analysis and examples.
Publication-related analysis | Description | Example |
---|---|---|
Years of publications | Determine interest in the research topic by years or the period established by the SLR, by quantifying the number of papers published. Using this information, it is also possible to forecast the growth rate of research interest. | [ ] identified the growth rate of research interest and the yearly publication trend. |
Top contribution journals/conferences | Identify the leading journals and conferences in which authors can share their current and future work. | , |
Top countries' or affiliation contributions | Examine the impacts of countries or affiliations leading the research topic. | [ , ] identified the most influential countries. |
Leading authors | Identify the most significant authors in a research field. | - |
Keyword correlation analysis | Explore existing relationships between topics in a research field based on the written content of the publication or related keywords established in the articles. | using keyword clustering analysis ( ). using frequency analysis. |
Total and average citation | Identify the most relevant publications in a research field. | Scatter plot citation scores and journal factor impact |
Several tools can perform this type of analysis, such as Excel and Google Sheets for statistical graphs or using programming languages such as Python that has available multiple data visualization libraries (i.e. Matplotlib, Seaborn). Cluster maps based on bibliographic data(i.e keywords, authors) can be developed in VosViewer which makes it easy to identify clusters of related items [18] . In Fig. 4 , node size is representative of the number of papers related to the keyword, and lines represent the links among keyword terms.
[1] Keyword co-relationship analysis using clusterization in vos viewer.
This second and most important goal is to answer the formulated research questions, which should include a quantitative and qualitative analysis. The quantitative analysis can make use of data categorized, labelled, or coded in the extraction form (see Section 1.6). This data can be transformed into numerical values to perform statistical analysis. One of the most widely employed method is frequency analysis, which shows the recurrence of an event, and can also represent the percental distribution of the population (i.e., percentage by technology type, frequency of use of different frameworks, etc.). Q ualitative analysis includes the narration of the results, the discussion indicating the way forward in future research work, and inferring a conclusion.
Finally, the literature review report should state the protocol to ensure others researchers can replicate the process and understand how the analysis was performed. In the protocol, it is essential to present the inclusion and exclusion criteria, quality assessment, and rationality beyond these aspects.
The presentation and reporting of results will depend on the structure of the review given by the researchers conducting the SLR, there is no one answer. This structure should tie the studies together into key themes, characteristics, or subgroups [ 28 ].
SLR can be an extensive and demanding task, however the results are beneficial in providing a comprehensive overview of the available evidence on a given topic. For this reason, researchers should keep in mind that the entire process of the SLR is tailored to answer the research question(s). This article has detailed a practical guide with the essential steps to conducting an SLR in the context of computer science and software engineering while citing multiple helpful examples and tools. It is envisaged that this method will assist researchers, and particularly early-stage researchers, in following an algorithmic approach to fulfill this task. Finally, a quick checklist is presented in Appendix A as a companion of this article.
Angela Carrera-Rivera: Conceptualization, Methodology, Writing-Original. William Ochoa-Agurto : Methodology, Writing-Original. Felix Larrinaga : Reviewing and Supervision Ganix Lasa: Reviewing and Supervision.
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Funding : This project has received funding from the European Union's Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie Grant No. 814078.
Carrera-Rivera, A., Larrinaga, F., & Lasa, G. (2022). Context-awareness for the design of Smart-product service systems: Literature review. Computers in Industry, 142, 103730.
1 https://parsif.al/
So, what is a literature review? "A literature review is an account of what has been published on a topic by accredited scholars and researchers. In writing the literature review, your purpose is to convey to your reader what knowledge and ideas have been established on a topic, and what their strengths and weaknesses are. As a piece of writing, the literature review must be defined by a guiding concept (e.g., your research objective, the problem or issue you are discussing, or your argumentative thesis). It is not just a descriptive list of the material available, or a set of summaries." Taylor, D. The literature review: A few tips on conducting it . University of Toronto Health Sciences Writing Centre.
What are the goals of creating a Literature Review? A literature could be written to accomplish different aims:
Baumeister, R. F., & Leary, M. R. (1997). Writing narrative literature reviews . Review of General Psychology , 1 (3), 311-320.
What kinds of sources require a Literature Review?
All these instances require you to collect what has been written about your research topic so that you can demonstrate how your own research sheds new light on the topic.
What kinds of literature reviews are written?
Narrative review: The purpose of this type of review is to describe the current state of the research on a specific topic/research and to offer a critical analysis of the literature reviewed. Studies are grouped by research/theoretical categories, and themes and trends, strengths and weakness, and gaps are identified. The review ends with a conclusion section which summarizes the findings regarding the state of the research of the specific study, the gaps identify and if applicable, explains how the author's research will address gaps identify in the review and expand the knowledge on the topic reviewed.
Systematic review : "The authors of a systematic review use a specific procedure to search the research literature, select the studies to include in their review, and critically evaluate the studies they find." (p. 139). Nelson, L. K. (2013). Research in Communication Sciences and Disorders . Plural Publishing.
Meta-analysis : "Meta-analysis is a method of reviewing research findings in a quantitative fashion by transforming the data from individual studies into what is called an effect size and then pooling and analyzing this information. The basic goal in meta-analysis is to explain why different outcomes have occurred in different studies." (p. 197). Roberts, M. C., & Ilardi, S. S. (2003). Handbook of Research Methods in Clinical Psychology . Blackwell Publishing.
Meta-synthesis : "Qualitative meta-synthesis is a type of qualitative study that uses as data the findings from other qualitative studies linked by the same or related topic." (p.312). Zimmer, L. (2006). Qualitative meta-synthesis: A question of dialoguing with texts . Journal of Advanced Nursing , 53 (3), 311-318.
A literature review is an integrated analysis -- not just a summary-- of scholarly writings and other relevant evidence related directly to your research question. That is, it represents a synthesis of the evidence that provides background information on your topic and shows a association between the evidence and your research question.
A literature review may be a stand alone work or the introduction to a larger research paper, depending on the assignment. Rely heavily on the guidelines your instructor has given you.
Why is it important?
A literature review is important because it:
APA Style Blog - for those harder to find answers
Your literature review should be guided by your central research question. The literature represents background and research developments related to a specific research question, interpreted and analyzed by you in a synthesized way.
How many studies do you need to look at? How comprehensive should it be? How many years should it cover?
Make a list of the databases you will search.
Where to find databases:
Some questions to help you analyze the research:
Tips:
Goals of a literature review:.
Before doing work in primary sources, historians must know what has been written on their topic. They must be familiar with theories and arguments–as well as facts–that appear in secondary sources.
Before you proceed with your research project, you too must be familiar with the literature: you do not want to waste time on theories that others have disproved and you want to take full advantage of what others have argued. You want to be able to discuss and analyze your topic.
Your literature review will demonstrate your familiarity with your topic’s secondary literature.
1) LENGTH: 8-10 pages of text for Senior Theses (485) (consult with your professor for other classes), with either footnotes or endnotes and with a works-consulted bibliography. [See also the citation guide on this site.]
2) NUMBER OF WORKS REVIEWED: Depends on the assignment, but for Senior Theses (485), at least ten is typical.
3) CHOOSING WORKS:
Your literature review must include enough works to provide evidence of both the breadth and the depth of the research on your topic or, at least, one important angle of it. The number of works necessary to do this will depend on your topic. For most topics, AT LEAST TEN works (mostly books but also significant scholarly articles) are necessary, although you will not necessarily give all of them equal treatment in your paper (e.g., some might appear in notes rather than the essay). 4) ORGANIZING/ARRANGING THE LITERATURE:
As you uncover the literature (i.e., secondary writing) on your topic, you should determine how the various pieces relate to each other. Your ability to do so will demonstrate your understanding of the evolution of literature.
You might determine that the literature makes sense when divided by time period, by methodology, by sources, by discipline, by thematic focus, by race, ethnicity, and/or gender of author, or by political ideology. This list is not exhaustive. You might also decide to subdivide categories based on other criteria. There is no “rule” on divisions—historians wrote the literature without consulting each other and without regard to the goal of fitting into a neat, obvious organization useful to students.
The key step is to FIGURE OUT the most logical, clarifying angle. Do not arbitrarily choose a categorization; use the one that the literature seems to fall into. How do you do that? For every source, you should note its thesis, date, author background, methodology, and sources. Does a pattern appear when you consider such information from each of your sources? If so, you have a possible thesis about the literature. If not, you might still have a thesis.
Consider: Are there missing elements in the literature? For example, no works published during a particular (usually fairly lengthy) time period? Or do studies appear after long neglect of a topic? Do interpretations change at some point? Does the major methodology being used change? Do interpretations vary based on sources used?
Follow these links for more help on analyzing historiography and historical perspective .
5) CONTENTS OF LITERATURE REVIEW:
The literature review is a research paper with three ingredients:
a) A brief discussion of the issue (the person, event, idea). [While this section should be brief, it needs to set up the thesis and literature that follow.] b) Your thesis about the literature c) A clear argument, using the works on topic as evidence, i.e., you discuss the sources in relation to your thesis, not as a separate topic.
These ingredients must be presented in an essay with an introduction, body, and conclusion.
6) ARGUING YOUR THESIS:
The thesis of a literature review should not only describe how the literature has evolved, but also provide a clear evaluation of that literature. You should assess the literature in terms of the quality of either individual works or categories of works. For instance, you might argue that a certain approach (e.g. social history, cultural history, or another) is better because it deals with a more complex view of the issue or because they use a wider array of source materials more effectively. You should also ensure that you integrate that evaluation throughout your argument. Doing so might include negative assessments of some works in order to reinforce your argument regarding the positive qualities of other works and approaches to the topic.
Within each group, you should provide essential information about each work: the author’s thesis, the work’s title and date, the author’s supporting arguments and major evidence.
In most cases, arranging the sources chronologically by publication date within each section makes the most sense because earlier works influenced later ones in one way or another. Reference to publication date also indicates that you are aware of this significant historiographical element.
As you discuss each work, DO NOT FORGET WHY YOU ARE DISCUSSING IT. YOU ARE PRESENTING AND SUPPORTING A THESIS ABOUT THE LITERATURE.
When discussing a particular work for the first time, you should refer to it by the author’s full name, the work’s title, and year of publication (either in parentheses after the title or worked into the sentence).
For example, “The field of slavery studies has recently been transformed by Ben Johnson’s The New Slave (2001)” and “Joe Doe argues in his 1997 study, Slavery in America, that . . . .”
Your paper should always note secondary sources’ relationship to each other, particularly in terms of your thesis about the literature (e.g., “Unlike Smith’s work, Mary Brown’s analysis reaches the conclusion that . . . .” and “Because of Anderson’s reliance on the president’s personal papers, his interpretation differs from Barry’s”). The various pieces of the literature are “related” to each other, so you need to indicate to the reader some of that relationship. (It helps the reader follow your thesis, and it convinces the reader that you know what you are talking about.)
7) DOCUMENTATION:
Each source you discuss in your paper must be documented using footnotes/endnotes and a bibliography. Providing author and title and date in the paper is not sufficient. Use correct Turabian/Chicago Manual of Style form. [See Bibliography and Footnotes/Endnotes pages.]
In addition, further supporting, but less significant, sources should be included in content foot or endnotes . (e.g., “For a similar argument to Ben Johnson’s, see John Terry, The Slave Who Was New (New York: W. W. Norton, 1985), 3-45.”)
8 ) CONCLUSION OF LITERATURE REVIEW:
Your conclusion should not only reiterate your argument (thesis), but also discuss questions that remain unanswered by the literature. What has the literature accomplished? What has not been studied? What debates need to be settled?
Additional writing guidelines
How have History & American Studies majors built careers after earning their degrees? Learn more by clicking the image above.
Conducting a literature review, organizing a literature review, writing a literature review, helpful book.
A literature review is a compilation of the works published in a particular field of study or line of research, usually over a specific period of time, in the form of an in-depth, critical bibliographic essay or annotated list in which attention is drawn to the most significant works.
The objective of a Literature Review is to find previous published scholarly works relevant to an specific topic
A literature review is important because it:
Source: "What is a Literature Review?", Old Dominion University, https://guides.lib.odu.edu/c.php?g=966167&p=6980532
1. Choose a topic. Define your research question.
Your literature review should be guided by a central research question. It represents background and research developments related to a specific research question, interpreted, and analyzed by you in a synthesized way.
2. Decide on the scope of your review.
How many studies do you need to look at? How comprehensive should it be? How many years should it cover?
3. Select the databases you will use to conduct your searches.
4. Conduct your searches and find the literature.
5. Review the literature.
Some questions to help you analyze the research:
Source: "Literature Review", University of West Florida, https://libguides.uwf.edu/c.php?g=215113&p=5139469
A literature review is not a summary of the sources but a synthesis of the sources. It is made up of the topics the sources are discussing. Each section of the review is focused on a topic, and the relevant sources are discussed within the context of that topic.
1. Select the most relevant material from the sources
2. Arrange that material so you can focus on it apart from the source text itself
3. Group similar points, themes, or topics together and label them
4. Order those points, themes, or topics as you will discuss them in the paper, and turn the labels into actual assertions
This is now the outline for your literature review.
Source: "Organizing a Review of the Literature – The Basics", George Mason University Writing Center, https://writingcenter.gmu.edu/writing-resources/research-based-writing/organizing-literature-reviews-the-basics
The most common way that literature reviews are organized is by theme or author. Find a general pattern of structure for the review. When organizing the review, consider the following:
Writing Tips:
Source: "Composing your Literature Review", Florida A&M University, https://library.famu.edu/c.php?g=577356&p=3982811
Explore. Discover. Create.
Copyright © 2022 Pepperdine University
Loading metrics
Open Access
* E-mail: [email protected]
Affiliations Centre for Functional and Evolutionary Ecology (CEFE), CNRS, Montpellier, France, Centre for Biodiversity Synthesis and Analysis (CESAB), FRB, Aix-en-Provence, France
Published: July 18, 2013
Citation: Pautasso M (2013) Ten Simple Rules for Writing a Literature Review. PLoS Comput Biol 9(7): e1003149. https://doi.org/10.1371/journal.pcbi.1003149
Editor: Philip E. Bourne, University of California San Diego, United States of America
Copyright: © 2013 Marco Pautasso. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was funded by the French Foundation for Research on Biodiversity (FRB) through its Centre for Synthesis and Analysis of Biodiversity data (CESAB), as part of the NETSEED research project. The funders had no role in the preparation of the manuscript.
Competing interests: The author has declared that no competing interests exist.
Literature reviews are in great demand in most scientific fields. Their need stems from the ever-increasing output of scientific publications [1] . For example, compared to 1991, in 2008 three, eight, and forty times more papers were indexed in Web of Science on malaria, obesity, and biodiversity, respectively [2] . Given such mountains of papers, scientists cannot be expected to examine in detail every single new paper relevant to their interests [3] . Thus, it is both advantageous and necessary to rely on regular summaries of the recent literature. Although recognition for scientists mainly comes from primary research, timely literature reviews can lead to new synthetic insights and are often widely read [4] . For such summaries to be useful, however, they need to be compiled in a professional way [5] .
When starting from scratch, reviewing the literature can require a titanic amount of work. That is why researchers who have spent their career working on a certain research issue are in a perfect position to review that literature. Some graduate schools are now offering courses in reviewing the literature, given that most research students start their project by producing an overview of what has already been done on their research issue [6] . However, it is likely that most scientists have not thought in detail about how to approach and carry out a literature review.
Reviewing the literature requires the ability to juggle multiple tasks, from finding and evaluating relevant material to synthesising information from various sources, from critical thinking to paraphrasing, evaluating, and citation skills [7] . In this contribution, I share ten simple rules I learned working on about 25 literature reviews as a PhD and postdoctoral student. Ideas and insights also come from discussions with coauthors and colleagues, as well as feedback from reviewers and editors.
How to choose which topic to review? There are so many issues in contemporary science that you could spend a lifetime of attending conferences and reading the literature just pondering what to review. On the one hand, if you take several years to choose, several other people may have had the same idea in the meantime. On the other hand, only a well-considered topic is likely to lead to a brilliant literature review [8] . The topic must at least be:
Ideas for potential reviews may come from papers providing lists of key research questions to be answered [9] , but also from serendipitous moments during desultory reading and discussions. In addition to choosing your topic, you should also select a target audience. In many cases, the topic (e.g., web services in computational biology) will automatically define an audience (e.g., computational biologists), but that same topic may also be of interest to neighbouring fields (e.g., computer science, biology, etc.).
After having chosen your topic and audience, start by checking the literature and downloading relevant papers. Five pieces of advice here:
The chances are high that someone will already have published a literature review ( Figure 1 ), if not exactly on the issue you are planning to tackle, at least on a related topic. If there are already a few or several reviews of the literature on your issue, my advice is not to give up, but to carry on with your own literature review,
The bottom-right situation (many literature reviews but few research papers) is not just a theoretical situation; it applies, for example, to the study of the impacts of climate change on plant diseases, where there appear to be more literature reviews than research studies [33] .
https://doi.org/10.1371/journal.pcbi.1003149.g001
When searching the literature for pertinent papers and reviews, the usual rules apply:
If you read the papers first, and only afterwards start writing the review, you will need a very good memory to remember who wrote what, and what your impressions and associations were while reading each single paper. My advice is, while reading, to start writing down interesting pieces of information, insights about how to organize the review, and thoughts on what to write. This way, by the time you have read the literature you selected, you will already have a rough draft of the review.
Of course, this draft will still need much rewriting, restructuring, and rethinking to obtain a text with a coherent argument [11] , but you will have avoided the danger posed by staring at a blank document. Be careful when taking notes to use quotation marks if you are provisionally copying verbatim from the literature. It is advisable then to reformulate such quotes with your own words in the final draft. It is important to be careful in noting the references already at this stage, so as to avoid misattributions. Using referencing software from the very beginning of your endeavour will save you time.
After having taken notes while reading the literature, you will have a rough idea of the amount of material available for the review. This is probably a good time to decide whether to go for a mini- or a full review. Some journals are now favouring the publication of rather short reviews focusing on the last few years, with a limit on the number of words and citations. A mini-review is not necessarily a minor review: it may well attract more attention from busy readers, although it will inevitably simplify some issues and leave out some relevant material due to space limitations. A full review will have the advantage of more freedom to cover in detail the complexities of a particular scientific development, but may then be left in the pile of the very important papers “to be read” by readers with little time to spare for major monographs.
There is probably a continuum between mini- and full reviews. The same point applies to the dichotomy of descriptive vs. integrative reviews. While descriptive reviews focus on the methodology, findings, and interpretation of each reviewed study, integrative reviews attempt to find common ideas and concepts from the reviewed material [12] . A similar distinction exists between narrative and systematic reviews: while narrative reviews are qualitative, systematic reviews attempt to test a hypothesis based on the published evidence, which is gathered using a predefined protocol to reduce bias [13] , [14] . When systematic reviews analyse quantitative results in a quantitative way, they become meta-analyses. The choice between different review types will have to be made on a case-by-case basis, depending not just on the nature of the material found and the preferences of the target journal(s), but also on the time available to write the review and the number of coauthors [15] .
Whether your plan is to write a mini- or a full review, it is good advice to keep it focused 16 , 17 . Including material just for the sake of it can easily lead to reviews that are trying to do too many things at once. The need to keep a review focused can be problematic for interdisciplinary reviews, where the aim is to bridge the gap between fields [18] . If you are writing a review on, for example, how epidemiological approaches are used in modelling the spread of ideas, you may be inclined to include material from both parent fields, epidemiology and the study of cultural diffusion. This may be necessary to some extent, but in this case a focused review would only deal in detail with those studies at the interface between epidemiology and the spread of ideas.
While focus is an important feature of a successful review, this requirement has to be balanced with the need to make the review relevant to a broad audience. This square may be circled by discussing the wider implications of the reviewed topic for other disciplines.
Reviewing the literature is not stamp collecting. A good review does not just summarize the literature, but discusses it critically, identifies methodological problems, and points out research gaps [19] . After having read a review of the literature, a reader should have a rough idea of:
It is challenging to achieve a successful review on all these fronts. A solution can be to involve a set of complementary coauthors: some people are excellent at mapping what has been achieved, some others are very good at identifying dark clouds on the horizon, and some have instead a knack at predicting where solutions are going to come from. If your journal club has exactly this sort of team, then you should definitely write a review of the literature! In addition to critical thinking, a literature review needs consistency, for example in the choice of passive vs. active voice and present vs. past tense.
Like a well-baked cake, a good review has a number of telling features: it is worth the reader's time, timely, systematic, well written, focused, and critical. It also needs a good structure. With reviews, the usual subdivision of research papers into introduction, methods, results, and discussion does not work or is rarely used. However, a general introduction of the context and, toward the end, a recapitulation of the main points covered and take-home messages make sense also in the case of reviews. For systematic reviews, there is a trend towards including information about how the literature was searched (database, keywords, time limits) [20] .
How can you organize the flow of the main body of the review so that the reader will be drawn into and guided through it? It is generally helpful to draw a conceptual scheme of the review, e.g., with mind-mapping techniques. Such diagrams can help recognize a logical way to order and link the various sections of a review [21] . This is the case not just at the writing stage, but also for readers if the diagram is included in the review as a figure. A careful selection of diagrams and figures relevant to the reviewed topic can be very helpful to structure the text too [22] .
Reviews of the literature are normally peer-reviewed in the same way as research papers, and rightly so [23] . As a rule, incorporating feedback from reviewers greatly helps improve a review draft. Having read the review with a fresh mind, reviewers may spot inaccuracies, inconsistencies, and ambiguities that had not been noticed by the writers due to rereading the typescript too many times. It is however advisable to reread the draft one more time before submission, as a last-minute correction of typos, leaps, and muddled sentences may enable the reviewers to focus on providing advice on the content rather than the form.
Feedback is vital to writing a good review, and should be sought from a variety of colleagues, so as to obtain a diversity of views on the draft. This may lead in some cases to conflicting views on the merits of the paper, and on how to improve it, but such a situation is better than the absence of feedback. A diversity of feedback perspectives on a literature review can help identify where the consensus view stands in the landscape of the current scientific understanding of an issue [24] .
In many cases, reviewers of the literature will have published studies relevant to the review they are writing. This could create a conflict of interest: how can reviewers report objectively on their own work [25] ? Some scientists may be overly enthusiastic about what they have published, and thus risk giving too much importance to their own findings in the review. However, bias could also occur in the other direction: some scientists may be unduly dismissive of their own achievements, so that they will tend to downplay their contribution (if any) to a field when reviewing it.
In general, a review of the literature should neither be a public relations brochure nor an exercise in competitive self-denial. If a reviewer is up to the job of producing a well-organized and methodical review, which flows well and provides a service to the readership, then it should be possible to be objective in reviewing one's own relevant findings. In reviews written by multiple authors, this may be achieved by assigning the review of the results of a coauthor to different coauthors.
Given the progressive acceleration in the publication of scientific papers, today's reviews of the literature need awareness not just of the overall direction and achievements of a field of inquiry, but also of the latest studies, so as not to become out-of-date before they have been published. Ideally, a literature review should not identify as a major research gap an issue that has just been addressed in a series of papers in press (the same applies, of course, to older, overlooked studies (“sleeping beauties” [26] )). This implies that literature reviewers would do well to keep an eye on electronic lists of papers in press, given that it can take months before these appear in scientific databases. Some reviews declare that they have scanned the literature up to a certain point in time, but given that peer review can be a rather lengthy process, a full search for newly appeared literature at the revision stage may be worthwhile. Assessing the contribution of papers that have just appeared is particularly challenging, because there is little perspective with which to gauge their significance and impact on further research and society.
Inevitably, new papers on the reviewed topic (including independently written literature reviews) will appear from all quarters after the review has been published, so that there may soon be the need for an updated review. But this is the nature of science [27] – [32] . I wish everybody good luck with writing a review of the literature.
Many thanks to M. Barbosa, K. Dehnen-Schmutz, T. Döring, D. Fontaneto, M. Garbelotto, O. Holdenrieder, M. Jeger, D. Lonsdale, A. MacLeod, P. Mills, M. Moslonka-Lefebvre, G. Stancanelli, P. Weisberg, and X. Xu for insights and discussions, and to P. Bourne, T. Matoni, and D. Smith for helpful comments on a previous draft.
Some initial first steps towards a strong literature review are:
We want our literature reviews to be focused, critical, and engaging. Sometimes, it is helpful to review the following questions as a checklist to yourself. If you answer no, you might want to return to your literature review with this in mind.
Organization and Structure
Developed by James O'Neill with assistance from Ronald Levant, Rod Watts, Andrew Smiler, Michael Addis, and Stephen Wester.
It is not expected that reviews will be able to meet all of the above-listed criteria, but authors should meet many of them.
You have full access to this open access article
Engagement in self-regulated learning (SRL) may improve academic achievements and support development of lifelong learning skills. Despite its educational potential, many students find SRL challenging. Educational chatbots have a potential to scaffold or externally regulate SRL processes by interacting with students in an adaptive way. However, to our knowledge, researchers have yet to learn whether and how educational chatbots developed so far have (1) promoted learning processes pertaining to SRL and (2) improved student learning performance in different tasks. To contribute this new knowledge to the field, we conducted a systematic literature review of the studies on educational chatbots that can be linked to processes of SRL. In doing so, we followed the PRISMA guidelines. We collected and reviewed publications published between 2012 and 2023, and identified 27 publications for analysis. We found that educational chatbots so far have mainly supported learners to identify learning resources, enact appropriate learning strategies, and metacognitively monitor their studying. Limited guidance has been provided to students to set learning goals, create learning plans, reflect on their prior studying, and adapt to their future studying. Most of the chatbots in the reviewed corpus of studies appeared to promote productive SRL processes and boost learning performance of students across different domains, confirming the potential of this technology to support SRL. However, in some studies the chatbot interventions showed non-significant and mixed effects. In this paper, we also discuss the findings and provide recommendations for future research.
Avoid common mistakes on your manuscript.
Self-regulated learning (SRL) is considered a complex set of recursive and goal-oriented learning processes (Panadero, 2017 ). Self-regulated learners set their learning goals and actively select, monitor and modify their learning strategies to accomplish these goals and succeed in different learning tasks (Zimmerman, 2013 ; Winne & Hadwin, 1998 ; Winne, 2022 ; Cleary et al., 2022 ). Self-regulated learners are thus in control over their learning processes and learning goals (Winne, 2018 ). As engagement in SRL processes has a potential to improve academic achievements and, more broadly, to support lifelong learning (Cleary & Chen, 2009 ; Klug et al., 2011 ; Recommendation, 2018 ; Theobald, 2021 ), it is critical for students to master their command of SRL and become productive learners in different domains of knowledge.
To advance understanding of SRL and identify the relationships among different learning processes involved, researchers have proposed several SRL theoretical frameworks, such as Winne and Hadwin ( 1998 ); Winne ( 2018 ); Zimmerman ( 2000 ); Pintrich ( 2000 ). Although differences among these theoretical models are noticeable, these models broadly agree that SRL is a cyclic process that involves a repertoire of learning goals and learning strategies (Panadero, 2017 ). For example, according to Zimmerman ( 2000 ), self-regulated learners selectively use specific processes to work on learning tasks, over three cyclical phases: forethought, performance and self-refection. Winne and Hadwin ( 1998 )’s theoretical model describes SRL as a dynamic set of skills where learning unfolds over five facets (conditions, operations, products, evaluations, and standards - COPES) and four phases (defining task requirements, setting goals and devising plans, enacting study tactics, and adapting future studying).
Even though researchers have made a substantial progress over the past several decades towards deeper understanding and more effective support for learning processes involved in SRL, development of SRL skills is still considered challenging for many students (Bjork et al., 2013 ). For example, students struggle to gather appropriate resources for a learning task (List & Du, 2021 ); set relevant, specific and attainable goals to guide their engagement with the task(McCardle et al., 2017 ); select appropriate learning strategies and effectively use them (Azevedo, 2018 ; List & Lin, 2023 ); and accurately monitor and evaluate their own progress (Zimmerman, 2002 ; Gutierrez de Blume, 2022 ; Lim et al., 2023 ). Students often need guidance to successfully enact these learning processes. Educational researchers and practitioners proposed different types of external support to students as they are developing SRL skills (Jivet et al., 2020 , 2021 ; Perez-Alvarez et al., 2022 ). Broadly, the SRL support has so far been provided in a more traditional way, e.g., via a classroom-style coaching on goal setting (McCardle et al., 2017 ; Morisano et al., 2010 ; Alessandri et al., 2020 ) and metacognitive strategies (Cleary et al., 2022 ; Dignath & Veenman, 2021 ), and, more recently, using technology-enhanced learning platforms, e.g., computer-based scaffolding environments that support task orientation, strategy use and metacognitive monitoring (Baker et al., 2020 ; Azevedo et al., 2017 ; Azevedo & Aleven, 2013 ; Pérez et al., 2020 ; Jivet et al., 2020 , 2021 ; Dever et al., 2023 ; Srivastava et al., 2022 ; Lim et al., 2023 ).
In recent years, researchers have become increasingly interested in using chatbots to address educational problems (Wollny et al., 2021 ; Li et al., 2023 ; Dai et al., 2023 ). One of the main reasons for such increased interest is that chatbots have a potential to scaffold or externally regulate learning processes in dynamically changing learning contexts like SRL (Azevedo & Hadwin, 2005 ), because chatbots use artificial intelligence and natural language processing to simulate and adapt to conversation with humans. Following the growing interest in educational chatbots, researchers have recently published several literature reviews on the topic (Winkler & Söllner, 2018 ; Pérez et al., 2020 ; Smutny & Schreiberova, 2020 ). All these reviews have contributed a significant knowledge to this field, providing valuable findings about the currently available educational chatbots across disciplines and the benefits of using chatbot technologies in education to, e.g., supplement teaching or recommend learning content to students. However, to our knowledge, researchers have yet to learn how educational chatbots developed so far have supported processes theorised in SRL. These new findings may add to the current educational research and practice given the documented benefits of SRL skills for academic performance and life-long learning. To contribute new research knowledge to the fields of educational technology and learning sciences, we conducted the present systematic review of the literature explicitly focusing on how educational chatbots have been used to support SRL processes and learning achievements. Our analysis was based on Winne and Hadwin ( 1998 )’s theoretical framework that defined facets and phases of SRL. Our findings may inform future research related to development and implementation of educational chatbots that provide a more comprehensive SRL support to learners.
2.1 srl theoretical framework to guide this systematic review.
Different theoretical frameworks have been proposed to date to define SRL processes and to understand the relationships among them, and, in this way, help researchers to measure and support learners’ engagement in SRL. For an overview of major SRL theoretical frameworks, see Panadero ( 2017 ). To theoretically ground our systematic literature review, we utilized the SRL theoretical model proposed by Winne and Hadwin ( 1998 ). According to this framework, students’ SRL processes unfold over four general phases: task definition, goal setting and planning, enacting study tactics, and adaptation to future studying, and five facets: conditions, operations, products, evaluations and standards. We opted to use this framework because (1) it is one of the six most cited frameworks in the literature, signifying its robustness and widespread acceptance among researchers, and it is particularly welcomed in research involving computer assisted learning (Panadero et al., 2016 ; 2) it provides a comprehensive account of cognitive, metacognitive and motivational processes that interweave in SRL offering a holistic view of the learning process; and (3) the model is distinguished by its detailed depiction of how different phases interact with each other over time as learning unfolds, affording researchers and educators ways to design specific and time-sensitive SRL support to learners (Greene & Azevedo, 2007 ).
The first phase in Winne and Hadwin’s model of SRL is task definition where learners make inferences and develop perceptions about the features of the task, and survey available resources for studying. The next phase is goal setting and planning where learners set their learning goals, devise plans and determine learning strategies which will be used to accomplish goals for learning. In the following phase, students enact their learning strategies and oversee (i.e., metacognitively monitor) the effectiveness of those strategies in addressing the task. For example, learners might highlight key concepts and construct a vocabulary list during a reading task, and, if they deem this strategy to be ineffective, they may decide to modify (i.e., metacognitively control) it, e.g., engage in note-taking instead of highlighting. In the adaptation phase, learners reflect on their studying during the previous stages and make forward-reaching adaptations for similar tasks in the future, e.g., a learner may decide to include note-taking in a repository of preferable learning strategies for the upcoming reading comprehension tasks, as note-taking worked well for the learner in the present task. In this way, learners reach beyond the present task and change their cognitive conditions for future learning (Greene & Azevedo, 2007 ).
Learning activities that unfold over the four general phases of SRL can be characterised relative to five common dimensions, i.e., facets: conditions, operations, products, evaluations and standards (COPES). Conditions encompass different internal and external factors that affect how a learner will engage with a task. For example, internal conditions include the learner’s prior knowledge of a domain, knowledge of learning strategies, experience with a task, and motivation and interest in a task; whereas external conditions include available learning resources, task instructions, scoring rubrics and time constraints. Operations are the processes by which learners manipulate information at hand and, in that way, induce actual learning (Winne, 2022 ). Winne ( 2018 ) defined five fundamental operations including searching, monitoring, assembling, rehearsing and translating (SMART). As learners engage in operations, they create products of learning, e.g., a note, essay draft or program code. Self-regulated learners actively evaluate their learning products against standards , e.g., a scoring rubric or instructional objectives. Upon evaluating their learning products, self-regulated learners may engage in metacognitive control, i.e., they may decide to modify their learning goals and strategies, and revise the products (Greene & Azevedo, 2007 ; Raković et al., 2022a ).
A chatbot is an interactive computer program enhanced by artificial intelligence (AI) and natural language processing (NLP) to simulate conversation with humans through text and voice. Since the development of the earliest chatbot Eliza (Weizenbaum, 1966 ) in 1966, various chatbots have evolved providing interactive interface for users to engage with different services, resources, and data in a natural conversational style (McTear, 2020 ). As well, chatbots have been used as tools to understand and model human behavior (McTear, 2020 ). The use of chatbots has seen a significant increase over the past several years (Zawacki-Richter et al., 2019 ), offering support to users in different contexts, e.g., customer services, online shopping and banking (Illescas-Manzano et al., 2021 ).
Due to its characteristics to dynamically and adaptively interact with users, educational chatbots have been considered a viable option to support learning in different settings (Smutny & Schreiberova, 2020 ), including SRL. For example, as metacognitive processes of monitoring and control are considered central in SRL (Winne, 2022 ), learners need to continuously engage those processes to succeed in a learning task. Many learners, however, struggle to sustain these metacognitive processes throughout a learning session (Azevedo & Aleven, 2013 ), which further prevents them from productively engaging in SRL and performing well in a task. Educational chatbot may provide external regulation to learners by performing a part of metacognitive monitoring instead of students having to conduct these processes by themselves (Molenaar, 2022 ), e.g, a bot may identify two learning strategies that a learner had used previously in the task and ask a learner to compare the effectiveness of these two strategies relative to task requirements. In this way, a chatbot may help the learner preserve cognitive resources for other aspects of the task, e.g., constructing deeper understanding of concepts studied. As well, by providing SRL guidance to students, chatbot may help learners increase their engagement across phases and facets of SRL, which may further benefit their development of SRL skills and boost their academic achievements.
Recent literature reviews (Winkler & Söllner, 2018 ; Pérez et al., 2020 ; Smutny & Schreiberova, 2020 ; Wollny et al., 2021 ) have reported that chatbots have been used for the two main purposes in educational settings, including (1) service support and (2) teaching support. Building on the success of chatbots in the area of customer service, chatbots have been used at many educational institutions to provide service support to students, e.g., support with enrolment, library and campus resources (Sweidan et al., 2021 ; Allison, 2012 ). For example, an interactive bot SIAAA-C (Sweidan et al., 2021 ) is designed to provide students with important campus resources, e.g., campus map and notifications during COVID-19. On the other hand, teaching-oriented chatbots have been commonly used in formal education to supplement traditional teaching in different domains, e.g., languages, math and science. Harnessing their conversational features, those chatbots typically play the role of human tutor and provide learners with content knowledge and practice questions. For instance, Wu et al. ( 2020 ) developed a multi-module chatbot that supported students studying mathematics and Chinese history, whereas Mageira et al. ( 2022 ) and Vázquez-Cano et al. ( 2021 ) created the chatbots to help students learn English and Spanish, respectively, e.g., through prompting and recommending additional learning resources. The literature reviews published so far (Winkler & Söllner, 2018 ; Pérez et al., 2020 ; Smutny & Schreiberova, 2020 ; Wollny et al., 2021 ) identifed different types of educational chatbots and technologies used to implement those bots. These reviews have also revealed the potential of using chatbots to facilitate teaching and learning processes, to recommend learning content and to provide service support to students. While there have been several studies investigating the use of chatbots for SRL, there has been insufficient understanding about the extent to which different aspects of SRL have been supported by chatbots. To address this gap, we conducted a systematic literature review to learn (1) how educational chatbots have provided support for learners’ SRL and (2) how that support has affected learners’ SRL skills and performance. This inquiry is critical because by identifying and synthesizing the ways in which educational chatbots contribute to or hinder SRL, our study could potentially offer valuable insights into the design of more effective educational technologies that are aligned with pedagogical goals. Second, understanding the impact of chatbots on learners’ SRL skills and performance can inform educators and policymakers about the potential benefits and limitations of integrating these technologies into the learning environments. More formally, the following Research Questions guided our systematic review:
RQ1: How have educational chatbots been used to support students’ SRL processes relative to (i) phases and (ii) facets theorised in Winne and Hadwin ( 1998 ) and Winne ( 2018 )?
RQ2: To what extent has the use of educational chatbots improved learners’ SRL processing and learning performance?
We conducted a systematic review of the literature to answer our research questions. To ensure a thorough and transparent systematic literature review process, we carried this review using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) framework as a guideline (Page et al., 2021 ; Moher et al., 2009 ). The systematic literature review involved three major phases (1) search for relevant publications in multiple bibliographical databases, (2) select relevant publications following the PRISMA framework, (3) extract and analyse relevant information in selected publications to answer research questions.
We utilized the SPIDER framework (Cooke et al., 2012 ) to define parameters for the literature search. The SPIDER framework proposes five general groups of search criteria, including sample, phenomenon of interest, design, evaluation and research type. As per our inclusion criteria (detailed in the next section) our Sample (S) involved students studying in formal educational settings at primary, secondary and tertiary levels. The Phenomena of our Interest (PI) were self-regulated learning and educational chatbots. We searched for research studies that have been Designed to empirically evaluate the effects of chatbots on SRL (D) and that have reported outcome measures based on these Evaluations (E). We included qualitative, quantitative and mixed-methods studies (R) in our search.
We used the following search query: (“chatbot” OR “educational chatbot” OR “conversational agent”) AND “self-regulated learning” AND “formal education” AND (“student” OR “learner”) AND “research article” to search for titles, abstracts and keywords of publications in bibliographical databases. We included studies published between 2012 and 2023, inclusively, as we deemed this time range to be sufficient to capture the state-of-the-art in the emerging field of educational chatbots. We searched the following bibliographical databases: Scopus, Elsevier, ACM, IEEE Xplore, Web of Science, ERIC, PsychInfo, Wiley library, Google Scholar, ResearchGate and the library database at our university. The search was conducted in October 2023. At this stage, we retrieved 598 publications. After removing 72 duplicates, 526 publications remained in our dataset for further analysis.
To identify relevant publications for our review we performed two reviewing steps, following the PRISMA guidelines (1) abstract screening and (2) full paper review. In other words, publications selected in the abstract screening step were reviewed in full for their relevance at the full paper review step. For these two reviewing steps, we followed our inclusion and exclusion criteria. Specifically, we included research studies that:
Reported on the use of chatbots in formal educational settings
Reported on the use of chatbots to support students to engage in SRL processing (e.g., goal setting, strategy use, and monitoring)
Described characteristics of educational chatbots (e.g., chatbot architecture and types of utterances exchanged between student and bot)
Reported on the effectiveness of educational chatbots in supporting SRL skills and/or learning outcomes
Were published in peer-reviewed journals and conference proceedings in English between Jan 2012 and Oct 2023
We excluded:
Publications that reported on using chatbots outside of formal educational settings (e.g., school administration and customer service)
Publications from which it could not be clearly inferred what SRL processes have been supported by the chatbot (e.g., studies applying a third-party chatbot as a black box intervention or using a chatbot to conduct a quiz)
Publications that did not provide a clear description of chatbot characteristics
Publications that did not provide the evaluation of chatbot effectiveness
Technical reports, conceptual and design papers
Non-peer reviewed publications and publications without available full-text
At the screening step, two reviewers screened the titles and abstracts of 526 publications, i.e., those publications that remained from the previous phase in this review. Each reviewer had an opportunity to vote “Yes”, “Maybe” or “No” for the study, relative to whether the study should be included in the next stage of the review. The reviewers had the agreement on 456 papers ( 86.7%, Fleiss kappa = 0.734, p <0.001). The remaining 70 conflicts were resolved through discussion between the reviewers. The main reasons for conflicts came from abstracts that did not explicitly state whether the chatbot evaluation was performed in the study. The reviewers agreed to keep such articles in the dataset and fully assess those in the next stage. A total of 101 publications remained in the dataset after this stage.
At the full paper review step, the reviewers randomly selected 15 out of 101 publications (nearly 15%), separately reviewed those and voted whether the paper should be included in the study or not, following the inclusion and exclusion criteria. The reviewers agreed on 12 out of 15 publications (80%, Fleiss kappa = 0.52, p =0.04). The common disagreement between the reviewers at this stage was about whether the study provided a sufficiently clear description of the bot characteristics. This disagreement was resolved through discussion between the reviewers and the decision was made to include in the final review only those publications that described types of utterances exchanged between a student and a bot. The reviewers evenly split the remaining publications in the dataset (i.e., 86 publications were randomly assigned to each reviewer) and reviewed those separately. A total of 27 papers were extracted for the review. We summarized our review process in Fig. 1 (Page et al., 2021 ).
PRISMA flow diagram
Number of publications by year color-coded with chatbot architectures
The first author of this review extracted data from each publication as per following categories: general information (publication title, authors, year, sample size, level of education, domain of education and learning task), chatbot type, SRL facet (conditions, operations, products, evaluations, and standards), SRL phase (task understanding, goal setting and planning, enactment, and adaptation), and reported effects (on SRL processes and learning achievements). To categorise publications into suitable SRL facets and phases, the first author closely followed definitions of constructs provided in Winne and Hadwin ( 1998 ). See the section SRL Theoretical Framework to Guide This Review for details. The analysis of SRL facets and phases in selected publications was used to address RQ1, while the analysis of the reported effects of chatbots on SRL processes and learning achievements was used to address RQ2.
We summarised the studies included in our systematic literature review in Fig. 2 . Out of the 526 studies that we assessed in this review, 27 studies fit the inclusion criteria for full review. Over 92% of these studies were published in 2020 onward, i.e, six in 2020, 11 in 2021, two studies in 2022 and six studies in 2023, whereas only two studies were published before 2020. We observed that 13 studies utilized a natural language processing (NLP)-driven approach in their chatbot design to interpret and respond to user inputs in a conversational manner. On the other hand, 13 studies employed rule-based architectures in their chatbot design, i.e., following predefined pathways or rules to respond to specific commands or keywords, offering predictable and consistent interactions within a structured framework (Fig. 2 ). Additional architectures in the reviewed studies include an NLP-driven architecture with contextual bandit algorithm (Cai et al., 2021 ) and knowledge-based system accessing a vast domain-specific database to deliver accurate information (Chang et al., 2022b ).
Further, the chatbots we reviewed provided SRL support to students in different domains of education, including language learning, math, science, computer programming, accounting and educational psychology, with language learning being slightly more prominent than the other domains (Fig. 3 ). Moreover, the chatbots included in this review have been mainly utilised in higher education, i.e., researchers provided chatbots to university students in 21 studies. Two studies were conducted in primary schools, three studies were conducted in secondary school and one study involved a diverse student population recruited from Amazon Mechanical Turk (Fig. 3 ).
Domain of education supported by chatbot color-coded with participants’ level of education
Of 27 articles included in this review, 15 reported on using chatbots to support student SRL processing in a single SRL phase, 11 articles reported on support across two and 1 article reported on support across three SRL phases. None of the reviewed studies appeared to utilise educational chatbots to provide comprehensive SRL support across all four phases of SRL defined in Winne and Hadwin ( 1998 ). More specifically, in 25 articles researchers used chatbots to facilitate SRL during the strategy enactment phase, i.e., the phase in which students are to select and use learning tactics and strategies. In these studies, chatbots were mainly utilised to guide students to enact learning tactics/strategies to accomplish a particular learning task, such as writing a thesis statement (Lin & Chang, 2020 ) or an essay (Neumann et al., 2021 ), learning a programming language (Ait et al., 2023 ; Tian et al., 2021 ) and developing a project report (Kumar, 2021 ). Six chatbots supported students at the task definition stage, e.g., “Make sure to re-read the question!” (Cai et al., 2021 ). Five chatbots supported students to set goals and devise plans for learning, e.g., by scaffolding students to specify their achievement goals (Hew et al., 2021 , 2023 ) and by guiding goal setting with questions (Du et al., 2021 ; Al-Abdullatif et al., 2023 ). Four chatbots supported students to adapt to their future studying, e.g., by providing students with the opportunity to monitor their learning progress (Harati et al., 2021 ; Oliveira et al., 2021 ) (Fig. 4 ).
Venn diagram showing the number of studies over SRL phases
In all the studies we reviewed authors have reported on using chatbots to promote SRL processes at conditions, operations, and products, the three cognitive facets of SRL. For instance, researchers have used chatbots to promote students’ internal conditions for a task that include activation of domain knowledge (Cai et al., 2021 ; Neumann et al., 2021 ), task interest and motivation (Fryer et al., 2017 , 2020 ; Yin et al., 2021 ), self-efficacy (Chang et al., 2022a ), and outcome expectation (Hew et al., 2021 )). Researchers have also utilised chatbots to support students to leverage external conditions for a task. For example, chatbots recommended learning resources to students (Bailey et al., 2021 ; Chang et al., 2022b ), and guided students to manage their studying time (Harati et al., 2021 ) and to understand task requirements Du et al. ( 2021 ); Mellado-Silva et al. ( 2020 ); Chen et al. ( 2020 )). We also found that in 17 studies chatbots supported students to engage in cognitive operations of assembling. These include integrating and consolidating conceptual knowledge in math (Cai et al., 2021 ), English language learning (Fryer et al., 2017 ; Xia et al., 2023 ), physical sciences (Deveci Topal et al., 2021 ) and accounting (Mellado-Silva et al., 2020 ). Nine chatbots provided support for cognitive operations of translating. These include guiding students to transform knowledge from readings into a written narrative (Bailey et al., 2021 ) and to apply knowledge in a practical project (Kumar, 2021 ). 13 chatbots provided support for metacognitive operations of monitoring. These include guiding students to monitor for domain knowledge acquisition (Harati et al., 2021 ), for learning goals and responses to questions (Hew et al., 2021 ), for learning strategy employment (Song & Kim, 2021 ) and for progress and performance (Cai et al., 2021 ; Neumann et al., 2021 ; Oliveira et al., 2021 ; Zhang et al., 2023a , b ). Five chatbots provided support for searching operations. These include guiding students to search for course materials and learning content (Chang et al., 2022a , b ; Oliveira et al., 2021 ), for specific learning strategies (Du et al., 2021 ) and for learning tools (Jones & Castellano, 2018 ). And one chatbot included support for a cognitive operation of rehearsing by guiding students to formulate acquired knowledge in their own words (Jeon, 2021 ). Next, we found that the most common learning products that students created while studying with chatbots were answers to questions on tests/quizzes (Cai et al., 2021 ; Chang et al., 2022b ; Jeon, 2021 ), and only a few chatbots have supported students to produce essays (Neumann et al., 2021 ), thesis statements (Lin & Chang, 2020 ), project reports (Kumar, 2021 ) and learning goals (Du et al., 2021 ).
Further, 16 chatbots in the corpus we reviewed have appeared to provide support for learning processes theorised to occur at the evaluations facet of SRL. For instance, chatbots utilised in Cai et al. ( 2021 ), Oliveira et al. ( 2021 ), Zhang et al. ( 2023a ) and Lin and Chang ( 2020 ) assisted students to engage in judgment of learning, whereas chatbots in Jones and Castellano ( 2018 ), Hew et al. ( 2021 ), Song and Kim ( 2021 ) and Yin et al. ( 2021 ) promoted student engagement in self-reflection. Last, 14 chatbots provided a guidance to students to better comprehend task standards. Specifically, these chatbots provided students with initial explanations of task requirements and other task features (Bailey et al., 2021 ; Lin & Chang, 2020 ; Jones & Castellano, 2018 ; Chen et al., 2020 ), task-related tips (Tian et al., 2021 ), opportunities for progress check relative to task topics (Harati et al., 2021 ), and questions for goal setting (Du et al., 2021 ; Hew et al., 2023 ). We provide the summary table of the SRL phases and facets supported by the educational chatbots included in this review in the appendix (Figs. 5 , 6 , 7 , 8 , and 9 ).
Among the publications reviewed, we found mixed effects of educational chatbots on students’ SRL processes and learning performance. In terms of promoting SRL processing, researchers have reported that students who studied with chatbots tended to: use more effective learning strategies (Bailey et al., 2021 ; Chang et al., 2022b ; Mellado-Silva et al., 2020 ), increase their awareness of the importance of setting learning goals (Du et al., 2021 ; Hew et al., 2023 ), control the learning process over their study pace (Yin et al., 2021 ; Tian et al., 2021 ), enhance their learning engagement and self-efficacy (Chang et al., 2022a ; Hew et al., 2021 ; Oliveira et al., 2021 ), and transfer some of their SRL skills to a new learning activity (Jones & Castellano, 2018 ). Researchers have also found that students who studied with a chatbot did not sustain well their interest in task, attributed to the novelty effect (Fryer et al., 2017 ), and did not increase their SRL processing (Harati et al., 2021 ). Moreover, the use of chatbot in one of the studies did not appear to statistically significantly boost student internal conditions, i.e., need for cognition, perception of learning, creativity, self-efficacy and motivational beliefs – conditions critical for productive SRL (Kumar, 2021 ). The systematic review also shows that chatbots were used to improve students’ learning performance in tasks spanning different subjects, including English as a second language (Bailey et al., 2021 ), obstetrics (Chang et al., 2022a ), physical education (Chang et al., 2022b ), science (Deveci Topal et al., 2021 ), accounting (Mellado-Silva et al., 2020 ), geography (Jones & Castellano, 2018 ) and educational psychology (Lin & Chang, 2020 ; Kumar, 2021 ). We also note that the use of chatbot had limited effects on learning performance of students working on a chemistry task (Harati et al., 2021 ), and statistically non-significant effects on performance of students working on tasks in math (Cai et al., 2021 ), computer science (Oliveira et al., 2021 ) and geography (Jones & Castellano, 2018 ). We summarised descriptive and inferential statistics on SRL processes and learning performance across the reviewed studies in the appendix (Figs. 5 , 6 , 7 , 8 , and 9 ).
Even though chatbot is not a new technology, our results indicate that the application of chatbots for promoting SRL has only recently attracted attention from educational researchers and practitioners, i.e., over 90% of the papers in the reviewed corpus were published after 2020. Unlike some other educational technologies that have been widely researched as support for student SRL over the past decade – e.g., intelligent tutoring systems (Duffy & Azevedo, 2015 ; Dever et al., 2023 ; Taub et al., 2021 ) and computer-based scaffolding environments (Molenaar et al., 2012 ; Srivastava et al., 2022 ; Lim et al., 2023 ) – the use of chatbots to this purpose appears yet to be more deeply explored.
The two most prominent chatbot architectures in the reviewed corpus were NLP-driven and rule-based chatbots. NLP-driven chatbots utilize NLP and machine learning methods to derive the meaning from user input and understand user intents. Even though the NLP-driven models often require extensive training before they can be applied, chatbots based on this architecture typically offer more robustness in interpreting insufficiently clear and grammatically incorrect student inputs. We found DialogFlow to be a commonly used NLP platform powering NLP-driven chatbots for SRL (Deveci Topal et al., 2021 ; Bailey et al., 2021 ). On the other hand, rule-based chatbots use a set of predefined rules, e.g., a tree-like decision flow, to map student input to appropriate chatbot response. These rules are created after anticipating users’ input and pre-scripted during the bot design. Rule-based chatbot provides better behavior control and may be a particularly applicable architecture for researchers aiming to explicitly map user inputs to SRL processes, e.g., “What should I do first?” can be mapped to goal setting, and, based on that, chatbot may provide a series of prompts to guide a learner to set their goals. In this review, researchers utilised chatbots to support learning in a very diverse set of educational domains (i.e., 15 different domains identified in our corpus) and this finding aligns with findings from the previously conducted literature reviews (Winkler & Söllner, 2018 ; Pérez et al., 2020 ; Smutny & Schreiberova, 2020 ) that also reported that researchers tended to apply educational chatbots in diverse domains. The main reason for this cross-domain popularity of chatbots may be because this technology was designed to adapt to conversation with different users and on different topics.
Educational chatbots for self-regulated learning have mainly supported learners’ processes at one or two phases of the Winne and Hadwin model of SRL. Our findings suggest that the current design and implementation of educational chatbots lack the ability to aid the whole SRL cycle and thus provide students with comprehensive SRL support addressing all the four phases of SRL defined in Winne and Hadwin ( 1998 ) and Winne ( 2018 ). Commonly, almost all of the reviewed chatbots were designed to promote the enactment of learning tactics and strategies that educators deemed to be important for success in different learning tasks. For example, in the writing thesis statement task (Lin & Chang, 2020 ), educators may guide students to strategically engage the following learning activities “identify relevant passage” \(\rightarrow \) “identify claims” \(\rightarrow \) “compose thesis statement” \(\rightarrow \) “evaluate your conceptual understanding” \(\rightarrow \) “revise thesis statement”. The bot was designed to provide guidance to students on these activities, in any order they prefer. For this reason, utterances between learners and chatbots have been often mapped to specific learning tactics to reinforce the learning of students, taking into account required learning activities. In this way, chatbots have served as a potentially effective supplement to traditional classroom teaching, the trend also identified in the previous literature (Pérez et al., 2020 ). This finding ties with another finding from our review showing that chatbots mainly supported operations of rehearsing, assembling and translating, i.e., cognitive operations that are typically contingent upon task conditions (Winne, 1995 ), such as integrate information from several readings in an essay or recap a math formula in a quiz. Together, these findings may suggest that design of SRL chatbots was primarily informed by the nature of specific learning tasks, e.g., persuasive writing, numerical conversion and software programming, and, as such, dependent upon expected sequences of actions that learners should take to address those tasks.
To a lesser extent, chatbots supported students to metacognitively evaluate their immediate and past studying, and to adapt their studying accordingly. For instance, by using interactive and personalised feedback from chatbots the students were afforded the opportunity to engage in judgement of learning (Cai et al., 2021 ; Chang et al., 2022b ; Lin & Chang, 2020 ; Oliveira et al., 2021 ), and evaluate and adapt learning strategies they used during the task. In two of the studies, engagement in metacognitive judgement of learning was reported to be associated with increased student engagement in critical thinking (Chang et al., 2022b ) and writing performance (Lin & Chang, 2020 ), further confirming the potential of educational chatbots to support student metacognition, which is considered to be one of the central processes for productive SRL (Winne, 2018 ). Students’ internal conditions such as motivation, self-efficacy, and interest in a task, are often measured using self-report questionnaires, interviews and self-reflection prompts administered before or after the learning session. Data that dynamically capture student internal conditions as they evolve during the session is rarely collected, making it hard for educational technologies to provide immediate support adaptive to learning conditions. Even though some chatbots we reviewed have demonstrated ability to promote internal conditions, e.g., learning motivation (Yin et al., 2021 ), perception of learning (Neumann et al., 2021 ) and self-efficacy (Chang et al., 2022a ), the capability of educational chatbots to provide responses sensitive to evolving internal conditions remains limited. We also note that many chatbots in the reviewed corpus supported students to search for, gather and access learning resources for their tasks. As chatbots have been traditionally used in dialogue systems for customer service and information acquisition (Serban et al., 2017 ; Winkler & Söllner, 2018 ), we speculate the popularity of this feature in educational chatbots may have been naturally inherited from the field of customer service and adapted to support students as they gather learning content. Moreover, the recent explosion of advanced generative language models that generate sophisticated human-like responses and engage in natural language conversations, such as ChatGPT, has opened up new possibilities to improve educational chatbots from being tools mainly used for information acquisition to a powerful pedagogical tools that can revolutionize how students learn by offering personalized learning experiences and real-time guidance adapted to the student’s learning skills and knowledge of content.
We found that chatbots in the reviewed studies generally promoted increase in productive SRL processes and learning performance of students across different domains, confirming the potential of this technology to support SRL. Non-significant effects were identified in a group of studies and we attribute this finding to several possible reasons. Student motivation and engagement in learning sessions facilitated with chatbot may have dropped as many students may feel isolated in such learning context and may prefer direct support from teachers instead (Zhang et al., 2020 ). This may further lead to challenges in sustaining students’ learning interest in a task, as indicated in one of the reviewed studies (Fryer et al., 2017 ). As the reviewed chatbots have mainly supported university students, it may be expected that many students in this population already possessed a preferred catalogue of learning strategies and that one-time session with chatbot may not be sufficient to help those students alter their approaches to learning. Another reason for non-significant effects may be related to chatbot’s challenges to always provide satisfactory and accurate responses, that clearly target particular learning processes (Deveci Topal et al., 2021 ).
The findings of this systematic literature review indicate the increasing interest of researchers in using educational chatbots to support self-regulated learning. The reviewed studies predominantly employed NLP-driven and rule-based chatbot architectures. Both architectures have shown potential in promoting various processes in SRL, particularly in the enactment of learning strategies and cognitive operations such as assembling, translating, and monitoring. Despite these advancements, the review identifies significant gaps in the comprehensive support of SRL. None of the chatbots have provided SRL support across all the four phases of SRL, as proposed by Winne and Hadwin Winne and Hadwin ( 1998 ). The support often involved guiding students through the steps within specific learning tasks rather than offering a holistic support to student SRL processing. The effects of chatbots on students’ SRL processes and learning performance appeared to be mixed. While many studies reported improvements in the use of learning strategies, student engagement, and self-efficacy, others found limited or non-significant effects on learning performance.
Based on the findings from this systematic literature review, we propose the following areas of investigation towards advancing research on chatbots and SRL.
1. Create chatbots that provide a comprehensive SRL support across all the phases
Our results suggest that, to date, there has been no chatbot designed to provide a comprehensive support across all the four phases of SRL defined in the Winne and Hadwin model. For instance, even though student engagement in goal settings, planning, and adaptation has been widely documented to benefit student learning experiences and performance (Alessandri et al., 2020 ; Raković et al., 2022a ; Rakovic et al., 2022b ), SRL processes at these stages have been rarely supported in the reviewed corpus, which may partially explain small, insignificant and limited effects of several chatbots on student achievements in this review. Within the SRL framework, each phase builds upon the previous one creating a cyclical process that allows students to continuously improve their learning strategies and accomplish their learning goals. Supporting studying in each phase of SRL may provide students with better control over their learning and may lead to greater academic success, increased confidence and motivation in one’s ability to learn.
2. Identify specific learning tasks in which chatbots can provide most effective support
While it is important to apply chatbots in different subject domains, it is equally important to identify specific tasks within those domains where chatbots can be most effective. By doing so, researchers and educators can ensure that chatbots are used in a targeted and effective manner, maximizing the impact of this technology on students’ learning experience. In this way, chatbots may help learners develop a catalogue of task-specific learning skills and transfer these skills to similar tasks in the future.
3. Evaluate the effectiveness of SRL chatbots in longitudinal studies
Most of the educational chatbots in this review have been evaluated in small scale studies, e.g., a one-time intervention administered in one class. Such a lack of longitudinal data might impede researchers from gaining a deeper understanding of the long term benefits of SRL chatbots. Therefore, it may benefit future research in educational technology and learning sciences if researchers conduct a longitudinal study, e.g., a study spanning over one or several semesters, to examine the effects of chatbot on the development of students’ SRL skills over time.
4. Use chatbot to elicit students’ internal conditions
Student internal conditions including prior knowledge, motivation, interest, self-efficacy, achievement goals, utility value and outcome expectations can have a significant impact on how learners approach and engage with the learning process (Meece, 2023 ). However, there are very limited existing efforts in learning analytics focusing on understanding and eliciting internal conditions (Matcha et al., 2019 ). These constructs have been typically measured at the beginning of a learning task. Since SRL is a dynamic and cyclic process (Panadero, 2017 ), student internal conditions may often change during the learning session, also affecting other processes that learners enact. For example, use of effective learning strategies and accomplishment of some learning goals early in a learning session may increase students’ self-efficacy and motivation later in the session, compared to what learners reported at the outset of the session. Given the conversational and interactive nature of chatbots, researchers may consider using this technology as an instrument that dynamically captures changes in internal conditions and helps learners to reflect on their own learning process, e.g., by engaging in dialogues with learners, asking questions that gauge students’ understanding, their learning goals and confidence levels, analyzing the content and frequency of student interactions, providing feedback on their progress, and offering suggestions for improvement.
5. Record and analyse what students did, not only what they say they did
Digital trace-data, e.g., navigation logs, text annotations and keystrokes, that students generate in digital learning environments have been increasingly harnessed to unobtrusively measure SRL (Fan et al., 2022 ; Rakovic et al., 2022b ; Lim et al., 2023 ). For instance, trace-data are often mapped to theorised SRL processes and dynamically analysed (e.g., by using process mining and natural language processing approaches) to obtain a more complete picture of student learning behaviors. To our knowledge, educational chatbots developed to date have mainly gathered information about student learning in two ways (1) via self-reports, e.g., based on what students said to the bot they did, and (2) via student performance data, e.g., correct/incorrect answers on a test. Researchers, however, have identified several challenges related to those methods. For example, students self-reports may often be insufficiently accurate and biased towards student beliefs or social desirability (Winne, 2022 ), whereas performance data often cannot directly inform the intervention (Arizmendi et al., 2022 ). Researchers may consider introducing trace-data as an additional input to SRL chatbots to ensure bots more accurately monitor student SRL processes as they dynamically unfold and, based on that, provide students with a more accurate and timely SRL support.
6. Support students at all educational levels
The chatbots in the reviewed corpus have mainly supported university students. More research is needed to adapt chatbots to cater to the needs of students at other levels of education, e.g., primary and secondary. Students at different levels of education may have different learning needs and preferences (Ambrose et al., 2010 ). By conducting research and adapting chatbots to cater these specific needs from different levels of students, we can ensure that the benefits of educational chatbots are accessible to students of all developmental stages, potentially creating more effective, engaging and inclusive learning environment for them. Also, university students have become more experienced learners and have often formed certain learning habits. This may make it challenging for the educational chatbot to induce some changes to learning. An early intervention at a primary or secondary education level could help in preparing students to better self-regulate their learning at a tertiary education level and throughout life.
7. Improve the effectiveness and accuracy of chatbot responses by harnessing the potential of large language models and generative AI
In our review, a notable limitation of current educational chatbots is their often unsatisfactory responses (Deveci Topal et al., 2021 ), highlighting a gap in understanding users’ intentions and providing relevant support. This indicates that the current chatbots may have limited ability to interpret users’ intentions and provide adequate support, which further may hamper student engagement and motivation. Researchers may utilise the rapidly emerging technologies of generative AI specifically large language models like ChatGPT, that can handle complex language problems, e.g., large language models such as ChatGPT, to enhance the chatbots’ ability to understand learners’ intentions and provide appropriate responses in the context of SRL. In this way, the volume of productive interactions between students and SRL chatbots may improve student learning experiences and interest in studying with a bot, marking a step forward in AI-driven education.
Data sharing not applicable to this article as no datasets were generated or analyzed during the current study. This systematic literature review is based entirely on data from publicly available sources. The analysis synthesizes findings from a wide range of publications, including journal articles and conference papers, all of which are cited in the references section of this paper. These sources can be accessed through academic libraries and online databases. Supplementary materials created during this review, including summary tables (Figs. 5 - 9 ) and figures (Figs. 1 - 4 ), are available upon request.
Ait Baha, T., El Hajji, M., Es-Saady, Y., & Fadili, H. (2023). The impact of educational chatbot on student learning experience. Education and InformationTechnologies , 1–24.
Al-Abdullatif, A. M., Al-Dokhny, A. A., & Drwish, A. M. (2023). Implementing the bashayer chatbot in saudi higher education: Measuring the inuence on students’ motivation and learning strategies. Frontiers in Psychology, 14 , 1129070–1129070.
Article Google Scholar
Alessandri, G., Borgogni, L., Latham, G. P., Cepale, G., Theodorou, A., & De Longis, E. (2020). Self-set goals improve academic performance through nonlinear effects on daily study performance. Learning and Individual Differences, 77 , 101784.
Allison, D. (2012). Chatbots in the library: Is it time? Library Hi tech, 30 (1), 95–107.
Arizmendi, C. J., Bernacki, M. L., Raković, M., Plumley, R. D., Urban, C. J., Panter, A., Greene, J. A., & Gates, K. M. (2022). Predicting student outcomes using digital logs of learning behaviors: Review, current standards, and suggestions for future work. Behavior Research Methods , 1–29.
Ambrose, S. A., Bridges, M. W., DiPietro, M., Lovett, M. C., & Norman, M. K. (2010). How learning works: Seven research-based principles for smart teaching. John Wiley & Sons.
Azevedo, R. (2018). Using hypermedia as a metacognitive tool for enhancing student learning? the role of self-regulated learning. In: Educational psychologist (pp. 199–209). Routledge.
Azevedo, R., & Aleven, V. (2013). Metacognition and learning technologies: An overview of current interdisciplinary research. International Handbook of Metacognition and Learning Technologies , 1–16.
Azevedo, R., & Hadwin, A. F. (2005). Scaffolding self-regulated learning and metacognition - implications for the design of computer-based sca olds. Instructional Science, 33 (5/6), 367–379.
Azevedo, R., Taub, M., Mudrick, N. V., Millar, G. C., Bradbury, A. E., & Price, M. J. (2017). Using Data Visualizations to Foster Emotion Regulation During Self- Regulated Learning with Advanced Learning Technologies. In J. Buder & F. W. Hesse (Eds.), Informational environments : Effects of use, effective designs (pp. 225–247). https://doi.org/10.1007/978-3-319-64274-110
Bailey, D., Southam, A., & Costley, J. (2021). Digital storytelling with chatbots: Mapping l2 participation and perception patterns. Interactive Technology and Smart Education, 18 (1), 85–103.
Baker, R., Xu, D., Park, J., Yu, R., Li, Q., Cung, B., & Smyth, P. (2020). The benefits and caveats of using clickstream data to understand student self-regulatory behaviors: Opening the black box of learning processes. International Journal of Educational Technology in Higher Education, 17 , 1–24.
Bjork, R. A., Dunlosky, J., & Kornell, N. (2013). Self-regulated learning: Beliefs, techniques, and illusions. Annual Review of Psychology, 64 , 417–444.
Cai, W., Grossman, J., Lin, Z. J., Sheng, H., Wei, J.T.-Z., Williams, J. J., & Goel, S. (2021). Bandit algorithms to personalize educational chatbots. Machine Learning, 110 (9), 2389–2418.
Article MathSciNet Google Scholar
Chang, C.-Y., Hwang, G.-J., & Gau, M.-L. (2022). Promoting students’ learning achievement and self-efficacy: A mobile chatbot approach for nursing training. British Journal of Educational Technology, 53 (1), 171–188.
Chang, C.-Y., Kuo, S.-Y., & Hwang, G.-H. (2022). Chatbot-facilitated nursing education. Educational Technology & Society, 25 (1), 15–27.
Google Scholar
Chen, H.-L., Vicki Widarso, G., & Sutrisno, H. (2020). A chatbot for learning chinese: Learning achievement and technology acceptance. Journal of Educational Computing Research, 58 (6), 1161–1189.
Cleary, T. J., & Chen, P. P. (2009). Self-regulation, motivation, and math achievement in middle school: Variations across grade level and math context. Journal of School Psychology, 47 (5), 291–314.
Cleary, T. J., Kitsantas, A., Peters-Burton, E., Lui, A., McLeod, K., Slemp, J., & Zhang, X. (2022). Professional development in self-regulated learning: Shifts and variations in teacher outcomes and approaches to implementation. Teaching and Teacher Education, 111 , 103619.
Cooke, A., Smith, D., & Booth, A. (2012). Beyond pico: The spider tool for qualitative evidence synthesis. Qualitative Health Research, 22 (10), 1435–1443.
Dai, W., Lin, J., Jin, H., Li, T., Tsai, Y. S., Gašević, D., & Chen, G. (2023). Can large language models provide feedback to students? A case study on ChatGPT. In 2023 IEEE International Conference on Advanced Learning Technologies (ICALT) (pp. 323-325). IEEE.
Deveci Topal, A., Dilek Eren, C., & Kolburan Geçer, A. (2021). Chatbot application in a 5th grade science course. Education and Information Technologies, 26 (5), 6241–6265.
Dever, D. A., Sonnenfeld, N. A., Wiedbusch, M. D., Schmorrow, S. G., Amon, M. J., & Azevedo, R. (2023). A complex systems approach to analyzing pedagogical agents’ scaffolding of self-regulated learning within an intelligent tutoring system. Metacognition and Learning , 1–33.
Dignath, C., & Veenman, M. V. (2021). The role of direct strategy instruction and indirect activation of self-regulated learning|evidence from classroom observation studies. Educational Psychology Review, 33 (2), 489–533.
Du, J., Huang, W., & Hew, K. F. (2021). Supporting students goal setting process using chatbot: Implementation in a fully online course. 2021 IEEE International Conference on Engineering, Technology & Education (TALE) , 35–41.
Duffy, M. C., & Azevedo, R. (2015). Motivation matters: Interactions between achievement goals and agent scaffolding for self-regulated learning within an intelligent tutoring system. Computers in Human Behavior, 52 , 338–348.
Fan, Y., Lim, L., van der Graaf, J., Kilgour, J., Raković, M., Moore, J., Molenaar, I., Bannert, M., & Gašević, D. (2022). Improving the measurement of self-regulated learning using multi-channel data. Metacognition and Learning , 1–31.
Fryer, L. K., Ainley, M., Thompson, A., Gibson, A., & Sherlock, Z. (2017). Stimulating and sustaining interest in a language course: An experimental comparison of chatbot and human task partners. Computers in Human Behavior, 75 , 461–468.
Fryer, L. K., Thompson, A., Nakao, K., Howarth, M., & Gallacher, A. (2020). Supporting self-efficacy beliefs and interest as educational inputs and outcomes: Framing ai and human partnered task experiences. Learning and Individual Differences, 80 , 101850.
Greene, J. A., & Azevedo, R. (2007). A theoretical review of winne and hadwin’s model of self-regulated learning: New perspectives and directions. Review of Educational Research, 77 (3), 334–372.
Gutierrez de Blume, A. P. (2022). Calibrating calibration: A meta-analysis of learning strategy instruction interventions to improve metacognitive monitoring accuracy. Journal of Educational Psychology, 114 (4), 681.
Harati, H., Sujo-Montes, L., Tu, C.-H., Armfield, S. J., & Yen, C.-J. (2021). Assessment and learning in knowledge spaces (aleks) adaptive system impact on students’ perception and self-regulated learning skills. Education Sciences, 11 (10), 603.
Hew, K. F., Huang, W., Du, J., & Jia, C. (2021). Using chatbots in ipped learning online sessions: Perceived usefulness and ease of use. International Conference on Blended Learning , 164–175.
Hew, K. F., Huang, W., Du, J., & Jia, C. (2023). Using chatbots to support student goal setting and social presence in fully online activities: Learner engagement and perceptions. Journal of Computing in Higher Education, 35 (1), 40–68.
Illescas-Manzano, M. D., Vicente López, N., Afonso González, N., & Cristofol Rodríguez, C. (2021). Implementation of chatbot in online commerce, and open innovation. Journal of Open Innovation: Technology, Market, and Complexity, 7 (2), 125.
Jeon, J. (2021). Chatbot-assisted dynamic assessment (ca-da) for l2 vocabulary learning and diagnosis. Computer Assisted Language Learning , 1–27.
Jivet, I., Scheffel, M., Schmitz, M., Robbers, S., Specht, M., & Drachsler, H. (2020). From students with love: An empirical study on learner goals, self-regulated learning and sense-making of learning analytics in higher education. The Internet and Higher Education, 47 , 100758.
Jivet, I., Wong, J., Scheffel, M., Valle Torre, M., Specht, M., & Drachsler, H. (2021). Quantum of choice: How learners’ feedback monitoring decisions, goals and self-regulated learning skills are related. LAK21: 11th International Learning Analytics and Knowledge Conference , 416–427.
Jones, A., & Castellano, G. (2018). Adaptive robotic tutors that support self-regulated learning: A longer-term investigation with primary school children. International Journal of Social Robotics, 10 (3), 357–370.
Klug, J., Ogrin, S., Keller, S., Ihringer, A., & Schmitz, B. (2011). A plea for selfregulated learning as a process: Modelling, measuring and intervening.
Kumar, J. A. (2021). Educational chatbots for project-based learning: Investigating learning outcomes for a team-based design course. International Journal of Educational Technology in Higher Education, 18 (1), 1–28.
Li, Y., Sha, L., Yan, L., Lin, J., Raković, M., Galbraith, K., Lyons, K., Gašević, D., & Chen, G. (2023). Can large language models write reflectively. Computers and Education: Artificial Intelligence, 4 , 100140. https://doi.org/10.1016/j.caeai.2023.100140 .
Lim, L., Bannert, M., van der Graaf, J., Singh, S., Fan, Y., Surendrannair, S., Rakovic, M., Molenaar, I., Moore, J., & Gašević, D. (2023). Effects of real-time analytics-based personalized scaffolds on students’ self-regulated learning. Computers in Human Behavior , 107547.
Lin, M.P.-C., & Chang, D. (2020). Enhancing post-secondary writers’ writing skills with a chatbot. Journal of Educational Technology & Society, 23 (1), 78–92.
List, A., & Du, H. (2021). Reasoning beyond history: Examining students’ strategy use when completing a multiple text task addressing a controversial topic in education. Reading and Writing, 34 (4), 1003–1048.
List, A., & Lin, C.-J. (2023). Content and quantity of highlights and annotations predict learning from multiple digital texts. Computers & Education, 199 , 104791.
Mageira, K., Pittou, D., Papasalouros, A., Kotis, K., Zangogianni, P., & Daradoumis, A. (2022). Educational ai chatbots for content and language integrated learning. Applied Sciences, 12 (7), 3239.
Matcha, W., Gašević, D., Pardo, A., et al. (2019). A systematic review of empirical studies on learning analytics dashboards: A self-regulated learning perspective. IEEE Transactions on Learning Technologies, 13 (2), 226–245.
McCardle, L., Webster, E. A., Haffey, A., & Hadwin, A. F. (2017). Examining students’ self-set goals for self-regulated learning: Goal properties and patterns. Studies in Higher Education, 42 (11), 2153–2169.
McTear, M. (2020). Conversational ai: Dialogue systems, conversational agents, and chatbots. Synthesis Lectures on Human Language Technologies, 13 (3), 1–251.
Meece, J. L. (2023). The role of motivation in self-regulated learning. In Self-regulation of learning and performance (pp. 25–44). Routledge.
Mellado-Silva, R., Faúndez-Ugalde, A., & Blanco-Lobos, M. (2020). Effective learning of tax regulations using different chatbot techniques. Advances in Science, Technology and Engineering Systems, 5 (6), 439–446.
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., Altman, D., Antes, G., . . . Berlin, J. A., et al. (2009). Preferred reporting items for systematic reviews and metaanalyses: The prisma statement (chinese edition). Journal of Chinese Integrative Medicine , 7 (9), 889–896.
Molenaar, I. (2022). The concept of hybrid human-ai regulation: Exemplifying how to support young learners’ self-regulated learning. Computers and Education: Artificial Intelligence, 3 , 100070.
Molenaar, I., Roda, C., van Boxtel, C., & Sleegers, P. (2012). Dynamic scaffolding of socially regulated learning in a computer-based learning environment. Computers & Education, 59 (2), 515–523.
Morisano, D., Hirsh, J. B., Peterson, J. B., Pihl, R. O., & Shore, B. M. (2010). Setting, elaborating, and reecting on personal goals improves academic performance. Journal of Applied Psychology, 95 (2), 255.
Neumann, A. T., Arndt, T., Köbis, L., Meissner, R., Martin, A., de Lange, P., & Wollersheim, H.-W. (2021). Chatbots as a tool to scale mentoring processes: Individually supporting self-study in higher education. Frontiers in Artificial Intelligence, 4 , 668220.
Oliveira, E., de Barba, P. G., & Corrin, L. (2021). Enabling adaptive, personalised and context-aware interaction in a smart learning environment: Piloting the icollab system. Australasian Journal of Educational Technology, 37 (2), 1–23.
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Brennan, S. E., et al. (2021). The prisma 2020 statement: An updated guideline for reporting systematic reviews. Systematic Reviews, 10 (1), 1–11.
Panadero, E. (2017). A review of self-regulated learning: Six models and four directions for research. Frontiers in Psychology , 422.
Panadero, E., Klug, J., & Järvelä, S. (2016). Third wave of measurement in the self-regulated learning field: When measurement and intervention come hand in hand. Scandinavian Journal of Educational Research, 60 (6), 723–735.
Pérez, J. Q., Daradoumis, T., & Puig, J. M. M. (2020). Rediscovering the use of chatbots in education: A systematic literature review. Computer Applications in Engineering Education, 28 (6), 1549–1565.
Perez-Alvarez, R., Jivet, I., Pérez-Sanagustin, M., Scheffel, M., & Verbert, K. (2022). Tools designed to support self-regulated learning in online learning environments: A systematic review. IEEE Transactions on Learning Technologies .
Pintrich, P. R. (2000). The role of goal orientation in self-regulated learning. In: Handbook of self-regulation (pp. 451–502). Elsevier.
Raković, M., Bernacki, M. L., Greene, J. A., Plumley, R. D., Hogan, K. A., Gates, K. M., & Panter, A. T. (2022a). Examining the critical role of evaluation and adaptation in self-regulated learning. Contemporary Educational Psychology, 68 , 102027.
Rakovic, M., Fan, Y., Van Der Graaf, J., Singh, S., Kilgour, J., Lim, L., Moore, J., Bannert, M., Molenaar, I., & Gasevic, D. (2022b). Using learner trace data to understand metacognitive processes in writing from multiple sources. LAK22: 12th International Learning Analytics and Knowledge Conference , 130–141.
Recommendation, E. C. (2018). Key competences for lifelong learning. [SPACE] https://doi.org/10.1111/bjep.12173
Serban, I. V., Sankar, C., Germain, M., Zhang, S., Lin, Z., Subramanian, S., . . . Ke, N. R., et al. (2017). A deep reinforcement learning chatbot. arXiv:1709.02349 .
Smutny, P., & Schreiberova, P. (2020). Chatbots for learning: A review of educational chatbots for the facebook messenger. Computers & Education, 151 , 103862.
Song, D., & Kim, D. (2021). Effects of self-regulation scaffolding on online participation and learning outcomes. Journal of Research on Technology in Education, 53 (3), 249–263.
Srivastava, N., Fan, Y., Rakovic, M., Singh, S., Jovanovic, J., Van Der Graaf, J., Lim, L., Surendrannair, S., Kilgour, J., Molenaar, I., et al. (2022). Effects of internal and external conditions on strategies of self-regulated learning: A learning analytics study. LAK22: 12th International Learning Analytics and Knowledge Conference , 392–403.
Sweidan, S. Z., Abu Laban, S. S., Alnaimat, N. A., & Darabkh, K. A. (2021). Siaaa-c: A student interactive assistant android application with chatbot during covid-19 pandemic. Computer Applications in Engineering Education, 29 (6), 1718–1742.
Taub, M., Azevedo, R., Rajendran, R., Cloude, E. B., Biswas, G., & Price, M. J. (2021). How are students’ emotions related to the accuracy of cognitive and metacognitive processes during learning with an intelligent tutoring system? Learning and Instruction, 72 , 101200.
Theobald, M. (2021). Self-regulated learning training programs enhance university students’ academic performance, self-regulated learning strategies, and motivation: A meta-analysis. Contemporary Educational Psychology, 66 , 101976.
Tian, X., Risha, Z., Ahmed, I., Lekshmi Narayanan, A. B., & Biehl, J. (2021). Let’s talk it out: A chatbot for effective study habit behavioral change. Proceedings of the ACM on Human-computer Interaction, 5 (CSCW1), 1–32.
Vázquez-Cano, E., Mengual-Andrés, S., & López-Meneses, E. (2021). Chatbot to improve learning punctuation in spanish and to enhance open and exible learning environments. International Journal of Educational Technology in Higher Education, 18 (1), 1–20.
Weizenbaum, J. (1966). Eliza|a computer program for the study of natural language communication between man and machine. Communications of the ACM, 9 (1), 36–45.
Winkler, R., & Söllner, M. (2018). Unleashing the potential of chatbots in education: A state-of-the-art analysis. Academy of Management Annual Meeting (AOM) .
Winne, P. H. (1995). Inherent details in self-regulated learning. Educational Psychologist, 30 (4), 173–187.
Winne, P. H. (2018). Theorizing and researching levels of processing in self-regulated learning. British Journal of Educational Psychology, 88 (1), 9–20.
Winne, P. H. (2022). Modeling self-regulated learning as learners doing learning science: How trace data and learning analytics help develop skills for self-regulated learning. Metacognition and Learning , 1–19.
Winne, P. H., & Hadwin, A. F. (1998). Studying as self-regulated engagement in learning. in metacognition in educational theory and practice. Metacognition in Educational Theory and Practice , 277–304.
Wollny, S., Schneider, J., Di Mitri, D., Weidlich, J., Rittberger, M., & Drachsler, H. (2021). Are we there yet?-a systematic literature review on chatbots in education. Frontiers in Artificial Intelligence, 4 , 654924.
Wu, E.H.-K., Lin, C.-H., Ou, Y.-Y., Liu, C.-Z., Wang, W.-K., & Chao, C.-Y. (2020). Advantages and constraints of a hybrid model k-12 e-learning assistant chatbot. Ieee Access, 8 , 77788–77801.
Xia, Q., Chiu, T. K. F., Chai, C. S., & Xie, K. (2023). The mediating effects of needs satisfaction on the relationships between prior knowledge and self-regulated learning through artificial intelligence chatbot. British Journal of Educational Technology, 54 (4), 967–986.
Yin, J., Goh, T.-T., Yang, B., & Xiaobin, Y. (2021). Conversation technology with micro-learning: The impact of chatbot-based learning on students’ learning motivation and performance. Journal of Educational Computing Research, 59 (1), 154–177.
Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education- where are the educators? International Journal of Educational Technology in Higher Education, 16 (1), 1–27.
Zhang, J.-H., Zou, L.-C., Miao, J.-J., Zhang, Y.-X., Hwang, G.-J., & Zhu, Y. (2020). An individualized intervention approach to improving university students’ learning performance and interactive behaviors in a blended learning environment. Interactive Learning Environments, 28 (2), 231–245.
Zhang, R., Zou, D., & Cheng, G. (2023a). Chatbot-based learning of logical fallacies in e writing: Perceived effectiveness in improving target knowledge and learner motivation (pp. 1–18). Ahead-of-print(ahead-of-print): Interactive Learning Environments.
Zhang, R., Zou, D., & Cheng, G. (2023b). Chatbot-based training on logical fallacy in efl argumentative writing. Innovation in Language Learning and Teaching, 17 (5), 932–945.
Zimmerman, B. J. (2000). Attaining self-regulation: A social cognitive perspective. In Handbook of self-regulation (pp. 13–39). Elsevier.
Zimmerman, B. J. (2002). Becoming a self-regulated learner: An overview. Theory Into Practice, 41 (2), 64–70.
Zimmerman, B. J. (2013). Theories of self-regulated learning and academic achievement: An overview and analysis. Self-regulated Learning and Academic Achievement , 1–36.
Download references
This work was in part supported by funding from the Australian Research Council (DP220101209, DP240100069) and Jacobs Foundation.
Open Access funding enabled and organized by CAUL and its Member Institutions.
Authors and affiliations.
Centre for Learning Analytics at Monash, Faculty of Information Technology, Monash University, 25 Exhibition walk, Clayton, VIC, 3800, Australia
Rui Guan, Mladen Raković, Guanliang Chen & Dragan Gašević
School of Informatics, University of Edinburgh, Edinburgh, UK
Dragan Gašević
You can also search for this author in PubMed Google Scholar
Rui Guan: Conceptualization, Methodology, Formal analysis, Writing - Original Draft, Data Curation.Mladen Raković: Conceptualization, Methodology, Formal analysis, Writing - Original Draft, Data Curation, Supervision.Guanliang Chen: Conceptualization, Methodology, Writing - Original Draft, Supervision.Dragan Gašević: Conceptualization, Methodology, Writing - Original Draft, Supervision
Correspondence to Mladen Raković .
Competing interest.
The authors have no competing interests to declare that are relevant to the content of this article.
All authors certify that they have no affiliations with or involvement in any organization or entity with any financial interest or non-financial interest in the subject matter or materials discussed in this manuscript.
This systematic review has been conducted in accordance with the principles of academic integrity and honesty. All sources have been properly cited, and no copyrighted material has been used without permission. The review does not involve any original data collection from human or animal subjects, and therefore, ethical approval was not sought.
Summary table of reviewed chatbot articles including supported SRL stages and facets
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .
Reprints and permissions
Guan, R., Raković, M., Chen, G. et al. How educational chatbots support self-regulated learning? A systematic review of the literature. Educ Inf Technol (2024). https://doi.org/10.1007/s10639-024-12881-y
Download citation
Received : 18 March 2024
Accepted : 21 June 2024
Published : 30 August 2024
DOI : https://doi.org/10.1007/s10639-024-12881-y
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative
BMC Health Services Research volume 24 , Article number: 1006 ( 2024 ) Cite this article
1 Altmetric
Metrics details
Stroke is a leading cause of mortality and disability. In higher-income countries, mortality and disability have been reduced with advances in stroke care and early access to rehabilitation services. However, access to such services and the subsequent impact on stroke outcomes in the Philippines, which is a lower- and middle-income countries (LMIC), is unclear. Understanding gaps in service delivery and underpinning research from acute to chronic stages post-stroke will allow future targeting of resources.
This scoping review aimed to map available literature on stroke services in the Philippines, based on Arksey and O’Malley’s five-stage-process.
A targeted strategy was used to search relevant databases (Focused: MEDLINE (ovid), EMBASE (ovid), Cumulative Index to Nursing and Allied Health Literature (CINAHL), PsycINFO (ebsco); broad-based: Scopus; review-based: Cochrane Library, International Prospective Register of Systematic Reviews (PROSPERO), JBI (formerly Joanna Briggs Institute) as well as grey literature (Open Grey, Google scholar). The searches were conducted between 12/2022-01/2023 and repeated 12/2023. Literature describing adults with stroke in the Philippines and stroke services that aimed to maximize well-being, participation and function were searched. Studies were selected if they included one or more of: (a) patient numbers and stroke characteristics (b) staff numbers, qualifications and role (c) service resources (e.g., access to a rehabilitation unit) (d) cost of services and methods of payment) (e) content of stroke care (f) duration of stroke care/rehabilitation and interventions undertaken (g) outcome measures used in clinical practice.
A total of 70 papers were included. Articles were assessed, data extracted and classified according to structure, process, or outcome related information. Advances in stroke services, including stroke ready hospitals providing early access to acute care such as thrombectomy and thrombolysis and early referral to rehabilitation coupled with rehabilitation guidelines have been developed. Gaps exist in stroke services structure (e.g., low number of neurologists and neuroimaging, lack of stroke protocols and pathways, inequity of stroke care across urban and rural locations), processes (e.g., delayed arrival to hospital, lack of stroke training among health workers, low awareness of stroke among public and non-stroke care workers, inequitable access to rehabilitation both hospital and community) and outcomes (e.g., low government insurance coverage resulting in high out-of-pocket expenses, limited data on caregiver burden, absence of unified national stroke registry to determine prevalence, incidence and burden of stroke). Potential solutions such as increasing stroke knowledge and awareness, use of mobile stroke units, TeleMedicine, TeleRehab, improving access to rehabilitation, upgrading PhilHealth and a unified national long-term stroke registry representing the real situation across urban and rural were identified.
This scoping review describes the existing evidence-base relating to structure, processes and outcomes of stroke services for adults within the Philippines. Developments in stroke services have been identified however, a wide gap exists between the availability of stroke services and the high burden of stroke in the Philippines. Strategies are critical to address the identified gaps as a precursor to improving stroke outcomes and reducing burden. Potential solutions identified within the review will require healthcare government and policymakers to focus on stroke awareness programs, primary and secondary stroke prevention, establishing and monitoring of stroke protocols and pathways, sustainable national stroke registry, and improve access to and availability of rehabilitation both hospital and community.
Stroke services in the Philippines are inequitable, for example, urban versus rural due to the geography of the Philippines, location of acute stroke ready hospitals and stroke rehabilitation units, limited transport options, and low government healthcare insurance coverage resulting in high out-of-pocket costs for stroke survivors and their families.
The Philippines have a higher incidence of stroke in younger adults than other LMICs, which impacts the available workforce and the country’s economy. There is a lack of data on community stroke rehabilitation provision, the content and intensity of stroke rehabilitation being delivered and the role and knowledge/skills of those delivering stroke rehabilitation, unmet needs of stroke survivors and caregiver burden and strain,
A wide gap exists between the availability of stroke services and the high burden of stroke. The impact of this is unclear due to the lack of a compulsory national stroke registry as well as published data on community or home-based stroke services that are not captured/published.
This review provides a broad overview of existing evidence-base of stroke services in the Philippines. It provides a catalyst for a) healthcare government to address stroke inequities and burden; b) development of future evidence-based interventions such as community-based rehabilitation; c) task-shifting e.g., training non-neurologists, barangay workers and caregivers; d) use of digital technologies and innovations e.g., stroke TeleRehab, TeleMedicine, mobile stroke units.
Peer Review reports
In the Philippines, stroke is the second leading cause of death, with a prevalence of 0·9% equating to 87,402 deaths per annum [ 1 , 2 ]. Approximately 500,000 Filipinos will be affected by stroke, with an estimated US$350 million to $1·2 billion needed to meet the cost of medical care [ 1 ]. As healthcare is largely private, the cost is borne out-of-pocket by patients and their families. This provides a major obstacle for the lower socio-demographic groups in the country.
Research on implementation of locally and regionally adapted stroke-services and cost-effective secondary prevention programs in the Philippines have been cited as priorities [ 3 , 4 ]. Prior to developing, implementing, and evaluating future context-specific acute stroke management services and community-based models of rehabilitation, it was important to map out the available literature on stroke services and characteristics of stroke in the Philippines.
The scoping review followed a predefined protocol, established methodology [ 5 ] and is reported according to the Preferred Reporting Items for Systematic Review and Meta-Analyses Extension for Scoping Reviews Guidelines (PRISMA-ScR) [ 6 , 7 ]. Healthcare quality will be described according to the following three aspects: structures, processes, and outcomes following the Donabedian model [ 8 , 9 ].The review is based on Arksey and O'Malley’s five stages framework [ 5 ].
Stage 1: The research question:
What stroke services are available for adults within the Philippines? The objective was to systematically scope the literature to describe the availability, structure, processes, and outcome of stroke services for adults within the Philippines.
Stage 2: Identifying relevant studies:
The following databases were searched. Focused: MEDLINE, EMBASE, Cumulative Index to Nursing and Allied Health Literature (CINAHL), PsycINFO; broad-based: Scopus; review-based: Cochrane Library, Prospero, JBI (formerly Joanna Briggs Institute); Grey literature: Herdin, North Grey, Grey matters, MedRxiv, NIHR health technology assessment, Department of Health Philippines, The Kings Fund, Ethos, Carrot2. Additionally, reference lists of full text included studies were searched.
The targeted search strategy, developed in consultation with an information scientist, was adapted for each database (see supplemental data). Search terms were peer reviewed using the PRESS (Peer Review of Electronic Search Strategies) checklist [ 10 ].
The key search concepts from the Population, Concept and Context (PCC) framework were ≥ 18 years with a stroke living in the Philippines ( population ), stroke services aiming to maximize well-being, participation and function following a stroke ( concept ) and stroke services from acute to chronic including those involving healthcare professionals, non-healthcare related personnel or family or friends ( context ). Search tools such as medical subject headings (MESH) and truncation to narrow or expand searches were used. Single and combined search terms were included (see supplemental data). The search was initially conducted over two weeks in December 2022 and re-run in December 2023.
Studies were selected if they described stroke care in the Philippines in terms of one or more of the following: (a) patient numbers and stroke characteristics (b) staff numbers, qualifications and role (c) service resources (e.g., number of beds/access to a rehabilitation unit, equipment used) (d) cost of services and methods of payment (UHC, Insurance, private) (e) content of stroke care (f) duration of stroke care (hours of personnel contact e.g., Therapy hours per day); interventions undertaken (g) outcome measures used in clinical practice.
Additional criteria:
Context: all environments (home, hospital, outpatients, clinic, academic institute).
Date limits: published between 2002 onwards. This is based on the Philippines Community Rehabilitation Guidelines published in 2009 that would suggest that papers earlier than 2002 may not reflect current practice [ 11 ].
Qualitative and quantitative studies including grey literature.
Language: reported in English or Filipino only.
Publication status: no limit because the level of rigor was not assessed.
Type of study: no limit which included conference abstracts, as the level of rigor was not assessed.
Studies were excluded if they were in non-stroke populations or the full text article could not be obtained. Conference abstracts were excluded if there were insufficient data about methods and results.
Searches of databases were performed by one researcher (JM) and searches of grey literature were performed by one researcher (AO). All retrieved articles were uploaded into Endnote X9 software™, and duplicates identified and removed before transferring them to Rayyan [ 12 ] for screening.
Stage 3: study selection
The title and abstract were selected using eligibility criteria. Two pairs of researchers independently screened abstracts and titles;(Databases: JM and AL and grey literature by AO and LF). Where a discrepancy existed for title and abstract screening, the study was automatically included for full text review and discussed among reviewers.
Two reviewers (JM and AL) undertook full-text screening of the selected studies. Discrepancies were resolved through consensus discussions without the need for a third reviewer. There were no discrepancies that required a third reviewer. Reason for exclusion were documented according to pre-determined eligibility criteria. References of included full text articles were screened by each reviewer independently and identified articles were subjected to the same screening process as per the PRISMA-ScR checklist (Fig. 1 ).
PRISMA-ScR flow diagram
Stage 4: Charting the data
Two reviewers independently extracted the data using a piloted customized and standardized data extraction form including (1) Structure: financial (e.g., costs, insurance, government funding), resources (structure and number of stroke facilities, staff (number, profession/specialism, qualifications etc.), stroke characteristics (2) Process: duration of care, content of stroke care within acute, secondary care, community, outcome measures used; (3) Outcome: survival, function, patient satisfaction, cost (admission and interventions), and (4) year of publication, geographical location (including if Philippines only or multiple international locations) and type of evidence (e.g., policy, review, observational, experimental, clinical guidelines). Critical appraisal of included studies was not undertaken because the purpose of the review was to map available evidence on stroke services available within the Philippines.
Stage 5: Collating, summarising and reporting the results
The search identified 351 records from databases and registers. A total of 70 records are included and reasons for non-inclusion are summarized in Fig. 1 .
The characteristics of included studies are shown in Supplementary Material Table 1. Of the 70 included studies, 36 were observational with most being based on a retrospective review of case notes ( n = 31), two were audits, eight were surveys or questionnaires, four were consensus opinion and/or guideline development, three were randomized controlled trial (RCT) or feasibility RCT, 1 was a systematic review, two were policy and guidelines, 11 were narrative reviews or opinion pieces, two were case series or reports and one was an experimental study.
Of the 70 studies, 32 (45.7%) were based in a single tertiary hospital site. There were only three papers based in the community (4.3%). Papers that were opinion pieces or reviews were classified as having a national focus. Of the 22 papers classified as having a national focus, 10 (45.5%) were narrative reviews/ opinion pieces (Table 1 ).
The primary focus of the research studies (excluding the 11 narrative reviews and 2 policy documents) were classified as describing structure ( n = 8, 14%); process ( n = 21,36.8%) or outcomes ( n = 29, 49.2%). The structure of acute care was described in seven studies out of eight studies ( n = 7/8 87.5%) whilst neurosurgery structures were described in one out of eight studies (12.5%). Acute care processes were described in 11 out of 21 studies ( n = 11/21 52.3%) whilst rehabilitation processes were described in six out of 21 studies (28.6%), with three out of 21 studies primarily describing outcome measurement (14.3%). The primary focus of the outcomes were stroke characteristics (25 out of 28 papers, 89.2%) in terms of number of stroke (prevalence), mortality or severity of stroke. Measures of stroke quality of life were not reported. Healthcare professional knowledge was described in two studies ( n = 2/28 7.1%) whilst risk factors for stroke were described in one study ( n = 1/28, 3.6%). Carer burden was described in one study ( n = 1/28, 3.6%).
A summary of the findings is presented in Table 2 .
This scoping review describes the available literature on stroke services within the Philippines across the lifespan of an adult (> 18 years) with a stroke. The review has identified gaps in information about structures, processes and outcomes as well as deficits in provision of stroke services and processes as recommended by WHO. These included a low number of specialist clinicians including neurologists, neuro-radiographers and neurosurgeons. The high prevalence of stroke suggests attention and resources need to focus on primary and secondary prevention. Awareness of stroke is low, especially in terms of what a stroke is, the signs/symptoms and how to minimize risk of stroke [ 25 ]. Barriers exist, such as lack of healthcare resources, maldistribution of health facilities, inadequate training on stroke treatment among health care workers, poor stroke awareness, insufficient government support and limited health insurance coverage [ 22 ].
The scoping review also highlighted areas where further work is needed, for example, descriptions and research into the frequency, intensity, and content of rehabilitation services especially in the community setting and the outcome measures used to monitor recovery and impairment. PARM published stroke rehabilitation clinical practice guidelines in 2012, which incorporated an innovative approach to contextualize Western clinical practice guidelines for stroke care to the Philippines [ 42 ]. Unfortunately, availability and equitable access to evidence-based rehabilitation for people with stroke in the Philippines pose significant challenges because of multiple factors impacting the country (e.g., geographical, social, personal, environmental, educational, economic, workforce) [ 25 , 40 , 43 ].
The number of stroke survivors with disability has not been reported previously, thus, the extent and burden of stroke from acute to chronic is unknown. The recent introduction of a national stroke registry across public and private facilities may provide some of this data [ 82 ]. The project started in 2021 and captures data on people hospitalized for transient ischemic attack or stroke in the Philippines. National stroke registries have been identified as a pragmatic solution to reduce the global burden of stroke [ 83 ] through surveillance of incidence, prevalence, and outcomes (e.g., death, disability) of, and quality of care for, stroke, and prevalence of risk factors. For the Philippine government to know the full impact and burden of stroke nationally, identify areas for improvement and make meaningful changes for the benefit of Filipinos, the registry would need to be compulsory for all public and private facilities and include out of hospital data. This will require information technology, trained workforces for data capture, monitoring and sharing, as well as governance and funding [ 83 ].
This scoping review has generated a better understanding of the published evidence focusing on availability of stroke services in the Philippines, as well as the existing gaps through the lens of Donabedian’s Structure , Process and Outcome framework. The findings have helped to inform a wider investigation of current stroke service utilization conducted using survey and interview methods with stroke survivors, carers and key stakeholders in the Philippines, and drive forward local, regional and national policy and service changes.
This scoping review describes the existing evidence-based relating to structure, processes and outcomes of stroke services for adults within the Philippines. The review revealed limited information in certain areas, such as the impact of stroke on functional ability, participation in everyday life, and quality of life; the content and intensity of rehabilitation both in the hospital or community setting; and the outcome measures used to evaluate clinical practice. Developments in stroke services have been identified however, a wide gap exists between the availability of stroke services and the high burden of stroke in the Philippines. Strategies are critical to address the identified gaps as a precursor to improving stroke outcomes and reducing burden. Potential solutions identified within the review will require a comprehensive approach from healthcare policymakers to focus on stroke awareness programs, primary and secondary prevention, establishing and monitoring of stroke protocols and pathways, implementation of a compulsory national stroke registry, use of TeleRehab, TeleMedicine and mobile stroke units and improve access to and availability of both hospital- and community-based stroke rehabilitation. Furthermore, changes in PhilHealth coverage and universal credit to minimize catastrophic out-of-pocket costs.
Although a comprehensive search was undertaken, data were taken from a limited number of located published studies on stroke in the Philippines. This, together with data from databases and grey literature, may not reflect the current state of stroke services in the country.
Not applicable.
No datasets were generated or analysed during the current study.
Navarro JC, Baroque AC, Lokin JK, Venketasubramanian N. The real stroke burden in the Philippines. Int J Stroke. 2014;9(5):640–1.
Article PubMed Google Scholar
Philippines TSSot. Phillipines: stroke 2024. Available from: https://www.strokesocietyphilippines.org/philippines-stroke/#:~:text=Stroke%20is%20the%20Philippines'%20second,or%2014.12%25%20of%20total%20deaths .
Banaag MS, Dayrit MM, Mendoza RU. Health Inequity in the Philippines. In: Batabyal A, Higano Y, Nijkamp P (eds). Disease, Human Health, and Regional Growth and Development in Asia. New Frontiers in Regional Science: Asian Perspectives, vol 38. Singapore: Springer; 2019.
Hodge A, Firth S, Bermejo R, Zeck W, Jimenez-Soto E. Utilisation of health services and the poor: deconstructing wealth-based differences in facility-based delivering in teh Philippines. BMC Public Health. 2016;16:1–12.
Arksey H, O’Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8:19–32.
Article Google Scholar
Tricco AC, Lillie E, Zarin W, O’Brien KK, Colquhoun H, Levac D, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018;169(7):467–73.
Levac D, Colquhoun H, O’Brien KK. Scoping studies: advancing the methodology. Implement Sci. 2010;5:69.
Article PubMed PubMed Central Google Scholar
Donabedian A. The quality of care. How can it be assessed? JAMA. 1988;260(12):1743–8.
Article CAS PubMed Google Scholar
McDonald KM, Sundaram V, Bravata DM, Lewis R, Lin N, Kraft SA, et al. Closing the quality gap: a critical analysis of quality improvement strategies. Tech Rev. 2007;7(9).
McGowan J, Sampson M, Salzwedel DM, Cogo E, Foerster V, Lefebvre C. PRESS peer review of electronic search strategies: 2015 guideline statement. J Clin Epidemiol. 2016;75:40–6.
McGlade B, Mendoza VE. Philippines CBR manual: an inclusive development strategy. Philippines: CBM-CBR Coordinating office; 2009.
Ouzzani M, Hammady H, Fedorowicz Z, et al. Rayyan—a web and mobile app for systematic reviews. Syst Rev. 2016;5(210). https://doi.org/10.1186/s13643-016-0384-4 .
Baliguas B. Adherence to the clinical practice guidelines of the stroke society of the Philippines in the management of ischemic stroke in young adults admitted in 3 tertiary hospitals in Bacolod City, Philippines from May to October 2010. Neurology. 2018;90(15).
Barcelon EA, Moll MAKDN, Serondo DJ, Collantes MEV. Validation of the Filipino version of national institute of health stroke scale. Clinical Neurology. 2016;56:S379.
Google Scholar
Baticulon RE, Lucena LLN, Gimenez MLA, Sabalza MN, Soriano JA. The Neurosurgical Workforce of the Philippines. Neurosurgery. 2024;94(1):202–11. https://doi.org/10.1227/neu.0000000000002630 .
Berroya RM. Incidence of symptomatic intracerebral hemorrhage after thrombolysis for acute ischemic stroke at St. Luke’s Medical Center-Global City from January 2010 to February 2017. J Neurol Sci. 2010;2017(381):398–9.
Carcel C, Espiritu-Picar R. Circadian variation of ischemic and hemorrhagic strokes in adults at a tertiary hospital: a retrospective study. J Neurol Sci. 2009;285:S174.
Cayco CS, Gorgon EJR, Lazaro RT. Proprioceptive neuromuscular facilitation to improve motor outcomes in older adults with chronic stroke. Neurosciences (Riyadh). 2019;24(1):53–60.
Co COC, Yu JRT, Macrohon-Valdez MC, Laxamana LC, De Guzman VPE, Berroya-Moreno RMM, et al. Acute stroke care algorithm in a private tertiary hospital in the Philippines during the COVID-19 pandemic: a third world country experience. J Stroke Cerebrovasc Dis. 2020;29(9):105059.
Co COC, Yu JRT, Laxamana LC, David-Ona DIA. Intravenous thrombolysis for stroke in a COVID-19 positive Filipino patient, a case report. J Clin Neurosci. 2020;77:234–6.
Article CAS PubMed PubMed Central Google Scholar
Collantes ME. Evaluation of change in stroke care in the Philippines using RES-Q data. Eur Stroke J. 2019;4:318.
Collantes ME. Improving stroke systems of care in lmic: Philippines. Int J Stroke. 2021;16(2):4.
Collantes ME, Navarro J, Belen A, Gan R. Stroke systems of care in the Philippines: addressing gaps and developing strategies. Front Neurol. 2022;13:1046351.
Collantes MEV, Yves Miel H, Zuñiga Uezono DR. Incidence and prevalence of stroke and its risk factors in the Philippines: a systematic review. Acta Medica Philippina. 2022;56:26–34.
Collantes MV, Zuniga YH, Granada CN, Uezono DR, De Castillo LC, Enriquez CG, et al. Current state of stroke care in the Philippines. Front Neurol. 2021;12:665086.
Constantino GA, Soliven JA. Points of in-hospital delays in thrombolytic therapy among patients with acute ischemic stroke: a single center 5-year retrospective study. Neurology. 2020;94(15). https://doi.org/10.1212/WNL.94.15_supplement.2901 .
Constantino GAA, Señga MMA, Soliven JAR, Jocson VED. Emerging Utility of Endovascular Thrombectomy in the Philippines: A Single-center Clinical Experience. Acta Med Philipp [Internet]. 2023;57(5). Available from: https://actamedicaphilippina.upm.edu.ph/index.php/acta/article/view/5113 . [cited 2024 Aug 21].
Dans AL, Punzalan FE, Villaruz MV. National Nutrition and Health Survey (NNHeS): atherosclerosis-related diseases and risk factors. Philipp J Intern Med. 2005;43:103–15.
De Castillo LL, Collantes ME. Thrombolysis for stroke at the Philippine general hospital: a descriptive analysis. Cerebrovasc Dis. 2019;48:54.
de Castillo LLC, Diestro JDB, Tuazon CAM, Sy MCC, Añonuevo JC, San Jose MCZ. J Stroke Cerebrovasc Dis. 2021;30(7):105831.
Delfino JPM, Carandang-Chacon CA. Comparison of acute ischemic stroke care quality before and during the COVID-19 pandemic in a private tertiary hospital in metro Manila, Philippines. Neurol Asia. 2023;28(1):13–7.
Department of Health. Department of Health Administrative Order 2011-0003. 2011. [Accessed online: 12/2022], from the Philippine Department of Health].
Department of Health. The national policy framework on the prevention, control and management of acute stroke in the Philippines. 2020.
Diestro JDB, Omar AT, Sarmiento RJC, Enriquez CAG, Castillo LLC, Ho BL, et al. Cost of hospitalization for stroke in a low-middle-income country: Findings from a public tertiary hospital in the Philippines. Int J Stroke. 2021;16(1):39–42.
Duenas M, Ranoa G, Benjamin VS. Assessment of post-stroke caregivers’ burden through the modified caregivers strain index (MCSI) in a tertiary center in the Philippines: a cross-sectional study. Cerebrovasc Dis. 2019;48:56–7.
Duya JE, Hernandez K, San Jose MC. The evolving clinical and echocardiographic profile of patients admitted for acute cardioembolic stroke at a Tertiary Hospital in the Philippines. J Hong Kong Coll Cardiol. 2019;27(1):58.
Espiritu AI, San Jose MCZ. A call for a stroke referral network between primary care and stroke-ready hospitals in the philippines: a narrative review. Neurologist. 2021;26(6):253–60.
Gambito ED, Gonzalez-Suarez CB, Grimmer KA, Valdecañas CM, Dizon JM, Beredo ME, et al. Updating contextualized clinical practice guidelines on stroke rehabilitation and low back pain management using a novel assessment framework that standardizes decisions. BMC Res Notes. 2015;8:643.
Gelisanga MA, Gorgon EJ. Upright motor control test: interrater reliability, retest reliability, and concurrent validity in adults with subacute stroke. Eur Stroke J. 2017;2(1):357–8.
Gonzalez-Suarez C, Grimmer K, Alipio I, Anota-Canencia EG, Santos-Carpio ML, Dizon JM, et al. Stroke rehabilitation in the Philippines: an audit study. Disabil CBR Inclusive Develop. 2015;26(3):44–67.
Gonzalez-Suarez CB, Grimmer K, Cabrera JTC, Alipio IP, Anota-Canencia EGG, Santos-Carpio MLP, et al. Predictors of medical complications in stroke patients confined in hospitals with rehabilitation facilities: a Filipino audit of practice. Neurology Asia. 2018;23(3):199–208.
Gonzalez-Suarez CB, Grimmer-Somers K, Margarita Dizon J, King E, Lorenzo S, Valdecanas C, et al. Contextualizing Western guidelines for stroke and low back pain to a developing country (Philippines): an innovative approach to putting evidence into practice efficiently. J Healthc Leadersh. 2012;4:141–56.
Gonzalez-Suarez CB, Margarita J, Dizon R, Grimmer K, Estrada MS, Uyehara ED, et al. Implementation of recommendations from the Philippine Academy of Rehabilitation Medicine's Stroke Rehabilitation Guideline: a plan of action. Clin Audit. 2013;5:77–89.
Ignacio KHD, Diestro JDB, Medrano JMM, Salabi SKU, Logronio AJ, Factor SJV, et al. Depression and anxiety after stroke in young adult Filipinos. J Stroke Cerebrovasc Dis. 2022;31(2):106232.
Inting K, Canete MT. Ischemic stroke subtypes: a comparison between causative and phenotypic classifications in a tertiary hospital in the Philippines. Int J Stroke. 2021;16(2):28.
Jaca PKM, Chacon CAC, Alvarez RM. Clinical characteristics of cerebrovascular disease with COVID-19: a single-center study in Manila. Philippines Neurology Asia. 2021;26(1):15–25.
Jamora RDG, Corral EV, Ang MA, Epifania M, Collantes V, Gan R. Stroke recurrence among Filipino patients taking aspirin for first-ever non-cardioembolic ischemic stroke. Neurol Clin Neurosci. 2017;5:1–5.
Jamora RDG, Prado MB Jr, Anlacan VMM, Sy MCC, Espiritu AI. Incidence and risk factors for stroke in patients with COVID-19 in the Philippines: an analysis of 10,881 cases. J Stroke Cerebrovasc Dis. 2022;31(11).
Juangco DN, Mariano GS. Endovascular therapy for acute ischemic stroke: a review of cases and outcomes from a primary stroke center (a 5-year retrospective study). Cerebrovasc Dis. 2016;41:54.
Leochico CFD, Austria EMV, Gelisanga MAP, Ignacio SD, Mojica JAP. Home-based telerehabilitation for community-dwelling persons with stroke during the COVID-19 pandemic: a pilot study. J Rehabil Med. 2023;55:jrm4405.
Loo KW, Gan SH. Burden of stroke in the Philippines. Int J Stroke. 2013;8(2):131–4.
Mansouri A, Ku JC, Khu KJ, Mahmud MR, Sedney C, Ammar A, et al. Exploratory analysis into reasonable timeframes for the provision of neurosurgical care in low- and middle-income countries. World Neurosurg. 2018;117:e679–91.
Mendoza RA. The clinical profile and treatment outcome of acute ischemic stroke patients who underwent thrombolysis with recombinant tissue plasminogen activator therapy, Philippine experience: a retrospective study. J Neurol Sci. 2009;285:S85–6.
Navarro J. Prevalence of stroke: a community survey. Philipp J Neurol. 2005;9(2):11–5.
Navarro JC, Venketasubramanian N. Stroke burden and services in the Philippines. Cerebrovasc Dis Extra. 2021;11(2):52–4.
Navarro JC, Baroque AC 2nd, Lokin JK. Stroke education in the Philippines. Int J Stroke. 2013;8 Suppl A100:114–5.
Navarro JC, Chen CL, Lee CF, Gan HH, Lao AY, Baroque AC, et al. Durability of the beneficial effect of MLC601 (NeuroAiD™) on functional recovery among stroke patients from the Philippines in the CHIMES and CHIMES-E studies. Int J Stroke. 2017;12(3):285–91.
Navarro JC, Escabillas C, Aquino A, Macrohon C, Belen A, Abbariao M, et al. Stroke units in the Philippines: an observational study. Int J Stroke. 2021;16(7):849–54.
Navarro JC, San Jose MC, Collantes E, Macrohon-Valdez MC, Roxas A, Hivadan J, et al. Stroke thrombolysis in the Philippines. Neurol Asia. 2018;23(2):115.
Ng JC, Churojana A, Pongpech S, Vu LD, Sadikin C, Mahadevan J, et al. Current state of acute stroke care in Southeast Asian countries. Interv Neuroradiol. 2019;25(3):291–6.
Ocampo FF, De Leon-Gacrama FRG, Cuanang JR, Navarro JC. Profile of stroke mimics in a tertiary medical center in the Philippines. Neurol Asia. 2021;26(1):35–9.
Pascua R, Hiyadan JH. Outcome of decompressive hemicraniectomy without evacuation of hematoma in supratentorial intracerebral hemorrhage in a tertiary government hospital in the Philippines: a retrospective study. Eur Stroke J. 2023;8(2):586.
Prado M, Jamora RD, Charmaine Sy M, Anlacan M, Espiritu A. Determinants and Outcomes of Cerebrovascular Disease in Patients with COVID19 in the Philippines: An Analysis of 10881 Cases. Neurology. 2022;98(18). https://doi.org/10.1212/WNL.98.18_supplement.2076 .
Qua CV, Tiqui V, Villatima NE, Perales DJ, Rubio SM, Santos ER, et al. A predictive assessment of early neurological deterioration among Filipino acute ischemic stroke patients utilizing hematological, lipid profile, and metabolic parameters in a tertiary hospital in Pampanga. Philippines Cerebrovasc Dis. 2022;51:101.
Que DL, Cuanang J, San Jose MC. Clinical profile, management and outcomes of patients with cerebralvenous thrombosis in atertiary hospital in the Philippines. Int J Stroke. 2020;15(1):511.
Quiles LEP, Diamante PAB, Pascual JLV. Impact of the COVID-19 pandemic in the acute stroke admissions and outcomes in a Philippine Tertiary Hospital. Cerebrovasc Dis Extra. 2022;12(2):76–84.
Roxas AA. The RIFASAF project: a case-control study on risk factors for stroke among Filipinos. Philippine J Neurol. 2002;6(1):1–7.
Roxas AAC, Carabal-Handumon J. Knowledge and perceptions among the barangay health workers in Plaridel, Misamis Occidental. Philipp J Neurol. 2002;6(1):44.
Sasikumar S, Bengzon Diestro JD. Global & community health: acute ischemic stroke in Toronto and Manila: bridging the gap. Neurology. 2020;95(13):604–6.
Senga MM, Reyes JPB. Cerebral venous thrombosis in a single center tertiary hospital of a South East Asian country (CVSTS study)-a retrospective study on the clinical profiles of patients with cerebral venous thrombosis. Neurology. 2019;92(15). https://doi.org/10.1212/WNL.92.15_supplement.P5.3-011 .
Sese LVC, Guillermo MCL. Strengthening stroke prevention and awareness in the Philippines: a conceptual framework. Front Neurol. 2023;14:1258821.
Suwanwela NC, Chen CLH, Lee CF, Young SH, Tay SS, Umapathi T, et al. Effect of combined treatment with MLC601 (NeuroAiDTM) and rehabilitation on post-stroke recovery: the CHIMES and CHIMES-E studies. Cerebrovasc Dis. 2018;46(1–2):82–8.
Talamera AF, Franco DS. Validation study of Siriraj stroke score in Southern Philippines. Cerebrovasc Dis. 2011;32:9.
Tan A, Navarro J. Outcomes and quality of care outcome of patients with primary intracerebral hemorrhage in a single center in the philippines. Int J Stroke. 2014;9:269.
Tangcuangco NC, Bitanga ES, Roxas AA, Pascual JL, Saniel E, Reyes JP, et al. Intravenous recombinant tissue plasminogen activator (IV-rtPA) use in acute ischemic stroke in a private tertiary hospital: a Philippine setting. Int J Stroke. 2010;5:107.
Tsang ACO, Yang IH, Orru E, Nguyen QA, Pamatmat RV, Medhi G, et al. Overview of endovascular thrombectomy accessibility gap for acute ischemic stroke in Asia: a multi-national survey. Int J Stroke. 2020;15(5):516–20.
Vatanagul J, Cantero-Auguis C. Awareness on acute stroke management among family medicine and internal medicine residents in Metro Cebu. Philippines J Neurol Sci. 2015;357:e418–9.
Vatanagul J, Rulona IA. The incidence of post-stroke depression in a tertiary hospital in Cebu City, Philippines. J Neurol Sci. 2015;357:e419.
Vatanagul JAS, Rulona IA, Belonguel NJ. Cerebral venous thrombosis (CVST): study of four Filipino patients and literature review. Cerebrovasc Dis. 2013;36:81.
Venketasubramanian N, Yoon BW, Pandian J, Navarro JC. Stroke epidemiology in south, east, and south-east Asia: a review. J Stroke. 2017;19(3):286–94.
Yu RF, San Jose MC, Manzanilla BM, Oris MY, Gan R. Sources and reasons for delays in the care of acute stroke patients. J Neurol Sci. 2002;199(1–2):49–54.
Philippine Neurological Association One Database - Stroke DsSMG. Multicentre collection of uniform data on patients hospitalised for transient ischaemic attack or stroke in the Philippines: the Philippine Neurological Association One Database-Stroke (PNA1DB-Stroke) protocol. BMJ Open. 2022;12(5):54.
Feigin VL, Owolabi MO, Group WSOLNCSC. Pragmatic solutions to reduce the global burden of stroke: a world stroke organization-lancet neurology commission. Lancet Neurol. 2023;22(12):1160–206.
Download references
We acknowledge the TULAY collaborators: Dr Roy Francis Navea, Dr Myrna Estrada, Dr Elda Grace Anota, Dr Maria Mercedes Barba, Dr June Ann De Vera, Dr Maria Elena Tan, Dr Sarah Buckingham and Professor Fiona Jones. We are grateful to Lance de Jesus and Dr Annah Teves, Research Assistants on the TULAY project, for their contribution to some of the data extraction.
This research was funded by the NIHR Global Health Policy and Systems Research Programme (Award ID: NIHR150244) in association with UK aid from the UK Government to support global health research. The views expressed in this publication are those of the authors and not necessarily those of the NIHR or the UK’s Department of Health and Social Care.
Authors and affiliations.
Faculty of Health, Intercity Place, University of Plymouth, Plymouth, Devon, PL4 6AB, UK
Angela Logan, Bridie Kent, Aira Ong & Jonathan Marsden
Royal Devon University Healthcare NHS Foundation Trust, William Wright House, Barrack Road, Exeter, Devon, EX2 5DW, UK
Angela Logan
De La Salle University-Evelyn D. Ang Institute of Biomedical Engineering and Health Technologies, 2401 Taft Avenue, Malate, Manila, 1004, Philippines
Lorraine Faeldon
The University of Plymouth Centre for Innovations in Health and Social Care: A JBI Centre of Excellence, Faculty of Health, Intercity Place, University of Plymouth, Plymouth, Devon, PL4 6AB, UK
Bridie Kent
You can also search for this author in PubMed Google Scholar
Conceptualisation, methodology and setting search terms, AL, LF, AO, JM, BK. Searches and screening, AL, JM, LF, AO. Data extraction, AL, LF, AO, JM, LdJ, AT. Original draft preparation, AL, JM. All authors provided substantive intellectual and editorial revisions and approved the final manuscript.
Correspondence to Angela Logan .
Ethics approval and consent to participate, consent for publication, competing interests.
The authors declare no competing interests.
Publisher’s note.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary material 1., rights and permissions.
Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/ .
Reprints and permissions
Cite this article.
Logan, A., Faeldon, L., Kent, B. et al. A scoping review of stroke services within the Philippines. BMC Health Serv Res 24 , 1006 (2024). https://doi.org/10.1186/s12913-024-11334-z
Download citation
Received : 20 March 2024
Accepted : 22 July 2024
Published : 30 August 2024
DOI : https://doi.org/10.1186/s12913-024-11334-z
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative
ISSN: 1472-6963
Here’s how you know
Meditation has a history that goes back thousands of years, and many meditative techniques began in Eastern traditions. The term “meditation” refers to a variety of practices that focus on mind and body integration and are used to calm the mind and enhance overall well-being. Some types of meditation involve maintaining mental focus on a particular sensation, such as breathing, a sound, a visual image, or a mantra, which is a repeated word or phrase. Other forms of meditation include the practice of mindfulness, which involves maintaining attention or awareness on the present moment without making judgments.
Programs that teach meditation or mindfulness may combine the practices with other activities. For example, mindfulness-based stress reduction is a program that teaches mindful meditation, but it also includes discussion sessions and other strategies to help people apply what they have learned to stressful experiences. Mindfulness-based cognitive therapy integrates mindfulness practices with aspects of cognitive behavioral therapy.
Meditation and mindfulness practices usually are considered to have few risks. However, few studies have examined these practices for potentially harmful effects, so it isn’t possible to make definite statements about safety.
A 2020 review examined 83 studies (a total of 6,703 participants) and found that 55 of those studies reported negative experiences related to meditation practices. The researchers concluded that about 8 percent of participants had a negative effect from practicing meditation, which is similar to the percentage reported for psychological therapies. The most commonly reported negative effects were anxiety and depression. In an analysis limited to 3 studies (521 participants) of mindfulness-based stress reduction programs, investigators found that the mindfulness practices were not more harmful than receiving no treatment.
According to the National Health Interview Survey, an annual nationally representative survey, the percentage of U.S. adults who practiced meditation more than doubled between 2002 and 2022, from 7.5 to 17.3 percent. Of seven complementary health approaches for which data were collected in the 2022 survey, meditation was the most popular, beating out yoga (used by 15.8 percent of adults), chiropractic care (11.0 percent), massage therapy (10.9 percent), guided imagery/progressive muscle relaxation (6.4 percent), acupuncture (2.2 percent), and naturopathy (1.3 percent).
For children aged 4 to 17 years, data are available for 2017; in that year, 5.4 percent of U.S. children used meditation.
In a 2012 U.S. survey, 1.9 percent of 34,525 adults reported that they had practiced mindfulness meditation in the past 12 months. Among those responders who practiced mindfulness meditation exclusively, 73 percent reported that they meditated for their general wellness and to prevent diseases, and most of them (approximately 92 percent) reported that they meditated to relax or reduce stress. In more than half of the responses, a desire for better sleep was a reason for practicing mindfulness meditation.
Meditation and mindfulness practices may have a variety of health benefits and may help people improve the quality of their lives. Recent studies have investigated if meditation or mindfulness helps people manage anxiety, stress, depression, pain, or symptoms related to withdrawal from nicotine, alcohol, or opioids.
Other studies have looked at the effects of meditation or mindfulness on weight control or sleep quality.
However, much of the research on these topics has been preliminary or not scientifically rigorous. Because the studies examined many different types of meditation and mindfulness practices, and the effects of those practices are hard to measure, results from the studies have been difficult to analyze and may have been interpreted too optimistically.
Few high-quality studies have examined the effects of meditation and mindfulness on blood pressure. According to a 2017 statement from the American Heart Association, the practice of meditation may have a possible benefit, but its specific effects on blood pressure have not been determined.
Studies examining the effects of mindfulness or meditation on acute and chronic pain have produced mixed results.
Mindfulness meditation practices may help reduce insomnia and improve sleep quality.
Several clinical trials have investigated if mindfulness-based approaches such as mindfulness-based relapse prevention (MBRP) might help people recover from substance use disorders. These approaches have been used to help people increase their awareness of the thoughts and feelings that trigger cravings and learn ways to reduce their automatic reactions to those cravings.
Studies have suggested that meditation and mindfulness may help reduce symptoms of post-traumatic stress disorder (PTSD).
Mindfulness-based approaches may improve the mental health of people with cancer.
Studies have suggested possible benefits of meditation and mindfulness programs for losing weight and managing eating behaviors.
Several studies have been done on using meditation and mindfulness practices to improve symptoms of attention-deficit hyperactivity disorder (ADHD). However, the studies have not been of high quality and the results have been mixed, so evidence that meditation or mindfulness approaches will help people manage symptoms of ADHD is not conclusive.
Some research suggests that meditation and mindfulness practices may affect the functioning or structure of the brain. Studies have used various methods of measuring brain activity to look for measurable differences in the brains of people engaged in mindfulness-based practices. Other studies have theorized that training in meditation and mindfulness practices can change brain activity. However, the results of these studies are difficult to interpret, and the practical implications are not clear.
NCCIH supports a variety of meditation and mindfulness studies, including:
Nccih clearinghouse.
The NCCIH Clearinghouse provides information on NCCIH and complementary and integrative health approaches, including publications and searches of Federal databases of scientific and medical literature. The Clearinghouse does not provide medical advice, treatment recommendations, or referrals to practitioners.
Toll-free in the U.S.: 1-888-644-6226
Telecommunications relay service (TRS): 7-1-1
Website: https://www.nccih.nih.gov
Email: [email protected] (link sends email)
NCCIH and the National Institutes of Health (NIH) provide tools to help you understand the basics and terminology of scientific research so you can make well-informed decisions about your health. Know the Science features a variety of materials, including interactive modules, quizzes, and videos, as well as links to informative content from Federal resources designed to help consumers make sense of health information.
Explaining How Research Works (NIH)
Know the Science: How To Make Sense of a Scientific Journal Article
Understanding Clinical Studies (NIH)
A service of the National Library of Medicine, PubMed® contains publication information and (in most cases) brief summaries of articles from scientific and medical journals. For guidance from NCCIH on using PubMed, see How To Find Information About Complementary Health Approaches on PubMed .
Website: https://pubmed.ncbi.nlm.nih.gov/
The National Institutes of Health (NIH) has created a website, NIH Clinical Research Trials and You, to help people learn about clinical trials, why they matter, and how to participate. The site includes questions and answers about clinical trials, guidance on how to find clinical trials through ClinicalTrials.gov and other resources, and stories about the personal experiences of clinical trial participants. Clinical trials are necessary to find better ways to prevent, diagnose, and treat diseases.
Website: https://www.nih.gov/health-information/nih-clinical-research-trials-you
RePORTER is a database of information on federally funded scientific and medical research projects being conducted at research institutions.
Website: https://reporter.nih.gov
Thanks to Elizabeth Ginexi, Ph.D., Erin Burke Quinlan, Ph.D., and David Shurtleff, Ph.D., NCCIH, for their review of this 2022 publication.
This publication is not copyrighted and is in the public domain. Duplication is encouraged.
NCCIH has provided this material for your information. It is not intended to substitute for the medical expertise and advice of your health care provider(s). We encourage you to discuss any decisions about treatment or care with your health care provider. The mention of any product, service, or therapy is not an endorsement by NCCIH.
Related Topics
Pain: Considering Complementary Approaches (eBook)
For Consumers
8 Things to Know About Meditation and Mindfulness
For Health Care Providers
Use of Yoga, Meditation, and Chiropractic by Adults and Children
Mind and Body Approaches for Chronic Pain
Meditation - Systematic Reviews/Reviews/Meta-analyses (PubMed®)
Meditation - Randomized Controlled Trials (PubMed®)
Research Results
National Survey Reveals Increased Use of Yoga, Meditation, and Chiropractic Care Among U.S. Adults
National Survey Reveals Increased Use of Yoga and Meditation Among U.S. Children
Mindfulness-Based Stress Reduction, Cognitive-Behavioral Therapy Shown To Be Cost Effective for Chronic Low-Back Pain
You are accessing a machine-readable page. In order to be human-readable, please install an RSS reader.
All articles published by MDPI are made immediately available worldwide under an open access license. No special permission is required to reuse all or part of the article published by MDPI, including figures and tables. For articles published under an open access Creative Common CC BY license, any part of the article may be reused without permission provided that the original article is clearly cited. For more information, please refer to https://www.mdpi.com/openaccess .
Feature papers represent the most advanced research with significant potential for high impact in the field. A Feature Paper should be a substantial original Article that involves several techniques or approaches, provides an outlook for future research directions and describes possible research applications.
Feature papers are submitted upon individual invitation or recommendation by the scientific editors and must receive positive feedback from the reviewers.
Editor’s Choice articles are based on recommendations by the scientific editors of MDPI journals from around the world. Editors select a small number of articles recently published in the journal that they believe will be particularly interesting to readers, or important in the respective research area. The aim is to provide a snapshot of some of the most exciting work published in the various research areas of the journal.
Original Submission Date Received: .
Find support for a specific problem in the support section of our website.
Please let us know what you think of our products and services.
Visit our dedicated information section to learn more about MDPI.
Drivers and consequences of land degradation on livestock productivity in sub-saharan africa: a systematic literature review.
2. materials and methods, 2.1. study design, 2.2. pertinence and state of the matter studied, 2.3. literature search, 2.4. inclusion and exclusion criteria.
Criteria | Included | Excluded | Justification for Criteria Application |
---|---|---|---|
Language publication | English | All other languages | To increase readability and due to the researchers’ proficiency in the English language |
Country or location of study | Sub-Saharan Africa-related papers | Non-sub-Saharan African papers | To remain within the scope of the systematic review |
Article availability | Fully available paper using University of Fort Hare’s library subscription | Full paper not accessible | Access- related issues |
Date of publication | Any article published before 30 June 2024 | - | Used available papers from selected databases to have a contemporary perspective on drivers and the consequences of land degradation on livestock productivity |
Research focus | Papers that included “drivers and consequences of land degradation in livestock” in general | Research focusing solely on agricultural crops without addressing livestock | To remain within the focused scope of the systematic review |
Type of article | Peer-reviewed research journal articles, conference papers, book chapters, review papers | Gray literature, including reports and theses, unless they provided substantial empirical data | To increase the validity of the study findings |
2.6. data analysis, 3. results and discussion, 3.1. primary drivers of land degradation in sub-saharan rangelands.
Reference | Location | Biophysical Drivers | Socio-Economic Drivers | Methodology | Key Findings |
---|---|---|---|---|---|
[ ] | Botswana | Soil erosion, overgrazing, drought | Poverty, land tenure issues | Field survey, remote sensing | Local people identified drought as the main cause of increasing resource depletion, which impedes vegetation regeneration and induces land degradation. The situation is exacerbated by widespread poverty and inappropriate perceptions of solutions. |
[ ] | Ethiopia | Bush encroachment, drought, water scarcity | Ban on traditional practices, increasing practice of crop cultivation on the rangelands | Survey | All respondents reported a dramatic decline in rangeland conditions, attributing it to past development policies based on equilibrium theories that opposed communal and traditional range management. Issues such as bush encroachment, bans on traditional burning practices, recurrent droughts, and the increasing practice of crop cultivation on rangelands were identified as serious threats to livestock production and traditional resource management. |
[ ] | South Africa | Heavy grazing | - | Remote sensing, statistical analysis | Rainfall and degradation accounted for 38% and 20% of the AVHRR ZNDVI variance and 50% and 33% of the MODIS ZNDVI variance, respectively, indicating that degradation significantly influences long-term vegetation productivity. This challenges the nonequilibrium model, which predicts a negligible long-term grazing impact. |
[ ] | South Africa | Land-use/land-cover change (LULCC), declining livestock, cultivation, renewable energy installations | - | Analysis of large data sets, repeat photographs | More than 95% of the Karoo has remained classified as natural and stable since 1990, with significant declines in cultivation and livestock over the last century. Vegetation productivity trends have remained unchanged over 90% of the biomes, with notable increases in nearly 10%, necessitating continuous monitoring to assess future LULCC impacts. |
[ ] | Ethiopia, Kenya, Malawi | Soil texture, surface slope, rainfall | Market access, human and livestock population densities | High-resolution geospatial data analysis | Conservation agriculture (CA) aims to reduce soil degradation, conserve water, and enhance crop productivity. The study identified potential recommendation domains (RDs) for CA, with 39%, 12%, and 5% of cultivated areas in Malawi, Kenya, and Ethiopia, respectively, showing high potential, highlighting significant areas for CA adoption that are influenced by biophysical and socio-economic conditions. |
[ ] | Ethiopia | Rainfall variability, land degradation, low soil fertility | Market access, human and livestock population densities | Field survey, IDSS tools (SWAT, APEX) | Rainfed agriculture in sub-Saharan Africa faces constraints from rainfall variability, land degradation, and low soil fertility. Small-scale irrigation in Ethiopia’s Robit and Dangishta watersheds shows potential for dry-season vegetable production, but groundwater recharge is insufficient; mulching and soil conservation can optimize irrigation by reducing soil evaporation. |
[ ] | South Africa | Vegetation change | Expansion of human settlements | Survey | The study examined local people’s perceptions of rangeland resources in three communal grasslands, finding that locals view vegetation changes primarily in terms of species richness, diversity, and abundance, unlike ecologists who link them to degradation. Abiotic, biotic, and institutional factors were identified as primary drivers, while human settlement expansion poses a threat by reducing and fragmenting grazing resources. |
[ ] | Namibia | Shrub encroachment, overgrazing | High livestock densities | Dynamic vegetation modeling | High livestock densities lead to shrub encroachment and severe decreases in fodder biomass, causing up to 100% losses in land productivity. Wildlife-based land use with a 40% browser to 60% grazer ratio is beneficial for plant structural and species diversity, enhancing ecosystem sustainability and resilience. |
[ ] | South Africa | Decades of overstocking with small livestock, historical ploughing for fodder, climate change | Reduced land-use options, vulnerability to environmental and economic stressors, costs of restoration | Local-scale participatory restoration trial, assessment of regional-scale restoration costs | Ecological restoration is difficult and expensive; climate change exacerbates challenges; holistic land management actions needed to sustain livelihoods |
[ ] | South Africa | Assumptions of overstocking and degradation, ecological models from large-scale commercial farming | Assumptions that increasing livestock sales and commercial farming improve productivity, belief that communal tenure causes degradation and that privatization is the solution | Examination of current policy, review of ecological and economic assumptions, analysis of the effectiveness of existing models | Current policies based on large-scale commercial farming models are inappropriate for rangeland commons; effective policy should support multiple livelihoods, strengthen common property management, and use diverse ecological and economic models for different contexts |
[ ] | Zimbabwe | Changes in rangeland use and productivity, cropland conversion affecting feed resources | Local knowledge of rangeland resources, role of new institutions for cropland use, changes in common property management | Participatory rural appraisals, household surveys | User communities categorize rangelands by feed resources and changes over time, view rangelands as diverse and dynamic; croplands have become dual-purpose for food security and livestock feed; new institutions govern cropland use while those for common rangelands have weakened, presenting ecological challenges but also opportunities for innovative feed resource management |
[ ] | Namibia | Overgrazing and climate change | Lack of grazing lands and feed followed by water scarcity and recurring droughts | Household surveys, focus group discussions | Respondents in all villages indicated that lack of grazing lands and feed followed by water scarcity and recurring droughts were the primary and secondary constraints of livestock production. Older respondents regarded overgrazing and climate change as the primary cause of rangeland degradation. Hence, the study concludes that communal rangelands are degraded and that degradation has resulted in gradual livestock population declining trends over the past years in communal areas due to feed shortages. |
[ ] | Kenya | Soil nutrient decline, land degradation, low nutrient levels (decline of 1.7 kg P and 5.4 kg K ha half year ), low phosphorus and potassium stocks | Rising population, poverty (all households below the poverty line of 1 USD/day), low farm economic returns, low livestock productivity, and low yields of staple food crops | Soil nutrient monitoring, household surveys | Soil nutrient decline rates are low compared with macro-scale data, but low farm productivity and economic returns threaten sustainability; intercropping systems (maize–beans) improve the nutrient balance and household incomes; the study highlights the need to encourage intercropping and to consider localized sustainability strategies |
References | Study Areas | Health Impacts | Productivity Impacts | Mortality Rates | Methodology | Key Findings |
---|---|---|---|---|---|---|
[ ] | South Africa | Increased disease incidence | Reduced milk and meat yield | Higher calf mortality | Field experiments, veterinary records | Increased land degradation correlates with higher disease incidence and reduced productivity, leading to higher mortality. |
[ ] | Namibia | Poor nutritional status | Decreased weight gain | Increased adult livestock deaths | Longitudinal study, surveys | Poor forage quality from degraded lands leads to poor nutrition, weight loss, and increased mortality. |
[ ] | Botswana | Higher parasite loads | Lower reproductive rates | Elevated young livestock mortality | Cross-sectional study, lab analysis | Land degradation results in higher parasite burdens and lower reproductive success, increasing young livestock deaths. |
[ ] | Kenya | Increased respiratory and digestive issues | Decline in wool and milk production | Higher lamb mortality | Observational study, interviews | Dust and poor vegetation from degraded lands contribute to respiratory and digestive problems, reducing wool and milk production, and increasing lamb mortality. |
[ ] | Ethiopia | Malnutrition and weakened immunity | Lower overall herd productivity | Spike in drought-related deaths | Survey, field observation | Degradation-related malnutrition weakens immunity, reducing herd productivity and increasing mortality during drought periods. |
[ ] | Tanzania | Reduced fertility rates | Lowered birth rates | Increased perinatal mortality | Case study, veterinary reports | Nutrient-deficient forage due to land degradation leads to reduced fertility and higher perinatal mortality, directly impacting herd sustainability. |
[ ] | Zambia | Stress-related health conditions | Decreased milk yield | Higher incidence of miscarriages | Mixed-methods approach | Environmental stress from land degradation contributes to stress-related conditions, reducing milk yield and increasing miscarriage rates among pregnant livestock. |
[ ] | Malawi | Increased susceptibility to zoonotic diseases | Decline in meat quality | Rising deaths during dry season | Field surveys, health monitoring | Land degradation exacerbates exposure to zoonotic diseases, affecting meat quality and increasing death rates during dry seasons due to limited resources. |
[ ] | Zimbabwe | Compromised immune response | Lower weaning weights | Increased mortality during disease outbreaks | Longitudinal health monitoring | Land degradation results in compromised immune responses, leading to lower weaning weights and increased mortality during disease outbreaks, particularly in young livestock. |
References | Study Areas | Impact on Livelihoods | Impact on Food Security | Methodology | Key Findings |
---|---|---|---|---|---|
[ ] | Kenya | Reduced income from livestock sales | Increased food insecurity | Household surveys, economic analysis | Lower livestock productivity directly reduces household income and food security. |
[ ] | Zimbabwe | Increased poverty | Reliance on food aid | Mixed methods, focus groups | Decreased livestock productivity exacerbates poverty, leading to a higher dependence on food aid. |
[ ] | Ethiopia | Migration to urban areas | Nutritional deficiencies | Longitudinal survey, interviews | Reduced livestock yields lead to rural–urban migration and higher rates of nutritional deficiencies. |
[ ] | South Africa | Loss of traditional livelihoods | Decline in dietary diversity | Case studies, participatory rural appraisal | Land degradation and reduced livestock productivity force communities to abandon traditional pastoral livelihoods, leading to a decline in dietary diversity and food security. |
[ ] | Tanzania | Increased vulnerability to economic shocks | Lower access to animal-source foods | Cross-sectional survey, economic modeling | Declining livestock productivity heightens household vulnerability to economic shocks, reducing access to nutritious animal-source foods and worsening food insecurity. |
[ ] | Zambia | Diversification into non-agricultural work | Reduced protein intake | Household surveys, livelihood assessments | As livestock productivity decreases, households diversify into non-agricultural work, leading to reduced protein intake due to the lower availability of animal products. |
References | Study Areas | Intervention | Effectiveness | Methodology | Key Findings |
---|---|---|---|---|---|
[ ] | Zambia | Rotational grazing | High | Controlled experiment, field observations | Rotational grazing significantly improves rangeland health and livestock productivity. |
[ ] | Tanzania | Agroforestry | Moderate | Case studies, participatory research | Agroforestry practices help reduce soil erosion and improve forage quality with moderate success. |
[ ] | Kenya | Soil conservation techniques | High | Field trials, farmer surveys | Soil conservation techniques, including terracing and mulching, show high effectiveness in reducing degradation and improving livestock yields. |
[ ] | Malawi | Integrated livestock–crop systems | Moderate | Mixed methods, longitudinal study | Integrated livestock–crop systems enhance soil fertility and provide supplementary feed, but require careful management to be sustainable. |
[ ] | Zimbabwe | Controlled burning | Low to moderate | Experimental plots, historical data | Controlled burning helps manage bush encroachment and improve grazing conditions, but its effectiveness varies based on the fire frequency and intensity. |
[ ] | Botswana | Water harvesting techniques | High | Case studies, community workshops | Water harvesting techniques, such as small dams and ponds, significantly improve water availability for livestock during dry seasons, boosting productivity. |
[ ] | Ethiopia | Community-based rangeland management | High | Participatory rural appraisal, interviews | Community-based rangeland management fosters collective action in rangeland restoration, leading to improved forage availability and livestock health. |
[ ] | Uganda | Livestock restocking programs | Moderate | Household surveys, program evaluation | Livestock restocking programs help rebuild herds after droughts or disease outbreaks, with moderate success depending on follow-up support and training. |
[ ] | Kenya | Drought-resistant forage species | High | Field trials, laboratory analysis | Introduction of drought-resistant forage species enhances rangeland resilience, ensuring consistent livestock feed during drought periods, leading to sustained productivity. |
[ ] | Tanzania | Pasture improvement programs | Moderate to high | Experimental designs, participatory approaches | Pasture improvement programs, including reseeding and fertilization, show moderate to high effectiveness in increasing biomass and supporting livestock growth. |
[ ] | Eswatini | Livestock health monitoring | High | Veterinary surveys, health records | Regular livestock health monitoring and vaccination programs significantly reduce disease incidence and improve overall herd productivity and survival rates. |
3.6. insights from the co-occurrence network diagram on land degradation, rangelands, and livestock in sub-saharan africa, 4. recommendations for policy makers in charge of these problems and future research directions, 5. potential limitations, 6. conclusions, author contributions, data availability statement, acknowledgments, conflicts of interest.
Click here to enlarge figure
The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
Slayi, M.; Zhou, L.; Dzvene, A.R.; Mpanyaro, Z. Drivers and Consequences of Land Degradation on Livestock Productivity in Sub-Saharan Africa: A Systematic Literature Review. Land 2024 , 13 , 1402. https://doi.org/10.3390/land13091402
Slayi M, Zhou L, Dzvene AR, Mpanyaro Z. Drivers and Consequences of Land Degradation on Livestock Productivity in Sub-Saharan Africa: A Systematic Literature Review. Land . 2024; 13(9):1402. https://doi.org/10.3390/land13091402
Slayi, Mhlangabezi, Leocadia Zhou, Admire Rukudzo Dzvene, and Zolisanani Mpanyaro. 2024. "Drivers and Consequences of Land Degradation on Livestock Productivity in Sub-Saharan Africa: A Systematic Literature Review" Land 13, no. 9: 1402. https://doi.org/10.3390/land13091402
Further information, mdpi initiatives, follow mdpi.
Subscribe to receive issue release notifications and newsletters from MDPI journals
IMAGES
VIDEO
COMMENTS
A literature review is a document or section of a document that collects key sources on a topic and discusses those sources in conversation with each other (also called synthesis ). The lit review is an important genre in many disciplines, not just literature (i.e., the study of works of literature such as novels and plays).
Literature reviews are in great demand in most scientific fields. Their need stems from the ever-increasing output of scientific publications .For example, compared to 1991, in 2008 three, eight, and forty times more papers were indexed in Web of Science on malaria, obesity, and biodiversity, respectively .Given such mountains of papers, scientists cannot be expected to examine in detail every ...
Examples of literature reviews. Step 1 - Search for relevant literature. Step 2 - Evaluate and select sources. Step 3 - Identify themes, debates, and gaps. Step 4 - Outline your literature review's structure. Step 5 - Write your literature review.
1. Outline and identify the purpose of a literature review. As a first step on how to write a literature review, you must know what the research question or topic is and what shape you want your literature review to take. Ensure you understand the research topic inside out, or else seek clarifications.
Literature reviews establish the foundation of academic inquires. However, in the planning field, we lack rigorous systematic reviews. In this article, through a systematic search on the methodology of literature review, we categorize a typology of literature reviews, discuss steps in conducting a systematic literature review, and provide suggestions on how to enhance rigor in literature ...
The best proposals are timely and clearly explain why readers should pay attention to the proposed topic. It is not enough for a review to be a summary of the latest growth in the literature: the ...
A formal literature review is an evidence-based, in-depth analysis of a subject. There are many reasons for writing one and these will influence the length and style of your review, but in essence a literature review is a critical appraisal of the current collective knowledge on a subject. Rather than just being an exhaustive list of all that ...
When writing a literature review it is important to start with a brief introduction, followed by the text broken up into subsections and conclude with a summary to bring everything together. A summary table including title, author, publication date and key findings is a useful feature to present in your review (see Table 1 for an example).
Overview. A Systematic Literature Review (SLR) is a research methodology to collect, identify, and critically analyze the available research studies (e.g., articles, conference proceedings, books, dissertations) through a systematic procedure .An SLR updates the reader with current literature about a subject .The goal is to review critical points of current knowledge on a topic about research ...
Example: Predictors and Outcomes of U.S. Quality Maternity Leave: A Review and Conceptual Framework: 10.1177/08948453211037398 ; Systematic review: "The authors of a systematic review use a specific procedure to search the research literature, select the studies to include in their review, and critically evaluate the studies they find." (p. 139).
tu. e review: Abstract, Body, Concluding Remarks, References;3. Use fo. t. imes New Roman, font size 11 and a line spacing of 1. 5; 4. Total length of document should not exc. ed. 15 pages;5. Typical number of references listed 100-150;6. Submit your review in a fo. mat that can be edited by the reviewer.
A literature review is an integrated analysis-- not just a summary-- of scholarly writings and other relevant evidence related directly to your research question.That is, it represents a synthesis of the evidence that provides background information on your topic and shows a association between the evidence and your research question.
As mentioned previously, there are a number of existing guidelines for literature reviews. Depending on the methodology needed to achieve the purpose of the review, all types can be helpful and appropriate to reach a specific goal (for examples, please see Table 1).These approaches can be qualitative, quantitative, or have a mixed design depending on the phase of the review.
Persuasive. Tell/convey information. Make observations and identify them. Explain and discuss quotes/quoted material. Paraphrase. Build your argument in a way that you think is more convincing. Arrange and present your scholarship so as to be convincing. Use persuasive language ("suggest," "recommend," "argue")
he simplest thing of all—structure. Everything you write has three components: a beginning, a middle and an e. d and each serves a different purpose. In practice, this means your review will have an introduction, a main body where you review the literature an. a conclusion where you tie things up.
GUIDELINES FOR A LITERATURE REVIEW: 1) LENGTH: 8-10 pages of text for Senior Theses (485) (consult with your professor for other classes), with either footnotes or endnotes and with a works-consulted bibliography. ... Your literature review must include enough works to provide evidence of both the breadth and the depth of the research on your ...
A literature review is a compilation of the works published in a particular field of study or line of research, usually over a specific period of time, in the form of an in-depth, critical bibliographic essay or annotated list in which attention is drawn to the most significant works.. Summarizes and analyzes previous research relevant to a topic ...
A diversity of feedback perspectives on a literature review can help identify where the consensus view stands in the landscape of the current scientific understanding of an issue . Rule 9: Include Your Own Relevant Research, but Be Objective ... (2005) Writing integrative literature reviews: guidelines and examples. Human Res Develop Rev 4: 356 ...
Guidelines for writing a systematic review. 1. Introduction. A key feature of any academic activity is to have a sufficient understanding of the subject area under investigation and thus an awareness of previous research. Undertaking a literature review with an analysis of the results on a specific issue is required to demonstrate sufficient ...
A literature review - or a review article - is "a study that analyzes and synthesizes an existing body of literature by identifying, challenging, and advancing the building blocks of a theory through an examination of a body (or several bodies) of prior work (Post et al. 2020, p. 352).Literature reviews as standalone pieces of work may allow researchers to enhance their understanding of ...
We want our literature reviews to be focused, critical, and engaging. Sometimes, it is helpful to review the following questions as a checklist to yourself. If you answer no, you might want to return to your literature review with this in mind. Organization and Structure. Have you organized your literature review?
General considerations. A good review should summarize the state of knowledge on a well-defined topic in the psychology of men and masculinity in concise and clear ways. This means that the review is written with exceptional clarity, cohesiveness, conciseness, and comprehensiveness. A good review should describe in detail the systematic process ...
Keep in mind: •Honing a research question and writing a literature review are recursive processes - reassessing and revising are part of the job. • It would be hard to create a perfect research question without first doing any research or writing: Research and writing themselves help us know what we want to say. • It's normal (and good!) for your research question to
The systematic literature review (SLR) is one of the important review methodologies which is increasingly becoming popular to synthesize literature in any discipline in general and management in particular. In this article, we explain the SLR methodology and provide guidelines for performing and documenting these studies.
GUIDELINES FOR WRITING A LITERATURE REVIEW. PURPOSE: a literature review provides a scholarly context for the argument you propose and support in your paper. It helps readers perceive how your argument fits into past and present scholarly discussion of your subject. Most often, a literature review is formatted to appear as a separate section of ...
We conducted a systematic review of the literature to answer our research questions. To ensure a thorough and transparent systematic literature review process, we carried this review using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) framework as a guideline (Page et al., 2021; Moher et al., 2009).The systematic literature review involved three major phases ...
The scoping review followed a predefined protocol, established methodology [] and is reported according to the Preferred Reporting Items for Systematic Review and Meta-Analyses Extension for Scoping Reviews Guidelines (PRISMA-ScR) [6, 7].Healthcare quality will be described according to the following three aspects: structures, processes, and outcomes following the Donabedian model [8, 9].The ...
A systematic, unbiased literature review, which represents a cornerstone for developing evidence-based guidelines, was carried out by an experienced methodologist using MEDLINE (appendix p 4). Literature published between Jan 1, 2003, and June 1, 2023, was reviewed and critically appraised.
A 2020 review examined 83 studies (a total of 6,703 participants) and found that 55 of those studies reported negative experiences related to meditation practices. ... including publications and searches of Federal databases of scientific and medical literature. The Clearinghouse does not provide medical advice, treatment recommendations, or ...
Land degradation is a major threat to sub-Saharan Africa rangelands, which are crucial for livestock farming and the livelihood of millions of people in the region. This systematic review aims to provide a comprehensive understanding of the causes and effects of land degradation, as well as to evaluate the effectiveness of different mitigation strategies. Following the PRISMA guidelines, we ...