Introduction to Research Methods
6 qualitative research and interviews.
So we’ve described doing a survey and collecting quantitative data. But not all questions can best be answered by a survey. A survey is great for understanding what people think (for example), but not why they think what they do. If your research is intending to understand the underlying motivations or reasons behind peoples actions, or to build a deeper understanding on the background of a subject, an interview may be the more appropriate data collection method.
Interviews are a method of data collection that consist of two or more people exchanging information through a structured process of questions and answers. Questions are designed by the researcher to thoughtfully collect in-depth information on a topic or set of topics as related to the central research question. Interviews typically occur in-person, although good interviews can also be conducted remotely via the phone or video conferencing. Unlike surveys, interviews give the opportunity to ask follow-up questions and thoughtfully engage with participants on the spot (rather than the anonymous and impartial format of survey research).
And surveys can be used in qualitative or quantitative research – though they’re more typically a qualitative technique. In-depth interviews , containing open-ended questions and structured by an interview guide . One can also do a standardized interview with closed-ended questions (i.e. answer options) that are structured by an interview schedule as part of quantitative research. While these are called interviews they’re far closer to surveys, so we wont cover them again in this chapter. The terms used for in-depth interviews we’ll cover in the next section.
6.1 Interviews
In-depth interviews allow participants to describe experiences in their own words (a primary strength of the interview format). Strong in-depth interviews will include many open-ended questions that allow participants to respond in their own words, share new ideas, and lead the conversation in different directions. The purpose of open-ended questions and in-depth interviews is to hear as much as possible in the person’s own voice, to collect new information and ideas, and to achieve a level of depth not possible in surveys or most other forms of data collection.
Typically, an interview guide is used to create a soft structure for the conversation and is an important preparation tool for the researcher. You can not go into an interview unprepared and just “wing it”; what the interview guide allows you to do is map out a framework, order of topics, and may include specific questions to use during the interview. Generally, the interview guide is thought of as just that — a guide to use in order to keep the interview focused. It is not set in stone and a skilled researcher can change the order of questions or topics in an interviews based on the organic conversation flow.
Depending on the experience and skill level of the researcher, an interview guide can be as simple as a list of topics to cover. However, for consistency and quality of research, the interviewer may want to take the time to at least practice writing out questions in advance to ensure that phrasing and word choices are as clear, objective, and focused as possible. It’s worth remembering that working out the wording of questions in advance allows researchers to ensure more consistency across interview. The interview guide below, taken from the wonderful and free textbook Principles of Sociological Inquiry , shows an interview guide that just has topics.
Alternatively, you can use a more detailed guide that lists out possible questions, as shown below. A more detailed guide is probably better for an interviewer that has less experience, or is just beginning to work on a given topic.
The purpose of an interview guide is to help ask effective questions and to support the process of acquiring the best possible data for your research. Topics and questions should be organized thematically, and in a natural progression that will allow the conversation to flow and deepen throughout the course of the interview. Often, researchers will attempt to memorize or partially memorize the interview guide, in order to be more fully present with the participant during the conversation.
6.2 Asking good Questions
Remember, the purposes of interviews is to go more in-depth with an individual than is possible with a generalized survey. For this reason, it is important to use the guide as a starting point but not to be overly tethered to it during the actual interview process. You may get stuck when respondents give you shorter answers than you expect, or don’t provide the type of depth that you need for your research. Often, you may want to probe for more specifics. Think about using follow up questions like “How does/did that affect you?” or “How does X make you feel?” and “Tell me about a time where X…”
For example, if I was researching the relationship between pets and mental health, some strong open-ended questions might be: * How does your pet typically make you feel when you wake up in the morning? * How does your pet generally affect your mood when you arrive home in the evening? * Tell me about a time when your pet had a significant impact on your emotional state.
Questions framed in this manner leave plenty of room for the respondent to answer in their own words, as opposed to leading and/or truncated questions, such as: * Does being with your pet make you happy? * After a bad day, how much does seeing your pet improve your mood? * Tell me about how important your pet is to your mental health.
These questions assume outcomes and will not result in high quality research. Researchers should always avoid asking leading questions that give away an expected answer or suggest particular responses. For instance, if I ask “we need to spend more on public schools, don’t you think?” the respondent is more likely to agree regardless of their own thoughts. Some wont, but humans generally have a strong natural desire to be agreeable. That’s why leaving your questions neutral and open so that respondents can speak to their experiences and views is critical.
6.3 Analyzing Interview Data
Writing good questions and interviewing respondents are just the first steps of the interview process. After these stages, the researcher still has a lot of work to do to collect usable data from the interview. The researcher must spend time coding and analyzing the interview to retrieve this data. Just doing an interview wont produce data. Think about how many conversations you have everyday, and none of those are leaving you swimming in data.
Hopefully you can record your interviews. Recording your interviews will allow you the opportunity to transcribe them word for word later. If you can’t record the interview you’ll need to take detailed notes so that you can reconstruct what you heard later. Do not trust yourself to “just remember” the conversation. You’re collecting data, precious data that you’re spending time and energy to collect. Treat it as important and valuable. Remember our description of the methodology section from Chapter 2, you need to maintain a chain of custody on your data. If you just remembered the interview, you could be accused of making up the results. Your interview notes and the recording become part of that chain of custody to prove to others that your interviews were real and that your results are accurate.
Assuming you recorded your interview, the first step in the analysis process is transcribing the interview. A transcription is a written record of every word in an interview. Transcriptions can either be completed by the researcher or by a hired worker, though it is good practice for the researcher to transcribe the interview him or herself. Researchers should keep the following points in mind regarding transcriptions: * The interview should take place in a quiet location with minimal background noise to produce a clear recording; * Transcribing interviews is a time-consuming process and may take two to three times longer than the actual interview; * Transcriptions provide a more precise record of the interview than hand written notes and allow the interviewer to focus during the interview.
After transcribing the interview, the next step is to analyze the responses. Coding is the main form of analysis used for interviews and involves studying a transcription to identify important themes. These themes are categorized into codes, which are words or phrases that denote an idea.
You’ll typically being with several codes in mind that are generated by key ideas you week seeking in the questions, but you can also being by using open coding to understand the results. An open coding process involves reading through the transcript multiple times and paying close attention to each line of the text to discover noteworthy concepts. During the open coding process, the researcher keeps an open mind to find any codes that may be relevant to the research topic.
After the open coding process is complete, focused coding can begin. Focused coding takes a closer look at the notes compiled during the open coding stage to merge common codes and define what the codes mean in the context of the research project.
Imagine a researcher is conducting interviews to learn about various people’s experiences of childhood in New Orleans. The following example shows several codes that this researcher extrapolated from an interview with one of their subjects.
6.4 Using interview data
The next chapter will address ways to identify people to interview, but most of the remainder of the book will address how to analyze quantitative data. That shouldn’t be taken as a sign that quantitative data is better, or that it’s easier to use interview data. Because in an interview the researcher must interpret the words of others it is often more challenging to identify your findings and clearly answer your research question. However, quantitative data is more common, and there are more different things you can do with it, so we spend a lot of the textbook focusing on it.
I’ll work through one more example of using interview data though. It takes a lot of practice to be a good and skilled interviewer. What I show below is a brief excerpt of an interview I did, and how that data was used in a resulting paper I wrote. These aren’t the only way you can use interview data, but it’s an example of what the intermediary and final product might look like.
The overall project these are drawn from was concerned with minor league baseball stadiums, but the specific part I’m pulling from here was studying the decline and rejuvenation of downtown around those stadiums in several cities. You’ll see that I’m using the words of the respondent fairly directly, because that’s my data. But I’m not just relying on one respondent and trusting them, I did a few dozen interviews in order to understand the commonalities in people’s perspectives to build a narrative around my research question.
Excerpt from Notes
Excerpt from Resulting Paper
How many interviews are necessary? It actually doesn’t take many. What you want to observe in your interviews is theoretical saturation , where the codes you use in the transcript begin to appear across conversations and groups. If different people disagree that’s fine, but what you want to understand is the commonalities across peoples perspectives. Most research on the subject says that with 8 interviews you’ll typically start to see a decline in new information gathered. That doesn’t mean you won’t get new words , but you’ll stop hearing completely unique perspectives or gain novel insights. At that point, where you’ve ‘heard it all before’ you can stop, because you’ve probably identified the answer to the questions you were trying to research.
6.5 Ensuring Anonymity
One significant ethical concern with interviews, that also applies to surveys, is making sure that respondents maintain anonymity. In either form of data collection you may be asking respondents deeply personal questions, that if exposed may cause legal, personal, or professional harm. Notice that in the excerpt of the paper above the respondents are only identified by an id I assigned (Louisville D) and their career, rather than their name. I can only include the excerpt of the interview notes above because there are no details that might lead to them being identified.
You may want to report details about a person to contextualize the data you gathered, but you should always ensure that no one can be identified from your research. For instance, if you were doing research on racism at large companies, you may want to preface people’s comments by their race, as there is a good chance that white and minority employees would feel differently about the issues. However, if you preface someones comments by saying they’re a minority manager, that may violate their anonymity. Even if you don’t state what company you did interviews with, that may be enough detail for their co-workers to identify them if there are few minority managers at the company. As such, always think long and hard about whether there is any way that the participation of respondents may be exposed.
6.6 Why not both?
We’ve discussed surveys and interviews as different methods the last two chapters, but they can also complement each other.
For instance, let’s say you’re curious to study people who change opinions on abortion, either going from support to opposition or vice versa. You could use a survey to understand the prevalence of changing opinions, i.e. what percentage of people in your city have changed their views. That would help to establish whether this is a prominent issue, or whether it’s a rare phenomenon. But it would be difficult to understand from the survey what makes people change their views. You could add an open ended question for anyone that said they changed their opinion, but many people won’t respond and few will provide the level of detail necessary to understand their motivations. Interviews with people that have changed their opinions would give you an opportunity to explore how their experiences and beliefs have changed in combination with their views towards abortion.
6.7 Summary
In the last two chapters we’ve discussed the two most prominent methods of data collection in the social sciences: surveys and interviews. What we haven’t discussed though is how to identify the people you’ll collect data from; that’s called a sampling strategy. In the next chapter
Chapter 1. Introduction
“Science is in danger, and for that reason it is becoming dangerous” -Pierre Bourdieu, Science of Science and Reflexivity
Why an Open Access Textbook on Qualitative Research Methods?
I have been teaching qualitative research methods to both undergraduates and graduate students for many years. Although there are some excellent textbooks out there, they are often costly, and none of them, to my mind, properly introduces qualitative research methods to the beginning student (whether undergraduate or graduate student). In contrast, this open-access textbook is designed as a (free) true introduction to the subject, with helpful, practical pointers on how to conduct research and how to access more advanced instruction.
Textbooks are typically arranged in one of two ways: (1) by technique (each chapter covers one method used in qualitative research); or (2) by process (chapters advance from research design through publication). But both of these approaches are necessary for the beginner student. This textbook will have sections dedicated to the process as well as the techniques of qualitative research. This is a true “comprehensive” book for the beginning student. In addition to covering techniques of data collection and data analysis, it provides a road map of how to get started and how to keep going and where to go for advanced instruction. It covers aspects of research design and research communication as well as methods employed. Along the way, it includes examples from many different disciplines in the social sciences.
The primary goal has been to create a useful, accessible, engaging textbook for use across many disciplines. And, let’s face it. Textbooks can be boring. I hope readers find this to be a little different. I have tried to write in a practical and forthright manner, with many lively examples and references to good and intellectually creative qualitative research. Woven throughout the text are short textual asides (in colored textboxes) by professional (academic) qualitative researchers in various disciplines. These short accounts by practitioners should help inspire students. So, let’s begin!
What is Research?
When we use the word research , what exactly do we mean by that? This is one of those words that everyone thinks they understand, but it is worth beginning this textbook with a short explanation. We use the term to refer to “empirical research,” which is actually a historically specific approach to understanding the world around us. Think about how you know things about the world. [1] You might know your mother loves you because she’s told you she does. Or because that is what “mothers” do by tradition. Or you might know because you’ve looked for evidence that she does, like taking care of you when you are sick or reading to you in bed or working two jobs so you can have the things you need to do OK in life. Maybe it seems churlish to look for evidence; you just take it “on faith” that you are loved.
Only one of the above comes close to what we mean by research. Empirical research is research (investigation) based on evidence. Conclusions can then be drawn from observable data. This observable data can also be “tested” or checked. If the data cannot be tested, that is a good indication that we are not doing research. Note that we can never “prove” conclusively, through observable data, that our mothers love us. We might have some “disconfirming evidence” (that time she didn’t show up to your graduation, for example) that could push you to question an original hypothesis , but no amount of “confirming evidence” will ever allow us to say with 100% certainty, “my mother loves me.” Faith and tradition and authority work differently. Our knowledge can be 100% certain using each of those alternative methods of knowledge, but our certainty in those cases will not be based on facts or evidence.
For many periods of history, those in power have been nervous about “science” because it uses evidence and facts as the primary source of understanding the world, and facts can be at odds with what power or authority or tradition want you to believe. That is why I say that scientific empirical research is a historically specific approach to understand the world. You are in college or university now partly to learn how to engage in this historically specific approach.
In the sixteenth and seventeenth centuries in Europe, there was a newfound respect for empirical research, some of which was seriously challenging to the established church. Using observations and testing them, scientists found that the earth was not at the center of the universe, for example, but rather that it was but one planet of many which circled the sun. [2] For the next two centuries, the science of astronomy, physics, biology, and chemistry emerged and became disciplines taught in universities. All used the scientific method of observation and testing to advance knowledge. Knowledge about people , however, and social institutions, however, was still left to faith, tradition, and authority. Historians and philosophers and poets wrote about the human condition, but none of them used research to do so. [3]
It was not until the nineteenth century that “social science” really emerged, using the scientific method (empirical observation) to understand people and social institutions. New fields of sociology, economics, political science, and anthropology emerged. The first sociologists, people like Auguste Comte and Karl Marx, sought specifically to apply the scientific method of research to understand society, Engels famously claiming that Marx had done for the social world what Darwin did for the natural world, tracings its laws of development. Today we tend to take for granted the naturalness of science here, but it is actually a pretty recent and radical development.
To return to the question, “does your mother love you?” Well, this is actually not really how a researcher would frame the question, as it is too specific to your case. It doesn’t tell us much about the world at large, even if it does tell us something about you and your relationship with your mother. A social science researcher might ask, “do mothers love their children?” Or maybe they would be more interested in how this loving relationship might change over time (e.g., “do mothers love their children more now than they did in the 18th century when so many children died before reaching adulthood?”) or perhaps they might be interested in measuring quality of love across cultures or time periods, or even establishing “what love looks like” using the mother/child relationship as a site of exploration. All of these make good research questions because we can use observable data to answer them.
What is Qualitative Research?
“All we know is how to learn. How to study, how to listen, how to talk, how to tell. If we don’t tell the world, we don’t know the world. We’re lost in it, we die.” -Ursula LeGuin, The Telling
At its simplest, qualitative research is research about the social world that does not use numbers in its analyses. All those who fear statistics can breathe a sigh of relief – there are no mathematical formulae or regression models in this book! But this definition is less about what qualitative research can be and more about what it is not. To be honest, any simple statement will fail to capture the power and depth of qualitative research. One way of contrasting qualitative research to quantitative research is to note that the focus of qualitative research is less about explaining and predicting relationships between variables and more about understanding the social world. To use our mother love example, the question about “what love looks like” is a good question for the qualitative researcher while all questions measuring love or comparing incidences of love (both of which require measurement) are good questions for quantitative researchers. Patton writes,
Qualitative data describe. They take us, as readers, into the time and place of the observation so that we know what it was like to have been there. They capture and communicate someone else’s experience of the world in his or her own words. Qualitative data tell a story. ( Patton 2002:47 )
Qualitative researchers are asking different questions about the world than their quantitative colleagues. Even when researchers are employed in “mixed methods” research ( both quantitative and qualitative), they are using different methods to address different questions of the study. I do a lot of research about first-generation and working-college college students. Where a quantitative researcher might ask, how many first-generation college students graduate from college within four years? Or does first-generation college status predict high student debt loads? A qualitative researcher might ask, how does the college experience differ for first-generation college students? What is it like to carry a lot of debt, and how does this impact the ability to complete college on time? Both sets of questions are important, but they can only be answered using specific tools tailored to those questions. For the former, you need large numbers to make adequate comparisons. For the latter, you need to talk to people, find out what they are thinking and feeling, and try to inhabit their shoes for a little while so you can make sense of their experiences and beliefs.
Examples of Qualitative Research
You have probably seen examples of qualitative research before, but you might not have paid particular attention to how they were produced or realized that the accounts you were reading were the result of hours, months, even years of research “in the field.” A good qualitative researcher will present the product of their hours of work in such a way that it seems natural, even obvious, to the reader. Because we are trying to convey what it is like answers, qualitative research is often presented as stories – stories about how people live their lives, go to work, raise their children, interact with one another. In some ways, this can seem like reading particularly insightful novels. But, unlike novels, there are very specific rules and guidelines that qualitative researchers follow to ensure that the “story” they are telling is accurate , a truthful rendition of what life is like for the people being studied. Most of this textbook will be spent conveying those rules and guidelines. Let’s take a look, first, however, at three examples of what the end product looks like. I have chosen these three examples to showcase very different approaches to qualitative research, and I will return to these five examples throughout the book. They were all published as whole books (not chapters or articles), and they are worth the long read, if you have the time. I will also provide some information on how these books came to be and the length of time it takes to get them into book version. It is important you know about this process, and the rest of this textbook will help explain why it takes so long to conduct good qualitative research!
Example 1 : The End Game (ethnography + interviews)
Corey Abramson is a sociologist who teaches at the University of Arizona. In 2015 he published The End Game: How Inequality Shapes our Final Years ( 2015 ). This book was based on the research he did for his dissertation at the University of California-Berkeley in 2012. Actually, the dissertation was completed in 2012 but the work that was produced that took several years. The dissertation was entitled, “This is How We Live, This is How We Die: Social Stratification, Aging, and Health in Urban America” ( 2012 ). You can see how the book version, which was written for a more general audience, has a more engaging sound to it, but that the dissertation version, which is what academic faculty read and evaluate, has a more descriptive title. You can read the title and know that this is a study about aging and health and that the focus is going to be inequality and that the context (place) is going to be “urban America.” It’s a study about “how” people do something – in this case, how they deal with aging and death. This is the very first sentence of the dissertation, “From our first breath in the hospital to the day we die, we live in a society characterized by unequal opportunities for maintaining health and taking care of ourselves when ill. These disparities reflect persistent racial, socio-economic, and gender-based inequalities and contribute to their persistence over time” ( 1 ). What follows is a truthful account of how that is so.
Cory Abramson spent three years conducting his research in four different urban neighborhoods. We call the type of research he conducted “comparative ethnographic” because he designed his study to compare groups of seniors as they went about their everyday business. It’s comparative because he is comparing different groups (based on race, class, gender) and ethnographic because he is studying the culture/way of life of a group. [4] He had an educated guess, rooted in what previous research had shown and what social theory would suggest, that people’s experiences of aging differ by race, class, and gender. So, he set up a research design that would allow him to observe differences. He chose two primarily middle-class (one was racially diverse and the other was predominantly White) and two primarily poor neighborhoods (one was racially diverse and the other was predominantly African American). He hung out in senior centers and other places seniors congregated, watched them as they took the bus to get prescriptions filled, sat in doctor’s offices with them, and listened to their conversations with each other. He also conducted more formal conversations, what we call in-depth interviews, with sixty seniors from each of the four neighborhoods. As with a lot of fieldwork , as he got closer to the people involved, he both expanded and deepened his reach –
By the end of the project, I expanded my pool of general observations to include various settings frequented by seniors: apartment building common rooms, doctors’ offices, emergency rooms, pharmacies, senior centers, bars, parks, corner stores, shopping centers, pool halls, hair salons, coffee shops, and discount stores. Over the course of the three years of fieldwork, I observed hundreds of elders, and developed close relationships with a number of them. ( 2012:10 )
When Abramson rewrote the dissertation for a general audience and published his book in 2015, it got a lot of attention. It is a beautifully written book and it provided insight into a common human experience that we surprisingly know very little about. It won the Outstanding Publication Award by the American Sociological Association Section on Aging and the Life Course and was featured in the New York Times . The book was about aging, and specifically how inequality shapes the aging process, but it was also about much more than that. It helped show how inequality affects people’s everyday lives. For example, by observing the difficulties the poor had in setting up appointments and getting to them using public transportation and then being made to wait to see a doctor, sometimes in standing-room-only situations, when they are unwell, and then being treated dismissively by hospital staff, Abramson allowed readers to feel the material reality of being poor in the US. Comparing these examples with seniors with adequate supplemental insurance who have the resources to hire car services or have others assist them in arranging care when they need it, jolts the reader to understand and appreciate the difference money makes in the lives and circumstances of us all, and in a way that is different than simply reading a statistic (“80% of the poor do not keep regular doctor’s appointments”) does. Qualitative research can reach into spaces and places that often go unexamined and then reports back to the rest of us what it is like in those spaces and places.
Example 2: Racing for Innocence (Interviews + Content Analysis + Fictional Stories)
Jennifer Pierce is a Professor of American Studies at the University of Minnesota. Trained as a sociologist, she has written a number of books about gender, race, and power. Her very first book, Gender Trials: Emotional Lives in Contemporary Law Firms, published in 1995, is a brilliant look at gender dynamics within two law firms. Pierce was a participant observer, working as a paralegal, and she observed how female lawyers and female paralegals struggled to obtain parity with their male colleagues.
Fifteen years later, she reexamined the context of the law firm to include an examination of racial dynamics, particularly how elite white men working in these spaces created and maintained a culture that made it difficult for both female attorneys and attorneys of color to thrive. Her book, Racing for Innocence: Whiteness, Gender, and the Backlash Against Affirmative Action , published in 2012, is an interesting and creative blending of interviews with attorneys, content analyses of popular films during this period, and fictional accounts of racial discrimination and sexual harassment. The law firm she chose to study had come under an affirmative action order and was in the process of implementing equitable policies and programs. She wanted to understand how recipients of white privilege (the elite white male attorneys) come to deny the role they play in reproducing inequality. Through interviews with attorneys who were present both before and during the affirmative action order, she creates a historical record of the “bad behavior” that necessitated new policies and procedures, but also, and more importantly , probed the participants ’ understanding of this behavior. It should come as no surprise that most (but not all) of the white male attorneys saw little need for change, and that almost everyone else had accounts that were different if not sometimes downright harrowing.
I’ve used Pierce’s book in my qualitative research methods courses as an example of an interesting blend of techniques and presentation styles. My students often have a very difficult time with the fictional accounts she includes. But they serve an important communicative purpose here. They are her attempts at presenting “both sides” to an objective reality – something happens (Pierce writes this something so it is very clear what it is), and the two participants to the thing that happened have very different understandings of what this means. By including these stories, Pierce presents one of her key findings – people remember things differently and these different memories tend to support their own ideological positions. I wonder what Pierce would have written had she studied the murder of George Floyd or the storming of the US Capitol on January 6 or any number of other historic events whose observers and participants record very different happenings.
This is not to say that qualitative researchers write fictional accounts. In fact, the use of fiction in our work remains controversial. When used, it must be clearly identified as a presentation device, as Pierce did. I include Racing for Innocence here as an example of the multiple uses of methods and techniques and the way that these work together to produce better understandings by us, the readers, of what Pierce studied. We readers come away with a better grasp of how and why advantaged people understate their own involvement in situations and structures that advantage them. This is normal human behavior , in other words. This case may have been about elite white men in law firms, but the general insights here can be transposed to other settings. Indeed, Pierce argues that more research needs to be done about the role elites play in the reproduction of inequality in the workplace in general.
Example 3: Amplified Advantage (Mixed Methods: Survey Interviews + Focus Groups + Archives)
The final example comes from my own work with college students, particularly the ways in which class background affects the experience of college and outcomes for graduates. I include it here as an example of mixed methods, and for the use of supplementary archival research. I’ve done a lot of research over the years on first-generation, low-income, and working-class college students. I am curious (and skeptical) about the possibility of social mobility today, particularly with the rising cost of college and growing inequality in general. As one of the few people in my family to go to college, I didn’t grow up with a lot of examples of what college was like or how to make the most of it. And when I entered graduate school, I realized with dismay that there were very few people like me there. I worried about becoming too different from my family and friends back home. And I wasn’t at all sure that I would ever be able to pay back the huge load of debt I was taking on. And so I wrote my dissertation and first two books about working-class college students. These books focused on experiences in college and the difficulties of navigating between family and school ( Hurst 2010a, 2012 ). But even after all that research, I kept coming back to wondering if working-class students who made it through college had an equal chance at finding good jobs and happy lives,
What happens to students after college? Do working-class students fare as well as their peers? I knew from my own experience that barriers continued through graduate school and beyond, and that my debtload was higher than that of my peers, constraining some of the choices I made when I graduated. To answer these questions, I designed a study of students attending small liberal arts colleges, the type of college that tried to equalize the experience of students by requiring all students to live on campus and offering small classes with lots of interaction with faculty. These private colleges tend to have more money and resources so they can provide financial aid to low-income students. They also attract some very wealthy students. Because they enroll students across the class spectrum, I would be able to draw comparisons. I ended up spending about four years collecting data, both a survey of more than 2000 students (which formed the basis for quantitative analyses) and qualitative data collection (interviews, focus groups, archival research, and participant observation). This is what we call a “mixed methods” approach because we use both quantitative and qualitative data. The survey gave me a large enough number of students that I could make comparisons of the how many kind, and to be able to say with some authority that there were in fact significant differences in experience and outcome by class (e.g., wealthier students earned more money and had little debt; working-class students often found jobs that were not in their chosen careers and were very affected by debt, upper-middle-class students were more likely to go to graduate school). But the survey analyses could not explain why these differences existed. For that, I needed to talk to people and ask them about their motivations and aspirations. I needed to understand their perceptions of the world, and it is very hard to do this through a survey.
By interviewing students and recent graduates, I was able to discern particular patterns and pathways through college and beyond. Specifically, I identified three versions of gameplay. Upper-middle-class students, whose parents were themselves professionals (academics, lawyers, managers of non-profits), saw college as the first stage of their education and took classes and declared majors that would prepare them for graduate school. They also spent a lot of time building their resumes, taking advantage of opportunities to help professors with their research, or study abroad. This helped them gain admission to highly-ranked graduate schools and interesting jobs in the public sector. In contrast, upper-class students, whose parents were wealthy and more likely to be engaged in business (as CEOs or other high-level directors), prioritized building social capital. They did this by joining fraternities and sororities and playing club sports. This helped them when they graduated as they called on friends and parents of friends to find them well-paying jobs. Finally, low-income, first-generation, and working-class students were often adrift. They took the classes that were recommended to them but without the knowledge of how to connect them to life beyond college. They spent time working and studying rather than partying or building their resumes. All three sets of students thought they were “doing college” the right way, the way that one was supposed to do college. But these three versions of gameplay led to distinct outcomes that advantaged some students over others. I titled my work “Amplified Advantage” to highlight this process.
These three examples, Cory Abramson’s The End Game , Jennifer Peirce’s Racing for Innocence, and my own Amplified Advantage, demonstrate the range of approaches and tools available to the qualitative researcher. They also help explain why qualitative research is so important. Numbers can tell us some things about the world, but they cannot get at the hearts and minds, motivations and beliefs of the people who make up the social worlds we inhabit. For that, we need tools that allow us to listen and make sense of what people tell us and show us. That is what good qualitative research offers us.
How Is This Book Organized?
This textbook is organized as a comprehensive introduction to the use of qualitative research methods. The first half covers general topics (e.g., approaches to qualitative research, ethics) and research design (necessary steps for building a successful qualitative research study). The second half reviews various data collection and data analysis techniques. Of course, building a successful qualitative research study requires some knowledge of data collection and data analysis so the chapters in the first half and the chapters in the second half should be read in conversation with each other. That said, each chapter can be read on its own for assistance with a particular narrow topic. In addition to the chapters, a helpful glossary can be found in the back of the book. Rummage around in the text as needed.
Chapter Descriptions
Chapter 2 provides an overview of the Research Design Process. How does one begin a study? What is an appropriate research question? How is the study to be done – with what methods ? Involving what people and sites? Although qualitative research studies can and often do change and develop over the course of data collection, it is important to have a good idea of what the aims and goals of your study are at the outset and a good plan of how to achieve those aims and goals. Chapter 2 provides a road map of the process.
Chapter 3 describes and explains various ways of knowing the (social) world. What is it possible for us to know about how other people think or why they behave the way they do? What does it mean to say something is a “fact” or that it is “well-known” and understood? Qualitative researchers are particularly interested in these questions because of the types of research questions we are interested in answering (the how questions rather than the how many questions of quantitative research). Qualitative researchers have adopted various epistemological approaches. Chapter 3 will explore these approaches, highlighting interpretivist approaches that acknowledge the subjective aspect of reality – in other words, reality and knowledge are not objective but rather influenced by (interpreted through) people.
Chapter 4 focuses on the practical matter of developing a research question and finding the right approach to data collection. In any given study (think of Cory Abramson’s study of aging, for example), there may be years of collected data, thousands of observations , hundreds of pages of notes to read and review and make sense of. If all you had was a general interest area (“aging”), it would be very difficult, nearly impossible, to make sense of all of that data. The research question provides a helpful lens to refine and clarify (and simplify) everything you find and collect. For that reason, it is important to pull out that lens (articulate the research question) before you get started. In the case of the aging study, Cory Abramson was interested in how inequalities affected understandings and responses to aging. It is for this reason he designed a study that would allow him to compare different groups of seniors (some middle-class, some poor). Inevitably, he saw much more in the three years in the field than what made it into his book (or dissertation), but he was able to narrow down the complexity of the social world to provide us with this rich account linked to the original research question. Developing a good research question is thus crucial to effective design and a successful outcome. Chapter 4 will provide pointers on how to do this. Chapter 4 also provides an overview of general approaches taken to doing qualitative research and various “traditions of inquiry.”
Chapter 5 explores sampling . After you have developed a research question and have a general idea of how you will collect data (Observations? Interviews?), how do you go about actually finding people and sites to study? Although there is no “correct number” of people to interview , the sample should follow the research question and research design. Unlike quantitative research, qualitative research involves nonprobability sampling. Chapter 5 explains why this is so and what qualities instead make a good sample for qualitative research.
Chapter 6 addresses the importance of reflexivity in qualitative research. Related to epistemological issues of how we know anything about the social world, qualitative researchers understand that we the researchers can never be truly neutral or outside the study we are conducting. As observers, we see things that make sense to us and may entirely miss what is either too obvious to note or too different to comprehend. As interviewers, as much as we would like to ask questions neutrally and remain in the background, interviews are a form of conversation, and the persons we interview are responding to us . Therefore, it is important to reflect upon our social positions and the knowledges and expectations we bring to our work and to work through any blind spots that we may have. Chapter 6 provides some examples of reflexivity in practice and exercises for thinking through one’s own biases.
Chapter 7 is a very important chapter and should not be overlooked. As a practical matter, it should also be read closely with chapters 6 and 8. Because qualitative researchers deal with people and the social world, it is imperative they develop and adhere to a strong ethical code for conducting research in a way that does not harm. There are legal requirements and guidelines for doing so (see chapter 8), but these requirements should not be considered synonymous with the ethical code required of us. Each researcher must constantly interrogate every aspect of their research, from research question to design to sample through analysis and presentation, to ensure that a minimum of harm (ideally, zero harm) is caused. Because each research project is unique, the standards of care for each study are unique. Part of being a professional researcher is carrying this code in one’s heart, being constantly attentive to what is required under particular circumstances. Chapter 7 provides various research scenarios and asks readers to weigh in on the suitability and appropriateness of the research. If done in a class setting, it will become obvious fairly quickly that there are often no absolutely correct answers, as different people find different aspects of the scenarios of greatest importance. Minimizing the harm in one area may require possible harm in another. Being attentive to all the ethical aspects of one’s research and making the best judgments one can, clearly and consciously, is an integral part of being a good researcher.
Chapter 8 , best to be read in conjunction with chapter 7, explains the role and importance of Institutional Review Boards (IRBs) . Under federal guidelines, an IRB is an appropriately constituted group that has been formally designated to review and monitor research involving human subjects . Every institution that receives funding from the federal government has an IRB. IRBs have the authority to approve, require modifications to (to secure approval), or disapprove research. This group review serves an important role in the protection of the rights and welfare of human research subjects. Chapter 8 reviews the history of IRBs and the work they do but also argues that IRBs’ review of qualitative research is often both over-inclusive and under-inclusive. Some aspects of qualitative research are not well understood by IRBs, given that they were developed to prevent abuses in biomedical research. Thus, it is important not to rely on IRBs to identify all the potential ethical issues that emerge in our research (see chapter 7).
Chapter 9 provides help for getting started on formulating a research question based on gaps in the pre-existing literature. Research is conducted as part of a community, even if particular studies are done by single individuals (or small teams). What any of us finds and reports back becomes part of a much larger body of knowledge. Thus, it is important that we look at the larger body of knowledge before we actually start our bit to see how we can best contribute. When I first began interviewing working-class college students, there was only one other similar study I could find, and it hadn’t been published (it was a dissertation of students from poor backgrounds). But there had been a lot published by professors who had grown up working class and made it through college despite the odds. These accounts by “working-class academics” became an important inspiration for my study and helped me frame the questions I asked the students I interviewed. Chapter 9 will provide some pointers on how to search for relevant literature and how to use this to refine your research question.
Chapter 10 serves as a bridge between the two parts of the textbook, by introducing techniques of data collection. Qualitative research is often characterized by the form of data collection – for example, an ethnographic study is one that employs primarily observational data collection for the purpose of documenting and presenting a particular culture or ethnos. Techniques can be effectively combined, depending on the research question and the aims and goals of the study. Chapter 10 provides a general overview of all the various techniques and how they can be combined.
The second part of the textbook moves into the doing part of qualitative research once the research question has been articulated and the study designed. Chapters 11 through 17 cover various data collection techniques and approaches. Chapters 18 and 19 provide a very simple overview of basic data analysis. Chapter 20 covers communication of the data to various audiences, and in various formats.
Chapter 11 begins our overview of data collection techniques with a focus on interviewing , the true heart of qualitative research. This technique can serve as the primary and exclusive form of data collection, or it can be used to supplement other forms (observation, archival). An interview is distinct from a survey, where questions are asked in a specific order and often with a range of predetermined responses available. Interviews can be conversational and unstructured or, more conventionally, semistructured , where a general set of interview questions “guides” the conversation. Chapter 11 covers the basics of interviews: how to create interview guides, how many people to interview, where to conduct the interview, what to watch out for (how to prepare against things going wrong), and how to get the most out of your interviews.
Chapter 12 covers an important variant of interviewing, the focus group. Focus groups are semistructured interviews with a group of people moderated by a facilitator (the researcher or researcher’s assistant). Focus groups explicitly use group interaction to assist in the data collection. They are best used to collect data on a specific topic that is non-personal and shared among the group. For example, asking a group of college students about a common experience such as taking classes by remote delivery during the pandemic year of 2020. Chapter 12 covers the basics of focus groups: when to use them, how to create interview guides for them, and how to run them effectively.
Chapter 13 moves away from interviewing to the second major form of data collection unique to qualitative researchers – observation . Qualitative research that employs observation can best be understood as falling on a continuum of “fly on the wall” observation (e.g., observing how strangers interact in a doctor’s waiting room) to “participant” observation, where the researcher is also an active participant of the activity being observed. For example, an activist in the Black Lives Matter movement might want to study the movement, using her inside position to gain access to observe key meetings and interactions. Chapter 13 covers the basics of participant observation studies: advantages and disadvantages, gaining access, ethical concerns related to insider/outsider status and entanglement, and recording techniques.
Chapter 14 takes a closer look at “deep ethnography” – immersion in the field of a particularly long duration for the purpose of gaining a deeper understanding and appreciation of a particular culture or social world. Clifford Geertz called this “deep hanging out.” Whereas participant observation is often combined with semistructured interview techniques, deep ethnography’s commitment to “living the life” or experiencing the situation as it really is demands more conversational and natural interactions with people. These interactions and conversations may take place over months or even years. As can be expected, there are some costs to this technique, as well as some very large rewards when done competently. Chapter 14 provides some examples of deep ethnographies that will inspire some beginning researchers and intimidate others.
Chapter 15 moves in the opposite direction of deep ethnography, a technique that is the least positivist of all those discussed here, to mixed methods , a set of techniques that is arguably the most positivist . A mixed methods approach combines both qualitative data collection and quantitative data collection, commonly by combining a survey that is analyzed statistically (e.g., cross-tabs or regression analyses of large number probability samples) with semi-structured interviews. Although it is somewhat unconventional to discuss mixed methods in textbooks on qualitative research, I think it is important to recognize this often-employed approach here. There are several advantages and some disadvantages to taking this route. Chapter 16 will describe those advantages and disadvantages and provide some particular guidance on how to design a mixed methods study for maximum effectiveness.
Chapter 16 covers data collection that does not involve live human subjects at all – archival and historical research (chapter 17 will also cover data that does not involve interacting with human subjects). Sometimes people are unavailable to us, either because they do not wish to be interviewed or observed (as is the case with many “elites”) or because they are too far away, in both place and time. Fortunately, humans leave many traces and we can often answer questions we have by examining those traces. Special collections and archives can be goldmines for social science research. This chapter will explain how to access these places, for what purposes, and how to begin to make sense of what you find.
Chapter 17 covers another data collection area that does not involve face-to-face interaction with humans: content analysis . Although content analysis may be understood more properly as a data analysis technique, the term is often used for the entire approach, which will be the case here. Content analysis involves interpreting meaning from a body of text. This body of text might be something found in historical records (see chapter 16) or something collected by the researcher, as in the case of comment posts on a popular blog post. I once used the stories told by student loan debtors on the website studentloanjustice.org as the content I analyzed. Content analysis is particularly useful when attempting to define and understand prevalent stories or communication about a topic of interest. In other words, when we are less interested in what particular people (our defined sample) are doing or believing and more interested in what general narratives exist about a particular topic or issue. This chapter will explore different approaches to content analysis and provide helpful tips on how to collect data, how to turn that data into codes for analysis, and how to go about presenting what is found through analysis.
Where chapter 17 has pushed us towards data analysis, chapters 18 and 19 are all about what to do with the data collected, whether that data be in the form of interview transcripts or fieldnotes from observations. Chapter 18 introduces the basics of coding , the iterative process of assigning meaning to the data in order to both simplify and identify patterns. What is a code and how does it work? What are the different ways of coding data, and when should you use them? What is a codebook, and why do you need one? What does the process of data analysis look like?
Chapter 19 goes further into detail on codes and how to use them, particularly the later stages of coding in which our codes are refined, simplified, combined, and organized. These later rounds of coding are essential to getting the most out of the data we’ve collected. As students are often overwhelmed with the amount of data (a corpus of interview transcripts typically runs into the hundreds of pages; fieldnotes can easily top that), this chapter will also address time management and provide suggestions for dealing with chaos and reminders that feeling overwhelmed at the analysis stage is part of the process. By the end of the chapter, you should understand how “findings” are actually found.
The book concludes with a chapter dedicated to the effective presentation of data results. Chapter 20 covers the many ways that researchers communicate their studies to various audiences (academic, personal, political), what elements must be included in these various publications, and the hallmarks of excellent qualitative research that various audiences will be expecting. Because qualitative researchers are motivated by understanding and conveying meaning , effective communication is not only an essential skill but a fundamental facet of the entire research project. Ethnographers must be able to convey a certain sense of verisimilitude , the appearance of true reality. Those employing interviews must faithfully depict the key meanings of the people they interviewed in a way that rings true to those people, even if the end result surprises them. And all researchers must strive for clarity in their publications so that various audiences can understand what was found and why it is important.
The book concludes with a short chapter ( chapter 21 ) discussing the value of qualitative research. At the very end of this book, you will find a glossary of terms. I recommend you make frequent use of the glossary and add to each entry as you find examples. Although the entries are meant to be simple and clear, you may also want to paraphrase the definition—make it “make sense” to you, in other words. In addition to the standard reference list (all works cited here), you will find various recommendations for further reading at the end of many chapters. Some of these recommendations will be examples of excellent qualitative research, indicated with an asterisk (*) at the end of the entry. As they say, a picture is worth a thousand words. A good example of qualitative research can teach you more about conducting research than any textbook can (this one included). I highly recommend you select one to three examples from these lists and read them along with the textbook.
A final note on the choice of examples – you will note that many of the examples used in the text come from research on college students. This is for two reasons. First, as most of my research falls in this area, I am most familiar with this literature and have contacts with those who do research here and can call upon them to share their stories with you. Second, and more importantly, my hope is that this textbook reaches a wide audience of beginning researchers who study widely and deeply across the range of what can be known about the social world (from marine resources management to public policy to nursing to political science to sexuality studies and beyond). It is sometimes difficult to find examples that speak to all those research interests, however. A focus on college students is something that all readers can understand and, hopefully, appreciate, as we are all now or have been at some point a college student.
Recommended Reading: Other Qualitative Research Textbooks
I’ve included a brief list of some of my favorite qualitative research textbooks and guidebooks if you need more than what you will find in this introductory text. For each, I’ve also indicated if these are for “beginning” or “advanced” (graduate-level) readers. Many of these books have several editions that do not significantly vary; the edition recommended is merely the edition I have used in teaching and to whose page numbers any specific references made in the text agree.
Barbour, Rosaline. 2014. Introducing Qualitative Research: A Student’s Guide. Thousand Oaks, CA: SAGE. A good introduction to qualitative research, with abundant examples (often from the discipline of health care) and clear definitions. Includes quick summaries at the ends of each chapter. However, some US students might find the British context distracting and can be a bit advanced in some places. Beginning .
Bloomberg, Linda Dale, and Marie F. Volpe. 2012. Completing Your Qualitative Dissertation . 2nd ed. Thousand Oaks, CA: SAGE. Specifically designed to guide graduate students through the research process. Advanced .
Creswell, John W., and Cheryl Poth. 2018 Qualitative Inquiry and Research Design: Choosing among Five Traditions . 4th ed. Thousand Oaks, CA: SAGE. This is a classic and one of the go-to books I used myself as a graduate student. One of the best things about this text is its clear presentation of five distinct traditions in qualitative research. Despite the title, this reasonably sized book is about more than research design, including both data analysis and how to write about qualitative research. Advanced .
Lareau, Annette. 2021. Listening to People: A Practical Guide to Interviewing, Participant Observation, Data Analysis, and Writing It All Up . Chicago: University of Chicago Press. A readable and personal account of conducting qualitative research by an eminent sociologist, with a heavy emphasis on the kinds of participant-observation research conducted by the author. Despite its reader-friendliness, this is really a book targeted to graduate students learning the craft. Advanced .
Lune, Howard, and Bruce L. Berg. 2018. 9th edition. Qualitative Research Methods for the Social Sciences. Pearson . Although a good introduction to qualitative methods, the authors favor symbolic interactionist and dramaturgical approaches, which limits the appeal primarily to sociologists. Beginning .
Marshall, Catherine, and Gretchen B. Rossman. 2016. 6th edition. Designing Qualitative Research. Thousand Oaks, CA: SAGE. Very readable and accessible guide to research design by two educational scholars. Although the presentation is sometimes fairly dry, personal vignettes and illustrations enliven the text. Beginning .
Maxwell, Joseph A. 2013. Qualitative Research Design: An Interactive Approach . 3rd ed. Thousand Oaks, CA: SAGE. A short and accessible introduction to qualitative research design, particularly helpful for graduate students contemplating theses and dissertations. This has been a standard textbook in my graduate-level courses for years. Advanced .
Patton, Michael Quinn. 2002. Qualitative Research and Evaluation Methods . Thousand Oaks, CA: SAGE. This is a comprehensive text that served as my “go-to” reference when I was a graduate student. It is particularly helpful for those involved in program evaluation and other forms of evaluation studies and uses examples from a wide range of disciplines. Advanced .
Rubin, Ashley T. 2021. Rocking Qualitative Social Science: An Irreverent Guide to Rigorous Research. Stanford : Stanford University Press. A delightful and personal read. Rubin uses rock climbing as an extended metaphor for learning how to conduct qualitative research. A bit slanted toward ethnographic and archival methods of data collection, with frequent examples from her own studies in criminology. Beginning .
Weis, Lois, and Michelle Fine. 2000. Speed Bumps: A Student-Friendly Guide to Qualitative Research . New York: Teachers College Press. Readable and accessibly written in a quasi-conversational style. Particularly strong in its discussion of ethical issues throughout the qualitative research process. Not comprehensive, however, and very much tied to ethnographic research. Although designed for graduate students, this is a recommended read for students of all levels. Beginning .
Patton’s Ten Suggestions for Doing Qualitative Research
The following ten suggestions were made by Michael Quinn Patton in his massive textbooks Qualitative Research and Evaluations Methods . This book is highly recommended for those of you who want more than an introduction to qualitative methods. It is the book I relied on heavily when I was a graduate student, although it is much easier to “dip into” when necessary than to read through as a whole. Patton is asked for “just one bit of advice” for a graduate student considering using qualitative research methods for their dissertation. Here are his top ten responses, in short form, heavily paraphrased, and with additional comments and emphases from me:
- Make sure that a qualitative approach fits the research question. The following are the kinds of questions that call out for qualitative methods or where qualitative methods are particularly appropriate: questions about people’s experiences or how they make sense of those experiences; studying a person in their natural environment; researching a phenomenon so unknown that it would be impossible to study it with standardized instruments or other forms of quantitative data collection.
- Study qualitative research by going to the original sources for the design and analysis appropriate to the particular approach you want to take (e.g., read Glaser and Straus if you are using grounded theory )
- Find a dissertation adviser who understands or at least who will support your use of qualitative research methods. You are asking for trouble if your entire committee is populated by quantitative researchers, even if they are all very knowledgeable about the subject or focus of your study (maybe even more so if they are!)
- Really work on design. Doing qualitative research effectively takes a lot of planning. Even if things are more flexible than in quantitative research, a good design is absolutely essential when starting out.
- Practice data collection techniques, particularly interviewing and observing. There is definitely a set of learned skills here! Do not expect your first interview to be perfect. You will continue to grow as a researcher the more interviews you conduct, and you will probably come to understand yourself a bit more in the process, too. This is not easy, despite what others who don’t work with qualitative methods may assume (and tell you!)
- Have a plan for analysis before you begin data collection. This is often a requirement in IRB protocols , although you can get away with writing something fairly simple. And even if you are taking an approach, such as grounded theory, that pushes you to remain fairly open-minded during the data collection process, you still want to know what you will be doing with all the data collected – creating a codebook? Writing analytical memos? Comparing cases? Having a plan in hand will also help prevent you from collecting too much extraneous data.
- Be prepared to confront controversies both within the qualitative research community and between qualitative research and quantitative research. Don’t be naïve about this – qualitative research, particularly some approaches, will be derided by many more “positivist” researchers and audiences. For example, is an “n” of 1 really sufficient? Yes! But not everyone will agree.
- Do not make the mistake of using qualitative research methods because someone told you it was easier, or because you are intimidated by the math required of statistical analyses. Qualitative research is difficult in its own way (and many would claim much more time-consuming than quantitative research). Do it because you are convinced it is right for your goals, aims, and research questions.
- Find a good support network. This could be a research mentor, or it could be a group of friends or colleagues who are also using qualitative research, or it could be just someone who will listen to you work through all of the issues you will confront out in the field and during the writing process. Even though qualitative research often involves human subjects, it can be pretty lonely. A lot of times you will feel like you are working without a net. You have to create one for yourself. Take care of yourself.
- And, finally, in the words of Patton, “Prepare to be changed. Looking deeply at other people’s lives will force you to look deeply at yourself.”
- We will actually spend an entire chapter ( chapter 3 ) looking at this question in much more detail! ↵
- Note that this might have been news to Europeans at the time, but many other societies around the world had also come to this conclusion through observation. There is often a tendency to equate “the scientific revolution” with the European world in which it took place, but this is somewhat misleading. ↵
- Historians are a special case here. Historians have scrupulously and rigorously investigated the social world, but not for the purpose of understanding general laws about how things work, which is the point of scientific empirical research. History is often referred to as an idiographic field of study, meaning that it studies things that happened or are happening in themselves and not for general observations or conclusions. ↵
- Don’t worry, we’ll spend more time later in this book unpacking the meaning of ethnography and other terms that are important here. Note the available glossary ↵
An approach to research that is “multimethod in focus, involving an interpretative, naturalistic approach to its subject matter. This means that qualitative researchers study things in their natural settings, attempting to make sense of, or interpret, phenomena in terms of the meanings people bring to them. Qualitative research involves the studied use and collection of a variety of empirical materials – case study, personal experience, introspective, life story, interview, observational, historical, interactional, and visual texts – that describe routine and problematic moments and meanings in individuals’ lives." ( Denzin and Lincoln 2005:2 ). Contrast with quantitative research .
In contrast to methodology, methods are more simply the practices and tools used to collect and analyze data. Examples of common methods in qualitative research are interviews , observations , and documentary analysis . One’s methodology should connect to one’s choice of methods, of course, but they are distinguishable terms. See also methodology .
A proposed explanation for an observation, phenomenon, or scientific problem that can be tested by further investigation. The positing of a hypothesis is often the first step in quantitative research but not in qualitative research. Even when qualitative researchers offer possible explanations in advance of conducting research, they will tend to not use the word “hypothesis” as it conjures up the kind of positivist research they are not conducting.
The foundational question to be addressed by the research study. This will form the anchor of the research design, collection, and analysis. Note that in qualitative research, the research question may, and probably will, alter or develop during the course of the research.
An approach to research that collects and analyzes numerical data for the purpose of finding patterns and averages, making predictions, testing causal relationships, and generalizing results to wider populations. Contrast with qualitative research .
Data collection that takes place in real-world settings, referred to as “the field;” a key component of much Grounded Theory and ethnographic research. Patton ( 2002 ) calls fieldwork “the central activity of qualitative inquiry” where “‘going into the field’ means having direct and personal contact with people under study in their own environments – getting close to people and situations being studied to personally understand the realities of minutiae of daily life” (48).
The people who are the subjects of a qualitative study. In interview-based studies, they may be the respondents to the interviewer; for purposes of IRBs, they are often referred to as the human subjects of the research.
The branch of philosophy concerned with knowledge. For researchers, it is important to recognize and adopt one of the many distinguishing epistemological perspectives as part of our understanding of what questions research can address or fully answer. See, e.g., constructivism , subjectivism, and objectivism .
An approach that refutes the possibility of neutrality in social science research. All research is “guided by a set of beliefs and feelings about the world and how it should be understood and studied” (Denzin and Lincoln 2005: 13). In contrast to positivism , interpretivism recognizes the social constructedness of reality, and researchers adopting this approach focus on capturing interpretations and understandings people have about the world rather than “the world” as it is (which is a chimera).
The cluster of data-collection tools and techniques that involve observing interactions between people, the behaviors, and practices of individuals (sometimes in contrast to what they say about how they act and behave), and cultures in context. Observational methods are the key tools employed by ethnographers and Grounded Theory .
Research based on data collected and analyzed by the research (in contrast to secondary “library” research).
The process of selecting people or other units of analysis to represent a larger population. In quantitative research, this representation is taken quite literally, as statistically representative. In qualitative research, in contrast, sample selection is often made based on potential to generate insight about a particular topic or phenomenon.
A method of data collection in which the researcher asks the participant questions; the answers to these questions are often recorded and transcribed verbatim. There are many different kinds of interviews - see also semistructured interview , structured interview , and unstructured interview .
The specific group of individuals that you will collect data from. Contrast population.
The practice of being conscious of and reflective upon one’s own social location and presence when conducting research. Because qualitative research often requires interaction with live humans, failing to take into account how one’s presence and prior expectations and social location affect the data collected and how analyzed may limit the reliability of the findings. This remains true even when dealing with historical archives and other content. Who we are matters when asking questions about how people experience the world because we, too, are a part of that world.
The science and practice of right conduct; in research, it is also the delineation of moral obligations towards research participants, communities to which we belong, and communities in which we conduct our research.
An administrative body established to protect the rights and welfare of human research subjects recruited to participate in research activities conducted under the auspices of the institution with which it is affiliated. The IRB is charged with the responsibility of reviewing all research involving human participants. The IRB is concerned with protecting the welfare, rights, and privacy of human subjects. The IRB has the authority to approve, disapprove, monitor, and require modifications in all research activities that fall within its jurisdiction as specified by both the federal regulations and institutional policy.
Research, according to US federal guidelines, that involves “a living individual about whom an investigator (whether professional or student) conducting research: (1) Obtains information or biospecimens through intervention or interaction with the individual, and uses, studies, or analyzes the information or biospecimens; or (2) Obtains, uses, studies, analyzes, or generates identifiable private information or identifiable biospecimens.”
One of the primary methodological traditions of inquiry in qualitative research, ethnography is the study of a group or group culture, largely through observational fieldwork supplemented by interviews. It is a form of fieldwork that may include participant-observation data collection. See chapter 14 for a discussion of deep ethnography.
A form of interview that follows a standard guide of questions asked, although the order of the questions may change to match the particular needs of each individual interview subject, and probing “follow-up” questions are often added during the course of the interview. The semi-structured interview is the primary form of interviewing used by qualitative researchers in the social sciences. It is sometimes referred to as an “in-depth” interview. See also interview and interview guide .
A method of observational data collection taking place in a natural setting; a form of fieldwork . The term encompasses a continuum of relative participation by the researcher (from full participant to “fly-on-the-wall” observer). This is also sometimes referred to as ethnography , although the latter is characterized by a greater focus on the culture under observation.
A research design that employs both quantitative and qualitative methods, as in the case of a survey supplemented by interviews.
An epistemological perspective that posits the existence of reality through sensory experience similar to empiricism but goes further in denying any non-sensory basis of thought or consciousness. In the social sciences, the term has roots in the proto-sociologist August Comte, who believed he could discern “laws” of society similar to the laws of natural science (e.g., gravity). The term has come to mean the kinds of measurable and verifiable science conducted by quantitative researchers and is thus used pejoratively by some qualitative researchers interested in interpretation, consciousness, and human understanding. Calling someone a “positivist” is often intended as an insult. See also empiricism and objectivism.
A place or collection containing records, documents, or other materials of historical interest; most universities have an archive of material related to the university’s history, as well as other “special collections” that may be of interest to members of the community.
A method of both data collection and data analysis in which a given content (textual, visual, graphic) is examined systematically and rigorously to identify meanings, themes, patterns and assumptions. Qualitative content analysis (QCA) is concerned with gathering and interpreting an existing body of material.
A word or short phrase that symbolically assigns a summative, salient, essence-capturing, and/or evocative attribute for a portion of language-based or visual data (Saldaña 2021:5).
Usually a verbatim written record of an interview or focus group discussion.
The primary form of data for fieldwork , participant observation , and ethnography . These notes, taken by the researcher either during the course of fieldwork or at day’s end, should include as many details as possible on what was observed and what was said. They should include clear identifiers of date, time, setting, and names (or identifying characteristics) of participants.
The process of labeling and organizing qualitative data to identify different themes and the relationships between them; a way of simplifying data to allow better management and retrieval of key themes and illustrative passages. See coding frame and codebook.
A methodological tradition of inquiry and approach to analyzing qualitative data in which theories emerge from a rigorous and systematic process of induction. This approach was pioneered by the sociologists Glaser and Strauss (1967). The elements of theory generated from comparative analysis of data are, first, conceptual categories and their properties and, second, hypotheses or generalized relations among the categories and their properties – “The constant comparing of many groups draws the [researcher’s] attention to their many similarities and differences. Considering these leads [the researcher] to generate abstract categories and their properties, which, since they emerge from the data, will clearly be important to a theory explaining the kind of behavior under observation.” (36).
A detailed description of any proposed research that involves human subjects for review by IRB. The protocol serves as the recipe for the conduct of the research activity. It includes the scientific rationale to justify the conduct of the study, the information necessary to conduct the study, the plan for managing and analyzing the data, and a discussion of the research ethical issues relevant to the research. Protocols for qualitative research often include interview guides, all documents related to recruitment, informed consent forms, very clear guidelines on the safekeeping of materials collected, and plans for de-identifying transcripts or other data that include personal identifying information.
Introduction to Qualitative Research Methods Copyright © 2023 by Allison Hurst is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License , except where otherwise noted.
Want to create or adapt books like this? Learn more about how Pressbooks supports open publishing practices.
Chapter 13: Interviews
Danielle Berkovic
Learning outcomes
Upon completion of this chapter, you should be able to:
- Understand when to use interviews in qualitative research.
- Develop interview questions for an interview guide.
- Understand how to conduct an interview.
What are interviews?
An interviewing method is the most commonly used data collection technique in qualitative research. 1 The purpose of an interview is to explore the experiences, understandings, opinions and motivations of research participants. 2 Interviews are conducted one-on-one with the researcher and the participant. Interviews are most appropriate when seeking to understand a participant’s subjective view of an experience and are also considered suitable for the exploration of sensitive topics.
What are the different types of interviews?
There are four main types of interviews:
- Key stakeholder: A key stakeholder interview aims to explore one issue in detail with a person of interest or importance concerning the research topic. 3 Key stakeholder interviews seek the views of experts on some cultural, political or health aspects of the community, beyond their personal beliefs or actions. An example of a key stakeholder is the Chief Health Officer of Victoria (Australia’s second-most populous state) who oversaw the world’s longest lockdowns in response to the COVID-19 pandemic.
- Dyad: A dyad interview aims to explore one issue in a level of detail with a dyad (two people). This form of interviewing is used when one participant of the dyad may need some support or is not wholly able to articulate themselves (e.g. people with cognitive impairment, or children). Independence is acknowledged and the interview is analysed as a unit. 4
- Narrative: A narrative interview helps individuals tell their stories, and prioritises their own perspectives and experiences using the language that they prefer. 5 This type of interview has been widely used in social research but is gaining prominence in health research to better understand person-centred care, for example, negotiating exercise and food abstinence whilst living with Type 2 diabetes. 6,7
- Life history: A life history interview allows the researcher to explore a person’s individual and subjective experiences within a history of the time framework. 8 Life history interviews challenge the researcher to understand how people’s current attitudes, behaviours and choices are influenced by previous experiences or trauma. Life history interviews have been conducted with Holocaust survivors 9 and youth who have been forcibly recruited to war. 10
Table 13.4 provides a summary of four studies, each adopting one of these types of interviews.
Interviewing techniques
There are two main interview techniques:
- Semi-structured: Semi-structured interviewing aims to explore a few issues in moderate detail, to expand the researcher’s knowledge at some level. 11 Semi-structured interviews give the researcher the advantage of remaining reasonably objective while enabling participants to share their perspectives and opinions. The researcher should create an interview guide with targeted open questions to direct the interview. As examples, semi-structured interviews have been used to extend knowledge of why women might gain excess weight during pregnancy, 12 and to update guidelines for statin uptake. 13
- In-depth: In-depth interviewing aims to explore a person’s subjective experiences and feelings about a particular topic. 14 In-depth interviews are often used to explore emotive (e.g. end-of-life care) 15 and complex (e.g. adolescent pregnancy) topics. 16 The researcher should create an interview guide with selected open questions to ask of the participant, but the participant should guide the direction of the interview more than in a semi-structured setting. In-depth interviews value participants’ lived experiences and are frequently used in phenomenology studies (as described in Chapter 6) .
When to use the different types of interview s
The type of interview a researcher uses should be determined by the study design, the research aims and objectives, and participant demographics. For example, if conducting a descriptive study, semi-structured interviews may be the best method of data collection. As explained in Chapter 5 , descriptive studies seek to describe phenomena, rather than to explain or interpret the data. A semi-structured interview, which seeks to expand upon some level of existing knowledge, will likely best facilitate this.
Similarly, if conducting a phenomenological study, in-depth interviews may be the best method of data collection. As described in Chapter 6 , the key concept of phenomenology is the individual. The emphasis is on the lived experience of that individual and the person’s sense-making of those experiences. Therefore, an in-depth interview is likely best placed to elicit that rich data.
While some interview types are better suited to certain study designs, there are no restrictions on the type of interview that may be used. For example, semi-structured interviews provide an excellent accompaniment to trial participation (see Chapter 11 about mixed methods), and key stakeholder interviews, as part of an action research study, can be used to define priorities, barriers and enablers to implementation.
How do I write my interview questions?
An interview aims to explore the experiences, understandings, opinions and motivations of research participants. The general rule is that the interviewee should speak for 80 per cent of the interview, and the interviewer should only be asking questions and clarifying responses, for about 20 per cent of the interview. This percentage may differ depending on the interview type; for example, a semi-structured interview involves the researcher asking more questions than in an in-depth interview. Still, to facilitate free-flowing responses, it is important to use open-ended language to encourage participants to be expansive in their responses. Examples of open-ended terms include questions that start with ‘who’, ‘how’ and ‘where’.
The researcher should avoid closed-ended questions that can be answered with yes or no, and limit conversation. For example, asking a participant ‘Did you have this experience?’ can elicit a simple ‘yes’, whereas asking them to ‘Describe your experience’, will likely encourage a narrative response. Table 13.1 provides examples of terminology to include and avoid in developing interview questions.
Table 13.1. Interview question formats to use and avoid
How long should my interview be.
There is no rule about how long an interview should take. Different types of interviews will likely run for different periods of time, but this also depends on the research question/s and the type of participant. For example, given that a semi-structured interview is seeking to expand on some previous knowledge, the interview may need no longer than 30 minutes, or up to one hour. An in-depth interview seeks to explore a topic in a greater level of detail and therefore, at a minimum, would be expected to last an hour. A dyad interview may be as short as 15 minutes (e.g. if the dyad is a person with dementia and a family member or caregiver) or longer, depending on the pairing.
Designing your interview guide
To figure out what questions to ask in an interview guide, the researcher may consult the literature, speak to experts (including people with lived experience) about the research and draw on their current knowledge. The topics and questions should be mapped to the research question/s, and the interview guide should be developed well in advance of commencing data collection. This enables time and opportunity to pilot-test the interview guide. The pilot interview provides an opportunity to explore the language and clarity of questions, the order and flow of the guide and to determine whether the instructions are clear to participants both before and after the interview. It can be beneficial to pilot-test the interview guide with someone who is not familiar with the research topic, to make sure that the language used is easily understood (and will be by participants, too). The study design should be used to determine the number of questions asked and the duration of the interview should guide the extent of the interview guide. The participant type may also determine the extent of the interview guide; for example, clinicians tend to be time-poor and therefore shorter, focused interviews are optimal. An interview guide is also likely to be shorter for a descriptive study than a phenomenological or ethnographic study, given the level of detail required. Chapter 5 outlined a descriptive study in which participants who had undergone percutaneous coronary intervention were interviewed. The interview guide consisted of four main questions and subsequent probing questions, linked to the research questions (see Table 13.2). 17
Table 13.2. Interview guide for a descriptive study
Table 13.3 is an example of a larger and more detailed interview guide, designed for the qualitative component of a mixed-methods study aiming to examine the work and financial effects of living with arthritis as a younger person. The questions are mapped to the World Health Organization’s International Classification of Functioning, Disability, and Health, which measures health and disability at individual and population levels. 18
Table 13.3. Detailed interview guide
It is important to create an interview guide, for the following reasons:
- The researcher should be familiar with their research questions.
- Using an interview guide will enable the incorporation of feedback from the piloting process.
- It is difficult to predict how participants will respond to interview questions. They may answer in a way that is anticipated or they may provide unanticipated insights that warrant follow-up. An interview guide (a physical or digital copy) enables the researcher to note these answers and follow-up with appropriate inquiry.
- Participants will likely have provided heterogeneous answers to certain questions. The interview guide enables the researcher to note similarities and differences across various interviews, which may be important in data analysis.
- Even experienced qualitative researchers get nervous before an interview! The interview guide provides a safety net if the researcher forgets their questions or needs to anticipate the next question.
Setting up the interview
In the past, most interviews were conducted in person or by telephone. Emerging technologies promote easier access to research participation (e.g. by people living in rural or remote communities, or for people with mobility limitations). Even in metropolitan settings, many interviews are now conducted electronically (e.g. using videoconferencing platforms). Regardless of your interview setting, it is essential that the interview environment is comfortable for the participant. This process can begin as soon as potential participants express interest in your research. Following are some tips from the literature and our own experiences of leading interviews:
- Answer questions and set clear expectations . Participating in research is not an everyday task. People do not necessarily know what to expect during a research interview, and this can be daunting. Give people as much information as possible, answer their questions about the research and set clear expectations about what the interview will entail and how long it is expected to last. Let them know that the interview will be recorded for transcription and analysis purposes. Consider sending the interview questions a few days before the interview. This gives people time and space to reflect on their experiences, consider their responses to questions and to provide informed consent for their participation.
- Consider your setting . If conducting the interview in person, consider the location and room in which the interview will be held. For example, if in a participant’s home, be mindful of their private space. Ask if you should remove your shoes before entering their home. If they offer refreshments (which in our experience many participants do), accept it with gratitude if possible. These considerations apply beyond the participant’s home; if using a room in an office setting, consider privacy and confidentiality, accessibility and potential for disruption. Consider the temperature as well as the furniture in the room, who may be able to overhear conversations and who may walk past. Similarly, if interviewing by phone or online, take time to assess the space, and if in a house or office that is not quiet or private, use headphones as needed.
- Build rapport. The research topic may be important to participants from a professional perspective, or they may have deep emotional connections to the topic of interest. Regardless of the nature of the interview, it is important to remember that participants are being asked to open up to an interviewer who is likely to be a stranger. Spend some time with participants before the interview, to make sure that they are comfortable. Engage in some general conversation, and ask if they have any questions before you start. Remember that it is not a normal part of someone’s day to participate in research. Make it an enjoyable and/or meaningful experience for them, and it will enhance the data that you collect.
- Let participants guide you. Oftentimes, the ways in which researchers and participants describe the same phenomena are different. In the interview, reflect the participant’s language. Make sure they feel heard and that they are willing and comfortable to speak openly about their experiences. For example, our research involves talking to older adults about their experience of falls. We noticed early in this research that participants did not use the word ‘fall’ but would rather use terms such as ‘trip’, ‘went over’ and ‘stumbled’. As interviewers we adopted the participant’s language into our questions.
- Listen consistently and express interest. An interview is more complex than a simple question-and-answer format. The best interview data comes from participants feeling comfortable and confident to share their stories. By the time you are completing the 20th interview, it can be difficult to maintain the same level of concentration as with the first interview. Try to stay engaged: nod along with your participants, maintain eye contact, murmur in agreement and sympathise where warranted.
- The interviewer is both the data collector and the data collection instrument. The data received is only as good as the questions asked. In qualitative research, the researcher influences how participants answer questions. It is important to remain reflexive and aware of how your language, body language and attitude might influence the interview. Being rested and prepared will enhance the quality of the questions asked and hence the data collected.
- Avoid excessive use of ‘why’. It can be challenging for participants to recall why they felt a certain way or acted in a particular manner. Try to avoid asking ‘why’ questions too often, and instead adopt some of the open language described earlier in the chapter.
After your interview
When you have completed your interview, thank the participant and let them know they can contact you if they have any questions or follow-up information they would like to provide. If the interview has covered sensitive topics or the participant has become distressed throughout the interview, make sure that appropriate referrals and follow-up are provided (see section 6).
Download the recording from your device and make sure it is saved in a secure location that can only be accessed by people on the approved research team (see Chapters 35 and 36).
It is important to know what to do immediately after each interview is completed. Interviews should be transcribed – that is, reproduced verbatim for data analysis. Transcribing data is an important step in the process of analysis, but it is very time-consuming; transcribing a 60-minute interview can take up to 8 hours. Data analysis is discussed in Section 4.
Table 13.4. Examples of the four types of interviews
Interviews are the most common data collection technique in qualitative research. There are four main types of interviews; the one you choose will depend on your research question, aims and objectives. It is important to formulate open-ended interview questions that are understandable and easy for participants to answer. Key considerations in setting up the interview will enhance the quality of the data obtained and the experience of the interview for the participant and the researcher.
- Gill P, Stewart K, Treasure E, Chadwick B. Methods of data collection in qualitative research: interviews and focus groups. Br Dent J . 2008;204(6):291-295. doi:10.1038/bdj.2008.192
- DeJonckheere M, Vaughn LM. Semistructured interviewing in primary care research: a balance of relationship and rigour. Fam Med Community Health . 2019;7(2):e000057. doi:10.1136/fmch-2018-000057
- Nyanchoka L, Tudur-Smith C, Porcher R, Hren D. Key stakeholders’ perspectives and experiences with defining, identifying and displaying gaps in health research: a qualitative study. BMJ Open . 2020;10(11):e039932. doi:10.1136/bmjopen-2020-039932
- Morgan DL, Ataie J, Carder P, Hoffman K. Introducing dyadic interviews as a method for collecting qualitative data. Qual Health Res . 2013;23(9):1276-84. doi:10.1177/1049732313501889
- Picchi S, Bonapitacola C, Borghi E, et al. The narrative interview in therapeutic education. The diabetic patients’ point of view. Acta Biomed . Jul 18 2018;89(6-S):43-50. doi:10.23750/abm.v89i6-S.7488
- Stuij M, Elling A, Abma T. Negotiating exercise as medicine: Narratives from people with type 2 diabetes. Health (London) . 2021;25(1):86-102. doi:10.1177/1363459319851545
- Buchmann M, Wermeling M, Lucius-Hoene G, Himmel W. Experiences of food abstinence in patients with type 2 diabetes: a qualitative study. BMJ Open . 2016;6(1):e008907. doi:10.1136/bmjopen-2015-008907
- Jessee E. The Life History Interview. Handbook of Research Methods in Health Social Sciences . 2018:1-17:Chapter 80-1.
- Sheftel A, Zembrzycki S. Only Human: A Reflection on the Ethical and Methodological Challenges of Working with “Difficult” Stories. The Oral History Review . 2019;37(2):191-214. doi:10.1093/ohr/ohq050
- Harnisch H, Montgomery E. “What kept me going”: A qualitative study of avoidant responses to war-related adversity and perpetration of violence by former forcibly recruited children and youth in the Acholi region of northern Uganda. Soc Sci Med . 2017;188:100-108. doi:10.1016/j.socscimed.2017.07.007
- Ruslin., Mashuri S, Rasak MSA, Alhabsyi M, Alhabsyi F, Syam H. Semi-structured Interview: A Methodological Reflection on the Development of a Qualitative Research Instrument in Educational Studies. IOSR-JRME . 2022;12(1):22-29. doi:10.9790/7388-1201052229
- Chang T, Llanes M, Gold KJ, Fetters MD. Perspectives about and approaches to weight gain in pregnancy: a qualitative study of physicians and nurse midwives. BMC Pregnancy & Childbirth . 2013;13(47)doi:10.1186/1471-2393-13-47
- DeJonckheere M, Robinson CH, Evans L, et al. Designing for Clinical Change: Creating an Intervention to Implement New Statin Guidelines in a Primary Care Clinic. JMIR Hum Factors . 2018;5(2):e19. doi:10.2196/humanfactors.9030
- Knott E, Rao AH, Summers K, Teeger C. Interviews in the social sciences. Nature Reviews Methods Primers . 2022;2(1)doi:10.1038/s43586-022-00150-6
- Bergenholtz H, Missel M, Timm H. Talking about death and dying in a hospital setting – a qualitative study of the wishes for end-of-life conversations from the perspective of patients and spouses. BMC Palliat Care . 2020;19(1):168. doi:10.1186/s12904-020-00675-1
- Olorunsaiye CZ, Degge HM, Ubanyi TO, Achema TA, Yaya S. “It’s like being involved in a car crash”: teen pregnancy narratives of adolescents and young adults in Jos, Nigeria. Int Health . 2022;14(6):562-571. doi:10.1093/inthealth/ihab069
- Ayton DR, Barker AL, Peeters G, et al. Exploring patient-reported outcomes following percutaneous coronary intervention: A qualitative study. Health Expect . 2018;21(2):457-465. doi:10.1111/hex.12636
- World Health Organization. International Classification of Functioning, Disability and Health (ICF). WHO. https://www.who.int/standards/classifications/international-classification-of-functioning-disability-and-health#:~:text=ICF%20is%20the%20WHO%20framework,and%20measure%20health%20and%20disability.
- Cuthbertson J, Rodriguez-Llanes JM, Robertson A, Archer F. Current and Emerging Disaster Risks Perceptions in Oceania: Key Stakeholders Recommendations for Disaster Management and Resilience Building. Int J Environ Res Public Health . 2019;16(3)doi:10.3390/ijerph16030460
- Bannon SM, Grunberg VA, Reichman M, et al. Thematic Analysis of Dyadic Coping in Couples With Young-Onset Dementia. JAMA Netw Open . 2021;4(4):e216111. doi:10.1001/jamanetworkopen.2021.6111
- McGranahan R, Jakaite Z, Edwards A, Rennick-Egglestone S, Slade M, Priebe S. Living with Psychosis without Mental Health Services: A Narrative Interview Study. BMJ Open . 2021;11(7):e045661. doi:10.1136/bmjopen-2020-045661
- Gutiérrez-García AI, Solano-Ruíz C, Siles-González J, Perpiñá-Galvañ J. Life Histories and Lifelines: A Methodological Symbiosis for the Study of Female Genital Mutilation. Int J Qual Methods . 2021;20doi:10.1177/16094069211040969
Qualitative Research – a practical guide for health and social care researchers and practitioners Copyright © 2023 by Danielle Berkovic is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License , except where otherwise noted.
Share This Book
- Open access
- Published: 21 October 2024
Medical student use of practice questions in their studies: a qualitative study
- Ryan Sheehy ORCID: orcid.org/0000-0003-2435-7234 1 ,
- Devin Scott ORCID: orcid.org/0009-0002-3670-0589 2 ,
- Diveena Davis 3 ,
- Marissa Roffler ORCID: orcid.org/0000-0002-3055-7999 4 ,
- Trevor Sweatman 5 &
- Eric Nemec ORCID: orcid.org/0000-0001-7794-6732 6
BMC Medical Education volume 24 , Article number: 1181 ( 2024 ) Cite this article
289 Accesses
Metrics details
Practice questions are highly sought out for use as a study tool among medical students in undergraduate medical education. At the same time, it remains unknown how medical students use and incorporate practice questions and their rationales into their studies. To explore this heavily relied upon study strategy, semi-structured interviews were conducted with second-year medical students to assess how they approach using practice questions. Qualitative thematic analysis revealed several recurrent themes: (1) Medical students use practice questions for primary learning, (2) Medical students place more importance on the rationale of a practice question versus selecting the right answer, and (3) Medical students view practice questions as being designed to be used once or having a single-use. Together, these themes provide insight into how medical students use practice questions to study, which may guide medical educators in their creation of practice questions with appropriate rationales and provide foundational data for future mixed methods analyses seeking to generalize these findings.
Peer Review reports
Introduction
At the heart of a professional school is the aim to produce competent professionals. Graduates must not only possess the knowledge of their field but also the ability to correctly apply it. Society expects a licensed clinician to be competent in their craft [ 1 ]. A successful clinician draws on basic science knowledge to inform diagnostic and therapeutic decisions to produce the best possible outcomes for their patients [ 2 , 3 , 4 ]. As adult learners of the basic sciences, medical students prefer to orient themselves through a problem-based approach rather than a subject-centered approach [ 5 , 6 ]. One specific strategy is using online quizzes for self-assessment [ 7 ]. A qualitative study exploring how medical students perceive basic science relevance to clinical rotations found that students relate basic science knowledge to their professional identity and their adaptive expertise [ 2 ]. At the beginning of their careers as medical students, these soon-to-be professionals face the daunting task of mastering an ever-widening body of medical knowledge [ 8 ]. To overcome this hurdle, they rely on many resources to facilitate learning, including the curriculum of their medical school, mentors, fellow medical students, clinical experience, and extracurricular resources such as board preparation materials and practice question banks [ 9 ].
In the United States, medical students are uniquely driven to compete to successfully match as residents after graduation from medical school. Specific use of competitive learning techniques has enhanced learning outcomes in this group [ 10 ]. This competitive drive fuels a strong desire among medical students to streamline their learning to maximize their most precious resource, time. Medical students that successfully manage their time minimize their risk of burnout [ 11 ] and increase their opportunities to pursue extracurricular activities. The desire to streamline learning and best manage their time leads some medical students to shift their learning to electronic resources created within or found outside of the medical school curriculum [ 12 , 13 , 14 , 15 ]. Many of these resources prioritize completing practice questions and committing concepts to memory. Practice questions most often take the form of a single best answer or multiple-choice style question. Completion of practice questions by medical students has been found to be a strong predictor of academic outcomes such as exam performance, course grades, and scores on board exams [ 16 , 17 , 18 ]. A post-exam survey completed by medical students found that a majority of students used 6–8 outside resources in exam preparation [ 19 ]. Contrary to the goal of producing competent professionals, the competitive environment of medical school can prompt a medical student to prioritize a memorization study technique for short-term gain at the detriment to long-term retention and understanding of the material.
Practice questions can be used for short-term gain and long-term material retention. The use of practice questions is a popular study technique among medical students [ 20 ]. Students utilize practice questions as a study technique with great frequency, especially in times of stress and anxiety [ 18 , 21 ]. Practice questions are an excellent way for a student to use retrieval practice to enhance their long-term retention of the material versus repeated studying [ 22 ]. However, practice questions can also be misused if they are used solely for learning rather than self-assessment. Students who used practice questions as a primary source of learning rather than for self-assessment had worse assessment outcomes [ 23 ]. There is a gap in understanding how medical students use practice questions as a study resource.
Despite the high demand and use of practice questions among medical students [ 20 , 21 , 24 , 25 ], little is known about how medical students use practice questions and their rationales in their study process. Rationales are defined as an explanation as to why the correct answer is correct and why the incorrect answers are incorrect. This qualitative research study aims to determine how medical students use practice questions as a study resource. Significant insight into this process has the potential to increase understanding of effective practices for using practice questions to enhance learning outcomes in medical education.
Materials and methods
Study design and sample.
This qualitative research study centered around semi-structured, individual interviews with second-year medical students within the College of Medicine (COM) at the University of Tennessee Health Science Center (UTHSC). The medical degree, Doctor of Medicine (MD), within the COM at UTHSC is a 4-year undergraduate medical education program. Medical students at UTHSC have access to practice questions from a variety of sources. Students have access to faculty generated questions that are posted in the form of a quiz to the learning management system (LMS). Students also have access to questions through a third-party resource called USMLE-Rx (Louisville, KY). Some students purchase access to additional third-party practice question sources. Questions from these sources vary in difficulty. Some can be fact recall, some can be higher order questions, and some integrate multiple disciplines. Faculty generated practice questions attempt to mimic the difficulty of the faculty generated questions that make up the course exams. Recruitment for the study began in the late Spring. In the UTHSC COM curriculum, first year students are still in pre-clinical courses in the late Spring, whereas second year students have taken the Step 1 United States Medical Licensing Exam (USMLE) and progressed to clerkships. At this stage of the curriculum at the UTHSC COM there are no true second year students. Recruitment of students to participate in the study continued over the Summer and into the Fall semester. Students that had or were being interviewed for this study were in the second-year cohort. Frist year students were not added to be recruited for this study as the authors had a greater interest in how medical students used practice questions to study during the pre-clinical curriculum. At the beginning of the Fall semester, first-year students had been exposed to a limited amount of the pre-clinical curriculum and would more than likely answer interview questions based on their educational experiences prior to medical school. First year medical students were excluded from the study as including them may have introduced confounding variables from their prior training that could have obfuscated the findings. Second-year medical students were the primary focus over more senior medical students, as there was greater interest amongst the authors in how medical students used practice questions to study during the pre-clinical curriculum. Medical students interviewed were beginning their second year of study and likely possessed a successful study routine due to passing their first-year courses. To identify potential research participants, an email was sent through the class email distribution list to recruit students from the entire second-year class. For participating in the study, research participants were provided with a free coffee thermos. Medical students that were a part of the three-year MD program cohort were excluded from the study. Sampling and recruitment were stopped once thematic saturation was reached. In total, ten interviews were conducted and included in qualitative thematic analysis. The class contains 180 students. Therefore, 5.5% of the class was interviewed. To protect the confidentiality of our research participants, demographic characteristics of research participants were not collected. Interview questions focused primarily on the research question. Ethical approval for this research study was obtained from the IRB at UTHSC and the Homewood IRB at Johns Hopkins University. The consolidated criteria for reporting qualitative research (COREQ) was consulted as a checklist for reporting this research [ 26 ]. A completed COREQ checklist is included in the supplemental section.
Data collection
The interview guide used in this study was developed for this study. The interview guide included the following questions: (1) How do you use practice questions and their rationales in your studies?(2) Do you always use practice questions this way, or does it change based on other factors? (3) [after being handed a sample practice question (appendix 1 )] Can you talk me through how you use this practice question to study? Clarifying questions included: (1) Can you explain that to me? (2) Can you tell me more about that? One investigator (D.S.) conducted the interviews. D.S. is not associated with the COM at UTHSC; he is an Instructional Consultant, with a PhD in Communications, housed within the UTHSC campus Teaching and Learning Center. D.S. conducted and recorded the interviews anonymously using the Zoom platform. Zoom was also used to generate initial transcripts of the interviews. A different member of the research team (D.D.) edited, updated, and confirmed these transcripts using the audio-video recordings of the interviews. D.D. is a member of the staff within the Office of Medical Education within the COM at UTHSC. To preserve anonymity of the research participants, all names and personal identifiers were removed prior to qualitative thematic analysis. Prior to the initiation of the interview, a brief informed consent statement was presented orally to research subjects. A research subject’s willingness to participate in the study constituted documentation to their consent. In an attempt to avoid potential bias, the principal investigator (R.S.) was not disclosed to be a part of the research study prior to initiation of interviews. R.S. served as the Assistant Dean of the Pre-Clinical Curriculum within the COM at UTHSC. R.S. was revealed to be the principal investigator of the study to the research participants once saturation was reached and data collection ceased.
Data analysis
Transcripts from the first ten interviews were used to build initial codes for qualitative thematic analysis. Impactful text segments and quotations that stood on their own formed the basis of analysis [ 27 ]. R.S. and D.S. independently determined codes and sub-codes after individually reading through the interview transcripts. Deidentified interview transcripts were hand-coded after being uploaded into a qualitative analysis software, Dedoose ® (Manhattan Beach, CA, USA). Dedoose aided in generating initial codes and in developing and reviewing themes. D.S. uses qualitative methods as a part of his scholarship and has a background in qualitative methods from his PhD training. D.S. viewed the data through the lens of an instructional consultant and his interactions with faculty at UTHSC. R.S. also has a background in qualitative methods from his Master of Education in the Health Professions (MEHP) degree. R.S. viewed this data through the lens of a teaching faculty member within the pre-clinical curriculum and as an academic administrator. After an initial analysis D.S. and R.S. met to share findings and to reconcile a single set of codes. A third analyst (M.R.) also reviewed the transcripts independently and acted as a tiebreaker during this reconciliation process. M.R. is a psychology professor and has a background in cognition and qualitative methods in her Experimental Psychology PhD training. M.R. viewed this data through the lens of an educator and as an experienced qualitative researcher. Interview transcripts were again read by D.S. and R.S. to develop themes independently. The qualitative data from the interview transcripts were analyzed using thematic analysis to determine patterns of meaning [ 28 ]. M.R. again acted as a tiebreaker as all three data analysts agreed on themes. At this time, sampling ceased due to the saturation and appearance of similar codes and repeated themes in the analyzed transcripts [ 29 , 30 ]. Reported here are the thematic qualitative findings with corresponding representative quotations.
All interviewees were familiar with the use of practice questions and their rationales as a study strategy in medical school. Identified themes center on how second-year medical students use practice questions to learn, the identification of the rationale as the most important part of the practice question, and how practice questions are perceived as being designed to be used once or having a single-use as a study tool.
Using practice questions to learn
Medical students use practice questions for self-assessment; however, the timing of their use in proximity to an exam and student reliance on practice questions during dense sections of the curriculum suggests they also use them for memorization and primary learning. Dense courses in medical school are defined as those that cover topics not typically encountered at the undergraduate level, including pharmacology and pathology, over a condensed period.
One participant stated their heavy use of practice questions in a dense course that takes place in the Spring of their first year of training as follows:
There was just so much information and so I used practice questions more regularly throughout the block rather than just concentrating at the end. Just because it was just a lot and that was a good way for me to quickly understand it and get it in my mind.
Another participant agreed when they stated:
Yeah. Probably when we did our CMOD [Common Mechanisms of Disease] block , there was common mechanisms of disease. There was just so much information and so I used practice questions more regularly throughout the block rather than just concentrating at the end.
This same participant went on to describe how they used practice questions early on in medical school:
Something like Anatomy , which was our first semester , I used to do just five questions a day on Grey’s Anatomy book. It doesn’t matter if I actually know the questions. Because that way , it can actually help me to think through it. That was like first semester , which I just barely started medical school.
Confidence played a role for one participant as they declared, “I think depending on how I’m feeling. If I feel less confident about something, then I will do more practice questions. If I feel pretty confident, then I will not.” When asked if the participants felt like practice questions were an effective use of their time for studying, one participant replied, “I think it’s probably the most effective use of your time. I think almost all medical students will use practice questions exclusively for the last couple years.”
Importance of practice question rationales
Medical students place more emphasis on the rationales and determining the reasoning of why correct answers are correct and why incorrect answers are incorrect than they do on selecting the right answer choice and using test-wise skills to come to a correct answer prior to looking at the rationale.
One participant disclosed this about practice question rationales:
Rationales are the most important ones because – I don’t think it’s a matter of just getting one question right especially in practice. I think what matters is organizing and then making sure my thinking process is correct. And then so something like , I have this thinking process. And then most of the time I confirm whether this is the right thinking process and when rationales are not good - I can’t confirm what changed.
Another participant discussed the importance of rationales and their differing use based on timing. They stated:
Probably 3 , 4 , 5 days before the exam , I’m looking at rationales pretty closely. The day before the exam , I’m not really looking at - it’s more like getting quick – I’m trying not to like study things super in depth the day before the exam because I’m just trying to see a lot of things. So [it’s] more about consolidating those details. I guess I’m not really sure. The rationales 5 , 6 days before the exam…rationales really helped me figure out , what are the high points of things that won’t take me a long time to study but that if I can just review them quickly , they’ll add a handful of extra points to my total , you know. Things that I can clarify right now for the next 10 min , and then I’m solid on it for the exam.
When given an actual practice question, one participant shared their process for using the practice question and rationale:
For this , I would probably – just because this one I’m not really sure – I would probably not answer the question and then review the material and then come back to it because I feel like if I were to just randomly guess and then look at the rationale , it’s just kind of a waste of an opportunity to actually check myself and sometimes practice questions are harder to find. There’s certain subjects that maybe there’s a ton , and I’d be less concerned about that then , but still just kind of a waste of my time , I think.
In relation to determining the reasoning of the practice question rationale, one participant asserted, “So a lot of the times when using the rationale for why something is incorrect, I like to kind of rewire my understanding of something and make sure I understand this is why you should rule out this answer.”
Practice questions as single-use study tools
Another emergent theme was that medical students interviewed did not use retrieval practice with their use of practice questions as medical students view practice questions as being designed to be used once as a study tool.
When a participant was asked about their use of practice questions and their reusability, they stated:
I like to say I do , but I typically…I don’t , like I should , but I don’t. Because I’ve tried that and what happens is I end up just knowing the answers based on previous questions. So , if I had more questions , that will be better.
When asked about reviewing a single practice question multiple times, one participant stated:
If I get it right , I typically don’t review them. If I get it wrong , I might. It depends , because usually I do practice questions in sections right. So , if it’s a test on eMedley [learning management system] …if I get like a core percentage on the overall then I’ll do that again like maybe the next day or a couple days later. But if I did pretty good overall then I just won’t look at the practice questions again.
Some participants stated that they use practice questions to guide future studies using the flashcard program Anki. If a knowledge gap was identified after reading the rationale of the question or if the participant selected the wrong answer, they would go back to find Anki flashcard decks or make their own flashcards to review the topic.
One participant specifically described this process:
I usually make flashcards based on the questions , based on the main ideas so I can remember it down the line… So , I would either find premade ones already related to the topic or make one specifically for the portion I missed… I basically read the explanation and try to find cards or make my own notes on aspects that I missed , always the facts that the explanations give.
Practice questions can be used for short-term gain, long-term material retention, and are a popular study technique among medical students [ 20 ]. The findings of this qualitative study indicate that the way medical students who participated in interviews use practice questions in their studies differ based on the density of the learning topic or differences in learning goals. Thematic analysis of interviews with second-year medical students suggests that while medical students use practice questions for self-assessment, the timing of when medical students use practice questions in relation to exams and medical student reliance on practice questions in dense courses indicates that medical students often use practice questions both for review and for primary learning. The finding that multiple medical students described only using practice questions to study immediately before the exam and how they place more emphasis on the rationale versus the question itself supports the conclusion that students use practice questions for both primary learning and self-assessment. Cognitive Load Theory (CLT) is a theoretical framework that suggests that learners have a limited working memory capacity that can be easily overloaded with new information [ 31 ]. This theory divides cognitive load into three types: intrinsic (the complexity of the subject matter), extraneous (the way information is presented to the learner), and germane (the work put into creating a permanent store of knowledge). Given the preference to use practice questions immediately before an exam, it would be reasonable to conclude that they can help reduce extraneous cognitive load by guiding learners to focus on the essential elements of the material. By engaging with practice questions, learners are actively processing information, organizing it into coherent structures, and integrating it with their prior knowledge, thereby reducing germane load. This process helps in forming deeper understandings and long-term retention of the material; however, again, given the proximity to the exam, it’s questionable if this practice allows for retention in working memory versus long-term memory. Last, considering exam preparation, practice questions may also help manage the intrinsic cognitive load by breaking down complex information into smaller, more manageable parts.
Multiple medical students indicated that they used Anki for retrieval practice; however, medical students tended to view practice questions as having a single-use. This indicates that medical students may not be using practice questions as faculty intend them to be used multiple times as a tool for self-assessment. Practice questions allow students to actively recall learned information and use retrieval practice to enhance their long-term retention of the material versus repeated studying [ 22 ]. CLT would posit that a better use of practice questions could perhaps be incremental, where learners can gradually build up their understanding over time without overwhelming their working memory. However, medical students may not use practice questions optimally if they are used for primary learning rather than self-assessment. Self-Regulated Learning (SRL) theory in medical education emphasizes the importance of learners’ active control over their own learning processes [ 32 ]. It involves setting goals and monitoring and regulating cognition, motivation, and behavior toward achieving those goals. Practice questions have a significant role in SRL by helping students set goals, monitor, and regulate their learning, reflect on their performance, stay motivated, build self-efficacy, adapt to new information, manage their time effectively, and develop resilience. Students reported preference for using practice questions for primary learning may assist students in feeling they’ve achieved their own goals by completing a certain number or a complete section of practice questions.
Constructivism posits that learners construct their own understanding and knowledge of the world, through experiencing things and reflecting on those experiences [ 33 ]. In medical education, the constructivist approach can be particularly useful because it mirrors the way medical practitioners encounter and solve problems in the real world. Construction of knowledge occurs on already existing knowledge. Anki has substantial question banks, which makes it an appealing application to allow students to check their knowledge [ 34 ]. However, using questions to construct new knowledge seems inefficient. Similarly, the repeated use of practice questions would help in developing and refining schemas for medical knowledge; however, we were surprised to see that students considered them one use only.
Students who used practice questions for self-assessment rather than as a primary source of learning had better assessment outcomes [ 23 ]. Self-assessments that use practice questions should be thoughtfully inserted, in regard to timing and availability, into the curriculum to optimize their ability to promote learning and to best take advantage of adult learning theory [ 7 , 35 ]. The results of this study suggest that the ways in which medical students use practice questions may not maximize the capacity of the practice question to best enhance their learning outcomes.
Limitations and future directions
Future mixed methods studies should focus on generalizing findings from this thematic qualitative analysis and exploring new connections between existing quantitative data sets. The themes generated in this study can be used to craft a class-wide medical student survey or to expand research to multiple medical student populations from different institutions to test these findings and to assess generalizability. Additionally, comparing the qualitative findings reported here with quantitative data from a learning management system (LMS) may provide additional insights into practice question use by medical students. LMS data would allow for reliable quantitative information on how medical students use practice questions by giving insight into the number of practice questions completed, time spent on individual practice questions, time spent on practice question quizzes, the number of times a student completes the same practice question, and the time between quiz access and a unit exam. Artificial intelligence (AI) may also play a role in future studies due to ease of access and its ability to generate practice questions [ 36 ]. There are several limitations that must be acknowledged with this study. A pilot study at a single institution limits its generalizability; however, given this is the first attempt that authors know of to quantify these data, it still serves an important, hypothesis-generating purpose for future studies. It remains to be determined how generalizable this finding is in the greater medical student population; another limitation to the study is a self-selection bias. Similar findings were seen in another study where medical students were found to highly utilize practice questions as a study technique, especially in times of stress and anxiety [ 21 ]. While the authors took great care in our methodology using individual thematic analysis of faculty at two different institutions, there remains the possibility of subjectivity whereby our own experiences might have influenced the identified themes [ 37 ].
Significant insight into the ways in which current medical students use practice questions has the potential to increase understanding of how best to integrate practice questions within coursework and curricula to enhance learning outcomes in undergraduate medical education. Identified uses do not consistently align with what could be expected from established learning theories. Investigating medical student study utilization of practice questions in their studies may allow for the future blending of techniques students already use with best teaching and learning practices to create a new practice question platform to optimize medical student satisfaction and learning outcomes.
Data availability
Select quotes supporting the qualitative thematic analysis are provided within the manuscript. Full transcripts are included as supplementary information files.
Cruess SR. Professionalism and medicine’s social contract with society. Clin Orthop Relat Res. 2006;449:170–6.
Article Google Scholar
Dickinson BL, Gibson K, VanDerKolk K, Greene J, Rosu CA, Navedo DD, et al. It is this very knowledge that makes us doctors: an applied thematic analysis of how medical students perceive the relevance of biomedical science knowledge to clinical medicine. BMC Med Educ. 2020;20(1):356.
Woods NN, Brooks LR, Norman GR. The role of biomedical knowledge in diagnosis of difficult clinical cases. Adv Health Sci Educ. 2007;12(4):417.
Woods NN. Science is fundamental: the role of biomedical knowledge in clinical reasoning. Med Educ. 2007;41(12):1173–7.
Knowles M. The modern practice of adult education: from pedagogy to andragogy. 2 ed. New York: Cambridge Books; 1980.
Google Scholar
Merriam S, Bierema L. Adult learning: linking theory and practice. San Francisco: Jossey-Bass; 2014.
Reed S, Shell R, Kassis K, Tartaglia K, Wallihan R, Smith K, et al. Applying adult learning practices in medical education. Curr Probl Pediatr Adolesc Health Care. 2014;44(6):170–81.
Densen P. Challenges and opportunities facing medical education. Trans Am Clin Climatol Assoc. 2011;122:48–58.
Ronner L, Linkowski L. Online forums and the step 1 climate: perspectives from a Medical Student Reddit user. Acad Med. 2020;95(9):1329–31.
Corell A, Regueras LM, Verdu E, Verdú MJ, de Castro JP. Effects of competitive learning tools on medical students: a case study. PLoS ONE. 2018;13(3).
Dunn LB, Iglewicz A, Moutier C. A conceptual model of Medical Student Well-Being: promoting resilience and preventing burnout. Acad Psychiatry. 2008;32(1):44–53.
Ellaway R, Masters K. AMEE Guide 32: e-Learning in medical education part 1: learning, teaching and assessment. Med Teach. 2008;30(5):455–73.
Haq R, Li B, Jovicic A, Dastur D, Trinkaus M, Kong A. Web-based Oncology Educational Tool for Medical Trainees on Oncology Rotation-results of a pilot study. J Cancer Educ. 2018;33(4):788–97.
Lewis PJ, Chen JY, Lin DJ, McNulty NJ. Radiology ExamWeb: development and implementation of a national web-based examination system for medical students in radiology. Acad Radiol. 2013;20(3):290–6.
Roffler M, Sheehy R. Self-reported learning and study strategies in First and Second Year Medical Students. Med Sci Educ. 2022;32(2):329–35.
Baños JH, Pepin ME, Van Wagoner N. Class-wide access to a commercial step 1 question bank during preclinical organ-based modules: a pilot project. Acad Med. 2018;93(3):486–90.
Bonasso P, Lucke-Wold B 3rd, Reed Z, Bozek J, Cottrell S. Investigating the impact of preparation strategies on USMLE Step 1 performance. MedEdPublish. 2015;4(1).
Kortz MW, Kongs BM, Bisesi DR, Roffler M, Sheehy RM. A retrospective and correlative analysis of academic and nonacademic predictors of COMLEX level 1 performance. J Osteopath Med. 2022.
Bauzon J, Alver A, Ravikumar V, Devera A, Mikhael T, Nauman R, et al. The impact of Educational resources and Perceived preparedness on Medical Education performance. Med Sci Educ. 2021;31(4):1319–26.
Briscoe GW, Fore-Arcand L, Levine RE, Carlson DL, Spollen JJ, Pelic C, et al. Psychiatry clerkship students’ preparation, reflection, and results on the NBME psychiatry subject exam. Acad Psychiatry. 2009;33(2):120–4.
Yavner SD. Stress, fatigue, and medical students’ study resource selection: implications for the design of educational multimedia. Education, and Human Development: New York University;: Steinhardt School of Culture; 2016.
Roediger HL 3rd, Butler AC. The critical role of retrieval practice in long-term retention. Trends Cogn Sci. 2011;15(1):20–7.
Brothen T, Wamback C. Effective student use of computerized quizzes. Teach Psychol. 2001;28(4):292–4.
Bijol V, Byrne-Dugan CJ, Hoenig MP. Medical student web-based formative assessment tool for renal pathology. Med Educ Online. 2015;20:26765.
Zhao C, Hu Y. Reflections on study strategy modifications using cognitive load theory and dual Processing Theory in the First Year of Medical School. Med Sci Educ. 2021;31(2):1–6.
Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349–57.
Miller W, Crabtree B. Primary care research: a multimethod typology and qualitative road map. Doing qualitative Resarch. Newbury Park, CA: Sage; 1992.
Braun V, Clarke V. Thematic analysis. In: Cooper H, editor. APA Handbook of Research Methods in psychology: vol 2 research designs. Volume 2. American Psychological Association; 2012.
Hennink M, Kaiser BN. Sample sizes for saturation in qualitative research: a systematic review of empirical tests. Soc Sci Med. 2022;292:114523.
Saunders B, Sim J, Kingstone T, Baker S, Waterfield J, Bartlam B, et al. Saturation in qualitative research: exploring its conceptualization and operationalization. Qual Quant. 2018;52(4):1893–907.
Young JQ, Van Merrienboer J, Durning S, Ten Cate O. Cognitive load theory: implications for medical education: AMEE Guide 86. Med Teach. 2014;36(5):371–84.
Boekaerts M. Self-regulated learning: a new concept embraced by researchers, policy makers, educators, teachers, and students. Learn Instruction. 1997;7(2):161–86.
Thampinathan S. The application of the constructivism learning theory to physician assistant students in primary care. Educ Health (Abingdon). 2022;35(1):26–30.
AMBOSS, Anki Qbank. 2024 [ https://www.amboss.com/us/anki/qbank
Ghosh P, Jacob J, Goldman E, Manikoth N. Optimizing the Use of an online self-assessment exam to Promote Self-directed learning behaviors in medical students. Med Sci Educ. 2020;30(1):81–5.
Narayanan S, Ramakrishnan R, Durairaj E, Das A. Artificial Intelligence revolutionizing the field of Medical Education. Cureus. 2023;15(11):e49604.
Olmos-Vega FM, Stalmeijer RE, Varpio L, Kahlke R. A practical guide to reflexivity in qualitative research: AMEE Guide 149. Med Teach. 2023;45(3):241–51.
Download references
Acknowledgements
The authors would like to acknowledge the support of the College of Medicine at the University of Tennessee Health Science Center and the University of Kansas School of Medicine, Salina campus for this research study. This project was completed as a component of the degree Master of Education in the Health Professions (MEHP) within Johns Hopkins School of Education.
No funding was obtained for this study.
Author information
Authors and affiliations.
Department of Family Medicine, School of Medicine, University of Kansas Medical Center, Salina, KS, USA
Ryan Sheehy
Teaching and Learning Center, University of Tennessee Health Science Center, Memphis, TN, USA
Devin Scott
Office of Medical Education, College of Medicine, University of Tennessee Health Science Center, Memphis, TN, USA
Diveena Davis
College of Arts and Sciences, Rockhurst University, Kansas City, MO, USA
Marissa Roffler
Department of Pharmacology, Addiction Science, and Toxicology, College of Medicine, University of Tennessee Health Science Center, Memphis, TN, USA
Trevor Sweatman
College of Health Professions, Sacred Heart University, Fairfield, CT, USA
You can also search for this author in PubMed Google Scholar
Contributions
All authors made substantial contributions to this manuscript. R.S., M.R., T.S., and E.N. contributed to the design of the work. D.S. and D.D. contributed to the acquisition of data. R.S., D.S., and M.R. contributed to the analysis of the data. R.S., D.S., M.R., and E.N. contributed to the interpretation of the data. R.S. initially drafted the manuscript with revisions provided by D.S., M.R., and E.N. All authors have approved the submitted version of this manuscript.
Corresponding author
Correspondence to Ryan Sheehy .
Ethics declarations
Ethical approval and consent to participate.
Ethical approval for this research study was obtained from the IRB at the UTHSC and the Homewood IRB at Johns Hopkins University. The study was deemed exempt under 45 CFR 46.104(d) (2)(iii). A brief informed consent statement was presented orally to research subjects. A research subject’s willingness to participate in the study constituted documentation to their consent.
Consent for publication
Not applicable.
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s note.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Supplementary Material 1
Supplementary material 2, supplementary material 4, rights and permissions.
Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/ .
Reprints and permissions
About this article
Cite this article.
Sheehy, R., Scott, D., Davis, D. et al. Medical student use of practice questions in their studies: a qualitative study. BMC Med Educ 24 , 1181 (2024). https://doi.org/10.1186/s12909-024-06168-6
Download citation
Received : 30 July 2024
Accepted : 10 October 2024
Published : 21 October 2024
DOI : https://doi.org/10.1186/s12909-024-06168-6
Share this article
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative
- Undergraduate medical education
- Study strategies
- Qualitative research
- Practice questions
- Medical school
BMC Medical Education
ISSN: 1472-6920
- General enquiries: [email protected]
Making crosscutting concepts explicit for senior high school students through concept-based instructions and improving their understanding thereof
- Original Research
- Published: 29 October 2024
Cite this article
- Dongxue Jin ORCID: orcid.org/0000-0003-1988-2560 1 , 2 &
- Enshan Liu ORCID: orcid.org/0000-0001-7032-034X 2
Clearly defining and clarifying crosscutting concepts (CCCs) helps students to apply them as thinking tools or lenses to understand disciplinary core ideas and science and engineering practices. This study identified three characteristics of the sub-concepts of CCCs: conceptual, superordinate, and common across disciplines, and explored a way based on the 5E instructional model that supports making CCCs explicit. A targeted and coherent unit of scale (one of the CCCs) served as an example to introduce the design and implementation of the instructions to externalise CCCs to students. After defining the four sub-concepts of scale based on scientific research literature, supportive teaching activities were selected and organised according to the 5E instructional model. There were 65 students (35 boys and 30 girls; 59 students in Grade One and six in Grade Two), who participated for two rounds of a CCCs elective course that we offered. They were all East Asian, aged 15–17, and came from 22 different classes. Most of them had chosen science as the compulsory subject to take the future university entrance exam. Through quantitative and qualitative analyses of students’ responses to the paper test, multiple group interviews, and group work, we determined their spontaneous uncertainty, pre-concepts, and prior foundational experiences before entering the unit; identified their process of activating, constructing, and clarifying thinking during the unit; and found their better understanding of the three characteristics of scale after the unit. The 5E-based instruction facilitated active learning, conceptual change, and transfer by actively constructing understanding, formalising knowledge, and interrelating disciplines.
This is a preview of subscription content, log in via an institution to check access.
Access this article
Subscribe and save.
- Get 10 units per month
- Download Article/Chapter or eBook
- 1 Unit = 1 Article or 1 Chapter
- Cancel anytime
Price includes VAT (Russian Federation)
Instant access to the full article PDF.
Rent this article via DeepDyve
Institutional subscriptions
Data availability
The data generated during the current study are partially included in this article and the other are available from the corresponding author on reasonable request.
American Association for the Advancement of Science (AAAS). (1989). Science for all Americans. Project 2061. Retrieved September 25, 2022, from http://www.project2061.org/publications/sfaa/online/sfaatoc.htm
Anderson, L. W., Krathwohl, D. R., Airasian, P. W., Cruikshank, K. A., Mayer, R. E., Pintrich, P. R., Raths, J., & Wittrock, M. C. (2009). A taxonomy for learning, teaching, and assessing. In: X. P. Jiang, Q. M. Zhang, & J. J. Luo, (Trans.). Foreign Language Teaching and Research Press.
Australian Curriculum, Assessment and Reporting Authority (ACARA). (2020). The Australian curriculum (science, version 8.4) . Retrieved September 25, 2022, from https://www.australiancurriculum.edu.au/download/DownloadF10
Balci, S., Cakiroglu, J., & Tekkaya, C. (2006). Engagement, exploration, explanation, extension, and evaluation (5E) learning cycle and conceptual change text as learning tools. Biochemistry and Molecular Biology Education, 34 (3), 199–203. https://doi.org/10.1002/bmb.2006.49403403199
Article Google Scholar
Barnes, M. E., Elser, J., & Brownell, S. E. (2019). Impact of a short evolution module on students’ perceived conflict between religion and evolution. The American Biology Teacher, 79 (2), 104–111. https://doi.org/10.1525/abt.2017.79.2.104
Bauer, S. (2019). The impact of the chukwin mini-unit on students’ understanding of natural selection. The American Biology Teacher, 79 (2), 120–127. https://doi.org/10.1525/abt.2017.79.2.120
Baumfalk, B., Bhattacharya, D., Vo, T., Forbes, C., Zangori, L., & Schwarz, C. (2019). Impact of model-based science curriculum and instruction on elementary students explanations for the hydrosphere. Journal of Research in Science Teaching, 56 (5), 570–597. https://doi.org/10.1002/tea.21514
Bransford, J. D., Brown, A. L., & Cocking, R. R. (Eds.). (2013). How people learn: Brain, mind, experience, and school: Expanded edition. K. L. Cheng, Y. L. Sun, & X. Q. Wang, (Trans.). East China Normal University Press.
Bybee, R. W., Taylor, J. A., Gardner, A., Scotter, P. V., Powell, J. C., Westbrook, A., & Landes, N. (2006). The BSCS 5E instructional model: Origins, effectiveness, and applications. BSCS. Retrieved December 12, 2022, from https://www.researchgate.net/publication/242363914_The_BSCS_5E_Instructional_Model_Origins_Effectiveness_and_Applications
Cardak, O., Dikmenli, M., & Saritas, O. (2008). Effect of 5E instructional model in student success in primary school 6th year circulatory system topic. Asia-Pacific Forum on Science Learning and Teaching, 9 (2), Article 10.
Chen, X. M. (2000). Qualitative research in social sciences . London: Educational Science Publishing House.
Google Scholar
Chesnutt, K., Jones, M. G., Corin, E. N., Hite, R., Childers, G., Perez, M. P., Cayton, E., & Ennes, M. (2019). Crosscutting concepts and achievement: Is a sense of size and scale related to achievement in science and mathematics? Journal of Research in Science Teaching, 56 (3), 302–321. https://doi.org/10.1002/tea.21511
Chesnutt, K., Jones, M. G., & Hite, R. (2018). Next generation crosscutting themes: Factors that contribute to students’ understandings of size and scale. Journal of Research in Science Teaching, 55 (6), 876–900. https://doi.org/10.1002/tea.21443
College Board. (2009). Science college board standards for college success . The College Board. Retrieved September 25, 2022, from https://secure-media.collegeboard.org/apc/cbscs-science-standards-2009.pdf
Czerniak, C. M., & Johnson, C. C. (2014). Interdisciplinary science teaching. In N. G. Lederman & S. K. Abell (Eds.), Handbook of research on science education (Vol. II, pp. 395–411). Routledge.
De Poorter, J., De Lange, J., Devoldere, L., Van Landeghem, J., & Strubbe, K. (2016). Deep understanding of electromagnetism using crosscutting concepts. Physics Education, 52 (1), 1–9.
Department for Education. (2014). The national curriculum in England: Key stages 3 and 4 framework document . Retrieved September 25, 2022, from https://www.gov.uk/government/publications/national-curriculum-in-england-secondary-curriculum
Dosemagen, D. M., & Schwalbach, E. M. (2019). Legitimacy of and value in action research. In C. A. Mertler (Ed.), The Wiley handbook of action research in education. London: Wiley Blackwell.
Duschl, R. A. (2012). The second dimension-crosscutting concepts: Understanding a framework for K-12 science education. Science Scope, 35 (6), 6–9.
Feng, Z. L., Wu, X. C., Yao, M. L., & Wang, J. M. (2015). Educational psychology (3rd ed.). London: People’s Education Press.
Fick, S. J. (2018). What does three-dimensional teaching and learning look like? Examining the potential for crosscutting concepts to support the development of science knowledge. Science Education, 102 (1), 5–35. https://doi.org/10.1002/sce.21313
Fick, S. J., Chiu, J. L., & McElhaney, K. W. (2022). An examination of elementary classroom dialogue: Implicit and explicit use of the NGSS crosscutting concepts in an integrated STEM unit. Journal of Science Teacher Education, 33 (4), 435–457. https://doi.org/10.1080/1046560X.2021.1961974
Fick, S. J., McAlister, A. M., Chiu, J. L., & McElhaney, K. W. (2021). Using students’ conceptual models to represent understanding of crosscutting concepts in an NGSS-aligned curriculum unit about urban water runoff. Journal of Science Education and Technology, 30 , 678–691. https://doi.org/10.1007/s10956-021-09911-6
Fu, X., & Liu, E. S. (2016). Using WISE materials to design an inquiry-based curriculum with the 5E instructional model. The American Biology Teacher, 78 (3), 208–219. https://doi.org/10.1525/abt.2016.78.3.208
Gagné, R. M., Briggs, L. J., & Wager, W. W. (1992). Principles of instructional design (4th ed.). London: Harcourt Brace Jovanovich College Publishers.
Gall, M. D., Brown, A. L., Gall, J. P., & Brog, W. R. (2010). Applying education research (6th ed.). London: Pearson Education Inc.
Garcia, I., Grau, F., Valls, C., Piqué, N., & Ruiz-Martín, H. (2021). The long-term effects of introducing the 5E model of instruction on students’ conceptual learning. International Journal of Science Education, 43 , 1–18. https://doi.org/10.1080/09500693.2021.1918354
Hall, J. A. (2018). Flipping with the first principles of instruction: An examination of preservice teachers’ technology integration development. Journal of Digital Learning in Teacher Education, 34 (4), 201–218. https://doi.org/10.1080/21532974.2018.1494520
Hmelo-Silver, C. E., Marathe, S., & Liu, L. (2007). Fish swim, rocks sit, and lungs breathe: Expert-novice understanding of complex systems. Journal of the Learning Sciences, 16 (3), 307–331. https://doi.org/10.1080/10508400701413401
Hokkanen, S. L. (2011). Improving student achievement, interest and confidence in science through the implementation of the 5E learning cycle in the middle grades of an urban school. Master Dissertation, Montana State University. Bozeman, Montana. Retrieved December 12, 2022, from https://scholarworks.montana.edu/xmlui/bitstream/handle/1/1487/HokkanenS0811.pdf?sequence=1&isAllowed=y
Illinois. (2012). What changes our minds? (Toxicants): Toxicants, exposure, and the environment. Retrieved September 25, 2022, from https://neuron.illinois.edu/curriculum-units.html
Keeley, P. (2008). Science formative assessment: 75 Practical strategies for linking assessment, instruction, and learning . London: Corwin Press.
Koyunlu Ünlü, Z., & Dökme, İ. (2022). A systematic review of 5E model in science education: Proposing a skill-based STEM instructional model within the 21st century skills. International Journal of Science Education, 44 (13), 2110–2130. https://doi.org/10.1080/09500693.2022.2114031
Krajcik, J., & Reiser, B. J. (2021). How crosscutting concepts, disciplinary core ideas, and science and engineering practices work together in the classroom. In J. Nordine & O. Lee (Eds.), Crosscutting concepts: Strengthening science and engineering learning (pp. 19–41). National Science Teaching Association Press.
Lauren, H., Lutz, C., Wallon, R. C., & Hug, B. (2016). Integrating the dimensions of NGSS within a collaborative board game about honey bees. The American Biology Teacher, 78 (9), 755–763. https://doi.org/10.1525/abt.2016.78.9.755
Li, C. J. (2011). The Moon’s orbit in the solar system: From a college entrance exam question. Secondary School Physics, 29 (4), 61.
Liftig, I. (2015). Crosscutting concepts: The ties that bind. Science Scope, 38 (7), 1.
Liu, E. S. (2012). Biology: Why to highlight key ideas. People’s Education, 6 , 45–46.
Liu, E. S. (Ed.). (2022). Interpretation of biology curriculum standards (2022 edition) for compulsory education . London: Beijing Normal University Publishing Group.
Lock, G., & Molyneaux, B. L. (2006). Confronting scale in archaeology: Issues of theory and practice . Springer.
Book Google Scholar
Magana, A. J., Brophy, S. P., & Bryan, L. A. (2012). An integrated knowledge framework to characterize and scaffold size and scale cognition (FS2C). International Journal of Science Education, 34 (14), 2181–2203. https://doi.org/10.1080/09500693.2012.715316
Marceau, D. J. (1999). The scale issue in social and natural sciences. Canadian Journal of Remote Sens, 25 (4), 347–356. https://doi.org/10.1080/07038992.1999.10874734
Merrill, M. D. (2002). First principles of instruction. Educational Technology Research and Development, 50 , 43–59. https://doi.org/10.1007/BF02505024
Ministry of Education, Ontario. (2008). The Ontario curriculum, grades 11 and 12. Science (revised). Retrieved September 25, 2022, from http://www.edu.gov.on.ca/eng/curriculum/secondary/2009science11_12.pdf
Ministry of Education, Singapore. (2014). Science syllabus primary . Retrieved September 25, 2022, from https://www.moe.gov.sg/primary/curriculum/syllabus
Ministry of Education of PRC. (2022). Biology curriculum standards for compulsory education . Beijing: Beijing Normal University Publishing Group.
National Science Teaching Association (NSTA). (n.d.). Matrix of crosscutting concepts in NGSS. Retrieved September 25, 2022, from https://static.nsta.org/ngss/MatrixOfCrosscuttingConcepts.pdf
National Research Council (NRC). (1996). National science education standards . London: National Academy Press.
National Research Council (NRC). (2012). A framework for K-12 science education: Practices, crosscutting concepts, and core ideas . London: National Academies Press.
National Research Council (NRC). (2013). Next generation science standards: For states, by states . London: National Academies Press.
Nordine, J., & Lee, O. (2021). Strengthening science and engineering learning with crosscutting concepts. In J. Nordine & O. Lee (Eds.), Crosscutting concepts: Strengthening science and engineering learning (pp. 3–17). National Science Teaching Association Press.
Park, B.-Y., Campbell, T., Kelly, M., Gray, R., Arnold, C., Chadwick, C., Cisneros, L. M., Dickson, D., Moss, D. M., Rodriguez, L., Volin, J. C., & Willig, M. R. (2021). Improving NGSS focused model-based learning curriculum through the examination of students’ experiences and iterated models. Research in Science and Technological Education . https://doi.org/10.1080/02635143.2021.1978962
Perkins, D., & Blythe, T. (1994). Putting understanding up front. Educational Leadership, 51 (5), 4–7.
Piaget, J. (2015). Piaget’s selected works on education. (R. Lu, Trans.) People’s Education Press.
Posner, G. J., Strike, K. A., Hewson, P. W., & Gertzog, W. A. (1982). Accommodation of a scientific conception: Toward a theory of conceptual change. Science Education, 66 (2), 211–227. https://doi.org/10.1002/sce.3730660207
Pratt, H. (2014). Implementing NGSS crosscutting concepts: Opportunities for elementary teacher contributions. Science and Children, 52 (2), 8–11.
Quinn, H. (2021). Preface. In J. Nordine & O. Lee (Eds.), Crosscutting concepts: Strengthening science and engineering learning (pp. 19–41). National Science Teaching Association Press.
Resnick, I., Davatzes, A., Newcombe, N. S., & Shipley, T. (2017). Using relational reasoning to learn about scientific phenomena at unfamiliar scales. Educational Psychology Review, 29 (1), 11–25. https://doi.org/10.1007/s10648-016-9371-5
Ruiz-Martín, H., & Bybee, R. (2022). The cognitive principles of learning underlying the 5E model of instruction. International Journal of STEM Education, 9 , Article 21. https://doi.org/10.1186/s40594-022-00337-z
Tretter, T. R., Jones, M. G., Andre, T., Negishi, A., & Minogue, J. (2006). Conceptual boundaries and distances: Students’ and experts’ concepts of the scale of scientific phenomena. Journal of Research in Science Teaching, 43 (3), 282–319. https://doi.org/10.1002/tea.20123
Tyler, R. W. (2014). Basic principles of curriculum and instruction. (Y. Zhang, & K. Luo, Trans.). China Light Industry Press.
van Merriënboer, J. J. G., Jelsma, O., & Paas, F. G. W. C. (1992). Training for reflective expertise: A four-component instructional design model for complex cognitive skills. Educational Technology Research and Development, 40 , 23–43. https://doi.org/10.1007/BF02297047
Wang, W., Liu, E. S., & Li, Q. (2012). Preliminary study on integrating crosscutting concepts into high school biology curriculum. Bulletin of Biology, 47 (8), 29–33.
Wiggins, G., & McTighe, J. (2005). Understanding by design (2nd ed.). London: Association for Supervision and Curriculum Development ASCD.
Wu, J. G. (2007). Landscape ecology: Pattern, process, scale and hierarchy (2nd ed.). London: Higher Education Press.
Yang, W. Y., Liu, E. S., Li, X. T., & Liu, C. (2019). Preparing a concept-based lesson from a design perspective: Facilitating students’ understanding through metacognitive strategies. The American Biology Teacher, 81 (9), 610–617. https://doi.org/10.1525/abt.2019.81.9.610
Yu, H. P., & Jen, E. (2020). Integrating nanotechnology in the science curriculum for elementary high-ability students in Taiwan: Evidenced-based lessons. Roeper Review, 42 (1), 38–48. https://doi.org/10.1080/02783193.2019.1690078
Zhang, Y. Z., & Liu, E. S. (2010). The significant role of key concepts in science teaching: The transforming from memorizing facts to understanding concept. Journal of Educational Studies, 6 (1), 57–61.
Zhong, K. D. (2008). SPSS for windows: Application tutorial of data statistical analysis tool . London: Beijing Normal University Publishing Group.
Download references
This work was supported by Jilin Province Educational Science “14th Five-Year Plan” 2021 Key Project: A practical study on the improvement of interdisciplinary literacy of science normal university students under the background of New Era (JF2111).
Author information
Authors and affiliations.
School of Life Sciences, Northeast Normal University, No. 5268, Renmin St, Changchun, Jilin Province, People’s Republic of China
Dongxue Jin
College of Life Sciences, Beijing Normal University, No. 19, Xinjiekouwai St, Haidian District, Beijing, People’s Republic of China
Dongxue Jin & Enshan Liu
You can also search for this author in PubMed Google Scholar
Contributions
Conceptualization: Dongxue Jin, Enshan Liu; Methodology: Dongxue Jin, Enshan Liu; Formal analysis and investigation: Dongxue Jin; Data Curation: Dongxue Jin; Writing—original draft preparation: Dongxue Jin; Funding acquisition: Dongxue Jin; Supervision: Enshan Liu; Project administration: Dongxue Jin, Enshan Liu.
Corresponding author
Correspondence to Enshan Liu .
Ethics declarations
Conflict of interest.
No potential conflict of interest was reported by the authors.
Ethical approval
All participants were informed about the purpose of the experiment and their right as the participants with a consent form.
Additional information
Publisher's note.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This study was completed in two locations, with the major completion site placed first.
See Table 8 .
The self-developed test
Read the materials and answer the questions:
Arizona is located in the southwestern United States. The Yarnell Mountains in the state have a large area of lush forest. A forest fire broke out on this mountain on June 28, 2013. As of the evening of June 30, 19 firefighters had died while fighting the fire, but the fire was still not under control. The fire department concluded that the forest fire was caused by lightning. In addition, extremely hot weather and hot winds in the local area further accelerated the fire, causing it to spread out of control gradually. The federal government urgently sent people to help suppress the fire, which was extinguished entirely on July 10. The fire burned a total of 3400 hectares of forest and destroyed hundreds of houses.
On August 7, 1883, the Krakatau volcano in Indonesia erupted. It spewed hot magma, killing all living things in its path and leaving a piece of land bare. A few years later, grass grew sparsely, and a kind of spider appeared on the ground. By 1909, 202 species of animals were living on this new land. The number of animal species increased to 621 in 1919 and 880 in 1934. During this period, the plants gradually flourished and formed a grove.
Why did the forest fire in Yarnell Mountain gradually spread out of control, causing the forest to deviate from its original stable state? Please build a system model for analysis and explanation. Additionally, do you think these changes to the forest in Yarnell Mountain are reversible? Why?
Please plot the general changes in biological species over time and complete the abscissa axis information in the coordinate system below, respectively: Yarnell Mountain (set the initial value of biological species to 1000) from fire to fire extinguished; Krakatoa volcano from bare land to the formation of groves.
The senior grade one students at X High School conducted a project-based learning. The following are some of the research topics selected by the students:
Effects of morning exercise noise on the singing behaviours of birds in city parks.
Effects of the inhibitor EERL on the survival rate of cervical cancer cells.
Analysis of the interaction between different components when the bicycle moves.
Analysis of the working principle of bicycle derailleur.
Factors influencing the variation of the velocity of the Moon’s orbit around the Earth.
The relationship between particle size and household activated carbon adsorption efficiency.
Why does topic iii require an analysis of the bicycle as a system?
The derailleur is part of a bike. If topics iii and iv both treat their research objects as systems, is it contradictory? Why?
Scientific research is conducted on a certain scale. Among the above topics, which cannot be directly observed at the spatial scale? Why?
Can the findings of topic v also be used to explain the changes in the velocity of ground objects? Why?
Please predict the possible research results of topic vi and briefly explain the basis for the prediction.
‘Bionic machinery’ is a machine designed and manufactured by imitating the form, structure, and control principles of living things with more concentrated functions, higher efficiency, and biological characteristics. Bionic manipulators are significant to people with hand or arm disabilities. A student made a simple manipulator model using common materials and successfully grabbed the empty pop can. The process is shown in the figure below. (Materials: pencil, ruler, cardboard, straws, double-sided tape, transparent tape, thin wire, scissors)
Please evaluate the advantages and disadvantages of the manipulator model in the function of grasping.
Provide a brief improvement plan for one of the shortcomings you mentioned in (1).
There is a type of bionic manipulator that is too heavy for people with disabilities. How could you improve this? On what spatial scale would your improvement measures be considered?
How do you specifically express the spatial scale mentioned in question (3)?
At one o’clock in the afternoon, a student found a little mouse next to a green plant on the windowsill in the laboratory. He found a large glass jar and caught the mouse and the entire plant. Half an hour later, he found that the mouse was still alive.
Build a system model for both the circulation of matter and the flow of energy and explain: How did the mouse survive in the closed jar for half an hour?
The student covered the glass jar entirely with a black cloth and found the mouse dead sometime later. After removing the mouse, he used sensors to measure changes in CO 2 content in the sealed glass jar (with plants) under no-light and light conditions, and obtained the data shown in the figure below. Please analyse and explain whether ‘the black cloth completely covers the glass jar’ and ‘the death of the mouse’ are causal or correlated.
The questions discussed in the group interviews about scale .
In the first round of implementation (after the post-test):
Have you been exposed to concentrated learning of the topic system and scale before?
What did you gain from this course?
What do you think of the activities in the scale unit?
In the second round of implementation:
after the pre-test
How do you think about question 2 (3)?
Do you have any ideas about what scale is?
How do you think about question 2 (4)?
How do you think about question 3 (3)?
How do you think about question 3 (4)?
after the scale teaching unit
Did you have any ideas about what scale is before this unit? How do you understand it now? What do you think prompted this change in your understanding?
Did you have any ideas about how to observe phenomena at extreme scales before this unit? How do you understand it now? What do you think prompted this change in your understanding?
Did you have any ideas about the impact of scale changes before this unit? How do you understand it now? What do you think prompted this change in your understanding?
Did you have any ideas about the transfer of patterns across scales before this unit? How do you understand it now? What do you think prompted this change in your understanding?
after the post-test
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
Reprints and permissions
About this article
Jin, D., Liu, E. Making crosscutting concepts explicit for senior high school students through concept-based instructions and improving their understanding thereof. Instr Sci (2024). https://doi.org/10.1007/s11251-024-09687-3
Download citation
Received : 26 January 2023
Accepted : 02 October 2024
Published : 29 October 2024
DOI : https://doi.org/10.1007/s11251-024-09687-3
Share this article
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative
- Crosscutting concepts
- 5E instructional model
- Senior high school
- Find a journal
- Publish with us
- Track your research
IMAGES
VIDEO
COMMENTS
Qualitative interview introduction. Length: 45-60 minutes . Primary goal: To see things the way you see them… more like a conversation with a focus on your experience, your opinions and what you think or feel about the topics covered . 2. Verbal consent . Would you like to participate in this interview?
Rapley, Timothy John. 2001. "The 'Artfulness' of Open-Ended Interviewing: Some considerations in analyzing interviews." Qualitative Research 1(3):303-323. Argues for the importance of "local context" of data production (the relationship built between interviewer and interviewee, for example) in properly analyzing interview data.
Designing and structuring the interview Qualitative interviews can range from highly exploratory to addressing specific hypotheses. As a result, the structure of interviews can range from loose conversations to structured exchanges in which all interviewees are asked the exact same set of questions. Your choice of interview
6.1 Interviews. In-depth interviews allow participants to describe experiences in their own words (a primary strength of the interview format). Strong in-depth interviews will include many open-ended questions that allow participants to respond in their own words, share new ideas, and lead the conversation in different directions. The purpose of open-ended questions and in-depth interviews is ...
Interviews are one of the most common metods of data collection in qualitative research. However they require the researcher to have a sound understanding of their use and appropriateness.
When conducting qualitative research, the researcher often relies on a smaller group of participants, often conducts individual interviews with them and is interested in hearing their perspectives. The goal of a qualitative study isn't to find wide generalizations but to identify and analyze specific examples of a certain phenomenon and ...
qualitative research interview ... • Use open ended not closed questions ©2010 Charlie Hopkinson, courtesy of RESYST. Examples of closed questions ... An introduction to qualitative methods in health and health services research'. British Medical Journal, 311, pp.42-5.
Qualitative Research Design: An Interactive Approach. 3rd ed. Thousand Oaks, CA: SAGE. A short and accessible introduction to qualitative research design, particularly helpful for graduate students contemplating theses and dissertations. This has been a standard textbook in my graduate-level courses for years. Advanced. Patton, Michael Quinn. 2002.
The qualitative research interview. May 2011; ... Introduction. The research interview ... sample of people, due to the large amount of time and effort involved and limitation of. access.
Qualitative research methods. Each of the research approaches involve using one or more data collection methods.These are some of the most common qualitative methods: Observations: recording what you have seen, heard, or encountered in detailed field notes. Interviews: personally asking people questions in one-on-one conversations. Focus groups: asking questions and generating discussion among ...
Doing Interview-based Qualitative Research - October 2015 ... Some examples of interpretative research. 3. ... 1 Introduction; 2 Some examples of interpretative research; 3 Planning and beginning an interpretative research project; 4 Making decisions about participants; 5 Designing the interview guide;
Its orientation is extremely practical, with many examples drawn from my own research. .1: Characteristics of idealized quantitative and qualitative approaches 1: Criteria of reliability and ...
Introduction. In medical education research, the qualitative research interview is a viable and highly utilized data-collection tool (DiCicco-Bloom and Crabtree Citation 2006; Jamshed Citation 2014).There are a range of interview formats, conducted with both individuals and groups, where semi-structured interviews are becoming increasingly prevalent in medical education research.
type of interview process. Therefore, we detail different types of interviews for use in qualitative research. Interviews can be categorized as structured, semi-structured, and unstructured (Neergaard & Leitch, 2015; Nicholls, 2009), and choosing the right type of interview is critical in qualitative research. Types of interviews
Types of Interviews in Research | Guide & Examples. Published on March 10, 2022 by Tegan George. Revised on June 22, 2023. An interview is a qualitative research method that relies on asking questions in order to collect data. Interviews involve two or more people, one of whom is the interviewer asking the questions.
What are interviews? An interviewing method is the most commonly used data collection technique in qualitative research. 1 The purpose of an interview is to explore the experiences, understandings, opinions and motivations of research participants. 2 Interviews are conducted one-on-one with the researcher and the participant. Interviews are most appropriate when seeking to understand a ...
use of interviews in qualitative research including Spradley's (1979) book The Ethnographic Interview and Mishler's (1986) book Re search Interviewing: Context and Narrative . Research
Introduction Interviewing in qualitative research is much like good conversation. It is the process of extracting people's experiences, describing how they felt about them and how they affected their lives. It is the most widely used method in qualitative research. It is flexible, inexpensive, and does not inter-
For example, qualitative case studies most often use observations, interviews, and documents as their data sources. ... interviews are one of the most common data generation methods in qualitative research. Interview formats Interviews in qualitative research generally follow three primary formats: structured, unstructured, and semi-structured ...
M.R. viewed this data through the lens of an educator and as an experienced qualitative researcher. Interview transcripts were again read by D.S. and R.S. to develop themes independently. The qualitative data from the interview transcripts were analyzed using thematic analysis to determine patterns of meaning . M.R. again acted as a tiebreaker ...
Clearly defining and clarifying crosscutting concepts (CCCs) helps students to apply them as thinking tools or lenses to understand disciplinary core ideas and science and engineering practices. This study identified three characteristics of the sub-concepts of CCCs: conceptual, superordinate, and common across disciplines, and explored a way based on the 5E instructional model that supports ...
An in‐depth interview is a qualitative research technique that is used to conduct detailed interviews with a small number of participants. In contrast to other forms of qualitative research ...