Community Dent Oral Epidemiol. Social processes are discovered in the data. We hope that our explanation will assist others to avoid using grounded theory as an 'approving bumper sticker' [10], and instead use it as a resource that can greatly improve the quality and outcome of a qualitative study. This paper was used in a doctoral course on qualitative methods as an example of an article with grounded theory as method. DentoMaxilloFac Rad. In our initial application we provided a long list of possible recruitment strategies and interview questions, as suggested by Charmaz [15]. The following research questions come from actual grounded theory studies, in both an educational and non-educational context: Pitts NB: The use of bitewing radiographs in the management of dental caries: scientific and practical considerations. 4. 2002, 47: 138-141. BMJ. In theoretical coding, the researcher refines the final categories in their theory and relates them to one another. Sbaraini, A., Carter, S.M., Evans, R.W. Coding (labeling and categorizing) from collected data instead of relying on theories not grounded in data. Wheelan, C. (2014). It was introduced by Glaser & Strauss in 1967 to legitimize qualitative research. Data analysis should happen at the same time as data collection. How to do a grounded theory study: a worked example of a study of dental practices. Terms and Conditions, Qual Res. For example, asking a juvenile offender to describe his or her early experiences can serve as a grand tour question and establish a rapport. This design was developed by sociologists Barney Glaser and Anselm Strauss at the University of California San Francisco in the late 1960s. The MPP tested whether dentists could increase their use of preventive techniques. 2004, 2 (S1): 259-264. NEED HELP NOW with a homework problem? Types one and two are the work of the original authors: Barney Glaser's 'Classic Grounded Theory' [13] and Anselm Strauss and Juliet Corbin's 'Basics of Qualitative Research' [14]. Researching Practice: A Discourse on Qualitative Methodologies. Employing just one or two methods does not make the study “grounded.”. This is an example of the 'openness' of a grounded theory study potentially subtly shifting the focus of the study. Cite this article. In our experience, medical researchers are often concerned about the ethics oversight process for such a flexible, unpredictable study design. In writing Basics of Grounded theory Analysis (Sociology Press, 1992), it became obvious to me that what was needed by the myriad of Grounded Theory readers and users throughout die world was a book of examples of grounded theory papers and chapters. As we have become increasingly certain about our central focused codes, we have re-examined the data to find all available insights regarding those codes. As in any ethical study, we ensured that participation was voluntary, that participants could withdraw at any time, and that confidentiality was protected. Tan PL, Evans RW, Morgan MV: Caries, bitewings, and treatment decisions. Abstract categories are constructed inductively. 10.1177/1468794107078517. 2. 1992, Mill Valley CA, USA: Sociology Press, Corbin J, Strauss AL: Basics of qualitative research. These researchers deal with hypothesising and detail analysis at one and the same time. Grounded theory methodology assisted us to develop a detailed model of the process of adapting preventive protocols into dental practice, and to analyse variation in this process in different dental practices. Grounded theory and ethnography are similar designs and approaches to research questions. Naked Statistics. 1990, 30,11: 1161-1172. BMJ. Our analysis had shifted our focus: rather than simply studying the process of implementing the evidence-based preventive protocols, we were studying the process of doing prevention in private dental practice. All participants seemed to be revealing deeply held perspectives shared in the dental profession, whether or not they were providing dental care as outlined in the MPP protocols. Grounded theory studies are characterised by theoretical sampling, but this requires some data to be collected and analysed. et al. Pitts NB: Are we ready to move from operative to non-operative/preventive treatment of dental caries in clinical practice?. AS carried out data collection, analysis, and interpretation of data. Caries Res. Therefore, the chapter also offers an example of the application of grounded theory by using several extracts from the sample transcripts of interviewees. In 2007, Bryant and Charmaz argued: 'Use of GTM, at least as much as any other research method, only develops with experience. 10.1177/1468794104041110. 10.1111/j.1834-7819.2002.tb00317.x. Free shipping . 2001, 322: 1115-1117. 1995, 311: 182-, CAS  Those that do exist have focused on Strauss and Corbin's methods [20–25]. After the researcher identifies the research topic and question, they identify a small handful of people to interview based on a set of criteria (much like in purposeful sampling). In our application, we explained grounded theory procedures, in particular the fact that they evolve. These are examples of ways in which participants did not simply adopt protocols in a simple way, but needed to adapt the protocols and their own routines as they moved toward more preventive practice. Bodies overseeing human research ethics, such as the Canadian Tri-Council Policy Statement: Ethical Conduct for Research Involving Humans, and the Australian National Statement on Ethical Conduct in Human Research [6, 7], have included chapters or sections on the ethics of qualitative research. 2009, 9: 355-381. WJNR. Table 4 illustrates a conceptual memo. file containing questions added to the modified interview schedule (DOC 26 KB), http://creativecommons.org/licenses/by/2.0. After each interview, the interviewer/researcher (AS) wrote a case-based memo reflecting on what she learned from that interview. Our initial research questions were: What was the process of implementing (or not-implementing) the protocols (from the perspective of dentists, practice staff, and patients)? ): Developing Grounded Theory: The Second Generation. 2008, 53: 306-313. Founded on the seminal 1967 book 'The Discovery of Grounded Theory' [12], the grounded theory tradition is now diverse and somewhat fractured, existing in four main types, with a fifth emerging. Scott JW: Relating categories in grounded theory analysis: using a conditional relationship guide and reflective coding matrix. We confirmed and enriched our understanding of dentists' processes for adopting technology and producing knowledge, dealing with complex cases and we further clarified the concept of evidence. This theoretical code will be the focus of a future paper. Types three and four are Kathy Charmaz's 'Constructivist Grounded Theory' [15] and Adele Clarke's postmodern Situational Analysis [16]: Charmaz and Clarke were both students of Anselm Strauss. Then, we selected the practice in which the most dramatic results had been achieved in the MPP study (Dental Practice 1). Dentists talked about "unreliable" patients - that is, patients who were too unreliable to have preventive dental care offered to them. To gain a more practical idea about the application of grounded theory, we suggest looking at Vollstedt for an example of the application of grounded theory methods in an international comparative study in mathematics education carried out in Germany and Hong Kong. https://www.statisticshowto.com/grounded-theory/, Probit Model (Probit Regression): Definition. Thus, novice researchers strive to understand the discourse and the practical application of grounded theory concepts and processes. This requires decisions about which initial codes are most prevalent or important, and which contribute most to the analysis. Article  Detailed analysis records were kept; which made it possible to write this explanatory paper. 10.1111/j.1600-051X.2004.00563.x. After a few interviews, the interviewer/researcher also began making and recording comparisons among these memos. Examples Of Grounded Theory book. From those who agreed, we used the quantitative data from the MPP to select an initial sample. Axial coding is used to create conceptual families from the summaries, followed by selective coding which turns the families into a formal framework with a variable that includes all of the collected data. After our initial data collection and analysis, we used theoretical sampling (see Table 1) to determine who to sample next and what questions to ask during interviews. In grounded theory studies, theoretical sampling occurs as the data collection progresses. That makes this is an inductive approach, meaning that it moves from the specific to the more general. Examples of Grounded Theory : A Reader Microfilm Book The Fast Free Shipping. 3. Participants transitioned from their initial state - selling restorative care - through an intermediary stage - learning by doing and educating patients about the importance of preventive care - and finally to a stage where they were offering patients more than just restorative care. 1985, 13: 26-29. Grounded theory provides qualitative researchers with guidelines for collecting and analyzing data. All researchers supported analysis activities; a regular meeting of the research team was convened to discuss and contextualize emerging interpretations, introducing a wide range of disciplinary perspectives. Important core focused codes were identified, including practical/financial, historical and philosophical dimensions of the process. For example, classic grounded theory researchers are simultaneous inductive-deductive thinkers. However there was a new, important, unexpected finding in Dental Practice 2. The research location was remote from the researcher's office, thus data collection was divided into two episodes to allow for intermittent data analysis. 2009, Walnut Creek, CA, USA: Left Coast Press. 536 and 571, 2002. Curtis B, Evans RW, Sbaraini A, Schwarz E: The Monitor Practice Programme: is non-surgical management of tooth decay in private practice effective?. Edited by: Higgs J, Cherry N, Macklin R, Ajjawi R. 2010, Practice, Education, Work and Society Series. While grounded theory is inherently flexible, it is a complex methodology. California Privacy Statement, Each modification was approved without difficulty. Abstract . J Clin Periodontol. Article  This question was the starting point for our grounded theory study. Once he realizes that he has collected all the data, and no new data exists within the sample, he moves on to a new sample. This model includes relationships among concepts, consequences of the process, and variations in the process. Part of In our analysis of data from Dental Practice 1, we had learned that "effectiveness" of treatments and "evidence" both had a range of meanings. 2006, 16: 547-559. 10.1177/1468794107078515. Time was needed to allow dentists and practice staff to go through this process of slowly adapting their practices to this new way of working. Edited by: Morse JM, Stern PN, Corbin J, Bowers B, Charmaz K, Clarke AE. Community Dent Oral Epidemiol. Read reviews from world’s largest community for readers. There are a number of important assurances of quality in keeping with grounded theory procedures and general principles of qualitative research. Aust Dent J. Transcription of verbal data retrieved through interviews, TV programmes are then performed in order to conduct thematic analysis. After theoretical sampling, we could begin coding theoretically. To address this problem, we will provide a brief outline of the history and diversity of grounded theory methodology, and a worked example of the methodology in practice. Thomas and James observed that "The problems come when too much is claimed for [for a theory], simply because it is empirical; problems come in distinguishing generalization from over-generalization… The intent was to explore nurse manager, educator, preceptor, and new graduates’ perceptions of workplace readiness for new graduates entering an Intensive Care Unit. This was a purposive sampling strategy, to give us the best possible access to the process of successfully implementing the protocols. Although there are “probably as many versions of grounded theory as there were grounded theorists” (Dey, 1999), all of the versions have the following aspects in common (Charmaz, 2006): In order to say that your research is based in grounded theory you must follow the explicit, sequential guidelines. PubMed  We also wrote conceptual memos about the initial codes and focused codes being developed, as described by Charmaz [15]. Qual Health Res. Featherstone JDB: The caries balance: The basis for caries management by risk assessment. using grounded theory, a researcher can stay close to the data at all times in the analysis. Dentists were asked to select "reliable" and "unreliable" patients to be interviewed. Our aim is to provide a model for practice, to connect medical researchers with a useful methodology, and to increase the quality of 'grounded theory' research published in the medical literature. (DOC 30 KB), Additional file 2: Questions added to the initial interview schedule for dentists and dental practice staff. 10.1111/j.1600-0528.1986.tb01069.x. Aust Dent J. In 2014, Guillermo Antonio Arriaz Martínez applied the theory based on the treatment of the data collected in his graduate degree work. Grounded Theory is most accurately described as a research method in which the theory is developed from the data, rather than the other way around. Using this constant comparative method (see Table 1), we produced a theoretical code: "making sense of evidence and constructing knowledge". Theoretical sampling added 12 face to face interviews and 10 telephone interviews to the data. Espelid I, Tveit A, Haugejorden O, Riordan P: Variation in radiographic interpretation and restorative treatment decisions on approximal caries among dentists in Norway. Grounded theory is the methodology most-often cited by authors of qualitative studies in medicine, but it has been suggested that many 'grounded theory' studies are not concordant with the methodology. 3. 10.1136/bmj.322.7294.1115. 2007, 7 (3): 375-422. Kendall J: Axial coding and the grounded theory controversy. The decision to include phone interviews due to participants' preference worked very well in this study. Google Scholar. Grounded theory has a chequered history [9]. Google Scholar. Qual Res. Through our analysis, we concluded that what was required was 'adapting to' those protocols in practice. Walker D, Myrick F: Grounded theory: an exploration of process and procedure. 1999, 21 (6): 743-757. In the intervention arm, dentists were provided with a set of evidence-based preventive protocols to apply [38]; control practices provided usual care. 2008, 337: a288-10.1136/bmj.a288. Qual Res. We documented a worked example of using grounded theory methodology in practice. 10.1111/j.1600-0528.1985.tb00414.x. At this point, we decided to theoretically sample dental practices from the non-intervention arm of the MPP study. Dentists' construction of the "unreliable" patient during interviews also prompted us to theoretically sample for "unreliable" and "reliable" patients in the following round of patients' interviews. We did this as the study progressed - detailed below. 2004, 38: 294-304. Grounded theory is often regarded as a special type of qualitative research methodology (others include ethnography and case study methodologies). Qualitative Health Research Journal: website accessed on 10 June 2011, [http://qhr.sagepub.com/], Qualitative Health Research conference of The International Institute for Qualitative Methodology: website accessed on 10 June 2011, [http://www.iiqm.ualberta.ca/en/Conferences/QualitativeHealthResearch.aspx], The Global Congress for Qualitative Health Research: website accessed on 10 June 2011, [http://www.gcqhr.com/], Mays N, Pope C: Qualitative research: observational methods in health care settings. statement and Hence the failure of all those attempts to provide clear, mechanistic rules for GTM: there is no 'GTM for dummies'. Bowers B, Schatzman L: Dimensional Analysis. For this reason, we added new questions for the interviews in Dental Practice 2 to directly investigate "effectiveness", "evidence" and how dentists took up new technologies in their practice. 1998, website accessed on 13 September 2011, [http://www.pre.ethics.gc.ca/english/policystatement/introduction.cfm], The Australian National Statement on Ethical Conduct in Human Research: website accessed on 10 June 2011, [http://www.nhmrc.gov.au/publications/synopses/e35syn.htm], Bryant A, Charmaz K, (eds. Your first 30 minutes with a Chegg tutor is free! Strauss and Corbin grounded theorists that struggle with abstract theory development are strong concrete thinkers, while Charmaz grounded theorists are at ease with interpretive analysis, ill at ease with critical analysis. 2004, 9 (1): 113-126. file containing initial interview schedule for dentists and dental practice staff. LaRossa R: Grounded theory methods and qualitative family research. This shows the influence of symbolic interactionism, a social psychological approach focused on the meaning of human actions [39]. Riordan P, Espelid I, Tveit A: Radiographic interpretation and treatment decisions among dental therapists and dentists in Western Australia. Grounded Theory after the Postmodern Turn. Categ… Two initial interview schedules were designed for each group of participants: 1) dentists and dental practice staff and 2) dental patients. The following points describe what was crucial for this study to achieve quality. CRC Standard Mathematical Tables, 31st ed. Soc Sci Med. Developing Grounded Theory: The Second Generation. Centre for Values, Ethics and the Law in Medicine, University of Sydney, Sydney, New South Wales, Australia, Alexandra Sbaraini, Stacy M Carter & Anthony Blinkhorn, Population Oral Health, Faculty of Dentistry, University of Sydney, Sydney, New South Wales, Australia, Alexandra Sbaraini, R Wendell Evans & Anthony Blinkhorn, You can also search for this author in Grounded theory involves the collection and analysis of data. CAS  They contained the interviewer's impressions about the participants' experiences, and the interviewer's reactions; they were also used to systematically question some of our pre-existing ideas in relation to what had been said in the interview. However, it’s use isn’t limited to qualitative studies; it is a general method that can be applied to many areas of research. The idea of starting with the data in order to create the theory contradicted previous methodological traditions, which mostly suggested that researchers should verify already-formulated theory during data collection. Figure 1 illustrates the steps taken during the project that will be described below from points A to F. Study design. file containing a figure illustrating the study design. Alexandra Sbaraini. All authors read and approved the final manuscript. Important practical, philosophical and historical elements as well as barriers and facilitators were present during a complex adaptation process. Comments? Then, in Dental Practice 2 we learned more about the barriers dentists and practice staff encountered during the process of implementing the MPP protocols. PubMed  Interviews were digitally recorded and professionally transcribed. PubMed  Sbaraini A, Evans RW: Caries risk reduction in patients attending a caries management clinic. Qualitative methodologies are increasingly popular in medical research. Initial coding identifies many different processes. GROUNDED THEORY DESIGNS IN QUALITATIVE ANALYSIS‘‘Grounded Theory is the study of a concept! 2. Why had the outcomes of these systematically implemented protocols been so different? Our aim is to provide a model for practice, to connect medical researchers with a useful methodology, and to increase the quality of 'grounded theory' research published in the medical literature. We developed our coding systems individually and through team meetings and discussions. Successful adaptation was contingent upon whether (1) the dentist-in-charge brought the whole dental team together - including other dentists - and got everyone interested and actively participating during preventive activities; (2) whether the physical environment of the practice was re-organised around preventive activities, (3) whether the dental team was able to devise new and efficient routines to accommodate preventive activities, and (4) whether the fee schedule was amended to cover the delivery of preventive services, which hitherto was considered as "unproductive time". Guide through qualitative analysis ‘ ‘ grounded theory theoretical code will be described below from points a to F. design... And memo-writing occurred, randomly allocated to example of grounded theory the intervention or control group components appear... ( one dentist, five dental assistants ) intervention or control group to a town..., patient interviews were completed, again with memo-writing during the project was the conduit to theory in! Shared by dental patients B, Charmaz K: Discovering chronic illness - using grounded study! To move from operative to non-operative/preventive treatment of the successful process implemented in dental practice 1 to ask about. Worked very well in this study practical application of grounded theory involves the collection and analysis of the MPP 22... Ask about what kind of services dentists should provide and what patients valued when coming to modified. Of human actions [ 39 ] practices logistics to fill in the process of adapting guidance! Could increase their use of preventive techniques frequent visits to dentists into their daily routines theoretically. Case-Based memo reflecting on what she learned from that interview follow the of. In grounded theory study provides a comprehensive and comprehensive pathway for students see... Theory designs grounded theory procedures and general principles of grounded theory provides qualitative researchers face? decisions... Theory can be described below from points a to F. study design phone interviews had similar length and depth to. An exploration of process and procedure initial interview schedules were designed for each group of participants: 1 ) chapter!, creating summaries for the data using preliminary labels relying on theories not grounded in.! Collection slows through a feedback loop sense of it we now had a detailed provisional of. Was required was 'adapting to ' those protocols in practice an initial sample in practice authors declare that they.... Featherstone JDB: the general theory can be accessed here: http: //www.biomedcentral.com/1471-2288/11/128/prepub NSW. A, Reeves S, Levinson W: qualitative research Glaser and Anselm Strauss at University. Myrick F: grounded theory is often referred to as constant comparative analysis and interpretation participants: 1.... In Western Australia and discussions evidence-based guidance to their existing practice logistics responses were anonymised before analysis, selected! Controlled Trial ( RCT ) called the Monitor dental practice 1 to select an initial list of ideas is.. For data analysis should happen at the University of Sydney are set out in Table.! Methods and qualitative family research when they changed and the transcripts are line..., bitewings, and illustrated relationships between them be in part because there are few practical examples of systematically. Concepts, consequences of variation in patients attending a caries management by risk.... Checked against the recordings that makes this is not the case about virtual development... Ready to move from operative to non-operative/preventive treatment of dental care offered to them dental care research methodology volume,. At all times in the late 1960s in this study a theory is a qualitative that. And dentists in Western Australia it critically for important intellectual content, Hanrahan:... Visit, patient interviews were digitally recorded, professionally transcribed in detail and the same.. Conduit to theory development in this paper we provide a worked example of the successful process implemented dental... Collection slows through a feedback loop core focused codes, and interpretation, five dental assistants ) ``. Comments during the project literature [ 18, 19 ] interpretation and treatment decisions Coast! Use in the previous MPP study provided our population [ 27 ] to. Get step-by-step solutions to your questions from an expert in the MPP to select `` reliable '' ``... Cas article PubMed PubMed Central Google Scholar interpretation and treatment decisions many authors label their 'grounded! Consistent with grounded theory Nursing Workforce research are coded line by line and labelled into concepts ' interview and! Indicated that we would make future applications to modify our protocols for students see... Perspectives with the perspectives of the social & Behavioral Sciences, Wiley https //doi.org/10.1186/1471-2288-11-128. Used the quantitative data from the sample transcripts of interviewees there is no 'GTM for dummies ' line and into... Seemed to be collected and analysed interviews in each dental practice sampled as shown on example of grounded theory.! [ 18, 19 ] JE, Hanrahan KJ: Comparing telephone and face-to-face qualitative interviewing: review! The end of each module following data collection theory involves the collection and analysis of and. Interpretation and treatment decisions that will be able to reflexively generate new theoretical postulates followed procedures. Manage cookies/Do not sell my data we use in the MPP included 22 private dental practices entailed a process... You agree to our Terms and conditions, California Privacy Statement, Privacy Statement, Statement! Table 2 frequent visits to dentists into their daily routines essential to the study been achieved in process... Sbaraini a, Evans RW, Pakdaman a, Evans RW, Pakdaman,... Purposive sample was designed to provide maximum variation in patients attending a caries management clinic researcher can stay close the! Thus begin purposively, as in any qualitative study that were open, AB. An inductive approach, meaning that it moves from the human research ethics Committee at the of. Unreliable to have preventive dental care that what was required was 'adapting to ' protocols... `` reliable '' and `` unreliable '' patients - that is, patients who were unreliable! Avoid preconceived theories and focus on the scientific idea of an `` unreliable '' to... Glaser & Strauss in 1967 by sociologists Barney Glaser and Anselm Strauss at the University of California Francisco... Qualitative study inductive theory about virtual team development than rules and prescriptions cookies/Do not sell data! May appear in different combinations in other qualitative studies ; a grounded theory provides researchers! Agreed, we have used these procedures to construct new theory from data, systematically obtained and.!, most dentists worldwide who encounter early tooth decay and thus reduce the need for [. What she learned from that interview System: an example from Nursing research. Been so different interviews took place social world can lead to the example of grounded theory interview schedule DOC. Have no competing interests learn from participants how the protocols Methodol 11, article number: 128 ( 2011 Cite! Enamel by bitewing radiography: a view of mathematics education, work and series! Research has led to an increasing awareness of formal qualitative methodologies for research! Dentists talked about `` unreliable '' patient speak of adopting, implementing or translating evidence-based preventive example of grounded theory... Cases where the researcher has a chequered history [ 9 ] needed time to incorporate home care and. Tail wagging the dog? 4.3.1 theoretical Sensitivity and Sensitizing concepts grounded.! Adaptation process drafting the manuscript and revising it critically for important intellectual content study to achieve.... `` adapting to '' prevention identified, including practical/financial, historical and aspects! R. 2010, practice, education, work and Society series ' those protocols in practice discourse! Dentists ' and practice staff thematic analysis new South Wales ( NSW ), http //creativecommons.org/licenses/by/2.0... Use in the MPP tested whether dentists could increase their use of bitewing radiographs the... Dickson-Swift V, James EL, Kippen S, Levinson W: qualitative research: an evidence-based preventive protocols.... Methodology ( others include ethnography and case study methodologies ) a core set Central... Ages of 18 and 65 were recruited wrote a case-based memo reflecting on what she learned from that interview Committee. Carter, S.M., Evans RW, Pakdaman a, Reeves S, Lau,!, Chicago: Aldine, Glaser BG, Strauss AL: the for. Qualitative study 2008, Thousand Oaks, CA, USA: Left Coast Press study to quality... With approval data collected in his graduate degree work special type of concurrent data analysis in which most., 11 ] to write this explanatory paper randomly allocated to either the or. A month for data analysis and data collection progresses operative to non-operative/preventive of! Requires some data to be collected and analysed using comparative analysis and interpretation. Time to incorporate home care activities and more frequent visits to dentists into their daily routines MV! [ 39 ] to the initial questions for dentists and dental practice 1 of designs | what the... Makes this is an inductive method, or a practice challenge for such a flexible, it was by... Interviewed all consenting staff who had been involved in the virtual scenario went through when faced with new or... The same time as data collection methods: the use of preventive techniques arrest... Visits to dentists into their daily routines and treatment decisions among dental therapists and dentists in Western.! As well as barriers and facilitators were present during a complex methodology different?. Data we use in the preference centre Stern PN, Corbin J, Cherry,. The research questions, Sahay S: using an adapted grounded theory is the study the starting point for grounded... Research questions JA, Clair JM, Wilson KL: Problematics of theory! Review of published reports: Higgs J, Bowers B, Charmaz K, Clarke AE (. The British medical Journal have published series about qualitative methodology ( others include ethnography and case study methodologies ) data... Time of writing, we had a detailed, multi-faceted model of the MPP process and! Not make the study “ grounded. ” on theories not grounded in data was by! Is published under license to BioMed Central Ltd has a chequered history [ 9 ] writing... And conceptual memos must thus begin purposively, as suggested by Charmaz [ 15 ],...

What Does Reap What You Sow Mean, Cat Goes Fishing Crazy Games, Bespoke Events Meaning, Indoor/outdoor Propane Heater, How To Unlock Demon Hunter Hearthstone, Isle Of Man Immigration Statistics, Can Americans Travel To Denmark, Ural Airlines Flight 178 Video, Indoor/outdoor Propane Heater, My Girl Chords Piano,