Principal methods for healthcare research

Introduction
Bulimia Nervosa (BN) is an eating disorder, which is characterised by repeated episodes of over eating and bingeing and by a set of compensatory behaviours intended to cause weight loss which includes vomiting, purging, fasting and excessive exercise.
The American Psychiatric society (A.P.A. DSM-IV, 2000) and the World Health Organisation ( World Health Organization. International Statistical Classification of Diseases, 10th Revision (ICD-10). Geneva, Switzerland: W.H.O., 1992), both suggest the following diagnostic criteria for the disorder

1. A persistent preoccupation with eating and irresistible craving for food.
2 .Repeated episodes of binging/overeating in which large quantities /amounts of food are consumed
3. Patients experiencing BN take excessive measures to compensate for the ‘fattening‘effects of food e.g. vomiting, purging and fasting.
The Beating Eating Disorder Association (BEAT). Formerly known as the Eating Disorders Association, a voluntary sector group in the UK., as provided figures that up to 1.15 million people in the UK, experience a significant problem with BN, and up to 90.000 people are receiving treatment at any one time.
It is not therefore surprising that BN is a major and widespread problem. Consequently a number of treatments have been developed and trialled, based on focused research, and developing an evidence base. The National Institute of Clinical Excellence (NICE). Published guidance in 2004, (Eating disorders: Core interventions in the treatment and management of anorexia nervosa, bulimia nervosa and related eating disorders. London: National Institute for Health and Clinical Excellence (NICE) 2004). Which recommends Cognitive Behavioural therapy (CBT) as an efficacious treatment as well as Selective Serotonin Re-uptake Inhibitors (SSRI’s) such as Fluoxetine. Research in this area is an important on a number of counts. Firstly, on clinical intervention grounds so that the treatment offered for the disorder can be expanded and improved and secondly given that the Disorder was only recognised in 1979 ( Russell, G.1979), and with a widespread epidemiology, sufferers experiences of the disorder are important in clinical practice to deepen understanding of sufferers experiences..
The two papers presented here both focus on the condition from different perspectives and ask different questions. The first paper is a qualitative study: Binge and purge Processes in Bulimia Nervosa: A Qualitative Investigation (Jeppson et al. 2003) using a grounded theory design focusing on the two core diagnostic behaviours of BN; binging and purging. They aimed to elucidate information on these processes and their function for Bulimic’s experience.
The second paper is a comparative intervention study, following a quantitative research design – a form of Randomised Control Trial (RCT) – Cognitive-Behavioural, Fluoxetine and Combined Treatment for Bulimia Nervosa: Short- and Long-term Results (Jacobi et al.2002). Both papers illustrate their design paradigms and contain a number of flaws, which will be discussed in relation to their respective research methods.
Their Respective Research Design and philosophy
Jeppson et al(2003), deployed a qualitative research design, which followed a grounded theory approach (Glaser & Strauss,1967). Grounded theory was originally developed by these social researchers, before the approach ‘split’ into different camps, (Stebbins, R.A., 2001), the approach essentially emphasizes the ’generation of theory’ from data that is acquired in the actual process of conducting the research.
So rather than beginning with an hypothesis that needs to be tested that is the hallmark of the experimental quantitative research design, grounded theory begins the research process with an aim for exploration.
The quantitative paradigm illustrated by the Jacobi et al. (2002) paper, forms the basis of RCT’s and Therapy trials which are common in much of health care research, including Cognitive Behavioural Therapy (CBT) and treatment approaches/interventions to Bulimia Nervosa. At its philosophical ‘core’ is the notion of empiricism (Owen, F. & Jones R, 1977), whereby quantitative properties and phenomena and their relationships are observed and studied. Thus the process of measurement is crucial to the paradigm and this affords the connection between ‘empirical’ observations i.e did X effect Y and mathematics, through the expression of quantitative relationships
As measurement is crucial to the quantitative paradigm, the choice of Randomised Comparison Study is entirely appropriate for the Jacobi investigation, as it wants to compare the treatment effects of three different conditions treating the disorder.
Studies of this type are a form of scientific experiment, with RCT’s often referred to as the ‘gold standard’ for intervention studies (Cartwright, A. 2007). They are often used for ‘safety’ studies in drug trials and for testing the effectiveness of clinical interventions and services
The two research studies presented here, display different philosophical foundations, which shape their whole approach to research deign.
The Contrasting Research Hypothesizes
Jeppson et al (2003), developed an aim for their qualitative study based on previous research they had encountered on the BN binge-purge process that is seen to be central to the disorder. The study was not concerned with assessing the ‘effects’ of interventions on binge and purge behaviour, but rather to try and understand what these behaviours meant and the functions they served for the patients they studied.
They considered in previous research that quantitative methods, had focused on self-monitoring of these episodes and ranking them to ‘measure’ links to mental state e.g. Stress, and had deemed that it had not sufficiently led to an understanding of their function as experienced by BN patients themselves. They had an idea that these behaviours were crucial and played a part in assisting sufferers with their ‘emotional regulation’, but were curious and wished to expand an understanding of their role.
They therefore set out with an ‘aim’ for the research to find out what BN patients experiences of these two processes and the meanings /function they served for them, I believe this ‘aim’ was entirely congruent with the qualitative method, and provided a question that RCTs looking at interventions had not and could not study.
The Jacobi et al., paper(2002), asked a different set of questions. They were interested in how CBT compared with the SSRI – Fluoxetine, and a combination of them both . They considered that both the psychological (Wilson, G.T., & Fairburn, C.G., 1993) and pharmacological interventions (Goldstein et al.,1995) had developed an evidence base for treating BN. They designed an ambitious study to investigate the question of the relative short and long-term effectiveness of the three interventions. They questioned whether the combined approach would be more beneficial in the long-term, as previous research studies investigating a combination approach, had experienced high drop-out rates due to the side effects of the of the SSRI, which may have influenced their results.
The study did not include a control or placebo condition, which would be the normal procedure for intervention type studies.The reason for this was that they considered previous research had demonstrated the effectiveness of CBT and Fluoxetine, and was not needed.
The study had four aims: To compare the effectiveness of CBT, Fluoxetine and there combination, to compare the short and long-term effects of these treatments. To inquire about the possible ‘additive’ effect of combined intervention and to examine the differential effects of the treatments. These types of intervention question are suitable for a randomised study as the questions Jacobi and team are asking are essentially ones of intervention and differential effectiveness/measurement on a number of variables e.g. Binging and purging episodes, short and long term effects as ascertained by validated psychological questionnaires and clinical interview.
Approaches to sampling
It is generally considered that sample size is generally much smaller in qualitative studies than those recruited for quantitative studies such as RCT’s (Cresswell,J.W., 2003). As qualitative studies are generally smaller in size, criticisms have been leveled at this paradigm. Although the paradigm does not seek to study the ‘total‘ population, issues surrounding diversity and variation within a population are often cited (Jones,2007).
The Jeppson study used only eight participants The approach to sampling used in the study is important as the process of selecting participants is relevant to the aims of the
study. They used purposeful sampling to generate the data for their enquiry.
Purposeful sampling generally refers to the selection of participants who have experience or knowledge of the area under investigation (Procter et al, 2010) As all participants were selected with a specific diagnosis of BN (APA., DSM-IV,1994) they would all currently have experiences of the processes under investigation.
They were recruited from a suburban area in Utah, USA., Descriptive information, including socio economic variation, inpatient and out patient status and educational information was given.This form of sampling used in the study is not random or based on statistical probability as in quantitative studies.
Sampling in quantitative research design, especially RCT’s, differs. This type of sampling is in essence the selection of of observable units, which can be measured (Maxim, P.S., 1999). As outlined in the introduction, BN is widespread in the UK (and other european countries). It is not possible in the Jacobi study to observe the effects of the treatment interventions with the whole population of people experiencing BN. Therefore quantitative studies tend to study a sample of the group or population which may represent the larger population.
The study recruited its patents by a mixture of media advert and direct referral to the Department of Psychology at the University of Hamburg. All underwent telephone screening, by a clinician not involved in the study (to assess inclusion criteria) and a semi structured psychiatric interview,and physical examination As selecting people for therapy trials is open to sampling errors, in that some people selected,may be ‘exceptional’ or ‘different’ from those of the larger ‘Bulimic’ population.The method attempts minimize these possibilities, by careful inclusion/exclusion criteria and the random distribution of the participants into one of the three treatment conditions[1] The size of sample for the Jacobi study is more important than the qualitative study, to gain meaningful results.
Data Collection Methods and Data analysis
The Jeppson et al study (2003) study, collected its data from interviewing eight participants who agreed to take part in the study, by using a semi-structured interview format, lasting one hour. The semi-structured format differs from a more limited ‘formalized’ set of questions, by nature of its flexibility. It allows for new questions to be added in response to what the interviewee says, inviting and generating further information, which the study utilised. The study used a ‘framework’ and ‘interview guide’, which is a collection or set of topics to guide the interview process (Lindlof &Taylor, 2002). The paper, makes reference to this, but does not provide specific details of what constituted the ‘guide.
To enhance validity, ‘member checks’ were conducted post interview, all participants received a 20 minute phone call, where findings were ‘shared’; allowing corrective feedback on accuracy. Transcripts were also read by three mental health professionals
The study reported that ‘redundancy’ or theoretical saturation occurred between interview 5-7. Grounded theory employs this framework, so sampling frame may be modified as a result of a process deemed, ‘constant comparison analysis’ i.e, that data is determined by its recurrence and re-evaluation to assist with the ‘theorizing process’ of the area under investigation. The type of process involved in the purposeful sampling used in Jeppson’s study, accepts that it is impossible to identify ahead of time, all categories of emergent data that the researcher needs to review. So its is purposely designed to pursue data collection categories to the point of concept or ‘data saturation’, which occurs when the data is stable and the pattern(s) unlikely to change (Locke,2001). They found this occurred during the interviewers 5-7, and added 1 further interview according to protocol. (Lincoln & Guba, 1985)
Once Jeppson collected the data, key points were assigned (or marked) to it, referred to as ‘codes’. Concepts and categories were then then worked out. The categories that emerged are seen within this methodology as the basis of theory generation for the study. This process as been referred to by Glaser and Strauss (1967) as the reverse emergence ‘hypothesis’. Thus, it was considered that to gain information on the participants binge and purging behaviours it was best to ask them about their experiences so as generate theory from their responses, rather than to come to the study with a pre-determined hypothesis or theory which needed testing.
As the researcher is part of the ‘research process’ and data collection, ‘reflexivity’, is a feature of the data collection process. This can be divided into ‘personal reflexivity’ and ‘epistemological reflexivity’. ‘Personal reflexivity’ involves the researcher being aware and examining their own values, experiences etc. and how this may have shaped the research. It also involves thinking about how the research may have affected and possibly changed people and researchers. ‘Epistemological reflexivity’ as such, asks how the research question is defined and conducted and how it may of limited what was foundby asking searching questions about the data and its findings (Willig,C. 2001). Jeppson notes, that he was ‘aware’ of himself and the potential influence on the study.
Jacobi, collected its data by using a battery of validated Psychological Measures to assess outcomes from the three intervention conditions.They were administered at pre and post treatment, and at 3 months and one year follow up. Descriptive statistics[2] were given using the mean[3] and standard deviation[4] of patients with regard to age, marital status, and education. Frequency of binging and vomiting, onset of these behaviours , lowest BMI etc., no table provided.
Data analysis was conducted by using a number of inferential statistical tests, to ‘measure’ and quantify a host of possible influences on the outcome results obtained form the measures of each condition.
Individual one-way analyses of variance ( ANOVAs) were used to compare data, i.e., demographics, clinical variables: frequency of binging etc pre and post. The ANOVA technique involves measuring the variance of the group means and comparing that to the variance predicted if all groups were randomly sampled from the same population i.e ANOVA, tests hypotheses about the mean(s) of a dependent variable(s) e.g frequency of binge eating across the different treatment groups, in relation to the independent variables i.e. group condition
To analyze the differential effects of the 3 treatments is was originally proposed to use uni and multivariate analyses of covariance[5], e.g .to study the covariance of say mood state with frequency of purging across the treatment conditions, to see if the amount of change between two or more variable maps changes in another variable, an estimate of correlation.[6]
Sample size, through attrition was assessed as to small to run theses tests, at one year follow up. The ANOVAs and MANOVA tests used in this study produce the F-statistic[7], which is used to calculate the P-value,[8] and significance. The choice of tests was appropriate[9], given 3 treatment conditions, and the comparative nature of the research question/hypotheses. A intention to treat analysis, conducted for drop-outs was in line with the research protocol for this study design.
Quality of studies
The two papers have approached the subject of BN from different research designs. It is important when considering research papers to assess their quality, in respect of their chosen methods.
Jeppson’s paper, in a my opinion is a well designed study. The aim is suited to qualitative methodology. Assessing the quality of the study as proved challenging as its requires a different set of criteria, from quantitative research (table 1),
And Patton (2002), outlines a series of considerations to establish rigor for qualitative research (table 2 ). The use of one interviewer, sample containing severe bulimics (Anorexia?), may have influenced the themes and results Also some ‘reporting issues‘ concerning method etc,, can all factors effecting quality.
Table1 . Critical evaluation of qualitative study
Table 2. Criteria to establish rigor in qualitative studies
Criteria to establish rigor in qualitative methods. Patton (2002) p.552-558