Learning about Quantitative and Qualitative research methods

Quantitative Methods
 

Before we begin, lets go over quantitative terminology so you have a better understanding of what we are talkin' about.

Terminology

These terms should help guide you through understanding more about quantitative research methods 

survey design - provides a quantitative or numeric description of trends, attitudes, or opinions of a population by studying a sample of that population

experimental design - to test the impact of a treatment (or an intervention) on an outcome, controlling for all other factors that might influence that outcome

confidence interval - A + or - figure that represents how accurate the answers given by your sample correlate to answers given by the population

validity of quantitative research - whether one can draw meaningful and useful inferences from scores on the instruments. 

reliability - reporting measures of internal consistency 

descriptive analysis - data for all of the dependent and independent variables in the study 

interpretation in quantitative research - the researcher draws conclusions from the results of the research questions, hypotheses, and the larger meaning of results

true experiment - individuals are randomly assigned into groups 

quasi-experiment - when individuals are not randomly assigned    



 








Checklist of questions for designing a quantitative survey method
- is the population and size mentioned? 
- will the population be stratified? If so, how? 
- is the purpose of a survey design stated? 
- are the reasons for choosing the design stated? 
- how many people will be chosen for the sample? 
- what is the procedure for sampling these individuals? (random, nonrandom) 
- what instrument will be used to develop the survey? 
- what are content areas addressed in the survey? 
- what is the timeline for administering the survey?
- what are the variables in the study?
- how do these variables cross-reference with the research questions and items on the survey?

Consider the following: 
- what specific steps will be taken in data analysis? 
     - analyze returns 
     - check for response bias 
     - conduct a descriptive analysis 
     - collapse items into scales 

     - run inferential statistics to answer the research questions or assess practical        implications of the results 

     - how will the results be interpreted 

Data Analysis and Interpretation

Steps for analyzing the data:

Step 1. Report response rate

Step 2. Determine response bias: the effect of non responses on survey estimates

Step 3. Conduct descriptive analyses

Step 4. Check instrument's scales

Step 5. Conduct inferential statistical analyses

Step 6. Present and interpret results

Qualitative Methods 

Terminology
Now that we have covered Quantitative method terminology, let’s see if there is a difference with Qualitative methods terminology.  

Qualitative observation – when the researcher takes field notes on behavior and activities done on the research site

Qualitative interviews – researcher conducts face-to-face interviews with participants, telephone interviews, or engage in focus groups 

Gatekeepers – individuals at the site who allow access and permit research to be done 

Qualitative audiovisual material – data which consists in a photograph, video, art, website, email, etc. 

Observation protocol – recording information while observing

Interview protocol – asking questions and recording the answers during the interview 

Qualitative reliability – indicates the researcher’s approach is consistent across different researchers and different projects


Checklist of questions for designing qualitative methods procedure

-       are the basic characteristics of qualitative studies mentioned

-       is the purposeful sampling strategy for sites and individuals identified

-       does the reader understand the researchers rote in the study

-       are the specific forms of data collection mentioned and a rationale given for their use?

-       Are the data analysis steps identified?

-       Has the researcher coded the data?

-       Have multiple strategies been cited for validating the findings

The Researchers Role in a Qualitative study

- Researcher has sustained and intensive experience with participants 

- Strategic, ethical, and personal issues can arise

Researchers should:

-       Discuss prior experiences with participants and the phenomenon

-       Indicate steps to get IRB permissions

-       Discuss steps to gain entry into the setting

-       Comment about ethical issues

Data Analysis and Interpretation

Preparing data for analysis

Conducting different analyses

Generic analysis

Themes

Procedure specific to strategy of inquiry

Moving deeper and deeper into understanding the data

Representing the data

Making an interpretation or the larger meaning of the data

Resources 

CH 8 Quantitative Methods Presentation – http://www.socsci.uci.edu/~castellj/198research/fall/Week%209/Readings/Ch08-PPTQuantitativeMethods.pdf  

CH 9 Qualitative Methods Presentation – http://www.socsci.uci.edu/~castellj/198research/fall/Week%209/Readings/Ch09-PPTQualitativeMethods.pdf

Creswell, J. W. (2003). Research design: Qualitative, quantitative, and mixed method approaches. Thousand Oaks, CA: Sage Publications.