Normal view MARC view ISBD view

Observational Measurement of Behavior.

by Yoder, Paul; Symons, Frank; Symons, Frank.
Material type: materialTypeLabelBookEdition: 1st ed.Description: 1 online resource (249 pages).ISBN: 9780826137975.Subject(s): Observation - methods | Electronic booksOnline resources: Click to View
Contents:
Cover -- Contents -- List of Figures -- List of Tables -- Foreword -- Preface -- Acknowledgments -- 1 Introduction and Measurement Contexts -- Overview -- Systematic Observation -- Count Coding Systems -- Importance of Falsifiable Research Questions or Hypotheses -- Behavior as "Behavior" Versus Behavior as a Sign or Indicant of a Construct -- Two Interpretations of Operationalism -- Distinction Between Context-Dependent Behavior and Generalized Tendencies to Behave -- Rationale for Identifying How We Are Conceptualizing Our Object of Measurement -- Influential Variables of a Measurement Context -- Structuredness -- Ecological Validity -- Tension Between Structuredness and Ecological Validity -- Recommendations for Measuring Generalized Characteristics From Observations -- Potential Disadvantages of Systematic Observational Count Measurement -- Recommendations -- References -- 2 Improving Measurement of Generalized Characteristics Through Direct Observation and Generalizability Theory -- Overview -- Two Concepts of Measurement -- Generalizability Theory as a Measurement Theory for Vaganotic Measures -- Example: Generalizability (G) Study With Multiple Sessions as a Single Facet -- Consequences of a Low G Coefficient -- Decision Studies -- McWilliam and Ware as an Example of a Two-Faceted Decision Study -- Practice Using a G Calculator on Data From a Two-Faceted G and D Study -- Accuracy of D Study Projections -- Implications of the Lessons of G and D Studies for Single-Subject Research -- A Dilemma -- Recommendations -- References -- 3 Designing or Adapting Coding Manuals -- Overview -- Selecting, Adapting, or Creating a Coding Manual -- Definition of a Coding Manual -- Relation of the Coding Manual to the Research Questions and Predictions -- Recommended Steps for Modifying or Designing Coding Manuals -- The Potential Value of Flowcharts.
Do Coding Manuals Need to Be Sufficiently Short to Be Included in Methods Sections? -- Recommendations -- References -- 4 Sampling Methods -- Overview -- The Elements of a Measurement System -- Behavior Sampling -- Continuous Behavior Sampling -- Intermittent Behavior Sampling -- Interval Sampling -- Participant Sampling -- Focal Sampling -- Multiple Pass Sampling -- Conspicuous Sampling -- Reactivity -- Live Coding Versus Recording the Observation for Later Coding -- Recording Coding Decisions -- Practice Recording Session -- Recommendations -- References -- 5 Common Metrics of Observational Variables -- Overview -- Definition of Metric -- Quantifiable Dimensions of Behavior -- Proportion Metrics -- Proportion Metrics Change the Meaning of Observational Variables -- Scrutinizing Proportions -- An Implicit Assumption of Proportion Metrics -- Testing Whether the Data Fit the Assumption of Proportion Metrics -- Consequences of Using a Proportion When the Data Do Not Fit the Assumption -- Alternative Methods to Control Nuisance Variables -- Statistical Control -- Procedural Control -- Transforming Metrics of Observational Variables in Group Statistical Analyses -- Scales of Measurement for Observational Variables -- Observational Variables in Parametric Analyses -- Recommendations -- References -- 6 Introduction to Sequential Analysis -- Overview -- Definitions of Terms Used in This Chapter -- Sequential Versus Nonsequential Variables -- Sequential Associations Are Not Sufficient Evidence for Causal Inferences -- Coded Units and Exhaustiveness -- Three Major Types of Sequential Analysis -- Event-Lag Sequential Analysis -- Time-Lag Sequential Analysis -- Time-Window Sequential Analysis -- The Need to "Control for Chance" -- How Sequential Data Are Represented Prior to Contingency Table Organization -- Contingency Tables.
Proper 2 × 2 Contingency Table Construction of Two Streams of Data for Concurrent Analysis -- Proper 2 × 2 Contingency Table Construction From One Stream of Data for Event-Lag Sequential Analysis -- Simulation Study to Compare Results From Two Ways to Construct Contingency Tables -- Contingency Tables for Time-Window Lag Sequential Analysis -- Transitional Probability -- Transitional Probabilities in Backward Sequential Analysis -- Summary of Transitional Probabilities -- Recommendations -- References -- 7 Analyzing Research Questions Involving Sequential Associations -- Overview -- Computer Software to Aid Sequential Analysis -- Practice Exercise Using MOOSES Software to Conduct Time-Window Analysis -- Yule's Q -- What Is "Enough Data" and How Do We Attain It? -- Proposed Solutions for Insufficient Data -- Sequential Association Indices as Dependent Variables in Group Designs -- Testing the Significance of a Mean Sequential Association -- Testing the Between-Group Difference in Mean Sequential Associations -- Testing the Within-Subject Difference in Sequential Associations -- Testing the Significance of the Summary-Level Association Between a Participant Characteristic and a Sequential Association Between Behaviors -- Statistical Significance Testing of Sequential Associations in Single Cases -- A Caveat Regarding the Use of Yule's Q -- Recommendations -- References -- 8 Observer Training, Observer Drift Checks, and Discrepancy Discussions -- Overview -- Three Purposes of Point-by-Point Agreement on Coding Decisions -- Two Definitions of Agreement -- Agreement Matrices -- Discrepancy Discussions -- Criterion Coding Standards -- Observer Training -- Method of Selecting and Conducting Agreement Checks -- Retraining When Observer Drift Is Identified -- Recommendations -- References -- 9 Interobserver Agreement and Reliability of Observational Variables.
Overview -- Additional Purposes of Point-by-Point Agreement -- Added Principles When Agreement Checks Are Used to Estimate Interobserver "Reliability" of Observational Variable Scores -- Exhaustive Coding Spaces Revisited -- The Effect of Chance on Agreement -- Common Indices of Point-by-Point Agreement -- Occurrence Percentage Agreement -- Nonoccurrence Percentage Agreement -- Total Percentage Agreement -- Kappa -- Base Rate and Chance Agreement Revisited -- Intraclass Correlation Coefficient as an Index of Interobserver Reliability from the Vaganotic Concept of Measurement -- Options for Running ICC With SPSS -- Between-Participant Variance on the Variable of Interest Affects ICC -- Using ICC as a Measure of Interobserver Reliability for Predictors and Dependent Variables in Group Designs -- The Interpretation of SPSS Output for ICC -- The Conceptual Relation Between Interobserver Agreement and ICC -- Consequences of Low or Unknown Interobserver Reliability -- Recommendations -- References -- 10 Validation of Observational Variables -- Overview -- The Changing Concept of Validation -- Understanding Which Types of Validation Evidence Are Most Relevant for Different Research Designs, Objects of Measurement, and Research Purposes -- Content Validation -- Definition of Content Validation -- Different Traditions Vary on the Levels of Importance Placed on Content Validation -- Weaknesses of Content Validation -- Sensitivity to Change -- Definition of Sensitivity to Change -- Influences on Sensitivity to Change -- Weakness of Sensitivity to Change -- Treatment Utility -- Definition of Treatment Utility -- Weaknesses of Treatment Utility -- Criterion-Related Validation -- Definition of Criterion-Related Validation -- Primary Appeal of Criterion-Related Validation -- Weaknesses of Criterion-Related Validation -- Construct Validation.
Definition of Construct Validation -- Discriminative Validation -- Nomological Validation -- Multitrait, Multimethod Validation -- An Implicit "Weakness" of Science? -- Recommendations -- References -- Glossary -- A -- B -- C -- D -- E -- F -- G -- H -- I -- K -- L -- M -- N -- O -- P -- R -- S -- T -- U -- V -- W -- Y -- Index -- A -- B -- C -- D -- E -- F -- G -- I -- K -- L -- M -- N -- O -- P -- R -- S -- T -- U -- V -- W -- Y -- Z.
Summary: "Yoder and Symons bring decades of work to bear and it shows....[The book is] presented with broad scholarship and conceptual depth." -Roger Bakeman, PhD Professor.
No physical items for this record

Cover -- Contents -- List of Figures -- List of Tables -- Foreword -- Preface -- Acknowledgments -- 1 Introduction and Measurement Contexts -- Overview -- Systematic Observation -- Count Coding Systems -- Importance of Falsifiable Research Questions or Hypotheses -- Behavior as "Behavior" Versus Behavior as a Sign or Indicant of a Construct -- Two Interpretations of Operationalism -- Distinction Between Context-Dependent Behavior and Generalized Tendencies to Behave -- Rationale for Identifying How We Are Conceptualizing Our Object of Measurement -- Influential Variables of a Measurement Context -- Structuredness -- Ecological Validity -- Tension Between Structuredness and Ecological Validity -- Recommendations for Measuring Generalized Characteristics From Observations -- Potential Disadvantages of Systematic Observational Count Measurement -- Recommendations -- References -- 2 Improving Measurement of Generalized Characteristics Through Direct Observation and Generalizability Theory -- Overview -- Two Concepts of Measurement -- Generalizability Theory as a Measurement Theory for Vaganotic Measures -- Example: Generalizability (G) Study With Multiple Sessions as a Single Facet -- Consequences of a Low G Coefficient -- Decision Studies -- McWilliam and Ware as an Example of a Two-Faceted Decision Study -- Practice Using a G Calculator on Data From a Two-Faceted G and D Study -- Accuracy of D Study Projections -- Implications of the Lessons of G and D Studies for Single-Subject Research -- A Dilemma -- Recommendations -- References -- 3 Designing or Adapting Coding Manuals -- Overview -- Selecting, Adapting, or Creating a Coding Manual -- Definition of a Coding Manual -- Relation of the Coding Manual to the Research Questions and Predictions -- Recommended Steps for Modifying or Designing Coding Manuals -- The Potential Value of Flowcharts.

Do Coding Manuals Need to Be Sufficiently Short to Be Included in Methods Sections? -- Recommendations -- References -- 4 Sampling Methods -- Overview -- The Elements of a Measurement System -- Behavior Sampling -- Continuous Behavior Sampling -- Intermittent Behavior Sampling -- Interval Sampling -- Participant Sampling -- Focal Sampling -- Multiple Pass Sampling -- Conspicuous Sampling -- Reactivity -- Live Coding Versus Recording the Observation for Later Coding -- Recording Coding Decisions -- Practice Recording Session -- Recommendations -- References -- 5 Common Metrics of Observational Variables -- Overview -- Definition of Metric -- Quantifiable Dimensions of Behavior -- Proportion Metrics -- Proportion Metrics Change the Meaning of Observational Variables -- Scrutinizing Proportions -- An Implicit Assumption of Proportion Metrics -- Testing Whether the Data Fit the Assumption of Proportion Metrics -- Consequences of Using a Proportion When the Data Do Not Fit the Assumption -- Alternative Methods to Control Nuisance Variables -- Statistical Control -- Procedural Control -- Transforming Metrics of Observational Variables in Group Statistical Analyses -- Scales of Measurement for Observational Variables -- Observational Variables in Parametric Analyses -- Recommendations -- References -- 6 Introduction to Sequential Analysis -- Overview -- Definitions of Terms Used in This Chapter -- Sequential Versus Nonsequential Variables -- Sequential Associations Are Not Sufficient Evidence for Causal Inferences -- Coded Units and Exhaustiveness -- Three Major Types of Sequential Analysis -- Event-Lag Sequential Analysis -- Time-Lag Sequential Analysis -- Time-Window Sequential Analysis -- The Need to "Control for Chance" -- How Sequential Data Are Represented Prior to Contingency Table Organization -- Contingency Tables.

Proper 2 × 2 Contingency Table Construction of Two Streams of Data for Concurrent Analysis -- Proper 2 × 2 Contingency Table Construction From One Stream of Data for Event-Lag Sequential Analysis -- Simulation Study to Compare Results From Two Ways to Construct Contingency Tables -- Contingency Tables for Time-Window Lag Sequential Analysis -- Transitional Probability -- Transitional Probabilities in Backward Sequential Analysis -- Summary of Transitional Probabilities -- Recommendations -- References -- 7 Analyzing Research Questions Involving Sequential Associations -- Overview -- Computer Software to Aid Sequential Analysis -- Practice Exercise Using MOOSES Software to Conduct Time-Window Analysis -- Yule's Q -- What Is "Enough Data" and How Do We Attain It? -- Proposed Solutions for Insufficient Data -- Sequential Association Indices as Dependent Variables in Group Designs -- Testing the Significance of a Mean Sequential Association -- Testing the Between-Group Difference in Mean Sequential Associations -- Testing the Within-Subject Difference in Sequential Associations -- Testing the Significance of the Summary-Level Association Between a Participant Characteristic and a Sequential Association Between Behaviors -- Statistical Significance Testing of Sequential Associations in Single Cases -- A Caveat Regarding the Use of Yule's Q -- Recommendations -- References -- 8 Observer Training, Observer Drift Checks, and Discrepancy Discussions -- Overview -- Three Purposes of Point-by-Point Agreement on Coding Decisions -- Two Definitions of Agreement -- Agreement Matrices -- Discrepancy Discussions -- Criterion Coding Standards -- Observer Training -- Method of Selecting and Conducting Agreement Checks -- Retraining When Observer Drift Is Identified -- Recommendations -- References -- 9 Interobserver Agreement and Reliability of Observational Variables.

Overview -- Additional Purposes of Point-by-Point Agreement -- Added Principles When Agreement Checks Are Used to Estimate Interobserver "Reliability" of Observational Variable Scores -- Exhaustive Coding Spaces Revisited -- The Effect of Chance on Agreement -- Common Indices of Point-by-Point Agreement -- Occurrence Percentage Agreement -- Nonoccurrence Percentage Agreement -- Total Percentage Agreement -- Kappa -- Base Rate and Chance Agreement Revisited -- Intraclass Correlation Coefficient as an Index of Interobserver Reliability from the Vaganotic Concept of Measurement -- Options for Running ICC With SPSS -- Between-Participant Variance on the Variable of Interest Affects ICC -- Using ICC as a Measure of Interobserver Reliability for Predictors and Dependent Variables in Group Designs -- The Interpretation of SPSS Output for ICC -- The Conceptual Relation Between Interobserver Agreement and ICC -- Consequences of Low or Unknown Interobserver Reliability -- Recommendations -- References -- 10 Validation of Observational Variables -- Overview -- The Changing Concept of Validation -- Understanding Which Types of Validation Evidence Are Most Relevant for Different Research Designs, Objects of Measurement, and Research Purposes -- Content Validation -- Definition of Content Validation -- Different Traditions Vary on the Levels of Importance Placed on Content Validation -- Weaknesses of Content Validation -- Sensitivity to Change -- Definition of Sensitivity to Change -- Influences on Sensitivity to Change -- Weakness of Sensitivity to Change -- Treatment Utility -- Definition of Treatment Utility -- Weaknesses of Treatment Utility -- Criterion-Related Validation -- Definition of Criterion-Related Validation -- Primary Appeal of Criterion-Related Validation -- Weaknesses of Criterion-Related Validation -- Construct Validation.

Definition of Construct Validation -- Discriminative Validation -- Nomological Validation -- Multitrait, Multimethod Validation -- An Implicit "Weakness" of Science? -- Recommendations -- References -- Glossary -- A -- B -- C -- D -- E -- F -- G -- H -- I -- K -- L -- M -- N -- O -- P -- R -- S -- T -- U -- V -- W -- Y -- Index -- A -- B -- C -- D -- E -- F -- G -- I -- K -- L -- M -- N -- O -- P -- R -- S -- T -- U -- V -- W -- Y -- Z.

"Yoder and Symons bring decades of work to bear and it shows....[The book is] presented with broad scholarship and conceptual depth." -Roger Bakeman, PhD Professor.

Description based on publisher supplied metadata and other sources.

Electronic reproduction. Ann Arbor, Michigan : ProQuest Ebook Central, 2019. Available via World Wide Web. Access may be limited to ProQuest Ebook Central affiliated libraries.


Hong Kong Nang Yan College of Higher Education
Lee Yan Fong Library
325-329 Lai Chi Kok Road, Shamshuipo, Kowloon, HONG KONG