Examining the validity, reliability and feasibility of capturing children's physical literacy through games-based assessment in physical education

WILKIE, Brett, JORDAN, Alastair, FOULKES, Jonathan, WOODS, Carl T., DAVIDS, Keith and RUDD, James (2023). Examining the validity, reliability and feasibility of capturing children's physical literacy through games-based assessment in physical education. Frontiers in Sports and Active Living, 5: 1188364.

[img]
Preview
PDF
fspor-05-1188364.pdf - Published Version
Creative Commons Attribution.

Download (349kB) | Preview
Official URL: https://www.frontiersin.org/articles/10.3389/fspor...
Open Access URL: https://www.frontiersin.org/articles/10.3389/fspor... (Published version)
Link to published version:: https://doi.org/10.3389/fspor.2023.1188364

Abstract

Background: Observational tools can help refine practice design and guide the creation of effective learning environments. The intention of this study was to design and validate an observational instrument for assessing physical literacy that remains more faithful to the philosophically complex and holistic nature of the concept. Methods: Framed by concepts of ecological dynamics, the emergent games-based assessment tool enables capture of children's interactions with their environment, providing insight on the manifestation of physical literacy within physical education games. The design and validation of the instrument consisted of a multistage process: (1) design of the observational instrument and establishing face validity; (2) pilot observation study; (3) expert qualitative and quantitative review to establish content validity; (4) observation training; and (5), establishing observer reliability. Results: Following expert qualitative and quantitative evaluation, Aiken's V coefficient was used to determine content validity. Results achieved demanding levels of validity (V ≥ 0.78) for all retained measurement variables. Cohen's κ values for inter- and intra-observer reliability ranged from 0.331 to 1.00 and 0.552 to 1.00, generally reporting “substantial” agreement during inter-observer analysis and “substantial” to “almost perfect” agreement during intra-observer analysis. Conclusions: The final model of the emergent games-based assessment tool, with 9 ecological conceptualisations of behaviour, 15 measurement variables, and 44 categorical observational items was found to be valid and reliable, providing both educators and researchers with a useful mechanism to assess physical literacy during gameplay.

Item Type: Article
Additional Information: ** From Frontiers via Jisc Publications Router ** Licence for this article: http://creativecommons.org/licenses/by/4.0/ ** Peer reviewed: TRUE ** Acknowledgements: Acknowledgments: The authors would like to thank the expert judges and coders for their participation in this research. **Journal IDs: eissn 2624-9367 **History: published_online 12-06-2023; accepted 29-05-2023; submitted 17-03-2023; collection 2023
Uncontrolled Keywords: emergent behaviours, performance analysis, ecological dynamics, observational instrument, assessment for / of learning, physical education
Identification Number: https://doi.org/10.3389/fspor.2023.1188364
SWORD Depositor: Colin Knott
Depositing User: Colin Knott
Date Deposited: 27 Jun 2023 10:54
Last Modified: 11 Oct 2023 13:47
URI: https://shura.shu.ac.uk/id/eprint/32060

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics