Test-Retest Reproducibility of the WebCas Electronic Questionnaire for Assessing Health-Related Behaviors in Adolescents
Abstract
Purpose: The goal of the study was to evaluate the reproducibility between the application-replication of the electronic version of the WebCas questionnaire. Methods: The sample consisted of 152 students (10 to 15 years old) of both sexes, enrolled in a public school in the city of Curitiba (PR). Anthropometric data (weight and height) were collected to calculate the body mass index. The reproducibility of the questionnaire was assessed by means of concordance between the repeated measures obtained by applying the WebCas, with a 7-day interval between applications. Results: Most of the variables showed percentages of reproducibility above 50% (7/12 variables). Eight variables presented Kappa values considered “very good”: commuting to school (K=0.95); alcohol intake in the last 30 days (K=0.92); alcohol intake in doses (K=0.92); smoking (K=0.93); intoxication (K=0.92), nap (K=0.83), illness (K=0.94) and medication use (K=0.90). Daytime sleepiness, frequency of consumption of fruits, vegetables, sweets, snacks and soft drinks showed “moderate” Kappa values (0.41 to 0.65). Regarding accuracy, the variables hours of sleep, time to wake up on weekdays and bedtime on weekdays showed substantial values (>0.95 to <0.99). For the other variables, the values were almost perfect (≥0.99), with the exception of the variable “bedtime the night before” which showed low accuracy (Cb=0.90). Conclusion: The results showed that the WebCas questionnaire showed satisfactory evidence of reproducibility.
References
ABEP - Associação Brasileira de Empresas de Pesquisa (2014). Critério de Classificação Econômica do Brasil. http://www.abep.org
Agostinis-Sobrinho, C., Werneck, AO, Kievisiene, J., Moreira, C., Ramírez-Vélez, R., Rosário, R., Norkiene, S., Lopes, L., Mota, J., & Santos, R. (2021). Estado de saúde cardiovascular ideal e qualidade de vida relacionada à saúde em adolescentes: estudo Labmed. Revista Paulista de Pediatria, 39, 1-7. https://doi.org/10.1590/1984-0462/2021/39/2019343
Bezerra, MKA, Carvalho, EF, Oliveira, JS, Cesse, EÂP, Lira, PIC, Cavalcante, JGT, Leal, VS, & Santos, MP (2021). Lifestyle of adolescent students from public and private schools in Recife: ERICA. Ciências e Saúde Coletiva, 26(1), 221-32. https://doi.org/10.1590/1413-81232020261.34622018
Casamali, F.F.C., Schuch, F.B., Scortegagna, S.A., Legnani, E., & De Marchi, A.C.B. (2019). Accordance and reproducibility of the electronic version of the WHOQOL-BREF and WHOQOL-OLD questionnaires. Experimental gerontology. 125, 110683. https://doi.org/10.1016/j.exger.2019.110683
De Jesus, G.M., De Assis, M.A.A., & Kupek, E. (2017). Validade e reprodutibilidade de questionário baseado na internet (Web-CAAFE) para avaliação do consumo alimentar de escolares de 7 a 15 anos. Caderno de Saúde Pública, 33(5), 1-16. https://doi.org/10.1590/0102-311X00163016
De Jesus, G.M., De Assis, M.A.A., & Kupek, E. (2016). Avaliação da atividade física de escolares com um questionário via internet. Revista Brasileira de Medicina do Esporte, 22(4), 261-6. https://doi.org/10.1590/1517-869220162204157067
De Jesus, G.M., De Assis, M.A.A., Kupek, E., & Dias, L.A. (2017). Avaliação da consistência de valores de peso, altura e índice de massa corporal no questionário consumo alimentar e atividade física de escolares: O controle da qualidade da entrada de dados no sistema. Revista Brasileira de Epidemiologia, 20(4), 573-82. https://doi.org/10.1590/1980-5497201700040002
Farias Junior, J.C., Lopes, A.S., Florindo, A.A., & Hallal, P.C. (2010). Validity and reliability of self-report instruments for measuring physical activity in adolescents: a systematic review. Caderno de Saúde Pública, 26(9), 1669-91. https://doi.org/10.1590/S0102-311X2010000900002
Farias Junior, J.C., Lopes, A.S., Mota, J., Santos, M.P., Ribeiro, J.C., & Hallal, P.C. (2012). Validade e reprodutibilidade de um questionário para medida de atividade física em adolescentes: uma adaptação do Self-Administered Physical Activity Checklist. Revista Brasileira de Epidemiologia, 15(1), 198-210. https://doi.org/10.1590/S1415-790X2012000100018
Faul, F., Erdfelder, E., Lang, A.G., & Buchner, A. (2007). G* Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior research methods, 39(2), 175-191. https://link.springer.com/article/10.3758/BF03193146
Guedes, D.P., & Guedes, J.E.R.P. (1995). Atividade física, aptidão física e saúde. Revista Brasileira de Atividade Física & Saúde, 1(1), 18-35. https://doi.org/10.12820/rbafs.v.1n1p18-35
Legnani, E., Legnani, R.F.S., Rech, C.R., Guimaraes, R.F., & De Campos, W. (2013). Instrumentos eletrônicos para avaliar atividade física em crianças: Uma revisão sistemática. Motricidade, 9(4), 90-9. http://dx.doi.org/10.6063/motricidade.9(4).594
Legnani, R.F.S., Camargo, E., Legnani, E, Bacil, E. Neto, N.M., & Campos, W. (2017). Students’ and teachers’ understanding of the WebCas questionnaire for assessing health related behaviors. Revista Brasileira de Atividade Física e Saúde, 22(3), 251-260. https://doi.org/10.12820/rbafs.v.22n3p251-260
Legnani, R.F.S., Legnani, E., Andrade, T.A., Martins, R.V., Gustave, E.L.D., & Campos, W. (2020). WebCas electronic questionnaire to evaluate health-related behaviors of schoolchildren. Motriz Revista Educação Física, 26(3), 1-5. https://doi.org/10.1590/s1980-6574202000030041
Legnani, R.F.S., Legnani, E., Quentino, R.A., Pereira, M.S., Bacil, E., & Campos, W. (2019). Reprodutibilidade da versão impressa do Questionário Webcas. Adolescência & Saúde, 16(4748), 7-15. https://www.researchgate.net/publication/334683825
Marques, A., Loureiro, N., Avelar-Rosa, B., Matos, A. de, & Gaspar, M. (2020). Adolescents healthy lifestyle. Journal of Pediatric, 96(2), 217-24. https://doi.org/10.1016/j.jped.2018.09.002
McBride, G.B. (2005). A proposal for strength-of-agreement criteria for Lin’s Concordance Correlation Coefficient. NIWA Client Report: HAM2005-062. https://api.semanticscholar.org/Corpus ID:125225327
Mclure, S.A., Reilly, J.J., Crooks, S., & Summerbell, C.D. (2009). Development and evaluation of a novel computer-based tool for assessing physical activity levels in schoolchildren. Pediatric Exercise Science, 21(4), 506-19. https://doi.org/10.1123/pes.21.4.506
Mountjoy, M., Andersen, LB, Armstrong, N., Biddle, S., Boreham, C., Bedenbeck, HPB, Ekelund, U, Engebretsen, L., Hardman, K., Hills, AP, Kahlmeier, S., Kriemler, S., Lambert, E., Ljungqvist, A., Matsudo, V., Mckay, H., Micheli, L., Pate, R., Riddoch, C., Schamasch, P., Sundberg, CJ, Tomkinson, G., Van Sluijs, E., & Van Mechelen, W. (2011). International Olympic Committee consensus statement on the health and fitness of young people through physical activity and sport. British Journal of Sports Medicine, 45(11), 839-848. https://doi.org/10.1136/bjsports-2011-090228
Parker, R., Vannest, K., & Davis, J. (2013). Inter-rater reliability for multi-category scales: problems and solution in PABAK-OS. Journal of School Psychology, 51(2), 217-29. https://doi.org/10.1016/j.jsp.2012.12.003
Pires, A.A.P.P., Junior, R.P., & De Oliveira, R.F. (2014). Concordância entre os formatos impresso e eletrônico do IPAQ-L. Revista Brasileira Medicina do Esporte, 20(6), 474-9. https://doi.org/10.1590/1517-86922014200602134
Skogen, J.C., Boe, T., Knudsen, A.K., & Hysing, M. (2013). Psychometric properties and concurrent validity of the CRAFFT among Norwegian adolescents. Ung@hordaland, a population-based study. Addict Behav, 38(10), 2500-2505. https://doi.org/10.1016/j.addbeh.2013.05.002
Spear, H.J., & Kulbok, P.A. (2001). Adolescent health behaviors and related factors: A review. Public health nursing, 18(2), 82-93. https://doi.org/10.1046/j.1525-1446.2001.00082.x
Tabacchi, J., Filippi, AR, Amodio, E., Napoli, G., Breda, J., Bianco, A., Jemni, M., Censi, L., Mammina, C., & De Jardim, T. (2014). The web-based ASSO-food frequency questionnaire for adolescents: Relative and absolute reproducibility assessment. Nutrition Journal, 13(1). https://doi.org/10.1186/1475-2891-13-119
Tabacchi, J., Filippi, AR, Breda, J., Censi, L., Amodio, E., Napoli, G., Bianco, A., Jemni, M., Firenze, A., & Mammina, C. (2015). Comparative validity of the ASSO-Food Frequency Questionnaire for the web-based assessment of food and nutrients intake in adolescents. Food Nutrition Research, 15(29), 1-15. https://doi.org/10.3402/fnr.v59.26216
Vannest, K.J., Parker, R.I., Gonen, O., & Adiguzel, T . (2016). Single Case Research: calculadoras baseadas na web para análise de SCR. (Versão 2.0) [Aplicativo baseado na web]. College Station, TX: Texas A&M; University. https://singlecaseresearch.org/calculators/
Author Biographies
https://lattes.cnpq.br/4699907120290396
http://lattes.cnpq.br/2009180216579790
http://lattes.cnpq.br/9611072482126021
http://lattes.cnpq.br/7246934528650661
http://lattes.cnpq.br/9160113968922728
https://lattes.cnpq.br/9897863590344289
Copyright (c) 2024 Lecturas: Educación Física y Deportes
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
