Utvrđivanje sadržajne valjanosti novokonstruisanih instrumenata istraživanja (primjer instrumenta za procjenu darovitosti školske djece)

Uzdanica XIX 1 (2022), (str. 269-282)

AUTOR(I): Vlado M. Simeunović, Sanja B. Milić

E-ADRESA: vlado.simeunovic@pfb.ues.rs.ba

Download Full Pdf 

DOI: 10.46793/Uzdanica19.1.269S

SAŽETAK: 

Dinamičan naučno-tehnološki i društveni razvoj nameće potrebu stalnog istraživanja njegovih posljedica u svim sferama života. Istraživači širom svijeta pokušavaju da registruju novonastale promjene i na naučno verifikovani način utvrde njihove efekte, kako bi mogli predvidjeti pravce kretanja i uticati na buduće događaje. Na tom putu se suočavaju sa nizom nepoznanica koje bi mogle uticati na kvalitet rezultata koji se dobijaju. Najčešći problemi s kojima se istraživači susreću su: teškoće oko preciznog određenja predmeta istraživanja (zbog multidisciplinarnosti problema), nedostatak relevantnih podataka na kojima bi se sprovelo istraživanje (dinamika promjena je velika), te problemi izrade instrumenata istraživanja (standardizovani instrumenti često nisu primjenjivi).

Ovaj rad bavi se problemom određivanja metrijskih karakteristika novokon- struisanih instrumenata istraživanja u oblasti procjene darovitosti djece školskog uzrasta koji su implementirani u Softver za procjenu darovitosti. Smatra se da je valjanost najvažnija mjerna karakteristika svakog instrumenta. U radu smo pokazali korišćenje sadržajne valjanosti kao mogućeg pristupa u novokonstruisanim instrumentima istraživanja. Osim teorijskih modela čiju smo vrijednost predstavili, na praktičnom primjeru smo pokazali primjenu izračunavanja indeksa sadržajne valjanosti (CVI) i kappa statistike, odnosno prikazali smo praktični model primjene postojećih procedura (indeksa) za izračunavanje sadržajne valjanosti i na osnovu toga zaključili da je CVI uvjerljiv metod za procjenu valjanosti sadržaja nove (ili revidirane) skale.

KLJUČNE REČI:

sadržajna valjanost, metrijske karakteristike, instrumenti istraživanja, procjena darovitosti.

LITERATURA:

  • APA (1952): American Psychological Association, Committee on Test Standards. Technical recommendations for psychological tests and diagnostic techniques: preliminary proposal, American Psychologist, 7(8), 461–475, https://doi.org/10.1037/h0056631.
  • APA (1966): American Psychological Association, Standards for Educational and Psychological Tests and Manuals, Washington, DC: American Psychological Association.
  • Armstrong (2009): T. Armstrong, Multiple Intelligences in the Classroom (3rd ed.), Alexandria, VA: Association for Supervision & Curriculum Development.
  • Vajnd, Šmit, Šefer (2003): C. Wynd, B. Schmidt, M. Schaefer, Two Quantita- tive Approaches for Estimating Content Validity, WestJ Nurs Res, 25(5), 508‒518, https://doi.org/10.1177/0193945903252998.
  • Volc, Strikland, Lenc (2005): C. F. Waltz, O. L. Strickland, E. R. Lenz, Meas- urement in nursing and health research (3rd ed.), New York: Springer.
  • Gardner (1993): H. Gardner, Multiple intelligence, The theory in practice, New York: Basic Books.
  • Gardner (2006): H. Gardner, Multiple Intelligences: New Horizons, New York: Basic Books.
  • Grant, Dejvs (1997): J. S. Grant, L. L. Davis, Selection and use of content experts in instrument development, Research in Nursing & Health, 20, 269–274. DOI: 10.1002/ (sici)1098-240x(199706)20:3<269::aid-nur9>3.0.co;2-g
  • Keli (1927): T. L. Kelley, Interpretation of educational measurements, New York: Macmillan.
  • Krisvol (2005): J. W. Creswell, Educational research: Planning, conducting and evaluating quantitative and qualitative research (2nd ed.), New Jersey: Pearson Education. Kronbah (1971): L. J. Cronbach, Test validation, In: R. L. Thorndike (Ed.), Educational Measurement, 2nd ed., Washington, DC: American Council on Education, 443–507.
  • Lenon (1955): R. Lennon, Standardized Testing,  The  bulletin  of the  Na-  tional Association of Secondary School Principals, 39(211), 34‒40, https://doi.org/10.1177/019263655503921106.
  • Lin (1986): M. R. Lynn, Determination and quantification of content validity, Nurs Res, 35(6) 382–385, https://doi.org/10.1097/00006199-198611000-00017.
  • Lin (1995). M. R. Lynn, Development  and Testing of the Nursing Role Mod-  el Competence Scale (NRMCS), Journal of Nursing Measurement, 3(2), 93‒108, DOI:10.1891/1061-3749.3.2.93.
  • Lindel, Brant (1999): M. K., Lindell, C. J. Brandt, Assessing interrater agree- ment on the job relevance of a test: A comparison of CVI, T, rWG(J)}, and r*WG(J)} indexes, Journal of Applied Psychology, 84(4), 640–647, https://doi.org/10.1037/0021-9010.84.4.640.
  • Lindel, Brant, Vitni (1999): M. K. Lindell, C. J. Brandt, D. J. Whitney, A re- vised index of interrater agreement for multiitem ratings of a single target, Applied Psycho- logical Measurement, 23, 127–135, https://doi.org/10.1177/01466219922031257.
  • Loš (1975): C. H. Lawshe, A quantitative approach to content validity, Personnel Psychology, 28, 563–575, https://doi.org/10.1111/j.1744-6570.1975.tb01393.x.
  • Milić, Simeunović (2020): S. Milic, V. Simeunovic, Concordance between gift- edness assessments by teachers, parents, peers and the self-assessment using multiple intel- ligences, High Ability Studies, 1‒14. DOI: 10.1080/13598139.2020.1832445
  • Palant (2011): J. Pallant, SPSSsurvival manual. A Step by step guide data to analy- sis using SPSS-4th edition, Maryborough: Midland Typesetters.
  • Perlet, Zigler (1997): C. Perleth, A. Ziegler, Uberlegungen zur Begabungsdiag- nose und Begabtenforderung in der Berufsaus- und Weiterbildung [Considerations on diag- nosis and promotion of gifted in personnel training and vocational education], In: U. Kittler, H. Metz-Gockel (Eds.), Padagogische Psychologie in Erziehung und Unterricht, 100–112.
  • Polit, Bek (2006): D. F. Polit, C. T. Beck, The content validity index: Are you sure you know what’s being reported? Critique and recommendations, Research in Nursing & Health, 29, 489–497. DOI: 10.1002/nur.20147
  • Polit, Bek, Oven (2007): D. F. Polit, C. T. Beck, S. Owen, Is the CVI an Accept- able Indicator of Content Validity? Appraisal and Recommendations, Research in Nursing & Health, 30, 459–467. DOI: 10.1002/nur.20199
  • Sekiran, Buži (2010): U. Sekaran, R. Bougie, Research methods for business: A skill building approach (5th ed.), West Sussex, UK: John Wiley & Sons Ltd.
  • Stemler (2004): S. Stemler, A comparison of consensus, consistency, and measure- ment approaches to estimating interrater reliability, Practical Assessment, Research, and Evaluation, 9, article 4, https://doi.org/10.7275/96jp-xz07
  • Tilden, Nelson, Mej (1990): V. P. Tilden, C. A. Nelson, B. A. May, Use of quali- tative methods to enhance content validity, Nursing Research, 39(3), 172–175, https://doi.org/10.1097/00006199-199005000-00015.
  • Tinsli, Vajs (1975): H. E. Tinsley, D. J. Weiss, Interrater reliability and agree- ment of subjective judgments, Journal of Counseling Psychology, 22(4), 358–376, https://doi.org/10.1037/h0076640.
  • Flajš, Levin, Čo Pejk (2003): J L. Fleiss, B. Levin, M. Cho Paik, Statistical Methods for Rates and Proportions (3th ed.), Copyright John Wiley & Sons, Inc.
  • Hajnes, Ričard, Kubani (1995): S. Haynes, D. Richard, E. Kubany, Content valid- ity in psychological assessment: A functional approach to concepts and methods, Psycho- logical Assessment, 7, 238–247, https://doi.org/10.1037/1040-3590.7.3.238.
  • Heler, Perlet, Lim (2005): K. Heller, C. Perleth, T. Lim, The Munich Model of Giftedness Designed to Identify and Promote Gifted Students, In: R. Sternberg, J. Davidson (Eds.), Conceptions of Giftedness, Cambridge: Cambridge University Press, 147–170.
  • Džejms, Dimari, Volf (1993): L. R. James, R. G. Demaree, G. Wolf, An assess- ment of within-group interrater agreement, Journal of Applied Psychology, 78(2), 306‒309, https://doi.org/10.1037/0021-9010.78.2.306.
  • Džordž (2005): D. George, Obrazovanjedarovitih: Kako identificirati i obrazovati darovite i talentirane učenike, Zagreb: Educa.
  • Šepard (1993): L. A. Shepard, Evaluating test validity, Review of Research in Education, 19, 405–450, https://doi.org/10.3102/0091732X019001405.