The reliability of language performance measurement in language sample analysis of children aged 5-6 years
,
Abstract
Background and Aim: The language sample analysis (LSA) is more common in other languages than Persian to study language development and assess language pathology. We studied some psychometric properties of language sample analysis in this research such as content validity of written story and its pictures, test-retest reliability, and inter-rater reliability.
Methods: We wrote a story based on Persian culture from Schneider’s study. The validity of written story and drawn pictures was approved by experts. To study test-retest reliability, 30 children looked at the pictures and told their own story twice with 7-10 days interval. Children generated the story themselves and tester did not give any cue about the story. Their audio-taped story was transcribed and analyzed. Sentence and word structures were detected in the analysis.
Results: Mean of experts' agreement with the validity of written story was 92.28 percent. Experts scored the quality of pictures high and excellent. There was correlation between variables in sentence and word structure (p<0.05) in test-retest, except complex sentences (p=0.137). The agreement rate was 97.1 percent in inter-rater reliability assessment of transcription. The results of inter-rater reliability of language analysis showed that correlation coefficients were significant.
Conclusion: The results confirmed that the tool was valid for eliciting language sample. The consistency of language performance in repeated measurement varied from mild to high in language sample analysis approach.
2. Stockman IJ. The promises and pitfalls of language sample analysis as an assessment tool for linguistic minority children. LSHSS. 1996;27:355-66.
3. Liles BZ. Narrative discourse in children with language disorders and children with normal language: a critical review of literature. J speech Hear Res.1993;36(5):868-82.
4. Gavin WJ, Giles L. Sample size effects on temporal reliability of language sample measures of preschool children. J Speech Hear Res. 1996;36(6): 1258-62.
5. Reilly J, Losh M, Bellugi U, Wulfeck B. Frog, Where are you? narratives in children with specific language impairment, early focal brain injury and Williams syndrome. Brain Lang. 2004;88(2):229-47.
6. Watkins RV, Kelly DJ, Harbers HM, Hollis W. Measuring children’s lexical diversity: differentiating typical and impaired language learners. J Speech Hear Res.1995;38(6):1349-55.
7. Schneider P, Hayward D, Dube′ RV. Storytelling from picture using the edmonton narratives norms instrument. CJSLPA. 2006;30(4):224-38.
8. Paul R. Children with language disorder from infancy through adolescence: assessment and intervention. 3rd ed. United States of America: Mosby Elsevier; 2011.
9. Tilstra J, McMaster K. Productivity, fluency, and grammaticality measures from narratives potential indicators of language proficiency? Commun Disord Q. 2007;29(1):43-53.
10. Hewitt LE, Hammer CS, Yont KM, Tomblin JB. Language sampling in kindergarten children with and without SLI: mean length of utterance, IPSYN, and NDW. J Commun Disord. 2005;38(3):197-213.
11. Kemp K, Klee T. Clinical language sampling practices: results of a survey of speech-language pathologists in the united states. Child Lang Teach Ther.1997;13(2):161-76.
12. Shultz KS, Whitney DJ. Measurement theory in action: case studies and exercises. 2nd ed. California: Sage Publications; 2005.
13. Domholdt E. Rehabilitation research: principles and applications. 3rd ed. St. Louis, MO: Elsevier Saunders; 2005.
| Issue | Vol 23 No 1 (2014) | |
| Section | Research Article(s) | |
| Keywords | ||
| Reliability validity language sample analysis children Persian | ||
| Rights and permissions | |
|
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License. |
