|
 |
|
ORIGINAL ARTICLE |
|
|
|
| Year : 2022 | Volume
: 25
| Issue : 2 | Page : 224-228 |
| |
Transcultural adaptation and validation of Kannada version of the National Institute of Health Stroke Scale (NIHSS)
Priya Baby1, PR Srijithesh2, Ashok V Reddy2, Aravind K Rajasekaran3, Mariamma Philip4, Preetie S Akkunje3, Surbhi Chaturvedi2
1 College of Nursing, National Institute of Mental Health and Neurosciences, Bengaluru, Karnataka, India
2 Department of Neurology, National Institute of Mental Health and Neurosciences, Bengaluru, Karnataka, India
3 Department of Speech Pathology and Audiology, National Institute of Mental Health and Neurosciences, Bengaluru, Karnataka, India
4 Department of Biostatistics, National Institute of Mental Health and Neurosciences, Bengaluru, Karnataka, India
| Date of Submission | 06-Aug-2021 |
| Date of Acceptance | 13-Oct-2021 |
| Date of Web Publication | 07-Feb-2022 |
Correspondence Address:
P R Srijithesh
Department of Neurology, NIMHANS, Bengaluru, Karnataka
India
 Source of Support: None, Conflict of Interest: None  | Check |
DOI: 10.4103/aian.aian_707_21
 Abstract | | |
Background and Purpose: The National Institute of Health Stroke Scale (NIHSS) is widely used in clinical practice to evaluate stroke-related neurological deficits. The aim of this study was to develop Kannada language version of the NIHSS (Ka-NIHSS) and determine its validity and reliability. Materials and Methods: In the first phase of the study, Ka-NIHSS was adapted based on cultural and linguistic peculiarities. In the next phase, 51 acute stroke patients were prospectively enrolled in the study. The concurrent validity of the Ka-NIHSS was evaluated by comparison with the Glasgow Coma Scale (GCS) and the modified Rankin Scale (mRS). The predictive validity was assessed by comparison with Barthel Index (BI) score and mRS at a 90-day telephonic follow-up. The reliability was evaluated using the kappa statistics for inter-rater agreement between two independent raters and intra-class correlation coefficient (ICC) analysis. The inter-rater agreement of videotaped assessment of items 9 and 10 between four independent raters was evaluated using kappa statistics. Results: Ka-NIHSS scores highly correlated with GCS (P = –0.74 P < 0.001) and mRS (P = 0.85, P < 0.001) at baseline. It moderately correlated with mRS (P = 0.67, P < 0.001) and BI (P = –0.64, P < 0.001) at 90 days follow up. Inter-rater reliability was high between the two examiners, with kappa values ranging from 0.66 to 0.95. The inter-rater agreements of the video assessment of items 9 and 10 for nine patients among four raters were 0.81 and 1 respectively. Conclusions: Ka-NIHSS is a valid and reliable tool for assessing neurological deficits in Kannada-speaking stroke patients.
Keywords: Kannada, National Institute of Health Stroke Scale, Kannada NIHSS, transcultural adaptation, validity, reliability
How to cite this article:
Baby P, Srijithesh P R, Reddy AV, Rajasekaran AK, Philip M, Akkunje PS, Chaturvedi S. Transcultural adaptation and validation of Kannada version of the National Institute of Health Stroke Scale (NIHSS). Ann Indian Acad Neurol 2022;25:224-8 |
How to cite this URL:
Baby P, Srijithesh P R, Reddy AV, Rajasekaran AK, Philip M, Akkunje PS, Chaturvedi S. Transcultural adaptation and validation of Kannada version of the National Institute of Health Stroke Scale (NIHSS). Ann Indian Acad Neurol [serial online] 2022 [cited 2022 Jul 1];25:224-8. Available from: https://www.annalsofian.org/text.asp?2022/25/2/224/337346 |
| Introduction | |  |
The National Institute of Health Stroke Scale (NIHSS) is a clinical instrument used widely to quantify neurological deficits in acute stroke.[1] It was initially developed for use in clinical trials[2] and has now become a routine clinical assessment tool to measure the severity of stroke. It is used to evaluate a patients' eligibility for reperfusion therapies and hence has surmount clinical significance. NIHSS has proven to have a strong correlation with short-term and long-term outcomes after stroke.[3] Thus it is a useful tool for prognostic stratification of acute stroke patients. It is a simple, highly reliable, and well-validated tool that can be administered by any trained health care provider including physicians, therapists, nurses, and research fellows.[4],[5]
The NIHSS has 15 items that evaluate the effect of stroke on domains including the level of consciousness, eye movement, visual field, facial symmetry, motor strength, sensory function, speech-language function, coordination, and extinction. Each item is scored from 0 to 4 (or lesser in some items). The total score can range from 0 to 42. A trained rater takes up to 10 minutes for assessment of a patient using NIHSS.
The original NIHSS was developed for the English-speaking population. The items used to test aphasia and dysarthria are not culturally relevant or linguistically appropriate for non- English speaking population. Hence, it has been adapted to several non-English versions[6],[7] including Indian languages like Bengali[8] and Hindi.[9] Indian languages have substantial linguistic and cultural differences from English. Further, there exists a significant variation between the Indian languages. This study reports the development and validation of the Kannada (South Indian language) version of NIHSS (Ka-NIHSS).
| Materials and Methods | | |
This study was undertaken at the National Institute of Mental Health and Neurosciences, (NIMHANS), Bangalore, India. NIMHANS is a tertiary hospital for Mental Health and Neurosciences. Kannada is the mother tongue of majority of patients attending emergency services in the hospital.
Development of Ka-NIHSS
The first phase of the study was the development of Ka-NIHSS by adapting the original NIHSS (English version). The adaptation was required for items 9 and 10 which assess aphasia and dysarthria respectively. Item 9 includes the picture description, picture naming (six items), and reading/repetition (five phrases/sentences) tasks. Item 10 corresponds to the reading/repetition (six words) task [Figure 1]. The adaptation was performed in two steps. Two Kannada language experts who were oriented to the tool developed a preliminary list of words, sentences, pictures and scenarios.
The list was screened and a final tool was made. A panel of three speech and language pathologists, whose experience ranged between 12 to 40 years. In the case of words and phrases, the number of syllables and the word length were kept as similar to the English version as possible. Further, familiarity and cultural relevancy of the items too were accounted for. The consensus was reached between all three experts before finalization of the words and sentences [Figure 2]a and [Figure 2]b. Following this, a language expert did a forward and backward translation and a certificate of translation was obtained. | Figure 2: (a) Kannada phrases/sentences. (b) Kannada words for identifying dysarthria. (c) Mane Horage Aduge' picture for assessing aphasia. (d) Pictures for identification
Click here to view |
Regarding the scenario for picture description task, the cookie jar picture (original NIHSS) was replaced with a culturally appropriate picture (Mane horage aduge). This is a familiar scenario in villages of Karnataka and was similar to the 'Chullah' picture in the Hindi version of NIHSS.[9] The conceptualized 'Mane horage aduge' picture was drawn by a professional artist [Figure 2]c. The picture had adequate cues like, 'the child falling from mango tree' and 'girl playing in a swing' to prompt the picture description task. The naming card was prepared with pictures of six items that are familiar and commonly used in the Kannada culture [Figure 2]d.
The adapted items were administered to five volunteers, all of whom were native Kannada speakers. The responses were observed and recorded to ensure that the intended meaning of the items are well retained. The adapted version was called Ka-NIHSS. The development of the Ka-NIHSS is schematically represented in [Figure 3]. In [Table 1] the adapted items are given in Kannada and in the International Phonetic Alphabet (IPA) format. The rationale for the adaption too is discussed in [Table 1]. | Figure 3: Schematic representation of process of development of Ka-NIHSS
Click here to view |
 | Table 1: Rationale for the adapted items and the International Phonetic expression of words used
Click here to view |
Validity and reliability of Ka-NIHSS
The second phase of the study was to establish the validity and reliability of the Kannada version of NIHSS. The protocol for the study was approved by the Institute Ethics Committee. Written informed consent was obtained from the patients or primary caregivers.
Subjects
Acute ischemic stroke patients were considered for the study. All the patients were evaluated within 48 h of the onset of stroke. The socio-demographic information of the patients, Glasgow Coma Scale (GCS), and modified Rankin Scale (mRS) were assessed along with the Ka -NIHSS score.
Validity
The construct validity of Ka-NIHSS was evaluated by comparing the Ka-NIHSS score with the GCS and mRS. Both GCS and mRS scores of the acute stroke patients were assessed at the baseline along with Ka-NIHSS. GCS is well established as a reliable and objective tool for assessing a patients' status in acute neurological conditions. mRS is a single-item scale used widely in patients after stroke. It is considered a highly reliable and valid tool to measure global outcome in stroke patients.[10] Spearman's correlation coefficient was calculated between Ka-NIHSS score and GCS as well as mRS to determine the validity.
The predictive validity of the Ka-NIHSS was determined by comparing the baseline Ka-NIHSS score with the 90-day outcome of the stroke patients as measured using mRS and Barthel Index (BI) scores. The primary investigator acquired the 90 days mRS and BI scores by contacting the patients telephonically. Spearman correlation coefficient was used to estimate the relationship between the baseline Ka-NIHSS score and the BI and mRS scores at 90 days.
Reliability
The inter-observer reliability of Ka-NIHSS was determined by studying the agreement among two independent raters. Two investigators administered Ka-NIHSS on the same patient on the same day with a time gap of 1–3 h, blinded to each other. One of the raters was a neurologist who specialized in stroke. The other rater was an academic nurse who was specialized in Neuroscience Nursing. Both the raters were trained and were certified for NIHSS application through the American Stroke Association's Online NIH Stroke Scale Training Program. The Ka-NIHSS scale was administered for all 51 patients by both the raters independently within 48 h of admission. For illiterate patients, item 9 was scored based on their responses to picture description and naming tasks. For scoring item 10 in illiterate patients, the words were read out to them and asked to repeat aloud.
Non –parametric tests were used as the item-wise scoring of NIHSS is an ordinal level data. The inter-rater agreement was estimated using Kappa statistics and intra class correlation coefficient for individual items and the total scores respectively. The agreement was defined as follows: κ < 0.40 shows poor agreement, κ between 0.40 and 0.75 shows moderate agreement, and κ > 0.75 shows excellent agreement.[11] The ICC of 1 was defined as perfect reliability, 0.8 to 1 was considered excellent, 0.6–0.8 substantial, 0.4–0.6 as fair, and less than 0.4 as poor reliability.
To pursue the inter-rater agreement of the patient assessment, we sought to estimate the reliability of video recording of the Ka-NIHSS assessment. Four raters assessed the video recording of items 9 and 10 for nine patients. Out of the four raters, three were speech and language pathologists.
| Results | | |
Patient characteristics
Fifty one acute stroke patients were enrolled in the study. The mean age of the patients was 49.5 (SD 14.9 years; range, 23 – 80 years). The demographic characteristics of the subjects are given in [Table 2]. The mean Ka-NIHSS score of the patients was 12.3 (SD 8.7). Out of the 51 patients, 17 patients had a Ka-NIHSS score less than 8, 28 patients had a score range of 8–24 and 6 had more than 24. Except for one, all patients could be followed up telephonically at 90 days after baseline assessment to determine their functional outcome using mRS and BI.
Construct validity
Ka-NIHSS scores were highly correlated with both GCS (P = –0.74, P < 0.001) and mRS (P = 0.85, P < 0.001) at the baseline. GCS score decreases when the severity of stroke increases; hence Ka-NIHSS and GCS are inversely correlated. The correlation of Ka-NIHSS scores with both GCS and mRS indicates the construct validity of the Ka-NIHSS.
Predictive validity
The telephonic follow-up assessment after 90 days revealed that 21% of the patients had mRS score 0, 42.3% had score 1 or 2, and 22.7% had score 3 to 5. Six (11.5%) patients were dead at 90 days follow-up.
Ka-NIHSS scores were moderately correlated with both mRS (P = 0.67, P < 0.001) and BI (P = –0.64, P < 0.001) at 90 days follow up. As Barthel index is inversely related to the severity of stroke, a negative correlation is observed between BI and Ka-NIHSS. The correlation of Ka-NIHSS scores with both mRS and BI measured at 90 days indicates that Ka-NIHSS has predictive validity.
Reliability
The intraclass correlation coefficient, between the two raters for the total Ka- NIHSS score was 0.991. The kappa value of each item of the Ka- NIHSS, is given in [Table 3]. In the same table, the scores have been compared with the kappa values of the study by original authors.[12] Excellent inter-rater reliability was demonstrated in 12 items of the tool. Substantial reliability was seen in 3 items including limb ataxia, dysarthria, and visual field. | Table 3: Inter-rater agreement of Ka-NIHSS in comparison with the original NIHSS
Click here to view |
Reliability of Video recorded assessment
Kappa statistics were computed for each rater pair and then averaged to provide a single index of agreement. The resulting kappa indicated excellent agreement, κ = 0.81 for aphasia, and perfect agreement, κ = 1.00 for dysarthria.
| Discussion | | |
The NIHSS is a clinical evaluation tool used widely to assess the severity of neurological impairment in stroke. The original NIHSS is in English and has limitations for use in Kannada speaking population. Therefore the present study was undertaken to adapt a Kannada version of NIHSS which was then tested and validated using standard methods.
Ka- NIHSS strongly correlated with baseline GCS and mRS. It also correlated moderately well with the 90-day outcome as measured by BI and mRS. This is in line with the properties of the original NIHSS, which has demonstrated a modest correlation of baseline NIHSS with 90 days BI score (P = –0.51) and mRS (P = 0.56).[4] The findings of our study establish that the Ka-NIHSS can effectively assess the severity of neurological deficits due to acute stroke. It can also predict the outcome of acute stroke patients at 90 days.
The study demonstrated excellent inter-rater agreement in 12 items of the scale. The items which showed moderate agreement were limb ataxia, dysarthria, and visual field. The highest agreement was demonstrated in the items, level of consciousness, and motor power of the right leg.
In the reliability evaluation of the NIHSS by original authors, dysarthria and level of consciousness had fair to poor agreement between raters.[12] In comparison, the present study demonstrated dysarthria to have a moderate, and level of consciousness to have an excellent agreement. The inter-rater agreement of items of the present study is comparable to that of the original NIHSS [Table 3].[12] Across studies that have assessed the reliability of various language versions and videotape scoring of NIHSS, the items which consistently yield lower agreement include facial palsy, limb ataxia, dysarthria, and level of consciousness.[13] In the present study limb ataxia and dysarthria yielded a lower agreement. However level of consciousness was one of the items with the highest agreement in the present study. Direct patient examination as against scoring of video recording of the patient in most other studies would have resulted in this difference.
In the Hindi version developed by Prasad et al. 2012[9], the inter-rater agreement (between a neurologist and non-neurologist) was substantial for all items of NIHSS. The present study, where one of the raters is a nurse, shows good agreement in all items.
The video recording of items 9 and 10 showed excellent reliability among raters. As most of the raters were speech and language pathologists, their expertise in identifying abnormalities of aphasia and dysarthria could be considered as the best possible clinical assessment. Hence it can be concluded that video recording of Ka-NIHSS can be used reliability for assessment.
The major limitation of this study was the small sample size. Another limitation of the study was that the predictive validity was assessed using mRS and Barthel index at 90 days by a telephonic follow-up rather than direct assessment. As telephonic follow-up was practically more feasible than an in-person assessment, we opted for a telephonic assessment.
| Conclusions | | |
The Ka-NIHSS scale is culturally relevant for Kannada speaking population. It is a valid and reliable tool. It can be used by neurologists and non-neurologists alike.
Acknowledgements
The authors would like to thank Dr. N Shivashankar (Professor, Speech Language Pathology and Audiology) Mrs. Proornima H.N, Mr. Albert Manoraj (linguistic experts) Mr. Sripad Patil (Artist), Mr. Prashasti Poovaiah, Mr. Suman N, (Speech and language pathologists) for their support.
Statement on ethical issues
The institutional ethics committee has approved the protocol for the study. Written informed consent was obtained from participants.
Financial support and sponsorship
Nil.
Conflicts of interest
There are no conflicts of interest.
| References | | |
| 1. | Albanese MA, Clarke WR, Adams HP Jr, Woolson RF. Ensuring reliability of outcome measures in multicenter clinical trials of treatments for acute ischemic stroke. The program developed for the Trial of Org 10172 in Acute Stroke Treatment (TOAST). Stroke 1994;25:1746-51.  |
| 2. | Brott T, Adams HP Jr, Olinger CP, Marler JR, Barsan WG, Biller J, et al. Measurements of acute cerebral infarction: A clinical examination scale. Stroke 1989;20:864-70. |
| 3. | Adams HP Jr, Davis PH, Leira EC, Chang KC, Bendixen BH, Clarke WR, et al. Baseline NIH Stroke Scale score strongly predicts outcome after stroke: A report of the Trial of Org 10172 in Acute Stroke Treatment (TOAST). Neurology 1999;53:126-31. |
| 4. | Lyden P, Lu M, Jackson C, Marler J, Kothari R, Brott T, et al. Underlying structure of the National Institutes of Health Stroke Scale: Results of a factor analysis. NINDS tPA Stroke Trial Investigators. Stroke 1999;30:2347-54. |
| 5. | Hacke W, Donnan G, Fieschi C, Kaste M, von Kummer R, Broderick JP, et al. Investigators; ECASS Trials Investigators; NINDS rt-PA Study Group Investigators. Association of outcome with early stroke treatment: Pooled analysis of ATLANTIS, ECASS, and NINDS rt-PA stroke trials. Lancet 2004;363:768-74. |
| 6. | Nilanont Y, Phattharayuttawat S, Chiewit P, Chotikanuchit S, Limsriwilai J, Chalernpong L, et al. Establishment of the Thai version of National Institute of Health Stroke Scale (NIHSS) and a validation study. J Med Assoc Thai 2010;93(Suppl 1):S171-8. |
| 7. | Pezzella FR, Picconi O, De Luca A, Lyden PD, Fiorelli M. Development of the Italian version of the National Institutes of Health Stroke Scale: It-NIHSS. Stroke 2009;40:2557-9. |
| 8. | Apratim C, BimanKanti R. Validation of Bengali version of NIHSS scale. Neurology 2019;92 (15 Suppl):P3.3-069. |
| 9. | Prasad K, Dash D, Kumar A. Validation of the Hindi version of National Institute of Health Stroke Scale. Neurol India 2012;60:40-4. [ PUBMED] [Full text] |
| 10. | Wilson JT, Hareendran A, Hendry A, Potter J, Bone I, Muir KW. Reliability of the modified Rankin Scale across multiple raters: Benefits of a structured interview. Stroke 2005;36:777-81. |
| 11. | Fleiss JL. Statistical Methods for Raters and Proportions. New York: Wileyand Sons; 1981. p. 212-36. |
| 12. | Meyer BC, Hemmen TM, Jackson CM, Lyden PD. Modified National Institutes of Health Stroke Scale for use in stroke clinical trials: Prospective reliability and validity. Stroke 2002;33:1261-6. |
| 13. | Ghandehari K. Challenging comparison of stroke scales. J Res Med Sci 2013;18:906-10. |
[Figure 1], [Figure 2], [Figure 3]
[Table 1], [Table 2], [Table 3]
|
