|Year : 2018 | Volume
| Issue : 2 | Page : 120-123
Evaluation of interobserver reliability of Nugent score for diagnosis of bacterial vaginosis
Swapna Muthusamy1, Jessy Varghese2, Vinod Raveendran1, Kavitha Ezilarasan1, Joshy Maducolil Easow1
1 Department of Microbiology, Sri Venkateshwaraa Medical College Hospital and Research Centre, Puducherry, India
2 Department of Obstetrics and Gynaecology, Aarupadai Veedu Medical College and Hospital, Puducherry, India
|Date of Web Publication||7-Dec-2018|
Dr. Jessy Varghese
Department of Obstetrics and Gynaecology, Aarupadai Veedu Medical College and Hospital, Puducherry
Source of Support: None, Conflict of Interest: None
| Abstract|| |
Background: Vaginal discharge is the commonly narrated compliant of the female attendees of sexually transmitted infection clinic, among which bacterial vaginosis (BV) is responsible for one-third of the visits. BV is often diagnosed clinically which warrants laboratory confirmation. Aims: The study aims to detect the reliability of the Nugent scoring system between observers for the diagnosis of BV. Materials and Methods: This is a prospective study including 177 high vaginal swabs. The gram-stained smears were examined by three independent microbiologists, and the Nugent scoring was performed. Statistical analysis was performed using IBM-SPSS version-22 statistical package for kappa value. Results: Concordant results were seen in 64.03% of smears, discordant results were given in 4.51% of smears, and partial agreement was observed in 31.63% of smears. Conclusion: Interobserver reliability is good for the Nugent score. The Nugent score is a simple and reliable method for the diagnosis of BV that can be adapted even in the resource poor settings.
Keywords: Bacterial vaginosis, Nugent score, reliability
|How to cite this article:|
Muthusamy S, Varghese J, Raveendran V, Ezilarasan K, Easow JM. Evaluation of interobserver reliability of Nugent score for diagnosis of bacterial vaginosis. Indian J Sex Transm Dis 2018;39:120-3
|How to cite this URL:|
Muthusamy S, Varghese J, Raveendran V, Ezilarasan K, Easow JM. Evaluation of interobserver reliability of Nugent score for diagnosis of bacterial vaginosis. Indian J Sex Transm Dis [serial online] 2018 [cited 2019 Mar 23];39:120-3. Available from: http://www.ijstd.org/text.asp?2018/39/2/120/247092
| Introduction|| |
Bacterial vaginosis (BV) is a polymicrobial syndrome characterized by loss of normal vaginal flora and acquisition of mixed anaerobic bacteria with an increase in the bacterial load from 1000 to 10,000 times above the normal. The prevalence of BV was found to be 19% among sexually active females in Mysore, India. Common clinical presentations are malodorous homogeneous discharge, pruritus, dyspareunia, and lower abdominal pain. There is a bidirectional association between BV and increased risk of acquisition of sexually transmitted infections,, including HIV. The numerous diagnostic methods available for BV include Amsel's criteria, Nugent scoring, Hays/Ison system, Spiegel's criteria, Schimdt's scoring system, anaerobic culture, proline aminopeptidase test, gas-liquid chromatography, sialidase activity,, and molecular methods. Because of the complexity of bacterial flora in BV, none of the diagnostic methods are currently better than the standardized Gram's stain. Although microscopic methods are simple to perform, cost-effective, rapid, and reproducible, the reliability between various observers is of concern. This study was carried out to evaluate interobserver reliability in interpreting the microscopy of vaginal smears by the Nugent score method.
| Materials and Methods|| |
This is a prospective study including nonrepetitive high vaginal swabs received from patients with vaginal discharge in microbiology laboratory from January 2015 to May 2015. Ethical and research clearance was obtained from the Institutional Ethical and Research-Committee. Informed consent was obtained from each patient before the procedure. The total number of high vaginal swabs received during the period was 177. One gram-stained smear prepared from each sample was visualized by three independent microbiologists. They were graded as normal (N), intermediate (I), and BV based on the number of bacterial morphotypes [Table 1]. Statistical analysis was performed using SPSS 22 (IBM Corp, Armonk, NY, United States of America).
| Results|| |
Gram-stained vaginal smears were examined by three observers, and results were analyzed using IBM-SPSS version-22 for kappa value. The percentage of concordance and discordance were calculated and tabulated. All the three observers scored the smears concordantly in 113 (64.03%) smears. Completely discordant results were given by three examiners in eight (4.51%) smears [Table 2]. BV was diagnosed in 17.7% of females [Table 3]. Analysis of partial agreement results showed that the agreement between two observers in various combinations (observer 1 and 2, observer 2 and 3, and observer 3 and 1) was good based on kappa values. The percent of agreement were 66.7%, 65.5%, and 59.9%, respectively [Table 4]. The interobserver reliability was good to fair in our study.
|Table 2: Correlation of the Nugent score results among three observers (n=177)|
Click here to view
|Table 4: Percentage and kappa statistics for partial agreement between observers|
Click here to view
The weighted kappa statistics was used to measure agreement between the observers. Calculated kappa values of <0.4 are considered to reflect poor reproducibility or agreement, those of 0.4–0.75 reflect good to fair agreement, while >0.75 reflect excellent agreement. Since the calculated kappa values in our study were in the range of 0.4–0.75, the results reflect good agreement between the observers.
| Discussion|| |
BV is the most common health problem affecting women. It has been implicated in causing higher rates of late miscarriage, premature rupture of membrane, chorioamnionitis, spontaneous preterm labor, and postpartum endometritis. Among various diagnostic methods available for BV, Amsel's criteria are the gold standard method, and the Nugent score is considered as the reference method for microscopic reading of vaginal smears. Amsel's criteria are based on the clinical assessment with which the presence or absence of BV is detected. On the contrary, the Nugent score is laboratory-based and allows for assessment of alteration in vaginal microbial flora as a continuum rather than a dichotomy. Among the four criteria described by Amsel, amine odor was the least accurate, and character of vaginal discharge had the highest accuracy. The combination of only two criteria (pH and KOH test) showed the highest accuracy, which was even more than all four criteria combined together. Based on the accuracy values, Amsel's criteria can be used as a simple bedside test, but wherever resources are available, it is essential to diagnose BV by other reliable method.
In the present study, high vaginal smears were evaluated for interobserver reliability. The percentage of complete agreement achieved in our study was 64.03%. The complete disagreement was 4.51%, where all the three observers gave an entirely different report for eight smears. The partial agreement where two among the three observers reported similarly was seen in 31.63% [Table 2]. All the three observers scored 7.96% of smears as normal, 32.74% of smears as intermediate, and 17.7% of smears as BV [Table 3]. Based on percentage values, the agreement between observer 1 and 2 and observer 2 and 3 was almost equal, but the agreement between observer 3 and 1 was comparatively lower. However, all three sets of observer combinations fell into good reliability based on kappa values [Table 4]. In a similar study done by Mohanty et al., complete agreement was found in 76.2%, partial agreement was seen in 22.13%, and complete disagreement was seen only in 1.66%. The inter-rater reliability was good approaching to excellent in their study. Another study by Zarakolu et al. also showed that the agreement between observers for interpretation of the Nugent score was good.
The prevalence of BV in our study was 17.7% which is comparable to the study done by Rao et al. where the prevalence was found to be 17.42%. The intermediate flora was 14.4% which is lower compared to 32.7% in our study. The intermediate score is an additional finding in the Nugent score which is not done with Amsel's and Spiegel's criteria. The problem with intermediate flora is that 30% of it can revert back to normal, 30% can progress to BV, and the rest can remain as such. Because of the uncertainty of intermediate flora, it should be reassessed or considered as BV for treatment based on clinical risk. The disadvantage with Spiegel's criteria is that it involves Bacteroides and Gram-positive cocci in its grading, because of which the reliability is low. Hence, Spiegel's criteria which divide vaginal smears into BV and normal flora are not as popular as the Nugent method.
Examination of smears by all the three examiners showed that about 35.34% of smears were not scored due to insufficient material. The various reasons for nonvisualizable smear are the absence of vaginal discharge, improper collection technique, delayed transport of high vaginal swabs to the laboratory, delay in processing, unskilled smearing technique, skipping of drying, and fixation step during preparation of smear or observer error. In our study, most patients had symptomatic vaginal discharge, but few had complaints predominantly of lower abdominal pain and pruritus; swabs were collected by trained professionals; samples were processed immediately on receipt; smears were prepared and stained by trained technicians; and scoring was performed by qualified microbiologists. Since all the three observers reported nonvisualizable smear in concordant samples, the possibility of observer error was eliminated. The possible reasons for nonvisualizable smear in our study could be insufficient sample or delay in transport of swabs to the laboratory.
According to Mohanty et al., discrepancies in scoring can occur due to various reasons such as different sampling devices, collection technique, site of collection, homogeneity and thickness of vaginal discharge, different methods of fixation, tendency of the old lactobacilli to lose the Gram-positive nature, misinterpretation of diphtheroids as Gardnerella vaginalis and also due to differences in bacterial density, and image area observed under different microscopes. In this context, Hays/Ison system is the best method as image area, and bacterial density has minimal effect in its interpretation. However, it is difficult to teach Hays/Ison system as compared to the Nugent scoring method. The possible reasons for discordant results in our study can be due to differences in identifying various morphotypes by the observers, differences in bacterial density in various fields, and image area of the microscopes.
The eight smears that were given discrepant results by the three observers were examined by an expert microbiologist and were found to have intermediate score. All the three observers reexamined the slides and scored them correctly. The occurrence of discrepancy with intermediate score again emphasizes the need for reassessing the smears whenever such score is encountered. Limitations of the study are that prestudy refresher training for the Nugent score was not given to the observers before participation. Delay in the transport of samples to the laboratory should have been taken care to minimize the percentage of nonvisualizable smears.
| Conclusion|| |
Interobserver reliability for the Nugent score is good. After considering the constraints and accuracies for various methods, the Nugent score stands out as a reliable method for diagnosing BV.
Financial support and sponsorship
Conflicts of interest
There are no conflicts of interest.
| References|| |
Larsson PG, Carlsson B, Fåhraeus L, Jakobsson T, Forsum U. Diagnosis of bacterial vaginosis: Need for validation of microscopic image area used for scoring bacterial morphotypes. Sex Transm Infect 2004;80:63-7.
Madhivanan P, Krupp K, Chandrasekaran V, Karat C, Arun A, Cohen CR, et al.
Prevalence and correlates of bacterial vaginosis among young women of reproductive age in Mysore, India. Indian J Med Microbiol 2008;26:132-7.
] [Full text]
Rao PS, Devi S, Shriyan A, Rajaram M, Jagdishchandra K. Diagnosis of bacterial vaginosis in a rural setup: Comparison of clinical algorithm, smear scoring and culture by semiquantitative technique. Indian J Med Microbiol 2004;22:47-50.
] [Full text]
Watts DH, Fazzari M, Minkoff H, Hillier SL, Sha B, Glesby M, et al.
Effects of bacterial vaginosis and other genital infections on the natural history of human papillomavirus infection in HIV-1-infected and high-risk HIV-1-uninfected women. J Infect Dis 2005;191:1129-39.
Kaul R, Nagelkerke NJ, Kimani J, Ngugi E, Bwayo JJ, Macdonald KS, et al.
Prevalent herpes simplex virus type 2 infection is associated with altered vaginal flora and an increased susceptibility to multiple sexually transmitted infections. J Infect Dis 2007;196:1692-7.
Wiesenfeld HC, Hillier SL, Krohn MA, Landers DV, Sweet RL. Bacterial vaginosis is a strong predictor of Neisseria gonorrhoeae
and Chlamydia trachomatis
infection. Clin Infect Dis 2003;36:663-8.
Myer L, Denny L, Telerant R, Souza Md, Wright TC Jr., Kuhn L, et al.
Bacterial vaginosis and susceptibility to HIV infection in South African women: A nested case-control study. J Infect Dis 2005;192:1372-80.
Amsel R, Totten PA, Spiegel CA, Chen KC, Eschenbach D, Holmes KK. Nonspecific vaginitis. Diagnostic criteria and microbial and epidemiologic associations. Am J Med 1983;74:14-22.
Nugent RP, Krohn MA, Hillier SL. Reliability of diagnosing bacterial vaginosis is improved by a standardized method of gram stain interpretation. J Clin Microbiol 1991;29:297-301.
Ison CA, Hay PE. Validation of a simplified grading of gram stained vaginal smears for use in genitourinary medicine clinics. Sex Transm Infect 2002;78:413-5.
Spiegel CA, Amsel R, Holmes KK. Diagnosis of bacterial vaginosis by direct Gram stain of vaginal fluid. J Clin Microbiol 1983;18:170-7.
Schmidt H, Hansen JG. Diagnosis of bacterial vaginosis by wet mount identification of bacterial morphotypes in vaginal fluid. Int J STD AIDS 2000;11:150-5.
Sumati AH, Saritha NK. Bacterial vaginosis with special reference to anaerobes. Indian J Pathol Microbiol 2009;52:56-8.
] [Full text]
Calderón E, Rivera R, Gordillo S, Conde-Glez C. Evaluation of a fast test to identify the presence of proline aminopeptidase in women with bacterial vaginosis. Infect Dis Obstet Gynecol 1997;5:226-31.
Krohn MA, Hillier SL, Eschenbach DA. Comparison of methods for diagnosing bacterial vaginosis among pregnant women. J Clin Microbiol 1989;27:1266-71.
Briselden AM, Moncla BJ, Stevens CE, Hillier SL. Sialidases (neuraminidases) in bacterial vaginosis and bacterial vaginosis-associated microflora. J Clin Microbiol 1992;30:663-6.
Smayevsky J, Canigia LF, Lanza A, Bianchini H. Vaginal microflora associated with bacterial vaginosis in nonpregnant women: Reliability of sialidase detection. Infect Dis Obstet Gynecol 2001;9:17-22.
Kusters JG, Reuland EA, Bouter S, Koenig P, Dorigo-Zetsma JW. A multiplex real-time PCR assay for routine diagnosis of bacterial vaginosis. Eur J Clin Microbiol Infect Dis 2015;34:1779-85.
Money D. The laboratory diagnosis of bacterial vaginosis. Can J Infect Dis Med Microbiol 2005;16:77-9.
Taylor-Robinson D, Morgan DJ, Sheehan M, Rosenstein IJ, Lamont RF. Relation between gram-stain and clinical criteria for diagnosing bacterial vaginosis with special reference to gram grade II evaluation. Int J STD AIDS 2003;14:6-10.
Haggerty CL, Hillier SL, Bass DC, Ness RB; PID Evaluation and Clinical Health study investigators. Bacterial vaginosis and anaerobic bacteria are associated with endometritis. Clin Infect Dis 2004;39:990-5.
Sha BE, Chen HY, Wang QJ, Zariffard MR, Cohen MH, Spear GT, et al.
Utility of amsel criteria, nugent score, and quantitative PCR for Gardnerella vaginalis
, Mycoplasma hominis
, and Lactobacillus
spp. for diagnosis of bacterial vaginosis in human immunodeficiency virus-infected women. J Clin Microbiol 2005;43:4607-12.
Mittal V, Jain A, Pradeep Y. Development of modified diagnostic criteria for bacterial vaginosis at peripheral health centres in developing countries. J Infect Dev Ctries 2012;6:373-7.
Mohanty S, Sood S, Kapil A, Mittal S. Interobserver variation in the interpretation of Nugent scoring method for diagnosis of bacterial vaginosis. Indian J Med Res 2010;131:88-91.
] [Full text]
Zarakolu P, Sahin Hodoglugil NN, Aydin F, Tosun I, Gozalan A, Unal S. Reliability of interpretation of gram-stained vaginal smears by Nugent's scoring system for diagnosis of bacterial vaginosis. Diagn Microbiol Infect Dis 2004;48:77-80.
Udayalaxmi J, Bhat GK, Kotigadde S, Shenoy S. Comparison of the methods of diagnosis of bacterial vaginosis. J Clin Diagn Res 2011;5:498-501.
[Table 1], [Table 2], [Table 3], [Table 4]