US or CT for Diagnosis of Appendicitis in Children and Adults? A Meta-Analysis

Purpose: To perform a meta-analysis to evaluate the diagnostic performance of ultrasonography (US) and computed tomography (CT) for the diagnosis of appendicitis in pediatric and adult populations.

Materials and Methods: Medical literature (from 1986 to 2004) was searched for articles on studies that used US, CT, or both as diagnostic tests for appendicitis in children (26 studies, 9356 patients) or adults (31 studies, 4341 patients). Prospective and retrospective studies were included if they separately reported the rate of true-positive, true-negative, false-positive, and false-negative diagnoses of appendicitis from US and CT findings compared with the positive and negative rates of appendicitis at surgery or follow-up. Clinical variables, technical factors, and test performance were extracted. Three readers assessed the quality of studies.

Results: Pooled sensitivity and specificity for diagnosis of appendicitis in children were 88% (95% confidence interval [CI]: 86%, 90%) and 94% (95% CI: 92%, 95%), respectively, for US studies and 94% (95% CI: 92%, 97%) and 95% (95% CI: 94%, 97%), respectively, for CT studies. Pooled sensitivity and specificity for diagnosis in adults were 83% (95% CI: 78%, 87%) and 93% (95% CI: 90%, 96%), respectively, for US studies and 94% (95% CI: 92%, 95%) and 94% (95% CI: 94%, 96%), respectively, for CT studies.

Conclusion: From the diagnostic performance perspective, CT had a significantly higher sensitivity than did US in studies of children and adults; from the safety perspective, however, one should consider the radiation associated with CT, especially in children.

Supplemental material: radiology.rsnajnls.org/cgi/content/full/2411050913/DC1

© RSNA, 2006

References

  • 1 Storer EH. Appendix. In: Schwartz SI, ed. Principles of surgery. 3rd ed. New York, NY: McGraw-Hill International, 1979; 1257–1267. Google Scholar
  • 2 Federle MP. Focused appendix CT technique: a commentary. Radiology 1997; 202: 20–21. LinkGoogle Scholar
  • 3 Henderson J, Goldacre MJ, Fairweather JM. Conditions accounting for substantial time spent in hospital in children age 1–14 years of age. Arch Dis Child 1992;67:83–86. Crossref, MedlineGoogle Scholar
  • 4 Siegel MJ. Acute appendicitis in childhood: the role of US. Radiology 1992;185:341–342. LinkGoogle Scholar
  • 5 Lund DP, Kolkman J. Appendicitis. In: Walker WA, Durie PR, Hamilton JR, eds. Pediatric gastrointestinal disease. 2nd ed. Vol 1. St Louis, Mo: Mosby–Year Book, 1996; 907–914. Google Scholar
  • 6 Berry J Jr, Malt RA. Appendicitis near its centenary. Ann Surg 1984;200:567–575. Crossref, MedlineGoogle Scholar
  • 7 Lewis FR, Holcroft JW, Boey J, et al. Appendicitis: critical review of 1000 patients. Arch Surg 1975;110:677–684. Crossref, MedlineGoogle Scholar
  • 8 Puylaert JB, van der Zant FM, Rijke AM. Sonography and the acute abdomen: practical considerations. AJR Am J Roentgenol 1997;168:179–186. Crossref, MedlineGoogle Scholar
  • 9 Sivit CJ. Imaging children with acute right lower quadrant pain. Pediatr Clin North Am 1997;44:575–589. Crossref, MedlineGoogle Scholar
  • 10 Sivit CJ, Siegel MJ, Applegate KE, Newman KD. When appendicitis is suspected in children. RadioGraphics 2001;21:247–262. LinkGoogle Scholar
  • 11 Malone AJ, Wolf CR, Malmed AS, Melliere BF. Diagnosis of acute appendicitis: value of unenhanced CT. AJR Am J Roentgenol 1993;160:763–766. Crossref, MedlineGoogle Scholar
  • 12 Frush DP, Donnelly LF. Helical CT in children: technical considerations and body applications. Radiology 1998;209:37–48. LinkGoogle Scholar
  • 13 Rao PM, Rhea JT, Novelline RA. Helical CT of appendicitis and diverticulitis. Radiol Clin North Am 1999;37:895–910. Crossref, MedlineGoogle Scholar
  • 14 Puylaert JB. Acute appendicitis: US evaluation using graded compression. Radiology 1986;158:355–360. LinkGoogle Scholar
  • 15 Larson JM, Peirce JC, Ellinger DM, et al. The validity and utility of sonography in the diagnosis of appendicitis in the community setting. AJR Am J Roentgenol 1989;153:687–691. Crossref, MedlineGoogle Scholar
  • 16 Perdigon PL. Imaging techniques for diagnosis of serious intraabdominal and pelvic infections. Primary Care Update Obstet Gynecol 1999;6:115–121. CrossrefGoogle Scholar
  • 17 Rao PM, Wittenberg J, McDowell RK, et al. Appendicitis: use of arrowhead sign for diagnosis at CT. Radiology 1997;202:363–366. LinkGoogle Scholar
  • 18 Rao PM, Rhea JT, Novelline RA. Helical computed tomographic incidence and characterization of appendoliths in 100 patients with appendicitis. Emerg Radiol 1997;4:55–61. CrossrefGoogle Scholar
  • 19 Rao PM, Rhea JT, Rattner DW, Venus LG, Novelline RA. Introduction of appendiceal CT: impact on negative appendectomy and appendiceal perforation rates. Ann Surg 1999;229:344–349. Crossref, MedlineGoogle Scholar
  • 20 Birnbaum BA. CT evaluation of patients with acute lower abdominal pain. In: Balfe DM, Levine MS, eds. Syllabus: categorical course in diagnostic radiology—gastrointestinal 1997. Oak Brook, Ill: Radiological Society of North America, 1997; 199–209. Google Scholar
  • 21 Birnbaum BA, Balthazar EJ. CT of appendicitis and diverticulitis. Radiol Clin North Am 1994;32:885–898. MedlineGoogle Scholar
  • 22 Wise SW, Labuski MR, Kasales CJ, et al. Comparative assessment of CT and sonographic techniques for appendiceal imaging. AJR Am J Roentgenol 2001;176:933–941. Crossref, MedlineGoogle Scholar
  • 23 Styrud J, Josephson T, Eriksson S. Reducing negative appendectomy: evaluation of ultrasonography and computed tomography in acute appendicitis. Int J Qual Health Care 2000;12:65–68. Crossref, MedlineGoogle Scholar
  • 24 Cha SH, Kim SH, Lee ES, et al. Saline-filled appendiceal ultrasonography in clinically equivocal acute appendicitis. Abdom Imaging 1996;21:525–529. Crossref, MedlineGoogle Scholar
  • 25 Vazquez Ronco MA, Morteruel Arizkuren E, Garcia Ojeda E, Mintegui Raso S, Capape Zache S, Benito Fernandez J. Rendimiento de la ecografia abdominal en el diagnostico de appendicitis aguda. An Pediatr (Barc) 2003;58:556–561. Crossref, MedlineGoogle Scholar
  • 26 Morris KT, Kavanagh M, Hansen P, Whiteford MH, Deveny K, Standage B. The rational use of computed tomography scans in the diagnosis of appendicitis. Am J Surg 2002;183:547–550. Crossref, MedlineGoogle Scholar
  • 27 Irwig L, Macaskill P, Glasziou P, Fahey M. Meta-analytic methods for diagnostic test accuracy. J Clin Epidemiol 1995;48:119–130. Crossref, MedlineGoogle Scholar
  • 28 Mulrow CD, Linn WD, Gaul MK, et al. Assessing quality of a diagnostic test evaluation. J Gen Intern Med 1989;4:288–295. Crossref, MedlineGoogle Scholar
  • 29 Deville WL, van der Windt AW, Dzaferagic A, Bezemer PD, Bouter LM. The test of Lasegue: systematic review of the accuracy in diagnosing herniated discs. Spine 2000;25:1140–1147. Crossref, MedlineGoogle Scholar
  • 30 Bravo G, Potvin L. Estimating the reliability of continuous measures with Cronbach's alpha or the intraclass correlation coefficient: toward the integration of two traditions. J Clin Epidemiol 1991;44:381–390. Crossref, MedlineGoogle Scholar
  • 31 Thompson SG, Sharp SJ. Explaining heterogeneity in meta-analysis: a comparison of methods. Stat Med 1999;18:2693–2708. Crossref, MedlineGoogle Scholar
  • 32 Deeks JJ. Systematic reviews of evaluations of diagnostic and screening tests. In: Smith GD, Altman DG, Egger M, eds. Systematic reviews in health care: meta-analysis in context. 2nd ed. London, England: BMJ, 2002; 248–482. Google Scholar
  • 33 DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials 1986;7:177–188. Crossref, MedlineGoogle Scholar
  • 34 Higgins JP, Thompson SG. Quantifying heterogeneity in a meta-analysis. Stat Med 2002;21:1539–1558. Crossref, MedlineGoogle Scholar
  • 35 Garcia Pena BM, Mandl KD, Kraus SJ, et al. Ultrasonography and limited computed tomography in the diagnosis and management of appendicitis in children. JAMA 1999;282:1041–1046. Crossref, MedlineGoogle Scholar
  • 36 Chen SC, Chen KM, Wang SM, Chang KJ. Abdominal sonography screening of clinically diagnosed or suspected appendicitis before surgery. World J Surg 1998;22:449–452. Crossref, MedlineGoogle Scholar
  • 37 Birnbaum BA, Wilson SR. Appendicitis at the millennium. Radiology 2000;215:337–348. LinkGoogle Scholar
  • 38 Ege G, Akman H, Sahin A, Bugra D, Kuzucu K. Diagnostic value of unenhanced helical CT in adult patients with suspected acute appendicitis. Br J Radiol 2002;75:721–725. Crossref, MedlineGoogle Scholar
  • 39 Sackett DL, Haynes RB, Guyatt GH, Tugwell P. Clinical epidemiology: a basic science for clinical medicine. 2nd ed. Boston, Mass: Little, Brown, 1991. Google Scholar
  • 40 Sackett DL, Richardson WS, Rosenberg W, Haynes RB. Evidence-based medicine: how to practice and teach EBM. New York, NY: Churchill Livingstone, 1997. Google Scholar
  • 41 Newman TB, Browner WS, Cummings SR, Hulley SB. Designing an observational study: cross-sectional and case-control studies. In: Hulley SB, Cummings SR, Browner WS, Grady D, Hearst N, Newman TB, eds. Designing clinical research: an epidemiologic approach. 2nd ed. Philadelphia, Pa: Lippincott Williams & Wilkins, 2001. Google Scholar
  • 42 Egger M, Davey SG. Misleading meta-analysis: lessons from “an effective, safe, simple” intervention that wasn't. BMJ 1995;310:752–754. Crossref, MedlineGoogle Scholar
  • 43 Copas JB, Shi JQ. A sensitivity analysis for publication bias in systematic reviews. Stat Methods Med Res 2001;10:251–265. Crossref, MedlineGoogle Scholar
  • 44 Begg CB, Berlin JA. Publication bias: a problem in interpreting medical data. J R Stat Soc 1988;151:419–463. CrossrefGoogle Scholar
  • 45 Rubin SZ, Martin DJ. Ultrasonography in the management of possible appendicitis in childhood. J Pediatr Surg 1990;25:737–740. Crossref, MedlineGoogle Scholar
  • 46 Vignault F, Filiatrault D, Brandt ML, Garel L, Grignon A, Ouimet A. Acute appendicitis in children: evaluation with US. Radiology 1990;176:501–504. LinkGoogle Scholar
  • 47 Siegel MJ, Carel C, Surrat S. Ultrasonography of acute abdominal pain in children. JAMA 1991;266:1987–1989. Crossref, MedlineGoogle Scholar
  • 48 Hayden CK, Kuchelmeister J, Lipscomb TS. Sonography of acute appendicitis in childhood: perforation versus nonperforation. J Ultrasound Med 1992;11:209–216. Crossref, MedlineGoogle Scholar
  • 49 Quillin SP, Siegel MJ, Coffin CM. Acute appendicitis in children: value of sonography in detecting perforation. AJR Am J Roentgenol 1992;159:1265–1268. Crossref, MedlineGoogle Scholar
  • 50 Sivit CJ, Newman KD, Boenning DA, et al. Appendicitis: usefulness of US in diagnosis in a pediatric population. Radiology 1992;185:549–552. LinkGoogle Scholar
  • 51 Crady SK, Jones JS, Wyn T, Luttenton CR. Clinical validity of ultrasound in children with suspected appendicitis. Ann Emerg Med 1993;22:1125–1129. Crossref, MedlineGoogle Scholar
  • 52 Wong ML, Casey SO, Leonidas JC, Elkowitz SS, Becker J. Sonographic diagnosis of acute appendicitis. J Pediatr Surg 1994;29:1356–1360. Crossref, MedlineGoogle Scholar
  • 53 Ramachandran P, Sivit CJ, Newman KD, Schwartz MZ. Ultrasonography as an adjunct in the diagnosis of acute appendicitis: a 4-year experience. J Pediatr Surg 1996;31:164–167. Crossref, MedlineGoogle Scholar
  • 54 Hahn HB, Hoepner FU, Kalle T, et al. Sonography of acute appendicitis in children: 7 years experience. Pediatr Radiol 1998;28:147–151. Crossref, MedlineGoogle Scholar
  • 55 Davidson PM, Douglas CD, Hosking CS. Graded compression ultrasonography in the assessment of the “tough decision” acute abdomen in childhood. Pediatr Surg Int 1999;15:32–35. Crossref, MedlineGoogle Scholar
  • 56 Lessin MS, Chan M, Catallozzi M, et al. Selective use of ultrasonography for acute appendicitis in children. Am J Surg 1999;177:193–196. Crossref, MedlineGoogle Scholar
  • 57 Rice HE, Arbesman M, Martin DJ, et al. Does early ultrasonography affect management of pediatric appendicitis? a prospective analysis. J Pediatr Surg 1999;34:754–759. Crossref, MedlineGoogle Scholar
  • 58 Karakas SP, Guelfguat M, Leonidas JC, Springer S, Singh SP. Acute appendicitis in children: comparison of clinical diagnosis with ultrasound and CT imaging. Pediatr Radiol 2000;30:94–98. Crossref, MedlineGoogle Scholar
  • 59 Sivit CJ, Applegate KE, Stallion A, et al. Imaging evaluation of suspected appendicitis in a pediatric population: effectiveness of sonography versus CT. AJR Am J Roentgenol 2000;175:977–980. Crossref, MedlineGoogle Scholar
  • 60 Ang A, Chong NK, Daneman A. Pediatric appendicitis in “real-time”: the value of sonography in diagnosis and treatment. Pediatr Emerg Care 2001;17:334–340. Crossref, MedlineGoogle Scholar
  • 61 Lowe LH, Penney MW, Stein SM, et al. Unenhanced limited CT of the abdomen in the diagnosis of appendicitis in children: comparison with sonography. AJR Am J Roentgenol 2001;176:31–35. Crossref, MedlineGoogle Scholar
  • 62 Mullins ME, Kircher MF, Ryan DP, et al. Evaluation of suspected appendicitis in children using limited helical CT and colonic contrast material. AJR Am J Roentgenol 2001;176:37–41. Crossref, MedlineGoogle Scholar
  • 63 Fefferman NR, Roche KJ, Pinkney LP, Ambrosino MM, Genieser NB. Suspected appendicitis in children: focused CT technique for evaluation. Radiology 2001;220:691–695. LinkGoogle Scholar
  • 64 Han TI. Improved sonographic visualization of the appendix with a saline enema in children with suspected appendicitis. J Ultrasound Med 2002;21:511–516. Crossref, MedlineGoogle Scholar
  • 65 Kaiser S, Frenckner B, Jorulf HK. Suspected appendicitis in children: US and CT—a prospective randomized study. Radiology 2002;223:633–638. LinkGoogle Scholar
  • 66 Chang CC, Tsai CY, Lin CC, Jeng LB, Lee CC, Kao CH. Comparison between technetium-99m hexamethylpropyleneamineoxide labeled white blood cell abdomen scan and abdominal sonography to detect appendicitis in children with an atypical clinical presentation. Hepatogastroenterology 2003;50:426–429. MedlineGoogle Scholar
  • 67 Kaiser S, Finnbogason T, Jorulf HK, Soderman B, Frenckner B. Suspected appendicitis in children: diagnosis with contrast-enhanced versus nonenhanced helical CT. Radiology 2004;231:427–433. LinkGoogle Scholar
  • 68 Adams DH, Fine C, Brooks DC. High-resolution real-time ultrasonography: a new tool in the diagnosis of acute appendicitis. Am J Surg 1988;155:93–97. Crossref, MedlineGoogle Scholar
  • 69 Bilbey JH, Gibney RG, Cooperberg PL. Ultrasonography in acute appendicitis. Can Assoc Radiol J 1989;40:22–24. MedlineGoogle Scholar
  • 70 Kang WM, Lee CH, Chou YH, et al. A clinical evaluation of ultrasonography in the diagnosis of acute appendicitis. Surgery 1989;105:154–159. MedlineGoogle Scholar
  • 71 Amgwerd M, Rothlin M, Candinas D, Schimmer R, Klotz HP, Largiader F. Ultrasound diagnosis of appendicitis by surgeons: a matter of experience? a prospective study. Langenbecks Arch Chir 1994;379:335–340. MedlineGoogle Scholar
  • 72 Balthazar EJ, Birnbaum BA, Yee J, et al. Acute appendicitis: CT and US correlation in 100 patients. Radiology 1994;190:31–35. LinkGoogle Scholar
  • 73 Incesu L, Ciskun A, Selcuk MB, Akan H, Sozubit S, Bernay F. Acute appendicitis: MR imaging and sonographic correlation. AJR Am J Roentgenol 1997;168:669–674. Crossref, MedlineGoogle Scholar
  • 74 Lane MJ, Katz DS, Ross BA, Clautice-Engle TL, Mindelzun RE, Jeffrey RB Jr. Unenhanced helical CT for suspected acute appendicitis. AJR Am J Roentgenol 1997;168:405–409. Crossref, MedlineGoogle Scholar
  • 75 Schuler JG, Shortsleeve MJ, Goldenson RS, Perez-Rossello JM, Perlmutter RA, Thorsen A. Is there a role for abdominal computed tomographic scans in appendicitis? Arch Surg 1998;133:373–377. Crossref, MedlineGoogle Scholar
  • 76 Crombe A, Weber F, Gruner L, Martins A, Fouque P, Barth X. Abdominopelvic ultrasonography in suspected acute appendicitis: prospective study in adults. Ann Chir 2000;125:57–61. Crossref, MedlineGoogle Scholar
  • 77 Horton MD, Counter SF, Florence MG, Hart MJ. A prospective trial of computed tomography and ultrasonography for diagnosing appendicitis in the atypical patient. Am J Surg 2000;179:379–381. Crossref, MedlineGoogle Scholar
  • 78 Kamel IR, Goldberg SN, Keogan MT, Rosen MP, Raptopoulos V. Right lower quadrant pain and suspected appendicitis: nonfocused appendiceal CT—review of 100 cases. Radiology 2000;217:159–163. LinkGoogle Scholar
  • 79 Souparis AC, Makris JG, Arvaniti M, et al. The role of ultrasound scanning of the lower abdomen in the differential diagnosis of acute appendicitis. Arch Gastroenterohepatol 2000;19:28–30. Google Scholar
  • 80 Walker S, Haun W, Clark J, McMillin K, Zeren F, Gilliland T. The value of limited computed tomography with rectal contrast in the diagnosis of acute appendicitis. Am J Surg 2000;180:450–455. Crossref, MedlineGoogle Scholar
  • 81 Bouillot JL, Ruiz A, Alamowitch B, et al. Suspected acute appendicitis: role of enhanced helical computed tomography—prospective study of 100 patients. Ann Chir 2001;126:427–433. Crossref, MedlineGoogle Scholar
  • 82 Kan JH, Fines BP, Funaki B. Conventional and hydrocolonic US of the appendix with CT correlation performed by on-call radiology residents. Acad Radiol 2001;8:1208–1214. Crossref, MedlineGoogle Scholar
  • 83 Maluccio MA, Covey AM, Weyant MJ, Eachempati SR, Hydo LJ, Barie PS. A prospective evaluation of the use of emergency department computed tomography for suspected acute appendicitis. Surg Infect (Larchmt) 2001;2:205–214. Crossref, MedlineGoogle Scholar
  • 84 Wijetunga R, Tan BS, Rouse JC, Bigg-Wither GW, Doust BD. Diagnostic accuracy of focused appendiceal CT in clinically equivocal cases of acute appendicitis. Radiology 2001;221:747–753. LinkGoogle Scholar
  • 85 Cakirer S, Basak M, Colakoglu B, Bankaoglu M. Diagnosis of acute appendicitis with unenhanced helical CT: a study of 130 patients. Emerg Radiol 2002;9:155–161. Crossref, MedlineGoogle Scholar
  • 86 Hershko DD, Sroka G, Bahouth H, Ghersin E, Mahajna A, Krausz MM. The role of selective computed tomography in the diagnosis and management of suspected acute appendicitis. Am Surg 2002;68:1003–1007. MedlineGoogle Scholar
  • 87 Raman SS, Lu DS, Kadell BM, Vodopich DJ, Sayre J, Cryer H. Accuracy of nonfocused helical CT for the diagnosis of acute appendicitis: a 5-year review. AJR Am J Roentgenol 2002;178:1319–1325. Crossref, MedlineGoogle Scholar
  • 88 Sun SS, Wu HS, Wang JJ, Ho ST, Kao A. Comparison between technetium 99m hexamethylpropyleneamine oxide labeled white blood cell abdominal scan and abdominal sonography to detect appendicitis in adult patients with atypical clinical presentation. Abdom Imaging 2002;27:734–738. Crossref, MedlineGoogle Scholar
  • 89 Ujiki MB, Murayama KM, Cribbins AJ, et al. CT scan in the management of acute appendicitis. J Surg Res 2002;105:119–122. Crossref, MedlineGoogle Scholar
  • 90 Wong SK, Chan LP, Yeo A. Helical CT imaging of clinically suspected appendicitis: correlation of CT and histological findings. Clin Radiol 2002;57:741–745. Crossref, MedlineGoogle Scholar
  • 91 Yetkin G, Basak M, Isgor A, Kebudi A, Akgun I. Can negative appendectomy rate be decreased by using spiral computed tomography without contrast material? Acta Chir Belg 2002;102:334–337. Crossref, MedlineGoogle Scholar
  • 92 Hong JJ, Cohn SM, Ekeh AP, et al. A prospective randomized study of clinical assessment versus computed tomography for the diagnosis of acute appendicitis. Surg Infect (Larchmt) 2003;4:231–239. Crossref, MedlineGoogle Scholar
  • 93 Moses LE, Shapiro D, Littenberg B. Combining independent studies of a diagnostic test into a summary ROC curve: data-analytic approaches and some additional considerations. Stat Med 1993;12:1293–1316. Crossref, MedlineGoogle Scholar
  • 94 Shapiro DE. Issues in combining independent estimates of the sensitivity and specificity of a diagnostic test. Acad Radiol 1995;2(suppl 1):S37–S47. MedlineGoogle Scholar
  • 95 Vermeulen B, Morabia A, Unger PF, et al. Acute appendicitis: influence of early pain relief on the accuracy of clinical and US findings in the decision to operate—a randomized trial. Radiology 1999;210:639–643. LinkGoogle Scholar
  • 96 Orr RK, Porter D, Hartman D. Ultrasonography to evaluate adults for appendicitis: decision making based on meta-analysis and probabilistic reasoning. Acad Emerg Med 1995;2:644–650. Crossref, MedlineGoogle Scholar
  • 97 Terasawa T, Blackmore CC, Bent S, Kohlwes RJ. Systematic review: computed tomography and ultrasonography to detect acute appendicitis in adults and adolescents. Ann Intern Med 2004;141:537–546. Crossref, MedlineGoogle Scholar
  • 98 Gray JE. Safety (risk) of diagnostic radiology exposures radiation risk: a primer. American College of Radiology Commission on Physics and Radiation Safety, Committee on Radiologic Units, Standards, and Protection. Reston, Va: American College of Radiology, 1996; 15–17. Google Scholar
  • 99 Brenner D, Elliston C, Hall E, Berdon W. Estimated risks of radiation induced fatal cancer from pediatric CT. AJR Am J Roentgenol 2001;176:289–296. Crossref, MedlineGoogle Scholar
  • 100 Williams G, Zankl M, Abmayr W, Veit R, Drexler G. The calculation of dose from external photon exposures using reference and realistic human phantoms and Monte Carlo methods. Phys Med Biol 1986;31:449–452. Crossref, MedlineGoogle Scholar
  • 101 Redd JT. Sensitivity, specificity, prevalence, and disease stage [letter]. Ann Intern Med 1994;120(4):345. CrossrefGoogle Scholar
  • 102 Sackett DL. Bias in analytic research. J Chronic Dis 1979;32:51–63. Crossref, MedlineGoogle Scholar
  • 103 Fahey MT, Irwig L, Macaskill P. Meta-analysis of Pap test accuracy. Am J Epidemiol 1995;141:680–689. Crossref, MedlineGoogle Scholar
  • 104 Kwikkel HJ, Quaak MJ, de With C. Predictive value of the abnormal Pap smear: a retrospective analysis of error rates. Eur J Obstet Gynecol Reprod Biol 1986;21:101–112. Crossref, MedlineGoogle Scholar
  • 105 Lijmer JG, Mol BW, Heisterkamp S, et al. Empirical evidence of design-related bias in studies of diagnostic tests. JAMA 1999;282:1061–1066. Crossref, MedlineGoogle Scholar
  • 106 Ransohoff DF, Feinstein AR. Problems of spectrum and bias in evaluating the efficacy of diagnostic tests. N Engl J Med 1978;299:926–930. Crossref, MedlineGoogle Scholar

Article History

Published in print: 2006