Validation strategy of a bioinformatics whole genome sequencing workflow for Shiga toxin-producing using a reference collection extensively characterized with conventional methods Open Access

Abstract

Whole genome sequencing (WGS) enables complete characterization of bacterial pathogenic isolates at single nucleotide resolution, making it the ultimate tool for routine surveillance and outbreak investigation. The lack of standardization, and the variation regarding bioinformatics workflows and parameters, however, complicates interoperability among (inter)national laboratories. We present a validation strategy applied to a bioinformatics workflow for Illumina data that performs complete characterization of Shiga toxin-producing (STEC) isolates including antimicrobial resistance prediction, virulence gene detection, serotype prediction, plasmid replicon detection and sequence typing. The workflow supports three commonly used bioinformatics approaches for the detection of genes and alleles: alignment with +, kmer-based read mapping with KMA, and direct read mapping with SRST2. A collection of 131 STEC isolates collected from food and human sources, extensively characterized with conventional molecular methods, was used as a validation dataset. Using a validation strategy specifically adopted to WGS, we demonstrated high performance with repeatability, reproducibility, accuracy, precision, sensitivity and specificity above 95 % for the majority of all assays. The WGS workflow is publicly available as a ‘push-button’ pipeline at https://galaxy.sciensano.be. Our validation strategy and accompanying reference dataset consisting of both conventional and WGS data can be used for characterizing the performance of various bioinformatics workflows and assays, facilitating interoperability between laboratories with different WGS and bioinformatics set-ups.

Funding
This study was supported by the:
  • Sciensano (Award Be READY)
    • Principle Award Recipient: NotApplicable
  • Belgian Federal Public Service of Health, Food Chain Safety and Environment (Award RF 17/6316 StEQIDEMIC.be)
    • Principle Award Recipient: NotApplicable
Loading

Article metrics loading...

/content/journal/mgen/10.1099/mgen.0.000531
2021-03-03
2024-03-28
Loading full text...

Full text loading...

/deliver/fulltext/mgen/7/3/mgen000531.html?itemId=/content/journal/mgen/10.1099/mgen.0.000531&mimeType=html&fmt=ahah

References

  1. Allard MW, Bell R, Ferreira CM, Gonzalez-Escalona N, Hoffmann M et al. Genomics of foodborne pathogens for microbial food safety. Curr Opin Biotechnol 2018; 49:224–229 [View Article][PubMed]
    [Google Scholar]
  2. Lindsey RL, Pouseele H, Chen JC, Strockbine NA, Carleton HA. Implementation of whole genome sequencing (WGS) for identification and characterization of Shiga toxin-producing Escherichia coli (STEC) in the United States. Front Microbiol 2016; 7:1–9
    [Google Scholar]
  3. Carriço JA, Sabat AJ, Friedrich AW, Ramirez M. Bioinformatics in bacterial molecular epidemiology and public health: databases, tools and the next-generation sequencing revolution, on behalf of the ESCMID Study Group for Epidemiological Markers (ESGEM). Eurosurveillance 2013; 18:1–9
    [Google Scholar]
  4. Dallman TJ, Byrne L, Ashton PM, Cowley LA, Perry NT et al. Whole-genome sequencing for national surveillance of Shiga toxin-producing Escherichia coli O157. Clin Infect Dis 2015; 61:305–312 [View Article][PubMed]
    [Google Scholar]
  5. Gilmour MW, Graham M, Reimer A, Van Domselaar G. Public health genomics and the new molecular epidemiology of bacterial pathogens. Public Health Genomics 2013; 16:25–30 [View Article][PubMed]
    [Google Scholar]
  6. Zhou Z, Alikhan N-F, Mohamed K, Fan Y et al. Agama Study Group The EnteroBase user's guide, with case studies on Salmonella transmissions, Yersinia pestis phylogeny, and Escherichia core genomic diversity. Genome Res 2020; 30:138–152 [View Article][PubMed]
    [Google Scholar]
  7. Ashton P, Nair S, Peters T, Tewolde R, Day M. SnapperDB: a database solution for routine sequencing analysis of bacterial isolates. Bioinformatics Epub ahead of print 2017
    [Google Scholar]
  8. Jackson BR, Tarr C, Strain E, Jackson KA, Conrad A et al. Implementation of nationwide real-time whole-genome sequencing to enhance listeriosis outbreak detection and investigation. Clin Infect Dis 2016; 63:380–386 [View Article][PubMed]
    [Google Scholar]
  9. Deurenberg RH, Bathoorn E, Chlebowicz MA, Couto N, Ferdous M et al. Reprint of "Application of next generation sequencing in clinical microbiology and infection prevention". J Biotechnol 2017; 250:2–10 [View Article][PubMed]
    [Google Scholar]
  10. Zankari E, Hasman H, Cosentino S, Vestergaard M, Rasmussen S et al. Identification of acquired antimicrobial resistance genes. J Antimicrob Chemother 2012; 67:2640–2644 [View Article][PubMed]
    [Google Scholar]
  11. Zankari E, Allesøe R, Joensen KG, Cavaco LM, Lund O et al. PointFinder: a novel web tool for WGS-based detection of antimicrobial resistance associated with chromosomal point mutations in bacterial pathogens. J Antimicrob Chemother 2017; 72:2764–2768 [View Article][PubMed]
    [Google Scholar]
  12. Joensen KG, Scheutz F, Lund O, Hasman H, Kaas RS et al. Real-time whole-genome sequencing for routine typing, surveillance, and outbreak detection of verotoxigenic Escherichia coli . J Clin Microbiol 2014; 52:1501–1510 [View Article][PubMed]
    [Google Scholar]
  13. Carattoli A, Hasman H. PlasmidFinder and in silico pMLST: identification and typing of plasmid replicons in whole-genome sequencing (WGS). Methods Mol Biol 2020; 2075:285–294 [View Article][PubMed]
    [Google Scholar]
  14. Joensen KG, Tetzschner AMM, Iguchi A, Aarestrup FM, Scheutz F. Rapid and easy in silico serotyping of Escherichia coli isolates by use of whole-genome sequencing data. J Clin Microbiol 2015; 53:2410–2426 [View Article][PubMed]
    [Google Scholar]
  15. Davis JJ, Wattam AR, Aziz RK, Brettin T, Butler R et al. The PATRIC bioinformatics resource center: expanding data and analysis capabilities. Nucleic Acids Res 2020; 48:D606–D612 [View Article][PubMed]
    [Google Scholar]
  16. Jia B, Raphenya AR, Alcock B, Waglechner N, Guo P et al. Card 2017: expansion and model-centric curation of the comprehensive antibiotic resistance database. Nucleic Acids Res 2017; 45:D566–D573 [View Article][PubMed]
    [Google Scholar]
  17. Galata V, Fehlmann T, Backes C, Keller A. PLSDB: a resource of complete bacterial plasmids. Nucleic Acids Res 2019; 47:D195-D202 [View Article][PubMed]
    [Google Scholar]
  18. Jolley KA, Bray JE, Maiden MCJ. A RESTful application programming interface for the PubMLST molecular typing and genome databases. Database 2017; 2017:1–7 [View Article][PubMed]
    [Google Scholar]
  19. Knijn A, Michelacci V, Orsini M, Morabito S. Advanced research infrastructure for experimentation in genomicS (aries): a lustrum of Galaxy experience. bioRxiv 2020; 2020:05.14.095901.
    [Google Scholar]
  20. Camacho C, Coulouris G, Avagyan V, Ma N, Papadopoulos J et al. BLAST+: architecture and applications. BMC Bioinformatics 2009; 10:421 [View Article][PubMed]
    [Google Scholar]
  21. Clausen P, Aarestrup FM, Lund O. Rapid and precise alignment of raw reads against redundant databases with KMA. BMC Bioinformatics 2018; 19:1–8
    [Google Scholar]
  22. Inouye M, Dashnow H, Raven L-AA, Schultz MB, Pope BJ. SRST2: rapid genomic surveillance for public health and hospital microbiology Labs. Genome Med 2014; 6:1–16
    [Google Scholar]
  23. Portmann AC, Fournier C, Gimonet J, Ngom-Bru C, Barretto C. A validation approach of an end-to-end whole genome sequencing workflow for source tracking of Listeria monocytogenes and Salmonella enterica. Front Microbiol 2018; 9:1–13
    [Google Scholar]
  24. Holmes A, Dallman TJ, Shabaan S, Hanson M, Allison L. Validation of whole-genome sequencing for identification and characterization of Shiga toxin-producing Escherichia coli to produce standardized data to enable data sharing. J Clin Microbiol 2018; 56:1–10 [View Article][PubMed]
    [Google Scholar]
  25. Kozyreva VK, Truong C-L, Greninger AL, Crandall J, Mukhopadhyay R et al. Validation and implementation of clinical laboratory improvements act-compliant whole-genome sequencing in the public health microbiology laboratory. J Clin Microbiol 2017; 55:2502–2520 [View Article][PubMed]
    [Google Scholar]
  26. Bogaerts B, Winand R, Fu Q, Van Braekel J, Ceyssens P-J et al. Validation of a bioinformatics workflow for routine analysis of whole-genome sequencing data and related challenges for pathogen typing in a european national reference center: Neisseria meningitidis as a Proof-of-Concept. Front Microbiol 2019; 10:362 [View Article][PubMed]
    [Google Scholar]
  27. ISO: International Organization for Standardization 23418:2018(E): Microbiology of the food chain — Whole genome sequencing for typing and genomic characterization of foodborne bacteria — General requirements and guidance. https://www.iso.org/standard/53328.html (2020, accessed 28 August 2020).
  28. González-Escalona N, Kase JA. Virulence gene profiles and phylogeny of Shiga toxin-positive Escherichia coli strains isolated from FDA regulated foods during 2010-2017. PLoS One 2019; 14:1–26 [View Article][PubMed]
    [Google Scholar]
  29. Mellmann A, SP A, Bletz S, Friedrich AW, Kohl TA. High interlaboratory reproducibility and sequencing-based bacterial genotyping. J Clin Microbiol 2017; 55:908–913
    [Google Scholar]
  30. Feldgarden M, Brover V, Haft DH, Prasad AB, Slotta DJ. Validating the AMRFINder tool and resistance gene database by using antimicrobial resistance genotype-phenotype correlations in a collection of isolates. Antimicrob Agents Chemother 2019; 63:1–20
    [Google Scholar]
  31. Zankari E, Hasman H, Kaas RS, Seyfarth AM, Agersø Y et al. Genotyping using whole-genome sequencing is a realistic alternative to surveillance based on phenotypic antimicrobial susceptibility testing. J Antimicrob Chemother 2013; 68:771–777 [View Article][PubMed]
    [Google Scholar]
  32. Katz LS, Griswold T, Williams-Newkirk AJ, Wagner D, Petkau A et al. A comparative analysis of the Lyve-SET phylogenomics pipeline for genomic epidemiology of foodborne pathogens. Front Microbiol 2017; 8:375 [View Article][PubMed]
    [Google Scholar]
  33. Timme RE, Rand H, Shumway M, Trees EK, Simmons M et al. Benchmark datasets for phylogenomic pipeline validation, applications for foodborne pathogen surveillance. PeerJ 2017; 5:e3893 [View Article][PubMed]
    [Google Scholar]
  34. Wielinga PR, Hendriksen RS, Aarestrup FM, Lund O, Smits SL. Global Microbial Identifier. Applied Genomics of Foodborne Pathogens In: 2017 pp 13–31
    [Google Scholar]
  35. EFSA Panel on Biological Hazards (EFSA BIOHAZ Panel) Koutsoumanis K, Allende A, Alvarez-Ordóñez A, Bolton D et al. Whole genome sequencing and metagenomics for outbreak investigation, source attribution and risk assessment of food-borne microorganisms. EFSA J 2019; 17:e05898 [View Article][PubMed]
    [Google Scholar]
  36. Barbour T, Johnson S, Cohney S, Hughes P. Thrombotic microangiopathy and associated renal disorders. Nephrol Dial Transplant 2012; 27:2673–2685 [View Article][PubMed]
    [Google Scholar]
  37. Frank C, Werber D, Cramer JP, Askar M, Faber M et al. Epidemic profile of Shiga-toxin-producing Escherichia coli O104:H4 outbreak in Germany. N Engl J Med 2011; 365:1771–1780 [View Article][PubMed]
    [Google Scholar]
  38. Nouws S, Bogaerts B, Verhaegen B, Denayer S, Crombé F et al. The benefits of whole genome sequencing for foodborne outbreak investigation from the perspective of a national reference laboratory in a smaller country. Foods 2020; 9:E1030 01 08 2020 [View Article][PubMed]
    [Google Scholar]
  39. Rowe W, Baker KS, Verner-Jeffreys D, Baker-Austin C, Ryan JJ et al. Search engine for antimicrobial resistance: a cloud compatible pipeline and web interface for rapidly detecting antimicrobial resistance genes directly from sequence data. PLoS One 2015; 10:e0133492 [View Article][PubMed]
    [Google Scholar]
  40. Bolger AM, Lohse M, Usadel B. Trimmomatic: a flexible trimmer for illumina sequence data. Bioinformatics 2014; 30:2114–2120 [View Article][PubMed]
    [Google Scholar]
  41. Bankevich A, Nurk S, Antipov D, Gurevich AA, Dvorkin M et al. SPAdes: a new genome assembly algorithm and its applications to single-cell sequencing. J Comput Biol 2012; 19:455–477 [View Article][PubMed]
    [Google Scholar]
  42. ECDC Proficiency test for Listeria monocytogenes whole genome assembly –; 2018
  43. Gurevich A, Saveliev V, Vyahhi N, Tesler G. QUAST: quality assessment tool for genome assemblies. Bioinformatics 2013; 29:1072–1075 [View Article][PubMed]
    [Google Scholar]
  44. Ben L, Steven S. Fast gapped-read alignment with Bowtie 2. Nat Methods 2013; 9:357–359
    [Google Scholar]
  45. Li H. A statistical framework for SNP calling, mutation discovery, association mapping and population genetical parameter estimation from sequencing data. Bioinformatics 2011; 27:2987–2993 [View Article][PubMed]
    [Google Scholar]
  46. Wood DE, Lu J, Langmead B. Improved metagenomic analysis with Kraken 2. Genome Biol 2019; 20:762302 [View Article][PubMed]
    [Google Scholar]
  47. Li W, Godzik A. Cd-hit: a fast program for clustering and comparing large sets of protein or nucleotide sequences. Bioinformatics 2006; 22:1658–1659 [View Article][PubMed]
    [Google Scholar]
  48. Larsen MV, Cosentino S, Rasmussen S, Friis C, Hasman H et al. Multilocus sequence typing of total-genome-sequenced bacteria. J Clin Microbiol 2012; 50:1355–1361 [View Article][PubMed]
    [Google Scholar]
  49. Carattoli A, Zankari E, García-Fernández A, Voldby Larsen M, Lund O et al. In silico detection and typing of plasmids using PlasmidFinder and plasmid multilocus sequence typing. Antimicrob Agents Chemother 2014; 58:3895–3903 [View Article][PubMed]
    [Google Scholar]
  50. Afgan E, Baker D, Batut B, van den Beek M, Bouvier D et al. The Galaxy platform for accessible, reproducible and collaborative biomedical analyses: 2018 update. Nucleic Acids Res 2018; 46:W537–W544 [View Article][PubMed]
    [Google Scholar]
  51. Gupta SK, Padmanabhan BR, Diene SM, Lopez-Rojas R, Kempf M et al. ARG-ANNOT, a new bioinformatic tool to discover antibiotic resistance genes in bacterial genomes. Antimicrob Agents Chemother 2014; 58:212–220 [View Article][PubMed]
    [Google Scholar]
  52. Jaureguy F, Landraud L, Passet V, Diancourt L, Frapy E. Phylogenetic and genomic diversity of human bacteremic Escherichia coli strains. BMC Genomics 2008; 9:1–14
    [Google Scholar]
  53. Llarena A, Ribeiro‐Gonçalves BF, Nuno Silva D, Halkilahti J, Machado MP. INNUENDO: a cross‐sectoral platform for the integration of genomics in the surveillance of food‐borne pathogens. EFSA Support Publ 2018; 15:
    [Google Scholar]
  54. Kaas RS, Leekitcharoenphon P, Aarestrup FM, Lund O. Solving the problem of comparing whole bacterial genomes across different sequencing platforms. PLoS One 2014; 9:1–8 [View Article][PubMed]
    [Google Scholar]
  55. Leinonen R, Sugawara H, Shumway M. The sequence read archive. Nucleic Acids Res 2011; 39:2010–2012
    [Google Scholar]
  56. Zhou Z, Alikhan N-F, Sergeant MJ, Luhmann N, Vaz C et al. GrapeTree: visualization of core genomic relationships among 100,000 bacterial pathogens. Genome Res 2018; 28:1395–1404 [View Article][PubMed]
    [Google Scholar]
  57. Letunic I, Bork P. Interactive tree of life (iTOL) V4: recent updates and new developments. Nucleic Acids Res 2019; 47:256–259 [View Article][PubMed]
    [Google Scholar]
  58. De Rauw K, Jacobs S, Piérard D. Twenty-seven years of screening for Shiga toxin-producing Escherichia coli in a university hospital. Brussels, Belgium, 1987-2014. PLoS One 2018; 13:1–15
    [Google Scholar]
  59. Karch H, Meyer T. Single primer pair for amplifying segments of distinct Shiga-like-toxin genes by polymerase chain reaction. J Clin Microbiol 1989; 27:2751–2757 [View Article][PubMed]
    [Google Scholar]
  60. Piérard D, Stevens D, Moriau L, Lior H, Lauwers S. Isolation and virulence factors of verocytotoxin-producing Escherichia coli in human stool samples. Clin Microbiol Infect 1997; 3:531–540 [View Article][PubMed]
    [Google Scholar]
  61. Piérard D. Infections with verotoxin-producing Escherichia coli . Acta Clin Belg 1992; 47:387–396 [View Article][PubMed]
    [Google Scholar]
  62. Buvens G, De Gheldre Y, Dediste A, de Moreau A-I, Mascart G et al. Incidence and virulence determinants of verocytotoxin-producing Escherichia coli infections in the Brussels-Capital region, Belgium, in 2008-2010. J Clin Microbiol 2012; 50:1336–1345 [View Article][PubMed]
    [Google Scholar]
  63. Paton AW, Paton JC. Detection and characterization of Shiga toxigenic Escherichia coli by using multiplex PCR assays for stx1, stx2, eaeA, enterohemorrhagic E. coli hlyA, rfbO111, and rfbO157 . J Clin Microbiol 1998; 36:598–602 [View Article][PubMed]
    [Google Scholar]
  64. Schmidt H, Scheef J, Morabito S, Caprioli A, Wieler LH et al. A new Shiga toxin 2 variant (Stx2f) from Escherichia coli isolated from pigeons. Appl Environ Microbiol 2000; 66:1205–1208 [View Article][PubMed]
    [Google Scholar]
  65. DebRoy C, Fratamico PM, Yan X, Baranzoni GM, Liu Y. Comparison of O-antigen gene clusters of all O-serogroups of Escherichia coli and proposal for adopting a new nomenclature for O-typing. PLoS One 2016; 11:1–13
    [Google Scholar]
  66. Ronholm J, Nasheri N, Petronella N, Pagotto F. Navigating microbiological food safety in the era of whole-genome sequencing. Clin Microbiol Rev 2016; 29:837–857 [View Article][PubMed]
    [Google Scholar]
  67. Sims D, Sudbery I, Ilott NE, Heger A, Ponting CP. Sequencing depth and coverage: key considerations in genomic analyses. Nat Rev Genet 2014; 15:121–132 [View Article][PubMed]
    [Google Scholar]
  68. Heydari M, Miclotte G, Demeester P, Van de Peer Y, Fostier J. Evaluation of the impact of illumina error correction tools on de novo genome assembly. BMC Bioinformatics 2017; 18:1–13
    [Google Scholar]
  69. Garijo D, Kinnings S, Xie L, Xie L, Zhang Y et al. Quantifying reproducibility in computational biology: the case of the tuberculosis drugome. PLoS One 2013; 8:e80278 [View Article][PubMed]
    [Google Scholar]
  70. Clausen PTLC, Zankari E, Aarestrup FM, Lund O. Benchmarking of methods for identification of antimicrobial resistance genes in bacterial whole genome data. J Antimicrob Chemother 2016; 71:2484–2488 [View Article][PubMed]
    [Google Scholar]
  71. Hunt M, Mather AE, Sánchez-Busó L, Page AJ, Parkhill J et al. ARIBA: rapid antimicrobial resistance genotyping directly from sequencing reads. Microb Genom 2017; 3:e000131 [View Article][PubMed]
    [Google Scholar]
  72. Nouws S, Bogaerts B, Verhaegen B, Denayer S, Piérard D et al. Impact of DNA extraction on whole genome sequencing analysis for characterization and relatedness of Shiga toxin-producing Escherichia coli isolates. Sci Rep 2020; 10:14649 [View Article][PubMed]
    [Google Scholar]
  73. Cooper AL, Low AJ, Koziol AG, Thomas MC, Leclair D. Systematic evaluation of whole genome sequence-based predictions of Salmonella serotype and antimicrobial resistance. Front Microbiol 2020; 11:1–20
    [Google Scholar]
  74. Su M, Satola SW, Read TD. Genome-based prediction of bacterial antibiotic resistance. J Clin Microbiol 2019; 57:1–15 [View Article][PubMed]
    [Google Scholar]
  75. Ruppé E, Cherkaoui A, Charretier Y, Girard M, Schicklin S et al. From genotype to antibiotic susceptibility phenotype in the order Enterobacterales: a clinical perspective. Clin Microbiol Infect 2020; 26:643.e1-643.e7 [View Article][PubMed]
    [Google Scholar]
  76. Fuller CA, Pellino CA, Flagler MJ, Strasser JE, Weiss AA. Shiga toxin subtypes display dramatic differences in potency. Infect Immun 2011; 79:1329–1337 [View Article][PubMed]
    [Google Scholar]
  77. Seth-Smith HMB, Bonfiglio F, Cuénod A, Reist J, Egli A et al. Evaluation of rapid library preparation protocols for whole genome sequencing based outbreak investigation. Front Public Health 2019; 7:241 [View Article][PubMed]
    [Google Scholar]
  78. Uelze L, Grützke J, Borowiak M, Hammerl JA, Juraschek K. Typing methods based on whole genome sequencing data; 20201–19
  79. Jolley KA, Maiden MCJ. BIGSdb: scalable analysis of bacterial genome variation at the population level. BMC Bioinformatics 2010; 11:595 [View Article][PubMed]
    [Google Scholar]
  80. Silva M, Machado MP, Silva DN, Rossi M, Moran-Gilad J et al. chewBBACA: a complete suite for gene-by-gene schema creation and strain identification. Microb Genom 2018; 4:1–7 [View Article][PubMed]
    [Google Scholar]
  81. Bergthorsson U, Ochman H. Distribution of chromosome length variation in natural isolates of Escherichia coli . Mol Biol Evol 1998; 15:6–16 [View Article][PubMed]
    [Google Scholar]
  82. Kluytmans-van den Bergh MFQ, Rossen JWA, Bruijning-Verhagen PCJ, Bonten MJM, Friedrich AW et al. Whole-Genome multilocus sequence typing of extended-spectrum-beta-lactamase-producing Enterobacteriaceae . J Clin Microbiol 2016; 54:2919–2927 [View Article][PubMed]
    [Google Scholar]
  83. Karberg KA, Olsen GJ, Davis JJ. Similarity of genes horizontally acquired by Escherichia coli and Salmonella enterica is evidence of a supraspecies pangenome. Proc Natl Acad Sci U S A 2011; 108:20154–20159 [View Article][PubMed]
    [Google Scholar]
  84. Yachison CA, Yoshida C, Robertson J, Nash JHE, Kruczkiewicz P. The validation and implications of using whole genome sequencing as a replacement for traditional serotyping for a national Salmonella reference laboratory. Front Microbiol 2017; 8:1–9
    [Google Scholar]
  85. Mellmann A, Andersen PS, Bletz S, Friedrich AW, Kohl TA et al. High interlaboratory reproducibility and accuracy of next-generation-sequencing-based bacterial genotyping in a ring trial. J Clin Microbiol 2017; 55:908–913 [View Article][PubMed]
    [Google Scholar]
  86. Hayashi T, Makino K, Ohnishi M, Kurokawa K, Ishii K et al. Complete genome sequence of enterohemorrhagic Escherichia coli O157:H7 and genomic comparison with a laboratory strain K-12. DNA Res 2001; 8:11–22 [View Article][PubMed]
    [Google Scholar]
http://instance.metastore.ingenta.com/content/journal/mgen/10.1099/mgen.0.000531
Loading
/content/journal/mgen/10.1099/mgen.0.000531
Loading

Data & Media loading...

Supplements

Supplementary material 1

PDF

Most cited Most Cited RSS feed