Overview

The EpiCompare package is designed to facilitate the comparison of epigenomic datasets for quality control and benchmarking purposes. The package combines several downstream analysis tools for epigenomic data and generates a single report that collates all results of the analysis. This allows users to conduct downstream analysis of multiple epigenomic datasets simultaneously and compare the results in a simple and efficient way.

Introduction

For many years, ChIP-seq has been the standard method for epigenomic profiling, but it suffers from a host of limitations. Recently, many other epigenomic technologies (e.g. CUT&Run, CUT&Tag and TIP-seq etc.), designed to overcome these constraints, have been developed. To better understand the performance of these novel approaches, it is important that we systematically compare these technologies and benchmark against a “gold-standard”.

There are many tools in R (e.g. ChIPseeker) that can be used to conduct downstream analysis and comparison of epigenomic datasets. However, these are often scattered across different packages and difficult to use for researchers with none or little computational experience.

EpiCompare is designed to provide a simple and comprehensive way of analysing and comparing epigenomic datasets. It combines many useful downstream analysis tools, which can easily be controlled by users and it collates the results in a single report. This allows researchers to systematically compare different epigenomic technologies.

While the main functionality of EpiCompare is to contrast epigenomic technologies, it can also be used to compare datasets generated using different experimental conditions and data analysis workflows of one technology. This can help researchers to establish a consensus regarding the optimal use of the method.

Currently, EpiCompare only works for human genome as it uses human-based hg19 and/or hg38 genome references.

Data

The EpiCompare package contains a small subset of histone mark H3K27ac profile data obtained/generated from:

  • ENCODE (data accession: ENCFF044JNJ)
  • CUT&Tag from Kaya-Okur et al., (2019). (PMID: 31036827)
  • CUT&Run from Meers et al., (2019). (PMID: 31232687)

It also contains human genome hg19 and hg38 blacklisted regions obtained from ENCODE. The ENCODE blacklist includes regions of the genome that have anomalous and/or unstructured signals independent of the cell-line or experiment. Removal of ENCODE blacklist is recommended for quality measure.

These dataset will be used to showcase EpiCompare functionality

Installation

To install the package, run the following:

if (!require("BiocManager", quietly = TRUE))
    install.packages("BiocManager")

BiocManager::install("EpiCompare") 

Running EpiCompare

In this example analysis, we will compare CUT&Run and CUT&Tag of histone mark H3K27ac against ENCODE ChIP-seq.

Load package and example datasets

Once installed, load the package:

## 
## Warning: replacing previous import 'Biostrings::pattern' by 'grid::pattern'
## when loading 'genomation'

Load example datasets used in this analysis:

data("encode_H3K27ac") # ENCODE ChIP-seq
data("CnT_H3K27ac") # CUT&Tag
data("CnR_H3K27ac") # CUT&Run
data("hg19_blacklist") # hg19 genome blacklist 
data("CnT_H3K27ac_picard") # CUT&Tag Picard summary output
data("CnR_H3K27ac_picard") # CUT&Run Picard summary output

Prepare input data

Peaklist

EpiCompare accepts datasets both as GRanges object and as paths to BED files. Peakfiles (GRanges or paths) that you would like to analyse must be listed and named (see below).

# To import BED files as GRanges object
peak_GRanges <-ChIPseeker::readPeakFile("/path/to/peak/file.bed",as = "GRanges")
# EpiCompare also accepts paths (to BED files) as input 
peak_path <- "/path/to/BED/file1.bed"
# Create named peak list
peaklist <- list(peak_GRanges, peak_path)
names(peaklist) <- c("sample1", "sample2")

In this example, we will use built-in data, which have been converted into GRanges object previously (CnT_H3K27ac and CnR_H3K27ac).

peaklist <- list(CnT_H3K27ac, CnR_H3K27ac) # create list of peakfiles 
names(peaklist) <- c("CnT", "CnR") # set names 

Blacklist

ENCODE blacklist contains regions of the genome that have anomalous and/or unstructured signals independent of the cell-line or experiment. Removal of these regions from peakfiles is recommended for quality measure.

EpiCompare has three built-in blacklist files, hg19, hg38 and mm10, downloaded from ENCODE. Run ?hg19_blacklist for more information.

In this example analysis, since all peakfiles (encode_H3K27ac, CnT_H3K27ac, CnR_H3K27ac) were generated using human genome reference build hg19, hg19_blacklist will be used. For hg38, use data(hg38_blacklist).

Please ensure that you specify the correct blacklist.

Picard summary files

Note that this is OPTIONAL. If you want the report to include metrics on DNA fragments (e.g. mapped fragments and duplication rate), please input summary files from Picard.

Picard MarkDuplicates can be used to mark duplicate reads that are found within the alignment. This tool outputs a metrics file with the ending .MarkDuplicates.metrics.txt. To import this text file into R as data frame, use:

picard <- read.table("/path/to/Picard/.MarkDuplicates.metrics.txt", header = TRUE, fill = TRUE)

In this example. we will use built-in data, which have been converted into data frame previously (CnT_H3K27ac_picard and CnR_H3K27ac_picard). The files must be listed and named:

# create list of Picard summary
picard <- list(CnT_H3K27ac_picard, CnR_H3K27ac_picard) 
names(picard) <- c("CnT", "CnR") # set names 

Reference file

This is OPTIONAL. If reference peak file is provided, stat_plot and chromHMM_plot of overlapping peaks are included in the report (see Optional plots section below).

Reference file must be listed and named. In this example, we will use built-in data (encode_H3K27ac), which has been converted to GRanges previously:

reference_peak <- list("ENCODE_H3K27ac" = encode_H3K27ac)

Output Directory

When running EpiCompare(), please ensure that you specify output_dir. All outputs (figures and HTML report) will be saved in the specified output_dir.

Run EpiCompare

Running EpiCompare is done using the function, EpiCompare() . Users can choose which analyses to run and include in the report by setting parameters to TRUE or FALSE.

EpiCompare(peakfiles = peaklist,
           genome_build = "hg19",
           blacklist = hg19_blacklist,
           picard_files = picard,
           reference = reference_peak,
           upset_plot = FALSE,
           stat_plot = FALSE,
           chromHMM_plot = FALSE,
           chromHMM_annotation = "K562",
           chipseeker_plot = FALSE,
           enrichment_plot = FALSE,
           tss_plot = FALSE,
           interact = FALSE,
           save_output = FALSE,
           output_filename = "EpiCompare_test",
           output_timestamp = FALSE,
           output_dir = tempdir())
## NOTE: The following EpiCompare features are NOT being used: 
##  - upset_plot=
##  - stat_plot=
##  - chromHMM_plot=
##  - chipseeker_plot=
##  - enrichment_plot=
##  - tss_plot=
##  - precision_recall_plot=
##  - corr_plot=
##  - add_download_button=
## processing file: EpiCompare.Rmd
## output file: EpiCompare.knit.md
## /usr/bin/pandoc +RTS -K512m -RTS EpiCompare.knit.md --to html4 --from markdown+autolink_bare_uris+tex_math_single_backslash --output /tmp/Rtmp6sR0mw/EpiCompare_test.html --lua-filter /__w/_temp/Library/rmarkdown/rmarkdown/lua/pagebreak.lua --lua-filter /__w/_temp/Library/rmarkdown/rmarkdown/lua/latex-div.lua --lua-filter /__w/_temp/Library/rmarkdown/rmarkdown/lua/table-classes.lua --embed-resources --standalone --variable bs3=TRUE --section-divs --table-of-contents --toc-depth 3 --variable toc_float=1 --variable toc_selectors=h1,h2,h3 --variable toc_collapsed=1 --variable toc_smooth_scroll=1 --variable toc_print=1 --template /__w/_temp/Library/rmarkdown/rmd/h/default.html --no-highlight --variable highlightjs=1 --number-sections --variable theme=bootstrap --css custom.css --mathjax --variable 'mathjax-url=https://mathjax.rstudio.com/latest/MathJax.js?config=TeX-AMS-MML_HTMLorMML' --include-in-header /tmp/Rtmp6sR0mw/rmarkdown-str4cd753601da.html --variable code_folding=hide --variable code_menu=1
## 
## Output created: /tmp/Rtmp6sR0mw/EpiCompare_test.html
## [1] "Done in 0.11 min."
## All outputs saved to: /tmp/Rtmp6sR0mw
## [1] "/tmp/Rtmp6sR0mw/EpiCompare_test.html"

Optional plots

By default, these plots will not be included in the report unless set TRUE.

  • upset_plot : Upset plot showing the number of overlapping peaks between samples. EpiCompare uses UpSetR package.
  • stat_plot : A reference peakfile must be included for this plot. The plot displays distribution of statistical significance (q-values) of sample peaks that are overlapping/non-overlapping with the reference dataset.
  • chromHMM_plot : ChromHMM annotation of peaks. If reference is provided, ChromHMM annotation of overlapping and non-overlapping peaks with the reference is also included in the report.
  • chipseeker_plot : ChIPseeker functional annotation of peaks.
  • enrichment_plot : KEGG pathway and GO enrichment analysis of peaks.
  • tss_plot : Peak frequency around (+/- 3000bp) transcriptional start site. Note that it may take awhile to generate this plot for large sample sizes.

Other options

  • chromHMM_annotation : Cell-line annotation for ChromHMM. Default is K562. Options are:
    • “K562” = K-562 cells
    • “Gm12878” = Cellosaurus cell-line GM12878
    • “H1hesc” = H1 Human Embryonic Stem Cell
    • “Hepg2” = Hep G2 cell
    • “Hmec” = Human Mammary Epithelial Cell
    • “Hsmm” = Human Skeletal Muscle Myoblasts
    • “Huvec” = Human Umbilical Vein Endothelial Cells
    • “Nhek” = Normal Human Epidermal Keratinocytes
    • “Nhlf” = Normal Human Lung Fibroblasts
  • interact : By default, all heatmaps (percentage overlap and ChromHMM heatmaps) in the report will be interactive. If set FALSE, all heatmaps will be static. N.B. If interact=TRUE, interactive heatmaps will be saved as html files, which may take time for larger sample sizes.
  • output_filename : By default, the report is named EpiCompare.html. You can specify the filename of the report here.
  • output_timestamp : By default FALSE. If TRUE, the filename of the report includes the date.

Output

EpiCompare outputs

  • An HTML report consisting of three sections:
      1. General Metrics: Metrics on peaks (percentage of blacklisted and non-standard peaks, and peak widths) and fragments (duplication rate) of samples.
      1. Peak Overlap: Percentage and statistical significance of overlapping and non-overlapping peaks. Also includes upset plot.
      1. Functional Annotation: Functional annotation (ChromHMM, ChIPseeker and enrichment analysis) of peaks. Also includes peak enrichment around TSS.
  • EpiCompare_file containing all plots generated by EpiCompare if save_output = TRUE.

Both outputs are saved in the specified output_dir.

Future Enhancements

In the current version, EpiCompare only recognizes certain BED formats. We hope to improve this. Moreover, if there are other downstream analysis tools that may be suitable in EpiCompare, feel free to report this through Github.

Code used to generate the example report

An example report comparing ATAC-seq, DNase-seq and ChIP-seq of K562 can be found here.

Code used to generate this:

## Load data
# ATAC-seq data: https://www.encodeproject.org/files/ENCFF558BLC/ 
atac1_hg38 <- ChIPseeker::readPeakFile("/path/to/bed/ENCFF558BLC.bed", as="GRanges")
# Dnase-seq data: https://www.encodeproject.org/files/ENCFF274YGF/
dna1_hg38 <- ChIPseeker::readPeakFile("/path/to/bed/ENCFF274YGF.bed", as="GRanges")
# Dnase-seq data: https://www.encodeproject.org/files/ENCFF185XRG/
dna2_hg38 <- ChIPseeker::readPeakFile("/path/to/bed/ENCFF185XRG.bed", as="GRanges")
# ChIP-seq data: https://www.encodeproject.org/files/ENCFF038DDS/
chip_hg38 <- ChIPseeker::readPeakFile("/path/to/bed/ENCODE_H3K27ac_hg38_ENCFF038DDS.bed", as="GRanges")

## Peaklist
peaklist <- list("ATAC_ENCFF558BLC" = atac1_hg38_unique,
                 "Dnase_ENCFF274YGF" = dna1_hg38,
                 "ChIP_ENCFF038DDS" = chip_hg38)

## Reference
reference <- list("Dnase_ENCFF185XRG_reference"=dna2_hg38)

## Blacklist
data("hg38_blacklist")

## Run Epicompare
EpiCompare(peakfiles = peaklist,
           genome_build = "hg38",
           genome_build_output = "hg38",
           blacklist = hg38_blacklist,
           reference = reference,
           picard_files = NULL,
           upset_plot = T,
           stat_plot = T,
           save_output = F,
           chromHMM_plot = T,
           chromHMM_annotation = "K562",
           chipseeker_plot = T,
           enrichment_plot = T,
           tss_plot = T,
           precision_recall_plot =T,
           corr_plot = T,
           interact = T,
           output_dir = "/path/")

Session Information

utils::sessionInfo()
## R version 4.4.1 (2024-06-14)
## Platform: x86_64-pc-linux-gnu
## Running under: Ubuntu 22.04.5 LTS
## 
## Matrix products: default
## BLAS:   /usr/lib/x86_64-linux-gnu/openblas-pthread/libblas.so.3 
## LAPACK: /usr/lib/x86_64-linux-gnu/openblas-pthread/libopenblasp-r0.3.20.so;  LAPACK version 3.10.0
## 
## locale:
##  [1] LC_CTYPE=en_US.UTF-8       LC_NUMERIC=C              
##  [3] LC_TIME=en_US.UTF-8        LC_COLLATE=en_US.UTF-8    
##  [5] LC_MONETARY=en_US.UTF-8    LC_MESSAGES=en_US.UTF-8   
##  [7] LC_PAPER=en_US.UTF-8       LC_NAME=C                 
##  [9] LC_ADDRESS=C               LC_TELEPHONE=C            
## [11] LC_MEASUREMENT=en_US.UTF-8 LC_IDENTIFICATION=C       
## 
## time zone: UTC
## tzcode source: system (glibc)
## 
## attached base packages:
## [1] stats     graphics  grDevices utils     datasets  methods   base     
## 
## other attached packages:
## [1] EpiCompare_1.9.10 BiocStyle_2.33.1 
## 
## loaded via a namespace (and not attached):
##   [1] splines_4.4.1                          
##   [2] BiocIO_1.15.2                          
##   [3] bitops_1.0-9                           
##   [4] ggplotify_0.1.2                        
##   [5] filelock_1.0.3                         
##   [6] tibble_3.2.1                           
##   [7] R.oo_1.26.0                            
##   [8] polyclip_1.10-7                        
##   [9] XML_3.99-0.17                          
##  [10] lifecycle_1.0.4                        
##  [11] lattice_0.22-6                         
##  [12] MASS_7.3-61                            
##  [13] magrittr_2.0.3                         
##  [14] plotly_4.10.4                          
##  [15] sass_0.4.9                             
##  [16] rmarkdown_2.28                         
##  [17] jquerylib_0.1.4                        
##  [18] yaml_2.3.10                            
##  [19] plotrix_3.8-4                          
##  [20] cowplot_1.1.3                          
##  [21] DBI_1.2.3                              
##  [22] RColorBrewer_1.1-3                     
##  [23] lubridate_1.9.3                        
##  [24] abind_1.4-8                            
##  [25] zlibbioc_1.51.1                        
##  [26] GenomicRanges_1.57.2                   
##  [27] purrr_1.0.2                            
##  [28] R.utils_2.12.3                         
##  [29] ggraph_2.2.1                           
##  [30] BiocGenerics_0.51.3                    
##  [31] RCurl_1.98-1.16                        
##  [32] yulab.utils_0.1.7                      
##  [33] tweenr_2.0.3                           
##  [34] rappdirs_0.3.3                         
##  [35] GenomeInfoDbData_1.2.13                
##  [36] IRanges_2.39.2                         
##  [37] S4Vectors_0.43.2                       
##  [38] enrichplot_1.25.3                      
##  [39] ggrepel_0.9.6                          
##  [40] tidytree_0.4.6                         
##  [41] pkgdown_2.1.1                          
##  [42] ChIPseeker_1.41.3                      
##  [43] codetools_0.2-20                       
##  [44] DelayedArray_0.31.14                   
##  [45] DOSE_3.99.1                            
##  [46] ggforce_0.4.2                          
##  [47] tidyselect_1.2.1                       
##  [48] aplot_0.2.3                            
##  [49] UCSC.utils_1.1.0                       
##  [50] farver_2.1.2                           
##  [51] viridis_0.6.5                          
##  [52] matrixStats_1.4.1                      
##  [53] stats4_4.4.1                           
##  [54] BiocFileCache_2.13.2                   
##  [55] GenomicAlignments_1.41.0               
##  [56] jsonlite_1.8.9                         
##  [57] tidygraph_1.3.1                        
##  [58] systemfonts_1.1.0                      
##  [59] tools_4.4.1                            
##  [60] treeio_1.29.1                          
##  [61] TxDb.Hsapiens.UCSC.hg19.knownGene_3.2.2
##  [62] ragg_1.3.3                             
##  [63] Rcpp_1.0.13                            
##  [64] glue_1.8.0                             
##  [65] gridExtra_2.3                          
##  [66] SparseArray_1.5.44                     
##  [67] xfun_0.48                              
##  [68] qvalue_2.37.0                          
##  [69] MatrixGenerics_1.17.0                  
##  [70] GenomeInfoDb_1.41.2                    
##  [71] dplyr_1.1.4                            
##  [72] withr_3.0.1                            
##  [73] BiocManager_1.30.25                    
##  [74] fastmap_1.2.0                          
##  [75] boot_1.3-31                            
##  [76] fansi_1.0.6                            
##  [77] caTools_1.18.3                         
##  [78] digest_0.6.37                          
##  [79] mime_0.12                              
##  [80] timechange_0.3.0                       
##  [81] R6_2.5.1                               
##  [82] gridGraphics_0.5-1                     
##  [83] seqPattern_1.37.0                      
##  [84] textshaping_0.4.0                      
##  [85] colorspace_2.1-1                       
##  [86] GO.db_3.20.0                           
##  [87] gtools_3.9.5                           
##  [88] RSQLite_2.3.7                          
##  [89] b64_0.1.3                              
##  [90] R.methodsS3_1.8.2                      
##  [91] utf8_1.2.4                             
##  [92] tidyr_1.3.1                            
##  [93] generics_0.1.3                         
##  [94] data.table_1.16.2                      
##  [95] bsplus_0.1.4                           
##  [96] rtracklayer_1.65.0                     
##  [97] graphlayouts_1.2.0                     
##  [98] httr_1.4.7                             
##  [99] htmlwidgets_1.6.4                      
## [100] S4Arrays_1.5.11                        
## [101] scatterpie_0.2.4                       
## [102] downloadthis_0.4.1                     
## [103] pkgconfig_2.0.3                        
## [104] gtable_0.3.5                           
## [105] blob_1.2.4                             
## [106] impute_1.79.0                          
## [107] XVector_0.45.0                         
## [108] shadowtext_0.1.4                       
## [109] htmltools_0.5.8.1                      
## [110] bookdown_0.41                          
## [111] fgsea_1.31.6                           
## [112] scales_1.3.0                           
## [113] Biobase_2.65.1                         
## [114] png_0.1-8                              
## [115] ggfun_0.1.6                            
## [116] knitr_1.48                             
## [117] tzdb_0.4.0                             
## [118] reshape2_1.4.4                         
## [119] rjson_0.2.23                           
## [120] nlme_3.1-166                           
## [121] curl_5.2.3                             
## [122] cachem_1.1.0                           
## [123] stringr_1.5.1                          
## [124] BiocVersion_3.20.0                     
## [125] KernSmooth_2.23-24                     
## [126] parallel_4.4.1                         
## [127] AnnotationDbi_1.67.0                   
## [128] restfulr_0.0.15                        
## [129] desc_1.4.3                             
## [130] pillar_1.9.0                           
## [131] grid_4.4.1                             
## [132] vctrs_0.6.5                            
## [133] gplots_3.2.0                           
## [134] dbplyr_2.5.0                           
## [135] evaluate_1.0.1                         
## [136] readr_2.1.5                            
## [137] GenomicFeatures_1.57.1                 
## [138] cli_3.6.3                              
## [139] compiler_4.4.1                         
## [140] Rsamtools_2.21.2                       
## [141] rlang_1.1.4                            
## [142] crayon_1.5.3                           
## [143] labeling_0.4.3                         
## [144] plyr_1.8.9                             
## [145] fs_1.6.4                               
## [146] stringi_1.8.4                          
## [147] genomation_1.37.0                      
## [148] viridisLite_0.4.2                      
## [149] gridBase_0.4-7                         
## [150] BiocParallel_1.39.0                    
## [151] munsell_0.5.1                          
## [152] Biostrings_2.73.2                      
## [153] lazyeval_0.2.2                         
## [154] GOSemSim_2.31.2                        
## [155] Matrix_1.7-0                           
## [156] BSgenome_1.73.1                        
## [157] hms_1.1.3                              
## [158] patchwork_1.3.0                        
## [159] bit64_4.5.2                            
## [160] ggplot2_3.5.1                          
## [161] KEGGREST_1.45.1                        
## [162] highr_0.11                             
## [163] SummarizedExperiment_1.35.4            
## [164] AnnotationHub_3.13.3                   
## [165] igraph_2.0.3                           
## [166] memoise_2.0.1                          
## [167] bslib_0.8.0                            
## [168] ggtree_3.13.1                          
## [169] fastmatch_1.1-4                        
## [170] bit_4.5.0                              
## [171] ape_5.8