Illustration of MEFISTO on simulated data with a temporal covariate
2021-02-04
library(MOFA2)
library(tidyverse)
library(pheatmap)1 Temporal data: Simulate an example data set
To illustrate the MEFISTO method in MOFA2 we simulate a small example data set with 4 different views and one covariates defining a timeline using make_example_data. The simulation is based on 4 factors, two of which vary smoothly along the covariate (with different lengthscales) and two are independent of the covariate.
set.seed(2020)
# set number of samples and time points
N <- 200
time <- seq(0,1,length.out = N)
# generate example data
dd <- make_example_data(sample_cov = time, n_samples = N,
n_factors = 4, n_features = 200, n_views = 4,
lscales = c(0.5, 0.2, 0, 0))
# input data
data <- dd$data
# covariate matrix with samples in columns
time <- dd$sample_cov
rownames(time) <- "time"Let’s have a look at the simulated latent temporal processes, which we want to recover:
df <- data.frame(dd$Z, t(time))
df <- gather(df, key = "factor", value = "value", starts_with("simulated_factor"))
ggplot(df, aes(x = time, y = value)) + geom_point() + facet_grid(~factor)
2 MEFISTO framework
Using the MEFISTO framework is very similar to using MOFA2. In addition to the omics data, however, we now additionally specify the time points for each sample. If you are not familiar with the MOFA2 framework, it might be helpful to have a look at MOFA2 tutorials first.
2.1 Create a MOFA object with covariates
To create the MOFA object we need to specify the training data and the covariates for pattern detection and inference of smooth factors. Here, sample_cov is a matrix with samples in columns and one row containing the time points. The sample order must match the order in data columns. Alternatively, a data frame can be provided containing one sample columns with samples names matching the sample names in the data.
First, we start by creating a standard MOFA model.
sm <- create_mofa(data = dd$data)## Creating MOFA object from a list of matrices (features as rows, sample as columns)...Now, we can add the additional temporal covariate, that we want to use for training.
sm <- set_covariates(sm, covariates = time)
sm## Untrained MEFISTO model with the following characteristics:
## Number of views: 4
## Views names: view_1 view_2 view_3 view_4
## Number of features (per view): 200 200 200 200
## Number of groups: 1
## Groups names: group1
## Number of samples (per group): 200
## Number of covariates per sample: 1
## We now successfully created a MOFA object that contains 4 views, 1 group and 1 covariate giving the time point for each sample.
2.2 Prepare a MOFA object
Before training, we can specify various options for the model, the training and the data preprocessing. If no options are specified, the model will use the default options. See also get_default_data_options, get_default_model_options and get_default_training_options to have a look at the defaults and change them where required. For illustration, we only use a small number of iterations.
Importantly, to activate the use of the covariate for a functional decomposition (MEFISTO) we now additionally to the standard MOFA options need to specify mefisto_options. For this you can just use the default options (get_default_mefisto_options), unless you want to make use of advanced options such as alignment across groups.
data_opts <- get_default_data_options(sm)
model_opts <- get_default_model_options(sm)
model_opts$num_factors <- 4
train_opts <- get_default_training_options(sm)
train_opts$maxiter <- 100
mefisto_opts <- get_default_mefisto_options(sm)
sm <- prepare_mofa(sm, model_options = model_opts,
mefisto_options = mefisto_opts,
training_options = train_opts,
data_options = data_opts)2.3 Run MOFA
Now, the MOFA object is ready for training. Using run_mofa we can fit the model, which is saved in the file specified as outfile. If none is specified the output is only saved in a temporary location.
sm <- run_mofa(sm)2.4 Down-stream analysis
2.4.1 Variance explained per factor
Using plot_variance_explained we can explore which factor is active in which view. plot_factor_cor shows us whether the factors are correlated.
plot_variance_explained(sm)
r <- plot_factor_cor(sm)
2.4.2 Relate factors to the covariate
The MOFA model has learnt scale parameters for each factor, which give us an indication of the smoothness per factor along the covariate (here time) and are between 0 and 1. A scale of 0 means that the factor captures variation independent of time, a value close to 1 tells us that this factor varys very smoothly along time.
get_scales(sm)## Factor1 Factor2 Factor3 Factor4
## 0.00000000 0.01198386 0.99892405 0.99496226In this example, we find two factors that are non-smooth and two smooth factors. Using plot_factors_vs_cov we can plot the factors along the time line, where we can distinguish smooth and non smooth variation along time.
plot_factors_vs_cov(sm, color_by = "time")
For more customized plots, we can extract the underlying data containing the factor and covariate values for each sample.
df <- plot_factors_vs_cov(sm, color_by = "time",
legend = FALSE, return_data = TRUE)
head(df)## sample covariate value.covariate factor value.factor group color_by
## 1 sample_1 time 0.00000000 Factor1 -4.98804804 group1 0.00000000
## 2 sample_1 time 0.00000000 Factor2 0.50849870 group1 0.00000000
## 3 sample_1 time 0.00000000 Factor4 -1.62411065 group1 0.00000000
## 4 sample_1 time 0.00000000 Factor3 -2.65808004 group1 0.00000000
## 5 sample_10 time 0.04522613 Factor4 -1.73719393 group1 0.04522613
## 6 sample_10 time 0.04522613 Factor2 0.02898661 group1 0.04522613
## shape_by
## 1 1
## 2 1
## 3 1
## 4 1
## 5 1
## 6 1We can compare the above plots to the factors that were simulated above and find that the model recaptured the two smooth as well as two non-smooth patterns in time. Note that factors are invariant to the sign, e.g. Factor 4 is the negative of the simulated factor but we can simply multiply the factors and its weights by -1 to obtain exactly the simulated factor.
2.4.3 Exploration of weights
As with standard MOFA, we can now look deeper into the meaning of these factors by exploring the weights or performing feature set enrichment analysis.
plot_weights(sm, factors = 4, view = 1)## Warning: ggrepel: 7 unlabeled data points (too many overlaps). Consider
## increasing max.overlaps
plot_top_weights(sm, factors = 3, view = 2)
In addition, we can take a look at the top feature values per factor along time and see that their patterns are in line with the pattern of the corresponding Factor (here Factor 3).
plot_data_vs_cov(sm, factor=3,
features = 2,
color_by = "time",
dot_size = 1)
2.4.4 Interpolation
Furthermore, we can interpolate or extrapolate a factor to new values. Here, we only show the mean of the prediction, to obtain uncertainties you need to specify the new values before training in get_default_mefisto_options(sm)$new_values.
sm <- interpolate_factors(sm, new_values = seq(0,1.1,0.01))## We recommend doing interpolation from python where additionally uncertainties are provided for the interpolation.plot_interpolation_vs_covariate(sm, covariate = "time",
factors = "Factor3")
Session Info
sessionInfo()## R version 4.0.3 (2020-10-10)
## Platform: x86_64-apple-darwin17.0 (64-bit)
## Running under: macOS Mojave 10.14.6
##
## Matrix products: default
## BLAS: /Library/Frameworks/R.framework/Versions/4.0/Resources/lib/libRblas.dylib
## LAPACK: /Library/Frameworks/R.framework/Versions/4.0/Resources/lib/libRlapack.dylib
##
## locale:
## [1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8
##
## attached base packages:
## [1] stats graphics grDevices utils datasets methods base
##
## other attached packages:
## [1] pheatmap_1.0.12 forcats_0.5.0 stringr_1.4.0 dplyr_1.0.2
## [5] purrr_0.3.4 readr_1.4.0 tidyr_1.1.2 tibble_3.0.4
## [9] ggplot2_3.3.2 tidyverse_1.3.0 MOFA2_1.1.10 BiocStyle_2.18.1
##
## loaded via a namespace (and not attached):
## [1] matrixStats_0.57.0 fs_1.5.0 lubridate_1.7.9.2
## [4] filelock_1.0.2 RColorBrewer_1.1-2 httr_1.4.2
## [7] tools_4.0.3 backports_1.2.1 R6_2.5.0
## [10] HDF5Array_1.18.0 uwot_0.1.10 DBI_1.1.0
## [13] BiocGenerics_0.36.0 colorspace_2.0-0 rhdf5filters_1.2.0
## [16] withr_2.3.0 tidyselect_1.1.0 compiler_4.0.3
## [19] cli_2.2.0 rvest_0.3.6 basilisk.utils_1.2.1
## [22] xml2_1.3.2 DelayedArray_0.16.0 labeling_0.4.2
## [25] bookdown_0.21 scales_1.1.1 mvtnorm_1.1-1
## [28] rappdirs_0.3.1 digest_0.6.27 rmarkdown_2.6
## [31] basilisk_1.2.1 pkgconfig_2.0.3 htmltools_0.5.0
## [34] MatrixGenerics_1.2.0 dbplyr_2.0.0 rlang_0.4.9
## [37] readxl_1.3.1 rstudioapi_0.13 farver_2.0.3
## [40] generics_0.1.0 jsonlite_1.7.2 magrittr_2.0.1
## [43] Matrix_1.2-18 Rcpp_1.0.5 munsell_0.5.0
## [46] S4Vectors_0.28.1 Rhdf5lib_1.12.0 fansi_0.4.1
## [49] reticulate_1.18 lifecycle_0.2.0 stringi_1.5.3
## [52] yaml_2.2.1 rhdf5_2.34.0 Rtsne_0.15
## [55] plyr_1.8.6 grid_4.0.3 parallel_4.0.3
## [58] ggrepel_0.9.0 crayon_1.3.4 lattice_0.20-41
## [61] haven_2.3.1 cowplot_1.1.0 hms_0.5.3
## [64] magick_2.5.2 knitr_1.30 pillar_1.4.7
## [67] reshape2_1.4.4 stats4_4.0.3 reprex_0.3.0
## [70] glue_1.4.2 evaluate_0.14 BiocManager_1.30.10
## [73] modelr_0.1.8 vctrs_0.3.6 cellranger_1.1.0
## [76] gtable_0.3.0 assertthat_0.2.1 xfun_0.19
## [79] broom_0.7.3 IRanges_2.24.1 corrplot_0.84
## [82] ellipsis_0.3.1