This tutorial will talk through hypothesis testing for alpha diversity indices using the functions betta and betta_random.

Disclaimer

Disclaimer: If you have not taken a introductory statistics class or devoted serious time to learning introductory statistics, I strongly encourage you to reconsider doing so before ever quoting a p-value or doing modeling of any kind. An introductory statistics class will teach you valuable skills that will serve you well throughout your entire scientific career, including the use and abuse of p-values in science, how to responsibly fit models and test null hypotheses, and an appreciation for how easy it is to inflate the statistical significance of a result. Please equip yourself with the statistical skills and scepticism necessary to responsibly test and discuss null hypothesis significance testing.

Preliminaries

Download the latest version of the package from github.

Let's use the Whitman et al dataset from corncob as our example.

library(corncob)
data("soil_phylo")
soil_phylo %>% sample_data %>% head
## Sample Data:        [6 samples by 5 sample variables]:
##      Plants DayAmdmt Amdmt ID Day
## S009      1       01     1  D   0
## S204      1       21     1  D   2
## S112      0       11     1  B   1
## S247      0       22     2  F   2
## S026      0       00     0  A   0
## S023      1       00     0  C   0

I'm only going to consider samples amended with biochar, and I want to look at the effect of Day. This will tell us how much diversity in the soil changed from Day 0 to Day 82. (Just to be confusing, Day 82 is called Day 2 in the dataset.)

subset_soil <- soil_phylo %>%
  subset_samples(Amdmt == 1) %>% # only biochar
  subset_samples(Day %in% c(0, 2))  # only Days 0 and 82

I now run breakaway on these samples to get richness estimates, and plot them.

richness_soil <- subset_soil %>% breakaway
plot(richness_soil, physeq=subset_soil, color="Day", shape = "ID")

plot of chunk unnamed-chunk-5

Don't freak out! Those are wide error bars, but nothing went wrong – it's just really hard to estimate the true number of unknown species in soil. breakaway was developed to deal with this, and to make sure that we account for that uncertainty when we do inference.

We can get a table of the estimates and their uncertainties as follows:

summary(richness_soil) %>% as_tibble
## # A tibble: 32 × 7
##    estimate  error lower   upper sample_names name      model            
##       <dbl>  <dbl> <dbl>   <dbl> <chr>        <chr>     <chr>            
##  1    5257.  203.  4010.  54003. S009         breakaway Kemp             
##  2    5343. 2252.  4317. 316529. S204         breakaway Kemp             
##  3    4609.  978.  2782. 250548. S012         breakaway Kemp             
##  4    5446. 1393.  3864. 299572. S207         breakaway Kemp             
##  5    5359.  143.  4370.  35608. S202         breakaway Kemp             
##  6    3882.  181.  2802.  44399. S007         breakaway Kemp             
##  7    4906. 4787.  3111. 748118. S022         breakaway Kemp             
##  8    5215.  343.  3327. 106472. S024         breakaway Negative Binomial
##  9    4509.   98.9 3443.  24952. S032         breakaway Kemp             
## 10    5070.  114.  4189.  27300. S212         breakaway Kemp             
## # … with 22 more rows

If you haven't seen a tibble before, it's like a data.frame, but way better. Already we can see that we only have 10 rows printed as opposed to the usual bajillion.

Inference

The first step to doing inference is to decide on your design matrix. We need to grab our covariates into a data frame (or tibble), so let's start by doing that:

meta <- subset_soil %>%
  sample_data %>%
  as_tibble %>%
  mutate("sample_names" = subset_soil %>% sample_names )

That warning is not a problem – it's just telling us that it's not a phyloseq object anymore.

Suppose we want to fit the model with Day as a fixed effect. Here's how we do that,

combined_richness <- meta %>%
  left_join(summary(richness_soil),
            by = "sample_names")
# Old way (still works)
bt_day_fixed <- betta(chats = combined_richness$estimate,
                      ses = combined_richness$error,
                      X = model.matrix(~Day, data = combined_richness))
# Fancy new way -- thanks to Sarah Teichman for implementing!
bt_day_fixed <- betta(formula = estimate ~ Day, 
                      ses = error, data = combined_richness)
bt_day_fixed$table
##             Estimates Standard Errors p-values
## (Intercept) 4547.1078        125.8542    0.000
## Day2         139.5325        170.1855    0.412

So we see an estimated increase in richness after 82 days of 122 taxa, with the standard error in the estimate of 171. A hypothesis test for a change in richness (i.e., testing a null hypothesis of no change) would not be rejected at any reasonable cut-off (p = 0.412).

Alternatively, we could fit the model with plot ID as a random effect. Here's how we do that:

# Old way (still works)
bt_day_fixed_id_random <- betta_random(chats = combined_richness$estimate,
                                       ses = combined_richness$error,
                                       X = model.matrix(~Day, data = combined_richness),
                                       groups=combined_richness$ID)
# Fancy new way 
bt_day_fixed_id_random <-
  betta_random(formula = estimate ~ Day | ID, 
               ses = error,  data = combined_richness)
bt_day_fixed_id_random$table
##             Estimates Standard Errors p-values
## (Intercept) 4455.2369        118.5874    0.000
## Day2         291.7193        160.4762    0.069

Under this different model, we see an estimated increase in richness after 82 days of 258 taxa, with the standard error in the estimate of 161. A hypothesis test for a change in richness still would not be rejected at any reasonable cut-off (p = 0.069).

If you choose to use the old way, the structure of betta_random is to input your design matrix as X, and your random effects as groups, where the latter is a categorical variable. Otherwise, the input looks like how you would hand this off to a regular mixed effects model in the package lme4!

Using betta with DivNet

Maybe you don't care about richness… but you care about Shannon or Simpson diversity! DivNet is our R package for estimating Shannon and Simpson diversity.

DivNet can be slow when you have a large number of taxa (but we are working on it!), so to illustrate we are going to estimate phylum-level Shannon diversity:

soil_phylum <- subset_soil %>%
  tax_glom(taxrank="Phylum")

Easter egg: phyloseq::tax_glom can be incredibly slow! Mike McLaren is a total champ and rewrote it faster – check out his package speedyseq and speedyseq::tax_glom in particular.

Let's treat all samples as independent observations (X = NULL) and fit the DivNet model:

(Check out the full documentation for details, including how to run in parallel)

# the following line contains the DivNet command to fit the model we will use
# dv <- DivNet::divnet(soil_phylum, X = NULL)

# to allow readers to build this vignette without installing DivNet
# we've saved the fitted model, which we'll load directly:

data("dv")

This produces an object containing common diversity estimates:

dv
## $shannon
## A collection of 32 alpha diversity estimates:
## 
## $ S009
## Estimate of shannon from method DivNet:
##   Estimate is 2.04
##  with standard error 0.01
##   Confidence interval: (2.03, 2.06)
## 
## 
## $ S204
## Estimate of shannon from method DivNet:
##   Estimate is 1.98
##  with standard error 0
##   Confidence interval: (1.98, 1.98)
## 
## 
## $ S012
## Estimate of shannon from method DivNet:
##   Estimate is 2
##  with standard error 0.01
##   Confidence interval: (1.99, 2.02)
## 
## 
## $ S207
## Estimate of shannon from method DivNet:
##   Estimate is 2.04
##  with standard error 0
##   Confidence interval: (2.04, 2.05)
## 
## 
## $ S202
## Estimate of shannon from method DivNet:
##   Estimate is 2.01
##  with standard error 0
##   Confidence interval: (2.01, 2.02)
## 
## 
## $ S007
## Estimate of shannon from method DivNet:
##   Estimate is 2.04
##  with standard error 0
##   Confidence interval: (2.04, 2.05)
## 
## 
## $ S022
## Estimate of shannon from method DivNet:
##   Estimate is 2.04
##  with standard error 0.01
##   Confidence interval: (2.03, 2.05)
## 
## 
## $ S024
## Estimate of shannon from method DivNet:
##   Estimate is 2.01
##  with standard error 0.01
##   Confidence interval: (2, 2.02)
## 
## 
## $ S032
## Estimate of shannon from method DivNet:
##   Estimate is 1.99
##  with standard error 0
##   Confidence interval: (1.99, 2)
## 
## 
## $ S212
## Estimate of shannon from method DivNet:
##   Estimate is 2.02
##  with standard error 0
##   Confidence interval: (2.02, 2.03)
## 
## 
## $ S019
## Estimate of shannon from method DivNet:
##   Estimate is 1.97
##  with standard error 0
##   Confidence interval: (1.96, 1.97)
## 
## 
## $ S214
## Estimate of shannon from method DivNet:
##   Estimate is 2.05
##  with standard error 0.01
##   Confidence interval: (2.04, 2.06)
## 
## 
## $ S037
## Estimate of shannon from method DivNet:
##   Estimate is 2.03
##  with standard error 0.01
##   Confidence interval: (2.02, 2.04)
## 
## 
## $ S217
## Estimate of shannon from method DivNet:
##   Estimate is 2.07
##  with standard error 0.01
##   Confidence interval: (2.06, 2.08)
## 
## 
## $ S039
## Estimate of shannon from method DivNet:
##   Estimate is 2
##  with standard error 0.01
##   Confidence interval: (1.98, 2.01)
## 
## 
## $ S034
## Estimate of shannon from method DivNet:
##   Estimate is 1.99
##  with standard error 0.01
##   Confidence interval: (1.98, 2.01)
## 
## 
## $ S229
## Estimate of shannon from method DivNet:
##   Estimate is 2
##  with standard error 0
##   Confidence interval: (1.99, 2.01)
## 
## 
## $ S209
## Estimate of shannon from method DivNet:
##   Estimate is 2
##  with standard error 0
##   Confidence interval: (1.99, 2.01)
## 
## 
## $ S227
## Estimate of shannon from method DivNet:
##   Estimate is 2
##  with standard error 0.01
##   Confidence interval: (1.99, 2.01)
## 
## 
## $ S237
## Estimate of shannon from method DivNet:
##   Estimate is 2.04
##  with standard error 0
##   Confidence interval: (2.03, 2.05)
## 
## 
## $ S224
## Estimate of shannon from method DivNet:
##   Estimate is 1.98
##  with standard error 0.01
##   Confidence interval: (1.97, 1.99)
## 
## 
## $ S017
## Estimate of shannon from method DivNet:
##   Estimate is 2.03
##  with standard error 0.01
##   Confidence interval: (2.01, 2.05)
## 
## 
## $ S219
## Estimate of shannon from method DivNet:
##   Estimate is 1.98
##  with standard error 0
##   Confidence interval: (1.98, 1.99)
## 
## 
## $ S027
## Estimate of shannon from method DivNet:
##   Estimate is 2.03
##  with standard error 0.01
##   Confidence interval: (2.01, 2.04)
## 
## 
## $ S232
## Estimate of shannon from method DivNet:
##   Estimate is 1.96
##  with standard error 0.01
##   Confidence interval: (1.94, 1.97)
## 
## 
## $ S002
## Estimate of shannon from method DivNet:
##   Estimate is 2.01
##  with standard error 0.01
##   Confidence interval: (2, 2.03)
## 
## 
## $ S004
## Estimate of shannon from method DivNet:
##   Estimate is 2.02
##  with standard error 0.01
##   Confidence interval: (2.01, 2.03)
## 
## 
## $ S234
## Estimate of shannon from method DivNet:
##   Estimate is 2.01
##  with standard error 0
##   Confidence interval: (2, 2.02)
## 
## 
## $ S029
## Estimate of shannon from method DivNet:
##   Estimate is 2.03
##  with standard error 0
##   Confidence interval: (2.03, 2.04)
## 
## 
## $ S222
## Estimate of shannon from method DivNet:
##   Estimate is 1.97
##  with standard error 0
##   Confidence interval: (1.96, 1.98)
## 
## 
## $ S239
## Estimate of shannon from method DivNet:
##   Estimate is 2.03
##  with standard error 0
##   Confidence interval: (2.02, 2.04)
## 
## 
## $ S014
## Estimate of shannon from method DivNet:
##   Estimate is 2.03
##  with standard error 0.01
##   Confidence interval: (2.02, 2.05)
## 
## 
## 
## $simpson
## A collection of 32 alpha diversity estimates:
## 
## $ S009
## Estimate of simpson from method DivNet:
##   Estimate is 0.18
##  with standard error 0
##   Confidence interval: (0.18, 0.19)
## 
## 
## $ S204
## Estimate of simpson from method DivNet:
##   Estimate is 0.2
##  with standard error 0
##   Confidence interval: (0.2, 0.2)
## 
## 
## $ S012
## Estimate of simpson from method DivNet:
##   Estimate is 0.19
##  with standard error 0
##   Confidence interval: (0.19, 0.19)
## 
## 
## $ S207
## Estimate of simpson from method DivNet:
##   Estimate is 0.18
##  with standard error 0
##   Confidence interval: (0.18, 0.18)
## 
## 
## $ S202
## Estimate of simpson from method DivNet:
##   Estimate is 0.19
##  with standard error 0
##   Confidence interval: (0.19, 0.2)
## 
## 
## $ S007
## Estimate of simpson from method DivNet:
##   Estimate is 0.18
##  with standard error 0
##   Confidence interval: (0.18, 0.18)
## 
## 
## $ S022
## Estimate of simpson from method DivNet:
##   Estimate is 0.18
##  with standard error 0
##   Confidence interval: (0.18, 0.19)
## 
## 
## $ S024
## Estimate of simpson from method DivNet:
##   Estimate is 0.19
##  with standard error 0
##   Confidence interval: (0.19, 0.19)
## 
## 
## $ S032
## Estimate of simpson from method DivNet:
##   Estimate is 0.19
##  with standard error 0
##   Confidence interval: (0.19, 0.19)
## 
## 
## $ S212
## Estimate of simpson from method DivNet:
##   Estimate is 0.19
##  with standard error 0
##   Confidence interval: (0.19, 0.19)
## 
## 
## $ S019
## Estimate of simpson from method DivNet:
##   Estimate is 0.2
##  with standard error 0
##   Confidence interval: (0.2, 0.21)
## 
## 
## $ S214
## Estimate of simpson from method DivNet:
##   Estimate is 0.19
##  with standard error 0
##   Confidence interval: (0.18, 0.19)
## 
## 
## $ S037
## Estimate of simpson from method DivNet:
##   Estimate is 0.18
##  with standard error 0
##   Confidence interval: (0.18, 0.19)
## 
## 
## $ S217
## Estimate of simpson from method DivNet:
##   Estimate is 0.18
##  with standard error 0
##   Confidence interval: (0.18, 0.19)
## 
## 
## $ S039
## Estimate of simpson from method DivNet:
##   Estimate is 0.18
##  with standard error 0
##   Confidence interval: (0.18, 0.19)
## 
## 
## $ S034
## Estimate of simpson from method DivNet:
##   Estimate is 0.19
##  with standard error 0
##   Confidence interval: (0.19, 0.2)
## 
## 
## $ S229
## Estimate of simpson from method DivNet:
##   Estimate is 0.2
##  with standard error 0
##   Confidence interval: (0.19, 0.2)
## 
## 
## $ S209
## Estimate of simpson from method DivNet:
##   Estimate is 0.19
##  with standard error 0
##   Confidence interval: (0.18, 0.19)
## 
## 
## $ S227
## Estimate of simpson from method DivNet:
##   Estimate is 0.2
##  with standard error 0
##   Confidence interval: (0.2, 0.2)
## 
## 
## $ S237
## Estimate of simpson from method DivNet:
##   Estimate is 0.19
##  with standard error 0
##   Confidence interval: (0.19, 0.19)
## 
## 
## $ S224
## Estimate of simpson from method DivNet:
##   Estimate is 0.19
##  with standard error 0
##   Confidence interval: (0.19, 0.2)
## 
## 
## $ S017
## Estimate of simpson from method DivNet:
##   Estimate is 0.19
##  with standard error 0
##   Confidence interval: (0.19, 0.2)
## 
## 
## $ S219
## Estimate of simpson from method DivNet:
##   Estimate is 0.21
##  with standard error 0
##   Confidence interval: (0.21, 0.21)
## 
## 
## $ S027
## Estimate of simpson from method DivNet:
##   Estimate is 0.19
##  with standard error 0
##   Confidence interval: (0.19, 0.19)
## 
## 
## $ S232
## Estimate of simpson from method DivNet:
##   Estimate is 0.21
##  with standard error 0
##   Confidence interval: (0.21, 0.21)
## 
## 
## $ S002
## Estimate of simpson from method DivNet:
##   Estimate is 0.19
##  with standard error 0
##   Confidence interval: (0.19, 0.19)
## 
## 
## $ S004
## Estimate of simpson from method DivNet:
##   Estimate is 0.19
##  with standard error 0
##   Confidence interval: (0.18, 0.19)
## 
## 
## $ S234
## Estimate of simpson from method DivNet:
##   Estimate is 0.19
##  with standard error 0
##   Confidence interval: (0.19, 0.19)
## 
## 
## $ S029
## Estimate of simpson from method DivNet:
##   Estimate is 0.19
##  with standard error 0
##   Confidence interval: (0.18, 0.19)
## 
## 
## $ S222
## Estimate of simpson from method DivNet:
##   Estimate is 0.2
##  with standard error 0
##   Confidence interval: (0.2, 0.21)
## 
## 
## $ S239
## Estimate of simpson from method DivNet:
##   Estimate is 0.2
##  with standard error 0
##   Confidence interval: (0.19, 0.2)
## 
## 
## $ S014
## Estimate of simpson from method DivNet:
##   Estimate is 0.19
##  with standard error 0
##   Confidence interval: (0.18, 0.19)
## 
## 
## 
## $`bray-curtis`
##            S009       S204       S012       S207       S202       S007
## S009 0.00000000 0.09312209 0.05530938 0.05564009 0.08567331 0.04483488
## S204 0.09312209 0.00000000 0.12099785 0.05270712 0.01595924 0.06253779
## S012 0.05530938 0.12099785 0.00000000 0.09069215 0.11571961 0.07538741
## S207 0.05564009 0.05270712 0.09069215 0.00000000 0.04492157 0.04118450
## S202 0.08567331 0.01595924 0.11571961 0.04492157 0.00000000 0.05704690
## S007 0.04483488 0.06253779 0.07538741 0.04118450 0.05704690 0.00000000
## S022 0.04408263 0.07085260 0.08031669 0.02411201 0.06332811 0.03914695
## S024 0.06918605 0.05786297 0.10331418 0.03901554 0.05035369 0.05006539
## S032 0.08621168 0.06667345 0.10269463 0.06695754 0.06594592 0.06056620
## S212 0.06791756 0.03294157 0.09303483 0.03032546 0.02707944 0.04057826
## S019 0.05420686 0.07360797 0.05368108 0.07664445 0.06725643 0.06139080
## S214 0.06341765 0.05216172 0.09666024 0.04234504 0.04423363 0.03738377
## S037 0.05465128 0.07305691 0.07239585 0.04111957 0.06674205 0.03077064
## S217 0.06498272 0.05185394 0.09843510 0.03470418 0.03705982 0.04434630
## S039 0.10436845 0.11033832 0.12315497 0.09367182 0.10918642 0.07715148
## S034 0.06219710 0.07445194 0.07674483 0.05682203 0.06824494 0.03592979
## S229 0.07258724 0.04608900 0.10836780 0.03968327 0.03903056 0.05128942
## S209 0.09198725 0.05277331 0.12501411 0.05302127 0.05378899 0.05948951
## S227 0.08155528 0.04318368 0.09788020 0.05160642 0.03779438 0.06123505
## S237 0.09123895 0.02432901 0.11897814 0.04938282 0.02105990 0.05989621
## S224 0.11171570 0.05157104 0.14633795 0.07165443 0.04682303 0.08613230
## S017 0.05723629 0.12510657 0.04180619 0.08906814 0.11930238 0.07731160
## S219 0.14571743 0.07114141 0.16203690 0.10803459 0.07265683 0.11667522
## S027 0.05334965 0.07271736 0.07270071 0.04486319 0.06621880 0.04481592
## S232 0.11353355 0.05215237 0.11524044 0.07488709 0.05689256 0.09188255
## S002 0.06010553 0.05180780 0.08899940 0.04312996 0.04671725 0.03835567
## S004 0.04607169 0.05832438 0.07333722 0.03437048 0.05249489 0.02084151
## S234 0.06854357 0.04652826 0.09867830 0.04086761 0.04173295 0.03907596
## S029 0.02876960 0.10598620 0.06147882 0.06204017 0.09831350 0.06324309
## S222 0.07383770 0.05432441 0.08815572 0.07066704 0.04463675 0.06606461
## S239 0.13512098 0.06634315 0.14878204 0.09943422 0.06501873 0.10514750
## S014 0.02996010 0.08786941 0.05802074 0.06459770 0.07768370 0.04529808
##            S022       S024       S032       S212       S019       S214
## S009 0.04408263 0.06918605 0.08621168 0.06791756 0.05420686 0.06341765
## S204 0.07085260 0.05786297 0.06667345 0.03294157 0.07360797 0.05216172
## S012 0.08031669 0.10331418 0.10269463 0.09303483 0.05368108 0.09666024
## S207 0.02411201 0.03901554 0.06695754 0.03032546 0.07664445 0.04234504
## S202 0.06332811 0.05035369 0.06594592 0.02707944 0.06725643 0.04423363
## S007 0.03914695 0.05006539 0.06056620 0.04057826 0.06139080 0.03738377
## S022 0.00000000 0.04479732 0.07086995 0.04495990 0.07628140 0.05214682
## S024 0.04479732 0.00000000 0.03400563 0.04148561 0.07630166 0.04908811
## S032 0.07086995 0.03400563 0.00000000 0.05003825 0.06911703 0.05929520
## S212 0.04495990 0.04148561 0.05003825 0.00000000 0.05921958 0.03864031
## S019 0.07628140 0.07630166 0.06911703 0.05921958 0.00000000 0.05952625
## S214 0.05214682 0.04908811 0.05929520 0.03864031 0.05952625 0.00000000
## S037 0.03238132 0.03790251 0.04415158 0.04393827 0.07012054 0.05079160
## S217 0.04947947 0.04670518 0.06592602 0.03314662 0.06448974 0.02826520
## S039 0.09824964 0.07161130 0.05479098 0.08968086 0.11876091 0.09616824
## S034 0.05435038 0.04374256 0.03417529 0.05103164 0.05066116 0.04299623
## S229 0.04381721 0.04666727 0.06705146 0.03939595 0.07010129 0.05574152
## S209 0.06773393 0.03575380 0.04432205 0.05465009 0.09519448 0.05760441
## S227 0.04991853 0.06138079 0.07878385 0.03993162 0.06805626 0.06534882
## S237 0.06877413 0.05629575 0.06746627 0.03158719 0.07372041 0.05324726
## S224 0.08688761 0.04829488 0.05728811 0.06088629 0.10102341 0.07865142
## S017 0.07683290 0.10486752 0.10242296 0.09654401 0.05531407 0.08809439
## S219 0.12727221 0.10920727 0.11797818 0.08944018 0.11800300 0.09658995
## S027 0.03235633 0.04849880 0.06502177 0.05386842 0.06347548 0.04786532
## S232 0.08523084 0.07919207 0.09823757 0.06283028 0.09532633 0.08478991
## S002 0.04974651 0.04510191 0.06692745 0.04497196 0.06003162 0.03229788
## S004 0.03149664 0.04223824 0.05043771 0.03355807 0.05232632 0.03734243
## S234 0.04730552 0.02822989 0.02993524 0.02457175 0.06334336 0.04561955
## S029 0.04645897 0.07762779 0.09445005 0.08184181 0.06758422 0.08075353
## S222 0.07879386 0.07913900 0.08956510 0.06177087 0.04572093 0.06373568
## S239 0.11712758 0.10179990 0.10836442 0.07963463 0.10832371 0.08722108
## S014 0.06087452 0.07338839 0.07429321 0.07006958 0.04707584 0.04786355
##            S037       S217       S039       S034         S229       S209
## S009 0.05465128 0.06498272 0.10436845 0.06219710 7.258724e-02 0.09198725
## S204 0.07305691 0.05185394 0.11033832 0.07445194 4.608900e-02 0.05277331
## S012 0.07239585 0.09843510 0.12315497 0.07674483 1.083678e-01 0.12501411
## S207 0.04111957 0.03470418 0.09367182 0.05682203 3.968327e-02 0.05302127
## S202 0.06674205 0.03705982 0.10918642 0.06824494 3.903056e-02 0.05378899
## S007 0.03077064 0.04434630 0.07715148 0.03592979 5.128942e-02 0.05948951
## S022 0.03238132 0.04947947 0.09824964 0.05435038 4.381721e-02 0.06773393
## S024 0.03790251 0.04670518 0.07161130 0.04374256 4.666727e-02 0.03575380
## S032 0.04415158 0.06592602 0.05479098 0.03417529 6.705146e-02 0.04432205
## S212 0.04393827 0.03314662 0.08968086 0.05103164 3.939595e-02 0.05465009
## S019 0.07012054 0.06448974 0.11876091 0.05066116 7.010129e-02 0.09519448
## S214 0.05079160 0.02826520 0.09616824 0.04299623 5.574152e-02 0.05760441
## S037 0.00000000 0.05238969 0.06787546 0.03360759 5.521290e-02 0.05342307
## S217 0.05238969 0.00000000 0.10020407 0.05716469 5.147249e-02 0.05920945
## S039 0.06787546 0.10020407 0.00000000 0.07289277 1.113911e-01 0.06208425
## S034 0.03360759 0.05716469 0.07289277 0.00000000 5.921198e-02 0.06531647
## S229 0.05521290 0.05147249 0.11139106 0.05921198 1.110223e-16 0.07330710
## S209 0.05342307 0.05920945 0.06208425 0.06531647 7.330710e-02 0.00000000
## S227 0.05894538 0.04918815 0.11935202 0.07054004 3.252965e-02 0.08429268
## S237 0.07172061 0.03438250 0.10707927 0.07301327 4.546313e-02 0.05704175
## S224 0.07711216 0.07099194 0.08011564 0.08425092 6.165965e-02 0.03365036
## S017 0.07742103 0.09860174 0.12014494 0.07235261 1.134245e-01 0.12422709
## S219 0.12513071 0.08367444 0.13690901 0.11989254 1.092607e-01 0.10044815
## S027 0.04479291 0.05439070 0.10265952 0.04111382 5.107444e-02 0.07553672
## S232 0.08800982 0.08050202 0.13867162 0.09744774 7.109250e-02 0.08898460
## S002 0.05559396 0.04544856 0.09624531 0.03814484 5.629203e-02 0.06087335
## S004 0.02657337 0.04214721 0.08532955 0.02888150 4.331496e-02 0.06093165
## S234 0.03185702 0.04199927 0.06890617 0.03655677 4.507537e-02 0.04271996
## S029 0.06325365 0.08130969 0.11265179 0.06976483 7.921333e-02 0.10018786
## S222 0.08271197 0.06092350 0.12819131 0.06935591 5.175321e-02 0.09391572
## S239 0.11539870 0.07183997 0.12900419 0.11030617 1.009433e-01 0.09453119
## S014 0.05360877 0.05813915 0.08898398 0.05262955 8.210668e-02 0.08750807
##            S227         S237       S224         S017       S219       S027
## S009 0.08155528 9.123895e-02 0.11171570 5.723629e-02 0.14571743 0.05334965
## S204 0.04318368 2.432901e-02 0.05157104 1.251066e-01 0.07114141 0.07271736
## S012 0.09788020 1.189781e-01 0.14633795 4.180619e-02 0.16203690 0.07270071
## S207 0.05160642 4.938282e-02 0.07165443 8.906814e-02 0.10803459 0.04486319
## S202 0.03779438 2.105990e-02 0.04682303 1.193024e-01 0.07265683 0.06621880
## S007 0.06123505 5.989621e-02 0.08613230 7.731160e-02 0.11667522 0.04481592
## S022 0.04991853 6.877413e-02 0.08688761 7.683290e-02 0.12727221 0.03235633
## S024 0.06138079 5.629575e-02 0.04829488 1.048675e-01 0.10920727 0.04849880
## S032 0.07878385 6.746627e-02 0.05728811 1.024230e-01 0.11797818 0.06502177
## S212 0.03993162 3.158719e-02 0.06088629 9.654401e-02 0.08944018 0.05386842
## S019 0.06805626 7.372041e-02 0.10102341 5.531407e-02 0.11800300 0.06347548
## S214 0.06534882 5.324726e-02 0.07865142 8.809439e-02 0.09658995 0.04786532
## S037 0.05894538 7.172061e-02 0.07711216 7.742103e-02 0.12513071 0.04479291
## S217 0.04918815 3.438250e-02 0.07099194 9.860174e-02 0.08367444 0.05439070
## S039 0.11935202 1.070793e-01 0.08011564 1.201449e-01 0.13690901 0.10265952
## S034 0.07054004 7.301327e-02 0.08425092 7.235261e-02 0.11989254 0.04111382
## S229 0.03252965 4.546313e-02 0.06165965 1.134245e-01 0.10926067 0.05107444
## S209 0.08429268 5.704175e-02 0.03365036 1.242271e-01 0.10044815 0.07553672
## S227 0.00000000 3.747618e-02 0.07132514 1.034094e-01 0.08790091 0.05373163
## S237 0.03747618 1.110223e-16 0.05116658 1.232081e-01 0.07063974 0.07170657
## S224 0.07132514 5.116658e-02 0.00000000 1.515374e-01 0.08408949 0.09233148
## S017 0.10340937 1.232081e-01 0.15153739 1.110223e-16 0.15832376 0.07648730
## S219 0.08790091 7.063974e-02 0.08408949 1.583238e-01 0.00000000 0.12744875
## S027 0.05373163 7.170657e-02 0.09233148 7.648730e-02 0.12744875 0.00000000
## S232 0.05360855 6.763666e-02 0.08431788 1.245065e-01 0.07417824 0.08350429
## S002 0.05925267 5.346925e-02 0.07950404 7.724517e-02 0.09522369 0.04358857
## S004 0.05101595 5.533439e-02 0.07935605 7.897849e-02 0.11756284 0.03163310
## S234 0.05572945 4.451186e-02 0.05216627 1.014995e-01 0.09979802 0.05936735
## S029 0.08308511 1.035495e-01 0.12198745 5.359583e-02 0.15603413 0.04808701
## S222 0.04258600 5.381484e-02 0.08371858 9.139143e-02 0.09519706 0.06907494
## S239 0.08080740 6.456304e-02 0.07814136 1.469177e-01 0.03449947 0.11982546
## S014 0.08646861 8.624909e-02 0.11378369 5.065709e-02 0.13141910 0.05804377
##            S232         S002         S004       S234       S029       S222
## S009 0.11353355 6.010553e-02 4.607169e-02 0.06854357 0.02876960 0.07383770
## S204 0.05215237 5.180780e-02 5.832438e-02 0.04652826 0.10598620 0.05432441
## S012 0.11524044 8.899940e-02 7.333722e-02 0.09867830 0.06147882 0.08815572
## S207 0.07488709 4.312996e-02 3.437048e-02 0.04086761 0.06204017 0.07066704
## S202 0.05689256 4.671725e-02 5.249489e-02 0.04173295 0.09831350 0.04463675
## S007 0.09188255 3.835567e-02 2.084151e-02 0.03907596 0.06324309 0.06606461
## S022 0.08523084 4.974651e-02 3.149664e-02 0.04730552 0.04645897 0.07879386
## S024 0.07919207 4.510191e-02 4.223824e-02 0.02822989 0.07762779 0.07913900
## S032 0.09823757 6.692745e-02 5.043771e-02 0.02993524 0.09445005 0.08956510
## S212 0.06283028 4.497196e-02 3.355807e-02 0.02457175 0.08184181 0.06177087
## S019 0.09532633 6.003162e-02 5.232632e-02 0.06334336 0.06758422 0.04572093
## S214 0.08478991 3.229788e-02 3.734243e-02 0.04561955 0.08075353 0.06373568
## S037 0.08800982 5.559396e-02 2.657337e-02 0.03185702 0.06325365 0.08271197
## S217 0.08050202 4.544856e-02 4.214721e-02 0.04199927 0.08130969 0.06092350
## S039 0.13867162 9.624531e-02 8.532955e-02 0.06890617 0.11265179 0.12819131
## S034 0.09744774 3.814484e-02 2.888150e-02 0.03655677 0.06976483 0.06935591
## S229 0.07109250 5.629203e-02 4.331496e-02 0.04507537 0.07921333 0.05175321
## S209 0.08898460 6.087335e-02 6.093165e-02 0.04271996 0.10018786 0.09391572
## S227 0.05360855 5.925267e-02 5.101595e-02 0.05572945 0.08308511 0.04258600
## S237 0.06763666 5.346925e-02 5.533439e-02 0.04451186 0.10354953 0.05381484
## S224 0.08431788 7.950404e-02 7.935605e-02 0.05216627 0.12198745 0.08371858
## S017 0.12450650 7.724517e-02 7.897849e-02 0.10149953 0.05359583 0.09139143
## S219 0.07417824 9.522369e-02 1.175628e-01 0.09979802 0.15603413 0.09519706
## S027 0.08350429 4.358857e-02 3.163310e-02 0.05936735 0.04808701 0.06907494
## S232 0.00000000 7.363579e-02 8.305119e-02 0.07913659 0.11337746 0.08065122
## S002 0.07363579 1.110223e-16 3.812708e-02 0.05081372 0.06973408 0.05804485
## S004 0.08305119 3.812708e-02 1.110223e-16 0.03367573 0.05861777 0.06066193
## S234 0.07913659 5.081372e-02 3.367573e-02 0.00000000 0.08507226 0.06827019
## S029 0.11337746 6.973408e-02 5.861777e-02 0.08507226 0.00000000 0.08321810
## S222 0.08065122 5.804485e-02 6.066193e-02 0.06827019 0.08321810 0.00000000
## S239 0.06301588 8.723856e-02 1.069703e-01 0.08996635 0.14668828 0.08441690
## S014 0.11464864 5.165358e-02 4.953422e-02 0.06770550 0.04652370 0.06353737
##            S239       S014
## S009 0.13512098 0.02996010
## S204 0.06634315 0.08786941
## S012 0.14878204 0.05802074
## S207 0.09943422 0.06459770
## S202 0.06501873 0.07768370
## S007 0.10514750 0.04529808
## S022 0.11712758 0.06087452
## S024 0.10179990 0.07338839
## S032 0.10836442 0.07429321
## S212 0.07963463 0.07006958
## S019 0.10832371 0.04707584
## S214 0.08722108 0.04786355
## S037 0.11539870 0.05360877
## S217 0.07183997 0.05813915
## S039 0.12900419 0.08898398
## S034 0.11030617 0.05262955
## S229 0.10094332 0.08210668
## S209 0.09453119 0.08750807
## S227 0.08080740 0.08646861
## S237 0.06456304 0.08624909
## S224 0.07814136 0.11378369
## S017 0.14691770 0.05065709
## S219 0.03449947 0.13141910
## S027 0.11982546 0.05804377
## S232 0.06301588 0.11464864
## S002 0.08723856 0.05165358
## S004 0.10697030 0.04953422
## S234 0.08996635 0.06770550
## S029 0.14668828 0.04652370
## S222 0.08441690 0.06353737
## S239 0.00000000 0.12210227
## S014 0.12210227 0.00000000
## 
## $euclidean
##            S009       S204       S012       S207       S202       S007
## S009 0.00000000 0.07614443 0.03987612 0.04732171 0.06985526 0.03516819
## S204 0.07614443 0.00000000 0.09216480 0.04038070 0.01101451 0.04990062
## S012 0.03987612 0.09216480 0.00000000 0.07239197 0.08904887 0.05962557
## S207 0.04732171 0.04038070 0.07239197 0.00000000 0.03286301 0.02376825
## S202 0.06985526 0.01101451 0.08904887 0.03286301 0.00000000 0.04358572
## S007 0.03516819 0.04990062 0.05962557 0.02376825 0.04358572 0.00000000
## S022 0.04051124 0.04831902 0.06445054 0.01415018 0.04207246 0.02471485
## S024 0.06043407 0.04585675 0.08890649 0.02914647 0.04037127 0.03826373
## S032 0.06862475 0.05582782 0.09302918 0.04520331 0.05246384 0.04638389
## S212 0.06035108 0.02578135 0.07809034 0.02101804 0.02150404 0.03133462
## S019 0.04477967 0.06465656 0.04466815 0.05987907 0.06289440 0.04910302
## S214 0.04713128 0.03813437 0.07174090 0.02860128 0.03107342 0.02445443
## S037 0.04341114 0.05410268 0.06868092 0.02448202 0.04862818 0.02210947
## S217 0.05303415 0.03745809 0.07615079 0.02582991 0.02813692 0.02952097
## S039 0.09224740 0.09318288 0.12136713 0.07412961 0.08842880 0.07479467
## S034 0.04568545 0.05171207 0.06511957 0.03675835 0.04784703 0.02806123
## S229 0.05950205 0.02766851 0.07869317 0.02690699 0.02447807 0.03991545
## S209 0.06966073 0.05586995 0.10071753 0.04034816 0.05038181 0.04659535
## S227 0.06441445 0.02820166 0.07431444 0.03672125 0.02740172 0.04526403
## S237 0.06953749 0.02088683 0.08752247 0.03299717 0.01501684 0.04247605
## S224 0.09125851 0.04922505 0.11851107 0.05149918 0.04649810 0.06505816
## S017 0.03870574 0.08840927 0.02662359 0.06960202 0.08433337 0.05624948
## S219 0.12499943 0.05382420 0.13810880 0.08650620 0.05784785 0.09723440
## S027 0.04243028 0.05013304 0.05693699 0.02935465 0.04644366 0.03067755
## S232 0.09242003 0.03743168 0.09836028 0.06406810 0.04220896 0.07296131
## S002 0.04475733 0.03916976 0.06388829 0.02955466 0.03377610 0.02633060
## S004 0.03955169 0.04268786 0.06013820 0.02144298 0.03798977 0.01545077
## S234 0.06019422 0.03638074 0.08478841 0.02502548 0.03130293 0.03206056
## S029 0.01879059 0.07732967 0.04278828 0.04846699 0.07121787 0.04207522
## S222 0.05511495 0.04398039 0.06398392 0.04980860 0.04212299 0.04673962
## S239 0.10466380 0.04235790 0.12073060 0.06729877 0.04211348 0.07732491
## S014 0.01989101 0.07079592 0.04281266 0.04959870 0.06501989 0.03278485
##            S022       S024       S032       S212       S019       S214
## S009 0.04051124 0.06043407 0.06862475 0.06035108 0.04477967 0.04713128
## S204 0.04831902 0.04585675 0.05582782 0.02578135 0.06465656 0.03813437
## S012 0.06445054 0.08890649 0.09302918 0.07809034 0.04466815 0.07174090
## S207 0.01415018 0.02914647 0.04520331 0.02101804 0.05987907 0.02860128
## S202 0.04207246 0.04037127 0.05246384 0.02150404 0.06289440 0.03107342
## S007 0.02471485 0.03826373 0.04638389 0.03133462 0.04910302 0.02445443
## S022 0.00000000 0.03189303 0.04494469 0.02802947 0.05546988 0.03208774
## S024 0.03189303 0.00000000 0.02586906 0.03460191 0.06963017 0.03583869
## S032 0.04494469 0.02586906 0.00000000 0.04386674 0.07056649 0.04587227
## S212 0.02802947 0.03460191 0.04386674 0.00000000 0.05959720 0.02832528
## S019 0.05546988 0.06963017 0.07056649 0.05959720 0.00000000 0.05001756
## S214 0.03208774 0.03583869 0.04587227 0.02832528 0.05001756 0.00000000
## S037 0.02062511 0.02676523 0.03303393 0.03277444 0.05954779 0.03368018
## S217 0.03305982 0.03859242 0.04879375 0.02580246 0.05644227 0.02152332
## S039 0.07493149 0.05319766 0.04505828 0.07926521 0.10837184 0.07947112
## S034 0.03282630 0.03414480 0.03007106 0.03729960 0.04332032 0.03248718
## S229 0.03116508 0.03534947 0.04778096 0.02557809 0.05434310 0.03629078
## S209 0.04634932 0.02138098 0.03660058 0.04627274 0.08421185 0.04574430
## S227 0.03892440 0.04923568 0.05744724 0.02665295 0.05154277 0.03958306
## S237 0.04226125 0.04246135 0.05278392 0.02252829 0.06396581 0.03422908
## S224 0.05910789 0.03312348 0.04377113 0.04915350 0.09556422 0.05791899
## S017 0.06082787 0.08199905 0.08353243 0.07471636 0.03755230 0.06395107
## S219 0.09478709 0.08636365 0.09072010 0.07016632 0.10916942 0.08186871
## S027 0.01959688 0.03963200 0.04747394 0.03358378 0.04643410 0.03646043
## S232 0.06886079 0.07533396 0.08674178 0.05054778 0.07786125 0.06003057
## S002 0.03143011 0.04092446 0.05436513 0.03050165 0.04671405 0.01878301
## S004 0.01914347 0.03312565 0.03967246 0.02479390 0.04393766 0.02496722
## S234 0.03065389 0.01827089 0.02476203 0.02234960 0.06310107 0.03003640
## S029 0.03827632 0.05988837 0.06787451 0.06161362 0.04626752 0.05107915
## S222 0.05133378 0.06064607 0.06755267 0.04709693 0.02930564 0.04144205
## S239 0.07723285 0.07218199 0.08147766 0.05382911 0.09702481 0.06248954
## S014 0.04469129 0.05991208 0.06419770 0.05709948 0.03574284 0.03920370
##            S037       S217       S039       S034       S229       S209
## S009 0.04341114 0.05303415 0.09224740 0.04568545 0.05950205 0.06966073
## S204 0.05410268 0.03745809 0.09318288 0.05171207 0.02766851 0.05586995
## S012 0.06868092 0.07615079 0.12136713 0.06511957 0.07869317 0.10071753
## S207 0.02448202 0.02582991 0.07412961 0.03675835 0.02690699 0.04034816
## S202 0.04862818 0.02813692 0.08842880 0.04784703 0.02447807 0.05038181
## S007 0.02210947 0.02952097 0.07479467 0.02806123 0.03991545 0.04659535
## S022 0.02062511 0.03305982 0.07493149 0.03282630 0.03116508 0.04634932
## S024 0.02676523 0.03859242 0.05319766 0.03414480 0.03534947 0.02138098
## S032 0.03303393 0.04879375 0.04505828 0.03007106 0.04778096 0.03660058
## S212 0.03277444 0.02580246 0.07926521 0.03729960 0.02557809 0.04627274
## S019 0.05954779 0.05644227 0.10837184 0.04332032 0.05434310 0.08421185
## S214 0.03368018 0.02152332 0.07947112 0.03248718 0.03629078 0.04574430
## S037 0.00000000 0.03704247 0.05926619 0.02535738 0.04113617 0.03677451
## S217 0.03704247 0.00000000 0.08064653 0.03927714 0.03292552 0.04728321
## S039 0.05926619 0.08064653 0.00000000 0.06727763 0.08496682 0.04627652
## S034 0.02535738 0.03927714 0.06727763 0.00000000 0.04030600 0.04930466
## S229 0.04113617 0.03292552 0.08496682 0.04030600 0.00000000 0.05016601
## S209 0.03677451 0.04728321 0.04627652 0.04930466 0.05016601 0.00000000
## S227 0.04881103 0.03319964 0.09702808 0.04518957 0.02294618 0.06392887
## S237 0.04741024 0.02337124 0.08749527 0.04807689 0.02629113 0.05111965
## S224 0.05567153 0.05506513 0.05957358 0.06254547 0.05019606 0.03049917
## S017 0.06484441 0.07014820 0.11355089 0.05524069 0.07510448 0.09622422
## S219 0.09881288 0.07684643 0.12142046 0.09544400 0.07659784 0.09225803
## S027 0.02834116 0.04000230 0.08223326 0.02859319 0.03347057 0.05659973
## S232 0.07873409 0.06044474 0.12365398 0.07737134 0.05559908 0.08548483
## S002 0.03669725 0.02924972 0.08731512 0.03542248 0.03664533 0.05225793
## S004 0.01959792 0.02969927 0.07476755 0.02038286 0.02987901 0.04666405
## S234 0.02548662 0.03066363 0.05965800 0.02902126 0.03051976 0.03062992
## S029 0.04541048 0.05594201 0.09358503 0.04601679 0.05760111 0.07284008
## S222 0.05909886 0.04285857 0.10647558 0.04604737 0.03767177 0.07428047
## S239 0.08149410 0.05589150 0.10985189 0.08274452 0.06443434 0.07535533
## S014 0.04414462 0.04837328 0.09172106 0.03892684 0.05965566 0.06957242
##            S227       S237       S224       S017       S219       S027
## S009 0.06441445 0.06953749 0.09125851 0.03870574 0.12499943 0.04243028
## S204 0.02820166 0.02088683 0.04922505 0.08840927 0.05382420 0.05013304
## S012 0.07431444 0.08752247 0.11851107 0.02662359 0.13810880 0.05693699
## S207 0.03672125 0.03299717 0.05149918 0.06960202 0.08650620 0.02935465
## S202 0.02740172 0.01501684 0.04649810 0.08433337 0.05784785 0.04644366
## S007 0.04526403 0.04247605 0.06505816 0.05624948 0.09723440 0.03067755
## S022 0.03892440 0.04226125 0.05910789 0.06082787 0.09478709 0.01959688
## S024 0.04923568 0.04246135 0.03312348 0.08199905 0.08636365 0.03963200
## S032 0.05744724 0.05278392 0.04377113 0.08353243 0.09072010 0.04747394
## S212 0.02665295 0.02252829 0.04915350 0.07471636 0.07016632 0.03358378
## S019 0.05154277 0.06396581 0.09556422 0.03755230 0.10916942 0.04643410
## S214 0.03958306 0.03422908 0.05791899 0.06395107 0.08186871 0.03646043
## S037 0.04881103 0.04741024 0.05567153 0.06484441 0.09881288 0.02834116
## S217 0.03319964 0.02337124 0.05506513 0.07014820 0.07684643 0.04000230
## S039 0.09702808 0.08749527 0.05957358 0.11355089 0.12142046 0.08223326
## S034 0.04518957 0.04807689 0.06254547 0.05524069 0.09544400 0.02859319
## S229 0.02294618 0.02629113 0.05019606 0.07510448 0.07659784 0.03347057
## S209 0.06392887 0.05111965 0.03049917 0.09622422 0.09225803 0.05659973
## S227 0.00000000 0.02461918 0.06229610 0.07107439 0.06961204 0.03467711
## S237 0.02461918 0.00000000 0.04826932 0.08375604 0.06072188 0.04584217
## S224 0.06229610 0.04826932 0.00000000 0.11263135 0.07186719 0.06706796
## S017 0.07107439 0.08375604 0.11263135 0.00000000 0.13142015 0.05145447
## S219 0.06961204 0.06072188 0.07186719 0.13142015 0.00000000 0.09616725
## S027 0.03467711 0.04584217 0.06706796 0.05145447 0.09616725 0.00000000
## S232 0.04354545 0.04800521 0.07843626 0.09726378 0.05422305 0.06728432
## S002 0.03686871 0.03710749 0.06419488 0.05880660 0.08442917 0.03196299
## S004 0.03532897 0.03764309 0.06032862 0.05624496 0.09146424 0.02070795
## S234 0.04107062 0.03300466 0.03763447 0.07867235 0.07806568 0.03827662
## S029 0.06204432 0.07103876 0.09108850 0.03630774 0.12496079 0.03656332
## S222 0.03536417 0.04414210 0.07968922 0.05865001 0.08766740 0.04628378
## S239 0.05804077 0.04382363 0.06260296 0.11594965 0.03106985 0.08202350
## S014 0.06144097 0.06541761 0.08980579 0.03574294 0.11683479 0.04401088
##            S232       S002       S004       S234       S029       S222
## S009 0.09242003 0.04475733 0.03955169 0.06019422 0.01879059 0.05511495
## S204 0.03743168 0.03916976 0.04268786 0.03638074 0.07732967 0.04398039
## S012 0.09836028 0.06388829 0.06013820 0.08478841 0.04278828 0.06398392
## S207 0.06406810 0.02955466 0.02144298 0.02502548 0.04846699 0.04980860
## S202 0.04220896 0.03377610 0.03798977 0.03130293 0.07121787 0.04212299
## S007 0.07296131 0.02633060 0.01545077 0.03206056 0.04207522 0.04673962
## S022 0.06886079 0.03143011 0.01914347 0.03065389 0.03827632 0.05133378
## S024 0.07533396 0.04092446 0.03312565 0.01827089 0.05988837 0.06064607
## S032 0.08674178 0.05436513 0.03967246 0.02476203 0.06787451 0.06755267
## S212 0.05054778 0.03050165 0.02479390 0.02234960 0.06161362 0.04709693
## S019 0.07786125 0.04671405 0.04393766 0.06310107 0.04626752 0.02930564
## S214 0.06003057 0.01878301 0.02496722 0.03003640 0.05107915 0.04144205
## S037 0.07873409 0.03669725 0.01959792 0.02548662 0.04541048 0.05909886
## S217 0.06044474 0.02924972 0.02969927 0.03066363 0.05594201 0.04285857
## S039 0.12365398 0.08731512 0.07476755 0.05965800 0.09358503 0.10647558
## S034 0.07737134 0.03542248 0.02038286 0.02902126 0.04601679 0.04604737
## S229 0.05559908 0.03664533 0.02987901 0.03051976 0.05760111 0.03767177
## S209 0.08548483 0.05225793 0.04666405 0.03062992 0.07284008 0.07428047
## S227 0.04354545 0.03686871 0.03532897 0.04107062 0.06204432 0.03536417
## S237 0.04800521 0.03710749 0.03764309 0.03300466 0.07103876 0.04414210
## S224 0.07843626 0.06419488 0.06032862 0.03763447 0.09108850 0.07968922
## S017 0.09726378 0.05880660 0.05624496 0.07867235 0.03630774 0.05865001
## S219 0.05422305 0.08442917 0.09146424 0.07806568 0.12496079 0.08766740
## S027 0.06728432 0.03196299 0.02070795 0.03827662 0.03656332 0.04628378
## S232 0.00000000 0.05435467 0.06661444 0.06774882 0.09232320 0.05941361
## S002 0.05435467 0.00000000 0.02546628 0.03731153 0.04838511 0.03752150
## S004 0.06661444 0.02546628 0.00000000 0.02582125 0.04168668 0.04126987
## S234 0.06774882 0.03731153 0.02582125 0.00000000 0.06163458 0.05336681
## S029 0.09232320 0.04838511 0.04168668 0.06163458 0.00000000 0.05645617
## S222 0.05941361 0.03752150 0.04126987 0.05336681 0.05645617 0.00000000
## S239 0.04477203 0.06500204 0.07502560 0.06388591 0.10702142 0.07532772
## S014 0.08672090 0.03881228 0.03700468 0.05656314 0.03071273 0.04825717
##            S239       S014
## S009 0.10466380 0.01989101
## S204 0.04235790 0.07079592
## S012 0.12073060 0.04281266
## S207 0.06729877 0.04959870
## S202 0.04211348 0.06501989
## S007 0.07732491 0.03278485
## S022 0.07723285 0.04469129
## S024 0.07218199 0.05991208
## S032 0.08147766 0.06419770
## S212 0.05382911 0.05709948
## S019 0.09702481 0.03574284
## S214 0.06248954 0.03920370
## S037 0.08149410 0.04414462
## S217 0.05589150 0.04837328
## S039 0.10985189 0.09172106
## S034 0.08274452 0.03892684
## S229 0.06443434 0.05965566
## S209 0.07535533 0.06957242
## S227 0.05804077 0.06144097
## S237 0.04382363 0.06541761
## S224 0.06260296 0.08980579
## S017 0.11594965 0.03574294
## S219 0.03106985 0.11683479
## S027 0.08202350 0.04401088
## S232 0.04477203 0.08672090
## S002 0.06500204 0.03881228
## S004 0.07502560 0.03700468
## S234 0.06388591 0.05656314
## S029 0.10702142 0.03071273
## S222 0.07532772 0.04825717
## S239 0.00000000 0.09744551
## S014 0.09744551 0.00000000
## 
## $`shannon-variance`
##         S009         S204         S012         S207         S202         S007 
## 3.318093e-05 9.739966e-07 4.167779e-05 1.055216e-05 6.818609e-06 2.150507e-05 
##         S022         S024         S032         S212         S019         S214 
## 2.800908e-05 2.764796e-05 1.696256e-06 5.855113e-07 7.885394e-06 3.554132e-05 
##         S037         S217         S039         S034         S229         S209 
## 3.149517e-05 3.712570e-05 6.882621e-05 5.163717e-05 2.371551e-05 2.122497e-05 
##         S227         S237         S224         S017         S219         S027 
## 3.541908e-05 1.302558e-05 3.006024e-05 9.061946e-05 4.250792e-06 4.832651e-05 
##         S232         S002         S004         S234         S029         S222 
## 4.090644e-05 3.002703e-05 2.988659e-05 2.454442e-05 1.108819e-05 1.216628e-05 
##         S239         S014 
## 1.918315e-05 6.290249e-05 
## 
## $`simpson-variance`
##         S009         S204         S012         S207         S202         S007 
## 1.278827e-06 1.145207e-07 1.498411e-06 1.017672e-06 2.232140e-07 1.133255e-06 
##         S022         S024         S032         S212         S019         S214 
## 1.139317e-06 1.213242e-06 2.025094e-07 1.776045e-07 4.167155e-07 1.325430e-06 
##         S037         S217         S039         S034         S229         S209 
## 1.567855e-06 2.168037e-06 3.485434e-06 2.039366e-06 1.057407e-06 1.330335e-06 
##         S227         S237         S224         S017         S219         S027 
## 8.987932e-07 4.636159e-07 1.156205e-06 4.383736e-06 2.688483e-07 2.342666e-06 
##         S232         S002         S004         S234         S029         S222 
## 2.036694e-06 9.245796e-07 3.789973e-06 2.344151e-06 1.219747e-06 3.928370e-07 
##         S239         S014 
## 6.457246e-07 2.998053e-06 
## 
## $`bray-curtis-variance`
##              S009         S204         S012         S207         S202
## S009 0.000000e+00 3.132798e-06 3.270767e-06 6.519241e-06 4.478991e-06
## S204 3.132798e-06 0.000000e+00 1.027574e-05 2.796795e-06 7.993523e-07
## S012 3.270767e-06 1.027574e-05 0.000000e+00 1.232570e-05 3.798449e-06
## S207 6.519241e-06 2.796795e-06 1.232570e-05 3.697785e-33 1.257050e-06
## S202 4.478991e-06 7.993523e-07 3.798449e-06 1.257050e-06 2.465190e-33
## S007 2.874170e-06 3.672059e-06 6.031215e-06 7.419307e-06 3.855593e-06
## S022 6.373194e-06 1.209461e-05 1.315374e-05 4.401007e-06 9.784239e-06
## S024 5.330822e-06 5.873455e-06 1.031575e-05 6.532676e-06 3.756801e-06
## S032 7.022261e-06 7.167029e-06 1.865546e-06 1.637985e-05 7.490831e-06
## S212 2.957887e-06 1.997964e-06 6.279474e-06 2.396243e-06 8.108974e-07
## S019 7.994986e-06 7.380840e-06 1.648734e-05 7.172910e-06 1.868537e-05
## S214 1.203568e-06 5.050459e-06 4.810577e-06 1.718490e-06 6.815041e-06
## S037 8.782561e-06 1.641612e-05 1.262582e-05 4.368847e-05 2.821312e-05
## S217 4.263090e-06 5.697711e-06 5.653286e-06 6.030306e-06 2.965306e-06
## S039 4.056082e-05 4.721310e-06 1.914056e-05 8.095026e-07 9.422799e-06
## S034 4.969306e-06 2.745276e-06 3.661720e-06 6.706299e-06 4.880960e-06
## S229 4.289240e-06 4.369589e-06 1.046441e-05 1.123910e-05 1.447195e-06
## S209 7.209406e-06 1.070646e-05 3.730882e-06 1.585047e-05 1.277733e-05
## S227 2.571405e-06 7.440083e-06 1.547399e-06 8.990484e-06 1.347965e-06
## S237 2.125380e-06 3.945605e-06 5.478932e-06 1.647537e-06 1.939142e-06
## S224 2.087004e-06 3.251306e-06 7.453575e-06 2.354680e-06 2.056361e-06
## S017 1.034590e-05 5.988951e-06 6.532868e-06 7.961045e-06 4.083074e-06
## S219 2.695316e-06 8.141548e-07 1.106623e-05 1.857669e-06 7.160661e-07
## S027 7.992417e-06 2.053994e-06 2.614996e-05 1.161436e-05 7.235752e-07
## S232 3.363912e-06 1.354724e-06 1.234721e-05 2.498760e-07 3.147167e-06
## S002 8.285991e-07 5.943575e-06 4.994711e-06 4.225724e-06 1.016777e-05
## S004 7.189411e-06 1.070087e-05 1.135249e-05 2.898579e-05 9.128553e-06
## S234 2.825216e-06 9.693587e-06 1.548646e-06 1.600019e-05 7.659430e-06
## S029 8.428725e-06 8.680794e-06 1.387569e-05 7.792501e-06 1.007378e-05
## S222 2.378929e-06 6.931639e-06 2.816260e-06 1.565219e-05 3.250449e-06
## S239 6.800870e-06 5.912538e-06 2.353818e-06 8.786702e-06 6.219311e-06
## S014 5.118557e-06 3.214875e-06 8.090181e-06 4.289241e-06 4.590320e-06
##              S007         S022         S024         S032         S212
## S009 2.874170e-06 6.373194e-06 5.330822e-06 7.022261e-06 2.957887e-06
## S204 3.672059e-06 1.209461e-05 5.873455e-06 7.167029e-06 1.997964e-06
## S012 6.031215e-06 1.315374e-05 1.031575e-05 1.865546e-06 6.279474e-06
## S207 7.419307e-06 4.401007e-06 6.532676e-06 1.637985e-05 2.396243e-06
## S202 3.855593e-06 9.784239e-06 3.756801e-06 7.490831e-06 8.108974e-07
## S007 2.465190e-33 1.966898e-05 2.779109e-06 6.806907e-06 1.911630e-06
## S022 1.966898e-05 2.465190e-33 1.828582e-05 3.776786e-06 4.719771e-06
## S024 2.779109e-06 1.828582e-05 3.697785e-33 9.513261e-06 1.625419e-06
## S032 6.806907e-06 3.776786e-06 9.513261e-06 2.465190e-33 3.604816e-06
## S212 1.911630e-06 4.719771e-06 1.625419e-06 3.604816e-06 0.000000e+00
## S019 7.405787e-06 9.166640e-06 6.438005e-06 1.117729e-06 1.722658e-06
## S214 1.009901e-06 5.370000e-06 1.408262e-05 2.135902e-06 4.197946e-06
## S037 9.015930e-06 2.748406e-05 1.454370e-05 1.273531e-05 2.299415e-05
## S217 1.561585e-05 7.317365e-06 1.008058e-05 8.046079e-06 5.873077e-06
## S039 1.206699e-05 1.136433e-05 1.612962e-05 1.712957e-05 2.895907e-06
## S034 4.485141e-06 3.492793e-06 2.130721e-05 5.883766e-06 3.533697e-06
## S229 3.327247e-06 7.916081e-06 6.759374e-06 2.475337e-06 5.435625e-07
## S209 4.574354e-06 2.363952e-05 3.889194e-06 6.768117e-06 5.757665e-06
## S227 4.123011e-06 2.077810e-06 3.513859e-06 8.768324e-06 1.023855e-07
## S237 5.694503e-06 6.214400e-06 8.441898e-07 2.797743e-06 2.624367e-06
## S224 4.862160e-07 8.850688e-06 4.238058e-06 2.001164e-06 1.417436e-06
## S017 1.529410e-05 9.444127e-06 4.009654e-06 1.338783e-06 6.130176e-06
## S219 3.435692e-06 3.435692e-06 1.647585e-06 5.573845e-07 2.806830e-06
## S027 1.001904e-05 1.866597e-06 8.117922e-06 2.763021e-05 1.925999e-06
## S232 3.243690e-06 1.029693e-05 5.039279e-06 9.542393e-06 2.294771e-06
## S002 8.154884e-06 4.747022e-06 1.743202e-06 1.499294e-05 6.535942e-06
## S004 7.828858e-06 1.986923e-05 5.975433e-06 1.302086e-05 4.352564e-06
## S234 3.035461e-06 1.333467e-05 4.140511e-06 1.494274e-05 7.860535e-06
## S029 2.642959e-05 7.427385e-06 2.706273e-05 2.662823e-05 3.945007e-06
## S222 1.220422e-05 6.314486e-06 1.362752e-06 3.774632e-06 3.569237e-06
## S239 1.210311e-05 1.456739e-05 7.620425e-06 5.374893e-06 6.081364e-06
## S014 9.984766e-07 1.089530e-05 7.580295e-06 1.392257e-05 3.383708e-06
##              S019         S214         S037         S217         S039
## S009 7.994986e-06 1.203568e-06 8.782561e-06 4.263090e-06 4.056082e-05
## S204 7.380840e-06 5.050459e-06 1.641612e-05 5.697711e-06 4.721310e-06
## S012 1.648734e-05 4.810577e-06 1.262582e-05 5.653286e-06 1.914056e-05
## S207 7.172910e-06 1.718490e-06 4.368847e-05 6.030306e-06 8.095026e-07
## S202 1.868537e-05 6.815041e-06 2.821312e-05 2.965306e-06 9.422799e-06
## S007 7.405787e-06 1.009901e-06 9.015930e-06 1.561585e-05 1.206699e-05
## S022 9.166640e-06 5.370000e-06 2.748406e-05 7.317365e-06 1.136433e-05
## S024 6.438005e-06 1.408262e-05 1.454370e-05 1.008058e-05 1.612962e-05
## S032 1.117729e-06 2.135902e-06 1.273531e-05 8.046079e-06 1.712957e-05
## S212 1.722658e-06 4.197946e-06 2.299415e-05 5.873077e-06 2.895907e-06
## S019 3.697785e-33 3.123379e-06 1.122388e-06 6.836364e-06 1.366393e-05
## S214 3.123379e-06 2.465190e-33 8.664891e-06 8.209650e-06 6.085256e-06
## S037 1.122388e-06 8.664891e-06 0.000000e+00 3.596447e-05 1.823868e-05
## S217 6.836364e-06 8.209650e-06 3.596447e-05 0.000000e+00 1.591975e-05
## S039 1.366393e-05 6.085256e-06 1.823868e-05 1.591975e-05 0.000000e+00
## S034 7.405335e-06 2.340302e-06 6.461742e-06 1.273282e-05 5.728655e-06
## S229 5.787889e-06 5.481564e-06 1.011968e-05 6.589152e-06 2.750264e-06
## S209 1.017139e-05 3.559802e-06 1.950322e-05 1.240390e-05 1.839726e-05
## S227 1.165236e-05 1.093287e-06 1.998303e-05 5.788830e-06 4.664623e-06
## S237 1.777043e-05 2.214097e-06 3.111458e-05 2.803888e-06 1.504744e-05
## S224 5.969937e-06 6.644169e-06 1.348073e-05 8.767134e-06 2.333295e-05
## S017 1.078336e-05 2.772743e-06 4.692431e-06 7.749791e-06 9.501257e-06
## S219 5.775401e-06 5.428359e-06 2.815949e-05 8.582384e-06 3.433783e-05
## S027 7.826168e-06 6.396091e-06 5.954898e-06 9.147866e-06 6.804065e-06
## S232 3.591955e-06 1.284606e-05 2.979224e-05 4.736594e-06 6.452639e-06
## S002 2.043358e-06 7.321185e-06 1.410467e-05 1.211793e-05 6.523369e-06
## S004 9.755784e-06 9.826511e-06 1.485651e-05 1.310589e-06 1.177240e-05
## S234 1.931232e-06 3.082959e-06 2.323720e-05 2.513322e-06 2.907287e-06
## S029 6.996444e-06 2.258905e-05 2.244468e-05 6.383381e-06 1.405489e-05
## S222 9.843370e-06 9.942044e-06 3.755038e-06 2.414058e-06 1.094396e-05
## S239 8.363968e-06 3.063572e-06 4.281583e-05 4.899098e-06 2.651328e-05
## S014 5.713317e-06 3.447326e-06 8.539033e-06 8.618618e-06 3.013953e-06
##              S034         S229         S209         S227         S237
## S009 4.969306e-06 4.289240e-06 7.209406e-06 2.571405e-06 2.125380e-06
## S204 2.745276e-06 4.369589e-06 1.070646e-05 7.440083e-06 3.945605e-06
## S012 3.661720e-06 1.046441e-05 3.730882e-06 1.547399e-06 5.478932e-06
## S207 6.706299e-06 1.123910e-05 1.585047e-05 8.990484e-06 1.647537e-06
## S202 4.880960e-06 1.447195e-06 1.277733e-05 1.347965e-06 1.939142e-06
## S007 4.485141e-06 3.327247e-06 4.574354e-06 4.123011e-06 5.694503e-06
## S022 3.492793e-06 7.916081e-06 2.363952e-05 2.077810e-06 6.214400e-06
## S024 2.130721e-05 6.759374e-06 3.889194e-06 3.513859e-06 8.441898e-07
## S032 5.883766e-06 2.475337e-06 6.768117e-06 8.768324e-06 2.797743e-06
## S212 3.533697e-06 5.435625e-07 5.757665e-06 1.023855e-07 2.624367e-06
## S019 7.405335e-06 5.787889e-06 1.017139e-05 1.165236e-05 1.777043e-05
## S214 2.340302e-06 5.481564e-06 3.559802e-06 1.093287e-06 2.214097e-06
## S037 6.461742e-06 1.011968e-05 1.950322e-05 1.998303e-05 3.111458e-05
## S217 1.273282e-05 6.589152e-06 1.240390e-05 5.788830e-06 2.803888e-06
## S039 5.728655e-06 2.750264e-06 1.839726e-05 4.664623e-06 1.504744e-05
## S034 0.000000e+00 3.972247e-06 1.593693e-05 5.461857e-06 2.423516e-06
## S229 3.972247e-06 2.465190e-33 1.243607e-05 3.909464e-06 1.951399e-06
## S209 1.593693e-05 1.243607e-05 2.465190e-33 1.115331e-05 1.518809e-05
## S227 5.461857e-06 3.909464e-06 1.115331e-05 3.697785e-33 6.176700e-06
## S237 2.423516e-06 1.951399e-06 1.518809e-05 6.176700e-06 0.000000e+00
## S224 8.016216e-06 7.516268e-06 4.775914e-06 3.399928e-06 7.615419e-06
## S017 7.970810e-06 2.395405e-06 8.747510e-06 2.526366e-06 1.299892e-06
## S219 3.702624e-06 7.459922e-07 5.534236e-06 3.982657e-06 3.242470e-06
## S027 5.055809e-06 3.838833e-06 1.531154e-05 7.275173e-06 4.587869e-06
## S232 2.605595e-06 6.453995e-06 8.170965e-06 4.613880e-06 4.636639e-06
## S002 4.554605e-06 4.513914e-06 4.499177e-06 1.020576e-05 1.173372e-05
## S004 8.235090e-06 7.453271e-06 6.655911e-06 1.201475e-05 9.280247e-06
## S234 5.483861e-06 5.844178e-06 8.890686e-06 3.151693e-06 7.764708e-06
## S029 3.755735e-05 1.776951e-05 1.297120e-05 1.498420e-05 8.768816e-06
## S222 1.489497e-05 1.077231e-06 8.471064e-06 3.089988e-06 1.013037e-06
## S239 2.055559e-06 7.203059e-06 1.419541e-05 7.534972e-06 7.148061e-06
## S014 6.660399e-06 3.697195e-06 7.251139e-07 6.719373e-06 4.717139e-06
##              S224         S017         S219         S027         S232
## S009 2.087004e-06 1.034590e-05 2.695316e-06 7.992417e-06 3.363912e-06
## S204 3.251306e-06 5.988951e-06 8.141548e-07 2.053994e-06 1.354724e-06
## S012 7.453575e-06 6.532868e-06 1.106623e-05 2.614996e-05 1.234721e-05
## S207 2.354680e-06 7.961045e-06 1.857669e-06 1.161436e-05 2.498760e-07
## S202 2.056361e-06 4.083074e-06 7.160661e-07 7.235752e-07 3.147167e-06
## S007 4.862160e-07 1.529410e-05 3.435692e-06 1.001904e-05 3.243690e-06
## S022 8.850688e-06 9.444127e-06 3.435692e-06 1.866597e-06 1.029693e-05
## S024 4.238058e-06 4.009654e-06 1.647585e-06 8.117922e-06 5.039279e-06
## S032 2.001164e-06 1.338783e-06 5.573845e-07 2.763021e-05 9.542393e-06
## S212 1.417436e-06 6.130176e-06 2.806830e-06 1.925999e-06 2.294771e-06
## S019 5.969937e-06 1.078336e-05 5.775401e-06 7.826168e-06 3.591955e-06
## S214 6.644169e-06 2.772743e-06 5.428359e-06 6.396091e-06 1.284606e-05
## S037 1.348073e-05 4.692431e-06 2.815949e-05 5.954898e-06 2.979224e-05
## S217 8.767134e-06 7.749791e-06 8.582384e-06 9.147866e-06 4.736594e-06
## S039 2.333295e-05 9.501257e-06 3.433783e-05 6.804065e-06 6.452639e-06
## S034 8.016216e-06 7.970810e-06 3.702624e-06 5.055809e-06 2.605595e-06
## S229 7.516268e-06 2.395405e-06 7.459922e-07 3.838833e-06 6.453995e-06
## S209 4.775914e-06 8.747510e-06 5.534236e-06 1.531154e-05 8.170965e-06
## S227 3.399928e-06 2.526366e-06 3.982657e-06 7.275173e-06 4.613880e-06
## S237 7.615419e-06 1.299892e-06 3.242470e-06 4.587869e-06 4.636639e-06
## S224 0.000000e+00 4.755504e-07 2.393716e-06 2.412835e-06 7.421253e-06
## S017 4.755504e-07 2.465190e-33 4.056237e-06 9.909587e-06 2.002157e-06
## S219 2.393716e-06 4.056237e-06 0.000000e+00 8.569259e-06 9.929951e-06
## S027 2.412835e-06 9.909587e-06 8.569259e-06 0.000000e+00 4.469855e-06
## S232 7.421253e-06 2.002157e-06 9.929951e-06 4.469855e-06 0.000000e+00
## S002 1.941192e-05 6.273098e-06 6.885344e-06 9.569952e-06 1.326143e-05
## S004 1.675494e-05 1.665796e-05 1.785166e-05 7.272732e-06 8.695690e-06
## S234 1.290037e-05 4.968012e-06 2.123978e-05 8.399659e-06 6.469747e-06
## S029 1.958191e-05 2.200336e-05 1.381938e-05 9.193263e-06 7.622010e-06
## S222 1.175525e-05 3.430692e-06 4.700657e-06 1.385849e-05 2.254161e-06
## S239 2.668235e-06 5.710306e-06 8.024126e-06 3.875227e-06 3.863177e-06
## S014 1.508945e-06 2.090088e-06 2.588783e-06 8.172050e-06 5.182364e-06
##              S002         S004         S234         S029         S222
## S009 8.285991e-07 7.189411e-06 2.825216e-06 8.428725e-06 2.378929e-06
## S204 5.943575e-06 1.070087e-05 9.693587e-06 8.680794e-06 6.931639e-06
## S012 4.994711e-06 1.135249e-05 1.548646e-06 1.387569e-05 2.816260e-06
## S207 4.225724e-06 2.898579e-05 1.600019e-05 7.792501e-06 1.565219e-05
## S202 1.016777e-05 9.128553e-06 7.659430e-06 1.007378e-05 3.250449e-06
## S007 8.154884e-06 7.828858e-06 3.035461e-06 2.642959e-05 1.220422e-05
## S022 4.747022e-06 1.986923e-05 1.333467e-05 7.427385e-06 6.314486e-06
## S024 1.743202e-06 5.975433e-06 4.140511e-06 2.706273e-05 1.362752e-06
## S032 1.499294e-05 1.302086e-05 1.494274e-05 2.662823e-05 3.774632e-06
## S212 6.535942e-06 4.352564e-06 7.860535e-06 3.945007e-06 3.569237e-06
## S019 2.043358e-06 9.755784e-06 1.931232e-06 6.996444e-06 9.843370e-06
## S214 7.321185e-06 9.826511e-06 3.082959e-06 2.258905e-05 9.942044e-06
## S037 1.410467e-05 1.485651e-05 2.323720e-05 2.244468e-05 3.755038e-06
## S217 1.211793e-05 1.310589e-06 2.513322e-06 6.383381e-06 2.414058e-06
## S039 6.523369e-06 1.177240e-05 2.907287e-06 1.405489e-05 1.094396e-05
## S034 4.554605e-06 8.235090e-06 5.483861e-06 3.755735e-05 1.489497e-05
## S229 4.513914e-06 7.453271e-06 5.844178e-06 1.776951e-05 1.077231e-06
## S209 4.499177e-06 6.655911e-06 8.890686e-06 1.297120e-05 8.471064e-06
## S227 1.020576e-05 1.201475e-05 3.151693e-06 1.498420e-05 3.089988e-06
## S237 1.173372e-05 9.280247e-06 7.764708e-06 8.768816e-06 1.013037e-06
## S224 1.941192e-05 1.675494e-05 1.290037e-05 1.958191e-05 1.175525e-05
## S017 6.273098e-06 1.665796e-05 4.968012e-06 2.200336e-05 3.430692e-06
## S219 6.885344e-06 1.785166e-05 2.123978e-05 1.381938e-05 4.700657e-06
## S027 9.569952e-06 7.272732e-06 8.399659e-06 9.193263e-06 1.385849e-05
## S232 1.326143e-05 8.695690e-06 6.469747e-06 7.622010e-06 2.254161e-06
## S002 2.465190e-33 1.192430e-06 1.324335e-05 2.667544e-05 9.785518e-06
## S004 1.192430e-06 2.465190e-33 1.086558e-05 1.023817e-05 1.008786e-05
## S234 1.324335e-05 1.086558e-05 0.000000e+00 1.598883e-05 1.292784e-05
## S029 2.667544e-05 1.023817e-05 1.598883e-05 2.465190e-33 9.716358e-06
## S222 9.785518e-06 1.008786e-05 1.292784e-05 9.716358e-06 2.465190e-33
## S239 6.987727e-06 7.218127e-06 6.396222e-06 2.763257e-06 1.562834e-06
## S014 1.710721e-06 3.579284e-06 8.073935e-06 1.642006e-05 1.469172e-06
##              S239         S014
## S009 6.800870e-06 5.118557e-06
## S204 5.912538e-06 3.214875e-06
## S012 2.353818e-06 8.090181e-06
## S207 8.786702e-06 4.289241e-06
## S202 6.219311e-06 4.590320e-06
## S007 1.210311e-05 9.984766e-07
## S022 1.456739e-05 1.089530e-05
## S024 7.620425e-06 7.580295e-06
## S032 5.374893e-06 1.392257e-05
## S212 6.081364e-06 3.383708e-06
## S019 8.363968e-06 5.713317e-06
## S214 3.063572e-06 3.447326e-06
## S037 4.281583e-05 8.539033e-06
## S217 4.899098e-06 8.618618e-06
## S039 2.651328e-05 3.013953e-06
## S034 2.055559e-06 6.660399e-06
## S229 7.203059e-06 3.697195e-06
## S209 1.419541e-05 7.251139e-07
## S227 7.534972e-06 6.719373e-06
## S237 7.148061e-06 4.717139e-06
## S224 2.668235e-06 1.508945e-06
## S017 5.710306e-06 2.090088e-06
## S219 8.024126e-06 2.588783e-06
## S027 3.875227e-06 8.172050e-06
## S232 3.863177e-06 5.182364e-06
## S002 6.987727e-06 1.710721e-06
## S004 7.218127e-06 3.579284e-06
## S234 6.396222e-06 8.073935e-06
## S029 2.763257e-06 1.642006e-05
## S222 1.562834e-06 1.469172e-06
## S239 2.465190e-33 6.750320e-06
## S014 6.750320e-06 0.000000e+00
## 
## $`euclidean-variance`
##              S009         S204         S012         S207         S202
## S009 0.000000e+00 3.311917e-06 1.776886e-06 6.677749e-06 2.564385e-06
## S204 3.311917e-06 0.000000e+00 6.495742e-06 1.521792e-06 2.802418e-07
## S012 1.776886e-06 6.495742e-06 0.000000e+00 7.943954e-06 3.108136e-06
## S207 6.677749e-06 1.521792e-06 7.943954e-06 0.000000e+00 6.828706e-07
## S202 2.564385e-06 2.802418e-07 3.108136e-06 6.828706e-07 0.000000e+00
## S007 3.905064e-06 1.995705e-06 3.648571e-06 2.579747e-06 1.476534e-06
## S022 2.639678e-06 6.426826e-06 6.509921e-06 3.217949e-06 4.482079e-06
## S024 1.064156e-05 3.604346e-06 8.608141e-06 6.548867e-06 3.075832e-06
## S032 3.776169e-06 4.002975e-06 2.899108e-06 8.447475e-06 2.710790e-06
## S212 4.350685e-06 9.678285e-07 4.094914e-06 7.884905e-07 9.721107e-07
## S019 5.850304e-06 4.260339e-06 7.511605e-06 3.047396e-06 7.420774e-06
## S214 5.256388e-07 5.478531e-06 1.464708e-06 1.556592e-07 2.717717e-06
## S037 1.063553e-05 1.657233e-05 6.309005e-06 1.231498e-05 2.205149e-05
## S217 7.690325e-06 5.966871e-06 4.380464e-06 1.759765e-06 5.704573e-06
## S039 9.550867e-06 6.730724e-06 9.825117e-06 2.286231e-06 1.429431e-05
## S034 3.245161e-06 8.697073e-07 2.332449e-06 4.925695e-06 2.317128e-06
## S229 4.117149e-06 1.359147e-06 6.127251e-06 2.153181e-06 3.977769e-07
## S209 3.887305e-06 7.282980e-06 3.793469e-06 5.376320e-06 6.141775e-06
## S227 2.121005e-06 2.563707e-06 2.477711e-06 3.199721e-06 7.776199e-07
## S237 3.042966e-06 1.597255e-06 5.338645e-06 2.543517e-06 6.164837e-07
## S224 1.942104e-06 3.386722e-06 2.301800e-06 2.908909e-06 4.346776e-06
## S017 7.014046e-06 7.894007e-06 1.020729e-06 8.319509e-06 2.697441e-06
## S219 1.598735e-06 2.016283e-06 6.569473e-06 6.466995e-07 1.243782e-06
## S027 1.017363e-05 8.736406e-07 1.973797e-05 5.365409e-06 1.112165e-06
## S232 4.916913e-06 6.992035e-07 1.426155e-05 1.051566e-06 4.127782e-07
## S002 2.448057e-06 7.353081e-06 2.813181e-06 5.323589e-06 4.134009e-06
## S004 1.218474e-05 1.105903e-05 7.314157e-06 1.550763e-05 1.027245e-05
## S234 7.629380e-06 6.298894e-06 9.519910e-07 6.305134e-06 5.262310e-06
## S029 3.838865e-06 8.507567e-06 8.781743e-06 4.416775e-06 1.144901e-05
## S222 2.035492e-06 2.918855e-06 2.104954e-06 1.151671e-05 3.884178e-07
## S239 3.815508e-06 2.130538e-06 5.020125e-07 4.442060e-06 2.222235e-06
## S014 2.751426e-06 2.966798e-06 2.198833e-06 1.078452e-06 3.784317e-06
##              S007         S022         S024         S032         S212
## S009 3.905064e-06 2.639678e-06 1.064156e-05 3.776169e-06 4.350685e-06
## S204 1.995705e-06 6.426826e-06 3.604346e-06 4.002975e-06 9.678285e-07
## S012 3.648571e-06 6.509921e-06 8.608141e-06 2.899108e-06 4.094914e-06
## S207 2.579747e-06 3.217949e-06 6.548867e-06 8.447475e-06 7.884905e-07
## S202 1.476534e-06 4.482079e-06 3.075832e-06 2.710790e-06 9.721107e-07
## S007 0.000000e+00 7.131556e-06 1.605341e-06 6.869514e-06 1.227480e-06
## S022 7.131556e-06 0.000000e+00 1.036267e-05 1.831566e-06 5.160189e-06
## S024 1.605341e-06 1.036267e-05 0.000000e+00 3.940984e-06 1.916832e-06
## S032 6.869514e-06 1.831566e-06 3.940984e-06 0.000000e+00 4.260138e-06
## S212 1.227480e-06 5.160189e-06 1.916832e-06 4.260138e-06 0.000000e+00
## S019 3.469562e-06 6.388060e-06 1.380405e-05 6.304690e-06 3.035368e-06
## S214 6.527850e-07 1.843981e-06 1.044078e-05 3.431417e-06 2.321803e-06
## S037 2.531325e-06 9.601592e-06 9.361235e-06 1.138308e-05 2.393413e-05
## S217 5.782052e-06 2.248868e-06 4.305337e-06 2.058394e-06 2.894856e-06
## S039 1.744229e-05 1.049931e-05 1.577916e-05 1.843524e-05 1.196413e-05
## S034 4.462601e-06 9.391466e-07 9.001544e-06 6.848438e-06 3.427748e-06
## S229 5.008823e-06 9.794852e-06 5.414210e-06 1.652415e-06 2.674430e-07
## S209 2.431191e-06 1.218104e-05 2.053734e-06 5.111576e-06 5.173019e-06
## S227 9.524171e-07 3.583568e-06 3.251290e-06 3.443889e-06 9.265956e-08
## S237 1.308745e-06 1.911267e-06 2.355492e-06 2.193743e-06 9.404116e-07
## S224 6.006757e-07 5.541238e-06 3.601918e-06 9.775090e-07 1.850401e-06
## S017 1.164058e-05 6.915538e-06 8.465775e-06 2.181449e-06 6.453192e-06
## S219 7.572954e-07 5.204456e-06 6.901263e-07 9.741787e-08 8.059106e-07
## S027 6.595121e-06 1.826546e-06 6.944975e-06 1.118581e-05 1.327908e-06
## S232 3.996893e-06 6.795980e-06 2.204726e-06 2.586929e-06 4.310075e-07
## S002 2.572204e-06 2.321185e-06 2.323027e-06 6.466687e-06 2.820169e-06
## S004 1.027631e-05 6.676162e-06 1.644911e-06 4.613813e-06 3.775147e-06
## S234 5.272726e-06 6.197341e-06 4.115768e-06 7.190609e-06 2.125390e-06
## S029 8.244425e-06 1.247373e-05 2.097650e-05 1.049212e-05 6.141267e-06
## S222 5.806686e-06 2.492282e-06 1.743576e-06 1.814854e-06 1.434532e-06
## S239 5.525836e-06 8.618904e-06 3.648310e-06 2.964921e-06 2.889498e-06
## S014 3.443435e-06 8.397080e-06 1.079285e-05 6.836751e-06 4.671506e-06
##              S019         S214         S037         S217         S039
## S009 5.850304e-06 5.256388e-07 1.063553e-05 7.690325e-06 9.550867e-06
## S204 4.260339e-06 5.478531e-06 1.657233e-05 5.966871e-06 6.730724e-06
## S012 7.511605e-06 1.464708e-06 6.309005e-06 4.380464e-06 9.825117e-06
## S207 3.047396e-06 1.556592e-07 1.231498e-05 1.759765e-06 2.286231e-06
## S202 7.420774e-06 2.717717e-06 2.205149e-05 5.704573e-06 1.429431e-05
## S007 3.469562e-06 6.527850e-07 2.531325e-06 5.782052e-06 1.744229e-05
## S022 6.388060e-06 1.843981e-06 9.601592e-06 2.248868e-06 1.049931e-05
## S024 1.380405e-05 1.044078e-05 9.361235e-06 4.305337e-06 1.577916e-05
## S032 6.304690e-06 3.431417e-06 1.138308e-05 2.058394e-06 1.843524e-05
## S212 3.035368e-06 2.321803e-06 2.393413e-05 2.894856e-06 1.196413e-05
## S019 0.000000e+00 1.320889e-06 3.365582e-06 9.636218e-06 2.564556e-06
## S214 1.320889e-06 0.000000e+00 6.168650e-06 4.032402e-06 4.867985e-06
## S037 3.365582e-06 6.168650e-06 0.000000e+00 7.775234e-06 1.713647e-05
## S217 9.636218e-06 4.032402e-06 7.775234e-06 0.000000e+00 1.928531e-05
## S039 2.564556e-06 4.867985e-06 1.713647e-05 1.928531e-05 0.000000e+00
## S034 2.858818e-06 2.202147e-06 4.694417e-06 4.542223e-06 8.438828e-06
## S229 5.834832e-06 3.024815e-06 9.519642e-06 6.162702e-06 1.174283e-05
## S209 5.919860e-06 3.367542e-06 4.890212e-06 7.968906e-06 5.696486e-06
## S227 7.792259e-06 4.310711e-07 1.177899e-05 5.238052e-06 5.451930e-06
## S237 7.041303e-06 1.198412e-06 2.114232e-05 5.316433e-06 1.485033e-05
## S224 4.014718e-06 3.541783e-06 1.328174e-05 9.378611e-06 1.376201e-05
## S017 6.668210e-06 1.056622e-06 7.861115e-06 3.905272e-06 5.895882e-06
## S219 5.533023e-06 3.988819e-06 2.839138e-05 1.191094e-05 3.155286e-05
## S027 5.446810e-06 1.301925e-06 2.691357e-06 1.027022e-07 1.040233e-05
## S232 4.922722e-06 5.428090e-06 1.857309e-05 9.312891e-06 1.011812e-05
## S002 1.734522e-06 3.488401e-06 9.887656e-06 3.115147e-06 1.389082e-05
## S004 8.252101e-06 4.476677e-06 1.009250e-05 5.132836e-07 1.785104e-05
## S234 4.370765e-06 2.563800e-06 2.314123e-05 1.637837e-06 6.915245e-06
## S029 5.611285e-06 1.070116e-05 1.707865e-05 9.596736e-06 1.573596e-06
## S222 5.308197e-06 5.331573e-06 3.325798e-06 2.302797e-06 1.570878e-05
## S239 4.614589e-06 3.343339e-06 2.151633e-05 2.381661e-06 2.033874e-05
## S014 6.796675e-06 2.421789e-06 9.099073e-06 1.124749e-05 8.027302e-06
##              S034         S229         S209         S227         S237
## S009 3.245161e-06 4.117149e-06 3.887305e-06 2.121005e-06 3.042966e-06
## S204 8.697073e-07 1.359147e-06 7.282980e-06 2.563707e-06 1.597255e-06
## S012 2.332449e-06 6.127251e-06 3.793469e-06 2.477711e-06 5.338645e-06
## S207 4.925695e-06 2.153181e-06 5.376320e-06 3.199721e-06 2.543517e-06
## S202 2.317128e-06 3.977769e-07 6.141775e-06 7.776199e-07 6.164837e-07
## S007 4.462601e-06 5.008823e-06 2.431191e-06 9.524171e-07 1.308745e-06
## S022 9.391466e-07 9.794852e-06 1.218104e-05 3.583568e-06 1.911267e-06
## S024 9.001544e-06 5.414210e-06 2.053734e-06 3.251290e-06 2.355492e-06
## S032 6.848438e-06 1.652415e-06 5.111576e-06 3.443889e-06 2.193743e-06
## S212 3.427748e-06 2.674430e-07 5.173019e-06 9.265956e-08 9.404116e-07
## S019 2.858818e-06 5.834832e-06 5.919860e-06 7.792259e-06 7.041303e-06
## S214 2.202147e-06 3.024815e-06 3.367542e-06 4.310711e-07 1.198412e-06
## S037 4.694417e-06 9.519642e-06 4.890212e-06 1.177899e-05 2.114232e-05
## S217 4.542223e-06 6.162702e-06 7.968906e-06 5.238052e-06 5.316433e-06
## S039 8.438828e-06 1.174283e-05 5.696486e-06 5.451930e-06 1.485033e-05
## S034 0.000000e+00 1.852093e-06 7.291311e-06 2.862578e-06 2.610967e-06
## S229 1.852093e-06 0.000000e+00 6.963759e-06 8.571041e-07 5.775454e-07
## S209 7.291311e-06 6.963759e-06 0.000000e+00 4.262374e-06 1.045047e-05
## S227 2.862578e-06 8.571041e-07 4.262374e-06 0.000000e+00 2.719403e-06
## S237 2.610967e-06 5.775454e-07 1.045047e-05 2.719403e-06 0.000000e+00
## S224 5.108557e-07 8.137283e-06 3.285815e-06 3.313561e-06 6.214393e-06
## S017 6.419389e-06 3.629588e-06 3.969564e-06 4.495932e-07 3.505282e-06
## S219 2.413489e-06 7.392102e-07 4.019103e-06 5.180994e-06 1.171046e-06
## S027 1.957827e-06 2.679440e-07 1.097308e-05 4.788816e-06 2.855424e-06
## S232 1.096974e-06 1.389533e-06 3.810012e-06 1.910719e-06 2.031234e-06
## S002 3.181351e-06 4.038636e-06 4.772888e-06 4.581655e-06 7.165426e-06
## S004 3.310467e-06 6.159769e-06 3.831195e-06 1.040292e-05 7.251508e-06
## S234 5.699754e-06 3.521759e-06 1.281238e-05 3.322027e-06 2.507398e-06
## S029 1.145681e-05 8.482942e-06 6.833148e-06 1.570969e-05 6.773862e-06
## S222 5.411999e-06 2.067838e-06 4.260602e-06 2.943339e-06 4.510317e-06
## S239 3.557593e-06 3.547440e-06 8.667410e-06 3.425144e-06 2.664776e-06
## S014 1.368255e-06 2.719874e-06 9.635730e-07 4.397566e-06 2.823807e-06
##              S224         S017         S219         S027         S232
## S009 1.942104e-06 7.014046e-06 1.598735e-06 1.017363e-05 4.916913e-06
## S204 3.386722e-06 7.894007e-06 2.016283e-06 8.736406e-07 6.992035e-07
## S012 2.301800e-06 1.020729e-06 6.569473e-06 1.973797e-05 1.426155e-05
## S207 2.908909e-06 8.319509e-06 6.466995e-07 5.365409e-06 1.051566e-06
## S202 4.346776e-06 2.697441e-06 1.243782e-06 1.112165e-06 4.127782e-07
## S007 6.006757e-07 1.164058e-05 7.572954e-07 6.595121e-06 3.996893e-06
## S022 5.541238e-06 6.915538e-06 5.204456e-06 1.826546e-06 6.795980e-06
## S024 3.601918e-06 8.465775e-06 6.901263e-07 6.944975e-06 2.204726e-06
## S032 9.775090e-07 2.181449e-06 9.741787e-08 1.118581e-05 2.586929e-06
## S212 1.850401e-06 6.453192e-06 8.059106e-07 1.327908e-06 4.310075e-07
## S019 4.014718e-06 6.668210e-06 5.533023e-06 5.446810e-06 4.922722e-06
## S214 3.541783e-06 1.056622e-06 3.988819e-06 1.301925e-06 5.428090e-06
## S037 1.328174e-05 7.861115e-06 2.839138e-05 2.691357e-06 1.857309e-05
## S217 9.378611e-06 3.905272e-06 1.191094e-05 1.027022e-07 9.312891e-06
## S039 1.376201e-05 5.895882e-06 3.155286e-05 1.040233e-05 1.011812e-05
## S034 5.108557e-07 6.419389e-06 2.413489e-06 1.957827e-06 1.096974e-06
## S229 8.137283e-06 3.629588e-06 7.392102e-07 2.679440e-07 1.389533e-06
## S209 3.285815e-06 3.969564e-06 4.019103e-06 1.097308e-05 3.810012e-06
## S227 3.313561e-06 4.495932e-07 5.180994e-06 4.788816e-06 1.910719e-06
## S237 6.214393e-06 3.505282e-06 1.171046e-06 2.855424e-06 2.031234e-06
## S224 0.000000e+00 5.198608e-06 4.263587e-06 8.111494e-06 4.183013e-06
## S017 5.198608e-06 0.000000e+00 7.671436e-06 1.457087e-05 8.936583e-06
## S219 4.263587e-06 7.671436e-06 0.000000e+00 5.019755e-06 1.016655e-05
## S027 8.111494e-06 1.457087e-05 5.019755e-06 0.000000e+00 3.835257e-06
## S232 4.183013e-06 8.936583e-06 1.016655e-05 3.835257e-06 0.000000e+00
## S002 6.317696e-06 1.511308e-06 7.446433e-06 1.688096e-06 8.481598e-06
## S004 4.447051e-06 1.380539e-05 1.196487e-05 2.062112e-06 1.170066e-05
## S234 4.165135e-06 1.353131e-06 1.545235e-05 3.932843e-06 7.661714e-06
## S029 1.018493e-05 4.649619e-06 1.091422e-05 1.008747e-05 8.696378e-06
## S222 6.645521e-06 3.439375e-06 5.147309e-06 7.485764e-06 7.247032e-07
## S239 1.021195e-06 5.830536e-06 8.130759e-06 4.600485e-06 2.557347e-06
## S014 7.210445e-07 6.459967e-07 1.471097e-06 6.302645e-06 6.125874e-06
##              S002         S004         S234         S029         S222
## S009 2.448057e-06 1.218474e-05 7.629380e-06 3.838865e-06 2.035492e-06
## S204 7.353081e-06 1.105903e-05 6.298894e-06 8.507567e-06 2.918855e-06
## S012 2.813181e-06 7.314157e-06 9.519910e-07 8.781743e-06 2.104954e-06
## S207 5.323589e-06 1.550763e-05 6.305134e-06 4.416775e-06 1.151671e-05
## S202 4.134009e-06 1.027245e-05 5.262310e-06 1.144901e-05 3.884178e-07
## S007 2.572204e-06 1.027631e-05 5.272726e-06 8.244425e-06 5.806686e-06
## S022 2.321185e-06 6.676162e-06 6.197341e-06 1.247373e-05 2.492282e-06
## S024 2.323027e-06 1.644911e-06 4.115768e-06 2.097650e-05 1.743576e-06
## S032 6.466687e-06 4.613813e-06 7.190609e-06 1.049212e-05 1.814854e-06
## S212 2.820169e-06 3.775147e-06 2.125390e-06 6.141267e-06 1.434532e-06
## S019 1.734522e-06 8.252101e-06 4.370765e-06 5.611285e-06 5.308197e-06
## S214 3.488401e-06 4.476677e-06 2.563800e-06 1.070116e-05 5.331573e-06
## S037 9.887656e-06 1.009250e-05 2.314123e-05 1.707865e-05 3.325798e-06
## S217 3.115147e-06 5.132836e-07 1.637837e-06 9.596736e-06 2.302797e-06
## S039 1.389082e-05 1.785104e-05 6.915245e-06 1.573596e-06 1.570878e-05
## S034 3.181351e-06 3.310467e-06 5.699754e-06 1.145681e-05 5.411999e-06
## S229 4.038636e-06 6.159769e-06 3.521759e-06 8.482942e-06 2.067838e-06
## S209 4.772888e-06 3.831195e-06 1.281238e-05 6.833148e-06 4.260602e-06
## S227 4.581655e-06 1.040292e-05 3.322027e-06 1.570969e-05 2.943339e-06
## S237 7.165426e-06 7.251508e-06 2.507398e-06 6.773862e-06 4.510317e-06
## S224 6.317696e-06 4.447051e-06 4.165135e-06 1.018493e-05 6.645521e-06
## S017 1.511308e-06 1.380539e-05 1.353131e-06 4.649619e-06 3.439375e-06
## S219 7.446433e-06 1.196487e-05 1.545235e-05 1.091422e-05 5.147309e-06
## S027 1.688096e-06 2.062112e-06 3.932843e-06 1.008747e-05 7.485764e-06
## S232 8.481598e-06 1.170066e-05 7.661714e-06 8.696378e-06 7.247032e-07
## S002 0.000000e+00 3.179341e-06 2.846448e-06 1.005792e-05 4.463875e-06
## S004 3.179341e-06 0.000000e+00 4.753447e-06 1.715571e-06 4.511055e-06
## S234 2.846448e-06 4.753447e-06 0.000000e+00 9.353271e-06 3.945072e-06
## S029 1.005792e-05 1.715571e-06 9.353271e-06 0.000000e+00 5.441832e-06
## S222 4.463875e-06 4.511055e-06 3.945072e-06 5.441832e-06 0.000000e+00
## S239 3.699729e-06 4.043180e-06 3.765773e-06 7.122740e-06 3.666271e-06
## S014 4.907339e-06 2.709880e-06 8.158133e-06 2.208718e-06 2.530998e-06
##              S239         S014
## S009 3.815508e-06 2.751426e-06
## S204 2.130538e-06 2.966798e-06
## S012 5.020125e-07 2.198833e-06
## S207 4.442060e-06 1.078452e-06
## S202 2.222235e-06 3.784317e-06
## S007 5.525836e-06 3.443435e-06
## S022 8.618904e-06 8.397080e-06
## S024 3.648310e-06 1.079285e-05
## S032 2.964921e-06 6.836751e-06
## S212 2.889498e-06 4.671506e-06
## S019 4.614589e-06 6.796675e-06
## S214 3.343339e-06 2.421789e-06
## S037 2.151633e-05 9.099073e-06
## S217 2.381661e-06 1.124749e-05
## S039 2.033874e-05 8.027302e-06
## S034 3.557593e-06 1.368255e-06
## S229 3.547440e-06 2.719874e-06
## S209 8.667410e-06 9.635730e-07
## S227 3.425144e-06 4.397566e-06
## S237 2.664776e-06 2.823807e-06
## S224 1.021195e-06 7.210445e-07
## S017 5.830536e-06 6.459967e-07
## S219 8.130759e-06 1.471097e-06
## S027 4.600485e-06 6.302645e-06
## S232 2.557347e-06 6.125874e-06
## S002 3.699729e-06 4.907339e-06
## S004 4.043180e-06 2.709880e-06
## S234 3.765773e-06 8.158133e-06
## S029 7.122740e-06 2.208718e-06
## S222 3.666271e-06 2.530998e-06
## S239 0.000000e+00 6.957372e-06
## S014 6.957372e-06 0.000000e+00
## 
## $X
##    (Intercept) xxS004 xxS007 xxS009 xxS012 xxS014 xxS017 xxS019 xxS022 xxS024
## 1            1      0      0      1      0      0      0      0      0      0
## 2            1      0      0      0      0      0      0      0      0      0
## 3            1      0      0      0      1      0      0      0      0      0
## 4            1      0      0      0      0      0      0      0      0      0
## 5            1      0      0      0      0      0      0      0      0      0
## 6            1      0      1      0      0      0      0      0      0      0
## 7            1      0      0      0      0      0      0      0      1      0
## 8            1      0      0      0      0      0      0      0      0      1
## 9            1      0      0      0      0      0      0      0      0      0
## 10           1      0      0      0      0      0      0      0      0      0
## 11           1      0      0      0      0      0      0      1      0      0
## 12           1      0      0      0      0      0      0      0      0      0
## 13           1      0      0      0      0      0      0      0      0      0
## 14           1      0      0      0      0      0      0      0      0      0
## 15           1      0      0      0      0      0      0      0      0      0
## 16           1      0      0      0      0      0      0      0      0      0
## 17           1      0      0      0      0      0      0      0      0      0
## 18           1      0      0      0      0      0      0      0      0      0
## 19           1      0      0      0      0      0      0      0      0      0
## 20           1      0      0      0      0      0      0      0      0      0
## 21           1      0      0      0      0      0      0      0      0      0
## 22           1      0      0      0      0      0      1      0      0      0
## 23           1      0      0      0      0      0      0      0      0      0
## 24           1      0      0      0      0      0      0      0      0      0
## 25           1      0      0      0      0      0      0      0      0      0
## 26           1      0      0      0      0      0      0      0      0      0
## 27           1      1      0      0      0      0      0      0      0      0
## 28           1      0      0      0      0      0      0      0      0      0
## 29           1      0      0      0      0      0      0      0      0      0
## 30           1      0      0      0      0      0      0      0      0      0
## 31           1      0      0      0      0      0      0      0      0      0
## 32           1      0      0      0      0      1      0      0      0      0
##    xxS027 xxS029 xxS032 xxS034 xxS037 xxS039 xxS202 xxS204 xxS207 xxS209 xxS212
## 1       0      0      0      0      0      0      0      0      0      0      0
## 2       0      0      0      0      0      0      0      1      0      0      0
## 3       0      0      0      0      0      0      0      0      0      0      0
## 4       0      0      0      0      0      0      0      0      1      0      0
## 5       0      0      0      0      0      0      1      0      0      0      0
## 6       0      0      0      0      0      0      0      0      0      0      0
## 7       0      0      0      0      0      0      0      0      0      0      0
## 8       0      0      0      0      0      0      0      0      0      0      0
## 9       0      0      1      0      0      0      0      0      0      0      0
## 10      0      0      0      0      0      0      0      0      0      0      1
## 11      0      0      0      0      0      0      0      0      0      0      0
## 12      0      0      0      0      0      0      0      0      0      0      0
## 13      0      0      0      0      1      0      0      0      0      0      0
## 14      0      0      0      0      0      0      0      0      0      0      0
## 15      0      0      0      0      0      1      0      0      0      0      0
## 16      0      0      0      1      0      0      0      0      0      0      0
## 17      0      0      0      0      0      0      0      0      0      0      0
## 18      0      0      0      0      0      0      0      0      0      1      0
## 19      0      0      0      0      0      0      0      0      0      0      0
## 20      0      0      0      0      0      0      0      0      0      0      0
## 21      0      0      0      0      0      0      0      0      0      0      0
## 22      0      0      0      0      0      0      0      0      0      0      0
## 23      0      0      0      0      0      0      0      0      0      0      0
## 24      1      0      0      0      0      0      0      0      0      0      0
## 25      0      0      0      0      0      0      0      0      0      0      0
## 26      0      0      0      0      0      0      0      0      0      0      0
## 27      0      0      0      0      0      0      0      0      0      0      0
## 28      0      0      0      0      0      0      0      0      0      0      0
## 29      0      1      0      0      0      0      0      0      0      0      0
## 30      0      0      0      0      0      0      0      0      0      0      0
## 31      0      0      0      0      0      0      0      0      0      0      0
## 32      0      0      0      0      0      0      0      0      0      0      0
##    xxS214 xxS217 xxS219 xxS222 xxS224 xxS227 xxS229 xxS232 xxS234 xxS237 xxS239
## 1       0      0      0      0      0      0      0      0      0      0      0
## 2       0      0      0      0      0      0      0      0      0      0      0
## 3       0      0      0      0      0      0      0      0      0      0      0
## 4       0      0      0      0      0      0      0      0      0      0      0
## 5       0      0      0      0      0      0      0      0      0      0      0
## 6       0      0      0      0      0      0      0      0      0      0      0
## 7       0      0      0      0      0      0      0      0      0      0      0
## 8       0      0      0      0      0      0      0      0      0      0      0
## 9       0      0      0      0      0      0      0      0      0      0      0
## 10      0      0      0      0      0      0      0      0      0      0      0
## 11      0      0      0      0      0      0      0      0      0      0      0
## 12      1      0      0      0      0      0      0      0      0      0      0
## 13      0      0      0      0      0      0      0      0      0      0      0
## 14      0      1      0      0      0      0      0      0      0      0      0
## 15      0      0      0      0      0      0      0      0      0      0      0
## 16      0      0      0      0      0      0      0      0      0      0      0
## 17      0      0      0      0      0      0      1      0      0      0      0
## 18      0      0      0      0      0      0      0      0      0      0      0
## 19      0      0      0      0      0      1      0      0      0      0      0
## 20      0      0      0      0      0      0      0      0      0      1      0
## 21      0      0      0      0      1      0      0      0      0      0      0
## 22      0      0      0      0      0      0      0      0      0      0      0
## 23      0      0      1      0      0      0      0      0      0      0      0
## 24      0      0      0      0      0      0      0      0      0      0      0
## 25      0      0      0      0      0      0      0      1      0      0      0
## 26      0      0      0      0      0      0      0      0      0      0      0
## 27      0      0      0      0      0      0      0      0      0      0      0
## 28      0      0      0      0      0      0      0      0      1      0      0
## 29      0      0      0      0      0      0      0      0      0      0      0
## 30      0      0      0      1      0      0      0      0      0      0      0
## 31      0      0      0      0      0      0      0      0      0      0      1
## 32      0      0      0      0      0      0      0      0      0      0      0
## attr(,"assign")
##  [1] 0 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
## attr(,"contrasts")
## attr(,"contrasts")$xx
## [1] "contr.treatment"
## 
## 
## $fitted_z
##            [,1]      [,2]       [,3]       [,4]         [,5]       [,6]
##  [1,] 0.3069772 0.2424165 0.03198894 0.12092804 3.362537e-05 0.05650183
##  [2,] 0.3619395 0.1975531 0.03608583 0.11580520 7.465324e-04 0.07189879
##  [3,] 0.3129618 0.2599778 0.03469152 0.09617992 1.604603e-04 0.04419077
##  [4,] 0.3283354 0.2037088 0.03426420 0.12566794 2.494703e-04 0.06702073
##  [5,] 0.3543266 0.1977404 0.03627736 0.11761705 7.827621e-04 0.07230695
##  [6,] 0.3210470 0.2152639 0.04331691 0.12213257 3.169530e-04 0.06069650
##  [7,] 0.3262410 0.2098106 0.02906999 0.12626256 7.524587e-05 0.06049768
##  [8,] 0.3358736 0.1998799 0.03378829 0.14925893 1.230156e-04 0.06343505
##  [9,] 0.3409425 0.1973619 0.03509614 0.15401573 2.378392e-04 0.04518944
## [10,] 0.3434245 0.1976351 0.03660926 0.11877975 8.123194e-04 0.06563321
## [11,] 0.3438294 0.2486121 0.03466806 0.10736084 6.609612e-04 0.04070744
## [12,] 0.3356578 0.2121173 0.03678630 0.12070699 5.991660e-04 0.06840479
## [13,] 0.3222974 0.2086717 0.03448341 0.13702915 2.261207e-04 0.05769847
## [14,] 0.3344311 0.2047050 0.03600740 0.11886420 4.575526e-04 0.06654406
## [15,] 0.3165953 0.1843812 0.04318418 0.18697621 1.996187e-04 0.05043700
## [16,] 0.3370168 0.2181138 0.03983973 0.13412084 1.339601e-04 0.04391212
## [17,] 0.3480819 0.2074322 0.02906534 0.12476278 2.633184e-04 0.05968551
## [18,] 0.3269617 0.1942405 0.03773505 0.15786283 4.977045e-04 0.07506289
## [19,] 0.3549311 0.2086976 0.02869165 0.10982810 3.415672e-04 0.05886342
## [20,] 0.3487295 0.1956142 0.03563435 0.11616934 1.004984e-03 0.06794714
## [21,] 0.3497517 0.1768936 0.03338324 0.15788507 2.783097e-04 0.07461482
## [22,] 0.3203109 0.2537004 0.03811161 0.10249799 1.507878e-04 0.03479428
## [23,] 0.3953477 0.1641059 0.04041143 0.10754736 1.373689e-03 0.08138483
## [24,] 0.3337390 0.2174508 0.02941662 0.12201912 1.813602e-06 0.05092593
## [25,] 0.3747435 0.2016430 0.02883300 0.09060090 4.956473e-04 0.08798594
## [26,] 0.3371073 0.2190100 0.04028465 0.11568254 3.219552e-04 0.07145394
## [27,] 0.3318709 0.2150687 0.03530111 0.12413549 3.793099e-04 0.05580913
## [28,] 0.3404797 0.1978011 0.03718466 0.13821835 2.908839e-04 0.06024530
## [29,] 0.3124303 0.2406743 0.02416185 0.12304087 1.287487e-04 0.04931077
## [30,] 0.3531397 0.2334969 0.03892123 0.10750182 6.702678e-04 0.05448973
## [31,] 0.3687192 0.1738431 0.04163651 0.10555459 1.248705e-03 0.09220906
## [32,] 0.3174421 0.2417811 0.03642109 0.11757114 3.337982e-04 0.05533632
##             [,7]         [,8]       [,9]       [,10]      [,11]       [,12]
##  [1,] 0.05951690 0.0012665556 0.05083035 0.018426703 0.06452708 0.012060299
##  [2,] 0.05414677 0.0044380065 0.03978760 0.009329081 0.07037484 0.014456986
##  [3,] 0.07852928 0.0007702096 0.05535881 0.013061471 0.06418413 0.007060254
##  [4,] 0.06412471 0.0041867621 0.04482873 0.016898900 0.07220538 0.010076430
##  [5,] 0.05149336 0.0079515115 0.04060227 0.012512931 0.06929416 0.012664978
##  [6,] 0.05932304 0.0023771477 0.05314246 0.012281930 0.06560928 0.013444091
##  [7,] 0.07040505 0.0012540978 0.04630129 0.018059008 0.06817275 0.011788519
##  [8,] 0.05945754 0.0015992029 0.04258390 0.013716240 0.06050317 0.012117037
##  [9,] 0.05745302 0.0016351443 0.05763140 0.010167625 0.05810708 0.015578466
## [10,] 0.06481540 0.0044787338 0.05047357 0.010368049 0.06912948 0.012579973
## [11,] 0.05226778 0.0028512053 0.05007753 0.013426585 0.06435948 0.013180345
## [12,] 0.04864479 0.0041442317 0.05095408 0.013256549 0.05543534 0.017712846
## [13,] 0.06892913 0.0012436639 0.05547495 0.011833651 0.06237163 0.012700447
## [14,] 0.05047004 0.0206495456 0.04955493 0.012453387 0.06361970 0.011558175
## [15,] 0.05862137 0.0013973311 0.06327914 0.008117828 0.05416321 0.010247095
## [16,] 0.06012129 0.0010448887 0.05516476 0.013154881 0.05733492 0.012190368
## [17,] 0.06008676 0.0070594416 0.03334113 0.013190999 0.07736546 0.014031110
## [18,] 0.05473242 0.0038006527 0.04441636 0.008038682 0.06147405 0.013453104
## [19,] 0.06731721 0.0160251963 0.03952218 0.009635043 0.06949470 0.011385575
## [20,] 0.05459278 0.0192139321 0.04098291 0.010611950 0.06995711 0.011327362
## [21,] 0.05488266 0.0081823040 0.03732133 0.008057065 0.06518012 0.012176048
## [22,] 0.06864613 0.0014701808 0.05499984 0.018999259 0.05130554 0.009951993
## [23,] 0.04797921 0.0197061929 0.04365833 0.009391037 0.05798216 0.009640799
## [24,] 0.07678789 0.0014508813 0.04280100 0.015089166 0.06061057 0.012985388
## [25,] 0.06619455 0.0035208048 0.03930996 0.010562414 0.06142608 0.009297659
## [26,] 0.05859585 0.0019719758 0.04459080 0.017546560 0.05418909 0.009739146
## [27,] 0.06339533 0.0011379297 0.05138385 0.012567802 0.06670797 0.012390790
## [28,] 0.05677085 0.0023270715 0.05232679 0.010326380 0.06679018 0.010891988
## [29,] 0.06643435 0.0013304036 0.04501914 0.020814379 0.06227147 0.011029475
## [30,] 0.04635511 0.0097341169 0.03707800 0.011683987 0.07080466 0.008424048
## [31,] 0.04702155 0.0218133147 0.04721666 0.010379860 0.05829891 0.007999516
## [32,] 0.05095986 0.0015948135 0.05978696 0.016356111 0.05604101 0.011571670
##             [,13]        [,14]        [,15]       [,16]        [,17]
##  [1,] 0.014324407 5.492144e-04 0.0020287306 0.008327883 5.043805e-04
##  [2,] 0.001395243 2.831675e-04 0.0007877204 0.013530257 1.338610e-04
##  [3,] 0.008696950 2.888286e-04 0.0038189558 0.009659712 3.851048e-04
##  [4,] 0.011660024 1.626980e-04 0.0018764504 0.008438603 1.518515e-04
##  [5,] 0.006160732 1.858356e-04 0.0011375392 0.012253887 1.520473e-04
##  [6,] 0.007474809 1.056510e-04 0.0020601947 0.015742000 7.923826e-05
##  [7,] 0.014723108 3.260654e-04 0.0015550812 0.007750324 2.759015e-04
##  [8,] 0.007914004 3.690468e-04 0.0011686482 0.010415321 3.690468e-04
##  [9,] 0.004295970 1.932443e-04 0.0018878484 0.012546016 3.716237e-04
## [10,] 0.006465623 2.634549e-04 0.0023052307 0.010340606 9.330695e-05
## [11,] 0.005819051 2.073604e-04 0.0034473664 0.011327061 1.296002e-04
## [12,] 0.011296776 4.993050e-05 0.0041941623 0.013406340 8.737838e-05
## [13,] 0.005728391 7.537357e-05 0.0025627014 0.011268349 1.130604e-04
## [14,] 0.011816792 2.586167e-04 0.0018302102 0.010344666 1.790423e-04
## [15,] 0.002661583 1.330792e-04 0.0025950435 0.010912490 6.653958e-05
## [16,] 0.005813868 2.947122e-04 0.0024380736 0.013235257 1.339601e-06
## [17,] 0.007397994 4.012471e-04 0.0002131625 0.010169107 1.253897e-04
## [18,] 0.001462950 1.357376e-04 0.0006334421 0.013302285 4.524587e-05
## [19,] 0.007315232 1.992476e-04 0.0004554230 0.010887456 3.557992e-04
## [20,] 0.002929784 1.533027e-04 0.0014137911 0.016062711 1.192354e-04
## [21,] 0.002963998 2.365632e-04 0.0002643942 0.011549851 9.740838e-05
## [22,] 0.021487257 4.146664e-04 0.0053152690 0.009575024 1.884847e-04
## [23,] 0.002422688 2.497616e-05 0.0025225925 0.009640799 2.872259e-04
## [24,] 0.012912844 2.539042e-04 0.0011969771 0.013239292 1.813602e-03
## [25,] 0.004922290 5.469211e-04 0.0013331203 0.011382796 1.880041e-04
## [26,] 0.007344604 8.048881e-05 0.0013683097 0.013139798 1.609776e-04
## [27,] 0.005664361 7.586198e-05 0.0016183889 0.014868948 2.275859e-04
## [28,] 0.005494474 3.716850e-04 0.0025048339 0.010714225 1.454420e-04
## [29,] 0.024676841 4.291624e-04 0.0009870736 0.009098244 3.433300e-04
## [30,] 0.008012747 1.980337e-04 0.0003960674 0.012186688 7.616680e-05
## [31,] 0.004487533 3.902203e-05 0.0006633745 0.009170177 3.902203e-05
## [32,] 0.011682936 4.450642e-04 0.0033379818 0.011905468 2.967095e-04
##              [,18]        [,19]        [,20]        [,21]        [,22]
##  [1,] 0.0005492144 4.371298e-04 4.035044e-04 5.716313e-04 5.380059e-04
##  [2,] 0.0005097014 4.170285e-04 7.104929e-04 3.089100e-05 1.508510e-03
##  [3,] 0.0013157747 4.171969e-04 7.702096e-04 2.888286e-04 3.530127e-04
##  [4,] 0.0002277772 6.074059e-04 3.687822e-04 2.169307e-05 1.149733e-03
##  [5,] 0.0002252553 5.237185e-04 3.209888e-04 6.194520e-05 1.616207e-03
##  [6,] 0.0006339060 2.113020e-04 5.546678e-04 1.320638e-06 7.131443e-04
##  [7,] 0.0008527865 2.508196e-04 2.006556e-04 7.524587e-05 3.009835e-04
##  [8,] 0.0008816118 1.845234e-04 1.640208e-04 5.330676e-04 3.690468e-04
##  [9,] 0.0009216268 2.527041e-04 5.797330e-04 4.459484e-05 8.324371e-04
## [10,] 0.0003896938 3.622505e-04 7.684102e-04 4.939780e-05 9.824673e-04
## [11,] 0.0005443210 2.980806e-04 9.331217e-04 1.296002e-04 5.702411e-04
## [12,] 0.0003744788 4.368919e-04 7.489575e-04 1.248263e-05 1.572811e-03
## [13,] 0.0012813507 1.884339e-04 3.391811e-04 7.537357e-05 7.914225e-04
## [14,] 0.0004376590 5.371269e-04 2.586167e-04 9.946795e-07 1.312977e-03
## [15,] 0.0011311728 3.992375e-04 6.653958e-04 3.326979e-06 9.315541e-04
## [16,] 0.0009109286 2.679202e-04 5.358404e-04 1.339601e-06 5.358404e-04
## [17,] 0.0003385523 9.278840e-04 1.003118e-04 1.755456e-04 6.896435e-04
## [18,] 0.0003619669 2.563932e-04 2.714752e-04 6.032782e-05 1.478032e-03
## [19,] 0.0002419435 5.977427e-04 2.846394e-04 7.115984e-07 7.542943e-04
## [20,] 0.0004599080 5.110088e-04 4.599080e-04 1.703363e-05 2.333607e-03
## [21,] 0.0005566193 4.870419e-04 9.740838e-05 6.957741e-05 1.335886e-03
## [22,] 0.0004900603 7.539389e-05 4.146664e-04 2.261817e-04 3.392725e-04
## [23,] 0.0004870352 7.118207e-04 1.123927e-03 1.248808e-05 1.835748e-03
## [24,] 0.0004352644 3.989924e-04 3.989924e-04 3.627203e-04 5.078085e-04
## [25,] 0.0002905519 8.203817e-04 3.589170e-04 1.709129e-05 8.887468e-04
## [26,] 0.0012475765 1.810998e-04 1.408554e-04 2.414664e-04 5.835439e-04
## [27,] 0.0013655157 2.528733e-04 3.540226e-04 1.770113e-04 4.551719e-04
## [28,] 0.0005979281 3.878453e-04 5.494474e-04 3.232044e-05 8.403314e-04
## [29,] 0.0004720787 5.149949e-04 1.287487e-04 3.862462e-04 4.291624e-05
## [30,] 0.0001675670 4.570008e-04 1.828003e-04 1.523336e-05 1.401469e-03
## [31,] 0.0005853304 8.584847e-04 7.414186e-04 1.951101e-06 2.107190e-03
## [32,] 0.0007046850 5.563303e-04 5.563303e-04 2.225321e-04 3.337982e-04
##              [,23]        [,24]        [,25]       [,26]        [,27]
##  [1,] 5.604228e-05 3.138368e-04 2.353776e-04 0.004573050 5.492144e-04
##  [2,] 3.089100e-05 1.390095e-04 1.493065e-04 0.002878011 5.457409e-04
##  [3,] 2.246445e-04 2.246445e-04 2.567365e-04 0.005391467 1.925524e-04
##  [4,] 1.952376e-04 2.711634e-04 1.410049e-04 0.001887297 8.134901e-04
##  [5,] 3.941967e-05 2.590436e-04 1.182590e-04 0.002207502 8.278132e-04
##  [6,] 5.282550e-05 1.848893e-04 7.923826e-05 0.002614862 3.961913e-04
##  [7,] 2.508196e-05 3.511474e-04 1.504917e-04 0.004414424 3.260654e-04
##  [8,] 4.100520e-05 4.100520e-04 2.460312e-04 0.003669966 2.255286e-04
##  [9,] 1.040546e-04 1.189196e-04 2.081093e-04 0.003255424 4.608134e-04
## [10,] 1.427048e-04 7.135238e-05 7.135238e-05 0.001981401 5.927736e-04
## [11,] 1.036802e-04 1.944004e-04 6.480012e-05 0.003330726 4.017607e-04
## [12,] 1.123436e-04 1.872394e-04 3.744788e-05 0.002097081 5.492355e-04
## [13,] 1.884339e-06 7.537357e-05 3.391811e-04 0.003467184 3.768679e-04
## [14,] 1.392551e-04 2.387231e-04 5.968077e-05 0.001869997 1.193615e-03
## [15,] 3.326979e-06 1.996187e-04 3.326979e-06 0.001929648 6.653958e-05
## [16,] 8.037605e-05 2.679202e-05 1.607521e-04 0.002679202 4.286723e-04
## [17,] 6.269486e-07 4.890199e-04 2.131625e-04 0.003109665 8.526501e-04
## [18,] 3.016391e-05 2.865572e-04 9.049173e-05 0.001945572 7.691797e-04
## [19,] 8.539181e-05 1.992476e-04 3.131033e-04 0.002319811 6.262066e-04
## [20,] 6.813451e-05 1.362690e-04 3.406726e-05 0.002248439 7.835469e-04
## [21,] 6.957741e-07 2.365632e-04 1.391548e-05 0.002240393 9.323374e-04
## [22,] 4.523633e-04 2.261817e-04 7.539389e-05 0.004561330 4.900603e-04
## [23,] 2.497616e-05 1.248808e-05 8.741657e-05 0.001348713 6.368922e-04
## [24,] 3.627203e-05 2.176322e-04 3.627203e-04 0.002865491 9.430729e-04
## [25,] 3.418257e-05 1.025477e-04 3.418257e-05 0.002597875 1.572398e-03
## [26,] 1.609776e-04 2.012220e-04 1.810998e-04 0.003702485 3.823218e-04
## [27,] 2.528733e-05 3.034479e-04 1.264366e-04 0.003489651 5.563212e-04
## [28,] 6.464088e-05 3.555248e-04 1.616022e-04 0.002892679 7.756905e-04
## [29,] 8.583249e-05 4.291624e-04 1.287487e-04 0.004377457 6.437437e-04
## [30,] 3.046672e-05 2.894338e-04 3.046672e-05 0.002909572 1.142502e-03
## [31,] 3.902203e-05 1.170661e-04 7.804406e-05 0.001326749 3.590027e-03
## [32,] 7.417737e-05 1.112661e-04 1.483547e-04 0.003375070 6.675964e-04
##              [,28]        [,29]        [,30]        [,31]        [,32]
##  [1,] 1.120846e-04 3.138368e-04 2.241691e-05 5.604228e-07 3.362537e-05
##  [2,] 1.647520e-04 1.750490e-04 5.148499e-06 2.574250e-07 2.574250e-07
##  [3,] 9.627620e-05 2.567365e-04 6.418413e-05 1.604603e-06 1.604603e-06
##  [4,] 9.761881e-05 2.386237e-04 1.084653e-05 5.423267e-07 5.423267e-07
##  [5,] 1.407846e-04 1.351532e-04 2.815691e-07 2.815691e-07 2.815691e-07
##  [6,] 2.641275e-05 7.923826e-05 2.641275e-05 1.320638e-06 1.320638e-06
##  [7,] 5.016391e-05 1.755737e-04 1.254098e-06 2.508196e-05 1.254098e-06
##  [8,] 2.050260e-04 2.665338e-04 1.025130e-06 1.025130e-06 2.050260e-05
##  [9,] 1.337845e-04 3.270289e-04 1.486495e-05 7.432474e-07 7.432474e-07
## [10,] 1.646593e-04 1.866139e-04 2.744322e-07 2.744322e-07 2.744322e-07
## [11,] 1.944004e-04 2.462405e-04 6.480012e-07 1.296002e-05 6.480012e-07
## [12,] 1.872394e-04 1.497915e-04 6.241313e-07 6.241313e-07 6.241313e-07
## [13,] 1.884339e-04 1.130604e-04 1.884339e-06 1.884339e-06 1.884339e-06
## [14,] 5.968077e-05 7.957436e-05 1.989359e-05 9.946795e-07 9.946795e-07
## [15,] 4.657770e-04 1.996187e-04 3.326979e-06 3.326979e-06 3.326979e-06
## [16,] 1.875441e-04 1.339601e-04 1.339601e-06 1.339601e-06 1.339601e-06
## [17,] 1.128508e-04 1.755456e-04 1.253897e-05 6.269486e-07 6.269486e-07
## [18,] 3.167211e-04 1.659015e-04 7.540978e-07 7.540978e-07 7.540978e-07
## [19,] 2.134795e-04 1.280877e-04 4.269590e-05 7.115984e-07 7.115984e-07
## [20,] 2.214372e-04 1.873699e-04 5.110088e-05 8.516814e-07 8.516814e-07
## [21,] 1.530703e-04 2.783097e-05 6.957741e-07 6.957741e-07 6.957741e-07
## [22,] 1.507878e-04 4.146664e-04 3.769694e-05 3.769694e-05 1.884847e-06
## [23,] 1.373689e-04 8.741657e-05 6.244041e-07 6.244041e-07 6.244041e-07
## [24,] 1.813602e-06 5.078085e-04 1.813602e-06 1.813602e-06 1.813602e-06
## [25,] 1.367303e-04 6.836514e-05 1.709129e-05 8.545643e-07 8.545643e-07
## [26,] 1.207332e-04 1.006110e-04 1.006110e-06 1.006110e-06 2.012220e-05
## [27,] 1.264366e-06 2.275859e-04 1.264366e-06 1.264366e-06 1.264366e-06
## [28,] 1.777624e-04 2.262431e-04 8.080109e-07 1.616022e-05 8.080109e-07
## [29,] 4.291624e-05 1.287487e-04 4.291624e-05 2.145812e-06 4.291624e-05
## [30,] 1.218669e-04 4.570008e-05 1.523336e-05 1.523336e-05 7.616680e-07
## [31,] 1.170661e-04 1.951101e-06 1.951101e-06 1.951101e-06 1.951101e-06
## [32,] 3.708869e-05 2.596208e-04 3.708869e-05 1.854434e-06 3.708869e-05
##              [,33]        [,34]        [,35]        [,36]        [,37]
##  [1,] 7.845920e-05 5.604228e-07 5.604228e-07 5.604228e-07 5.604228e-07
##  [2,] 3.603950e-05 2.574250e-07 2.574250e-07 2.574250e-07 2.574250e-07
##  [3,] 9.627620e-05 1.604603e-06 1.604603e-06 1.604603e-06 1.604603e-06
##  [4,] 9.761881e-05 5.423267e-07 5.423267e-07 5.423267e-07 5.423267e-07
##  [5,] 3.378829e-05 1.689415e-05 2.815691e-07 2.815691e-07 2.815691e-07
##  [6,] 1.320638e-06 1.320638e-06 1.320638e-06 1.320638e-06 1.320638e-06
##  [7,] 1.755737e-04 2.508196e-05 1.254098e-06 1.254098e-06 1.254098e-06
##  [8,] 1.640208e-04 2.050260e-05 1.025130e-06 1.025130e-06 1.025130e-06
##  [9,] 1.486495e-05 7.432474e-07 7.432474e-07 7.432474e-07 7.432474e-07
## [10,] 2.744322e-07 2.744322e-07 2.744322e-07 5.488644e-06 5.488644e-06
## [11,] 1.296002e-05 2.592005e-05 6.480012e-07 6.480012e-07 6.480012e-07
## [12,] 1.248263e-05 6.241313e-07 1.248263e-05 6.241313e-07 6.241313e-07
## [13,] 3.768679e-05 1.884339e-06 1.884339e-06 1.884339e-06 1.884339e-06
## [14,] 9.946795e-07 9.946795e-07 9.946795e-07 9.946795e-07 9.946795e-07
## [15,] 3.326979e-06 3.326979e-06 3.326979e-06 3.326979e-06 3.326979e-06
## [16,] 1.071681e-04 1.339601e-06 1.339601e-06 1.339601e-06 1.339601e-06
## [17,] 2.507795e-05 6.269486e-07 8.777281e-05 6.269486e-07 6.269486e-07
## [18,] 7.540978e-05 7.540978e-07 7.540978e-07 7.540978e-07 7.540978e-07
## [19,] 1.850156e-04 7.115984e-07 7.115984e-07 1.423197e-05 7.115984e-07
## [20,] 1.703363e-05 8.516814e-07 8.516814e-07 8.516814e-07 8.516814e-07
## [21,] 9.740838e-05 6.957741e-07 1.391548e-05 6.957741e-07 6.957741e-07
## [22,] 7.539389e-05 1.884847e-06 1.884847e-06 1.884847e-06 1.884847e-06
## [23,] 1.248808e-05 2.497616e-05 6.244041e-07 6.244041e-07 6.244041e-07
## [24,] 1.813602e-04 3.627203e-05 3.627203e-05 1.813602e-06 1.813602e-06
## [25,] 1.709129e-05 8.545643e-07 8.545643e-07 8.545643e-07 8.545643e-07
## [26,] 1.207332e-04 1.006110e-06 1.006110e-06 1.006110e-06 1.006110e-06
## [27,] 5.057465e-05 1.264366e-06 1.264366e-06 1.264366e-06 1.264366e-06
## [28,] 1.616022e-05 8.080109e-07 8.080109e-07 8.080109e-07 8.080109e-07
## [29,] 1.716650e-04 4.291624e-05 8.583249e-05 2.145812e-06 2.145812e-06
## [30,] 7.616680e-07 7.616680e-07 7.616680e-07 7.616680e-07 7.616680e-07
## [31,] 7.804406e-05 1.951101e-06 1.951101e-06 1.951101e-06 1.951101e-06
## [32,] 1.854434e-06 1.854434e-06 1.854434e-06 1.854434e-06 1.854434e-06
##              [,38]        [,39]
##  [1,] 5.604228e-07 5.604228e-07
##  [2,] 5.148499e-06 2.574250e-07
##  [3,] 1.604603e-06 6.418413e-05
##  [4,] 5.423267e-07 1.084653e-05
##  [5,] 5.631382e-06 5.631382e-06
##  [6,] 1.320638e-06 1.320638e-06
##  [7,] 1.254098e-06 2.508196e-05
##  [8,] 1.025130e-06 2.050260e-05
##  [9,] 7.432474e-07 1.486495e-05
## [10,] 2.744322e-07 1.646593e-05
## [11,] 6.480012e-07 6.480012e-07
## [12,] 4.993050e-05 6.241313e-07
## [13,] 1.884339e-06 1.884339e-06
## [14,] 3.978718e-05 9.946795e-07
## [15,] 3.326979e-06 3.326979e-06
## [16,] 1.339601e-06 1.339601e-06
## [17,] 6.269486e-07 1.253897e-05
## [18,] 3.016391e-05 7.540978e-07
## [19,] 7.115984e-07 4.269590e-05
## [20,] 8.516814e-07 8.516814e-07
## [21,] 1.391548e-05 6.957741e-07
## [22,] 1.884847e-06 1.884847e-06
## [23,] 6.244041e-07 2.497616e-05
## [24,] 1.813602e-06 1.813602e-06
## [25,] 8.545643e-07 5.127386e-05
## [26,] 1.006110e-06 2.012220e-05
## [27,] 1.264366e-06 1.264366e-06
## [28,] 1.616022e-05 8.080109e-07
## [29,] 2.145812e-06 4.291624e-05
## [30,] 7.616680e-07 7.616680e-07
## [31,] 1.951101e-06 1.951101e-06
## [32,] 1.854434e-06 1.854434e-06
## 
## attr(,"class")
## [1] "diversityEstimates" "list"

We can look at the first few Shannon diversity estimates with the following:

combined_shannon <- meta %>%
  dplyr::left_join(dv$shannon %>% summary,
            by = "sample_names")
combined_shannon
## # A tibble: 32 × 12
##    Plants DayAmdmt Amdmt ID    Day   sample_names estimate    error lower upper
##    <chr>  <chr>    <chr> <chr> <chr> <chr>           <dbl>    <dbl> <dbl> <dbl>
##  1 1      01       1     D     0     S009             2.04 0.00576   2.03  2.06
##  2 1      21       1     D     2     S204             1.98 0.000987  1.98  1.98
##  3 0      01       1     B     0     S012             2.00 0.00646   1.99  2.02
##  4 0      21       1     B     2     S207             2.04 0.00325   2.04  2.05
##  5 0      21       1     B     2     S202             2.01 0.00261   2.01  2.02
##  6 0      01       1     B     0     S007             2.04 0.00464   2.04  2.05
##  7 0      01       1     B     0     S022             2.04 0.00529   2.03  2.05
##  8 1      01       1     D     0     S024             2.01 0.00526   2.00  2.02
##  9 0      01       1     B     0     S032             1.99 0.00130   1.99  2.00
## 10 0      21       1     B     2     S212             2.02 0.000765  2.02  2.03
## # … with 22 more rows, and 2 more variables: name <chr>, model <chr>

You might notice that the estimates are not different from the plug-in estimate (only because we used X = NULL), but we have standard errors! That's the real advantage of using DivNet :)

bt_day_fixed_id_random <- betta_random(formula = estimate ~ Day | ID, 
               ses = error,  data = combined_shannon)
bt_day_fixed_id_random$table
##                Estimates Standard Errors p-values
## (Intercept)  2.007812428     0.005051644    0.000
## Day2        -0.001374709     0.007108301    0.847

and similarly for no random effects.

If you are interested in generating confidence intervals for and testing hypotheses about linear combinations of fixed effects estimated in a betta or betta_random model, we recommend using the betta_lincom function.

For example, to generate a confidence interval for \(\beta_0 + \beta_1\) (i.e., intercept plus 'Day2' coefficient, or in other words, the mean Shannon diversity in soils on day 82 of the experiment) in the Shannon diversity model we fit in the previous code chunk, we run the following code:

betta_lincom(fitted_betta = bt_day_fixed_id_random,
             linear_com = c(1,1),
             signif_cutoff = 0.05)
##   Estimates Standard Errors Lower CIs Upper CIs p-values
## 1  2.006438     0.007108301  1.992506   2.02037  < 1e-20

Here, we've set the linear_com argument equal to c(1,1) to tell betta_lincom to construct a confidence interval for \(1 \times \beta_0 + 1 \times \beta_1\). Because we set signif_cutoff equal to \(0.05\), betta_lincom returns a \(95\% = (1 - 0.05)*100\%\) confidence interval. The p-value reported here is for a test of the null hypothesis that \(1 \times \beta_0 + 1 \times \beta_1 = 0\) – unsurprisingly, this is small. (If you are confused about why this is “unsurprising,” remember that \(\beta_0 + \beta_1\) represents a mean Shannon diversity in soils on day 82 of the experiment of Whitman et al. When can a Shannon diversity be zero?)

The syntax and output using betta_lincom with a betta object as input is exactly the same as with a betta_random object, so we haven't included a separate example for this case.

To look at a more complicated example of hypothesis testing, let's now include another date of observation in the Whitman et al. dataset – Day = 1, or observations taken on day 12 of this study. We might be interested now in determining whether there is any difference across observation times in Shannon diversity.

We prepare data and fit a model essentially as we did above. First, we subset the soil data to only biochar-amended plots and allow Day to equal 0, 1, or 2.

subset_soil_days_1_2 <- soil_phylo %>%
  subset_samples(Amdmt == 1) %>% # only biochar
  subset_samples(Day %in% c(0, 1, 2))  # only Days 0 and 82

We extract metadata and aggregate to phylum level as above as well:

meta_days_1_2 <- subset_soil_days_1_2 %>%
  sample_data %>%
  as_tibble %>%
  mutate("sample_names" = subset_soil_days_1_2 %>% sample_names )

soil_phylum_days_1_2 <- subset_soil_days_1_2 %>%
  tax_glom(taxrank="Phylum")

We again run DivNet and extract estimates of Shannon diversity.

# we again have stored the output of the following DivNet call
# dv_days_1_2 <- DivNet::divnet(soil_phylum_days_1_2, X = NULL)

# and we load the fitted model directly
data("dv_days_1_2")

combined_shannon_days_1_2 <- meta_days_1_2 %>%
  dplyr::left_join(dv_days_1_2$shannon %>% summary,
            by = "sample_names")
combined_shannon_days_1_2
## # A tibble: 48 × 12
##    Plants DayAmdmt Amdmt ID    Day   sample_names estimate    error lower upper
##    <chr>  <chr>    <chr> <chr> <chr> <chr>           <dbl>    <dbl> <dbl> <dbl>
##  1 1      01       1     D     0     S009             2.04 0.00329   2.04  2.05
##  2 1      21       1     D     2     S204             1.98 0.00103   1.98  1.98
##  3 0      11       1     B     1     S112             1.96 0.00494   1.95  1.97
##  4 0      01       1     B     0     S012             2.00 0.00597   1.99  2.02
##  5 1      11       1     D     1     S134             1.99 0.00127   1.98  1.99
##  6 0      21       1     B     2     S207             2.04 0.00233   2.04  2.05
##  7 0      21       1     B     2     S202             2.01 0.000611  2.01  2.01
##  8 0      01       1     B     0     S007             2.04 0.00289   2.04  2.05
##  9 1      11       1     D     1     S139             1.91 0.00239   1.91  1.92
## 10 0      11       1     B     1     S122             1.99 0.00142   1.99  2.00
## # … with 38 more rows, and 2 more variables: name <chr>, model <chr>

Now we fit another model with betta_random.

bt_day_1_2_fixed_id_random <- betta_random(formula = estimate ~ Day | ID, 
               ses = error,  data = combined_shannon_days_1_2)
bt_day_1_2_fixed_id_random$table
##                Estimates Standard Errors p-values
## (Intercept)  2.016966250     0.006449933    0.000
## Day1        -0.098391806     0.011173895    0.000
## Day2        -0.001727782     0.011157578    0.877

The output we get from betta_random gives us p-values for testing whether mean Shannon diversity is the same at day 12 as at day 0 and for whether it is the same at day 82 as at day 0, but we want to get a single p-value for an overall test of whether mean Shannon diversity varies with day at all! To do this, we can use the test_submodel function in breakaway to test our full model against a null with no terms in Day using a parametric bootstrap:

do_computation_now <- FALSE

if(do_computation_now){ #if you want to run this bootstrap yourself, you can!
set.seed(345)
submodel_test <- test_submodel(bt_day_1_2_fixed_id_random,
                          submodel_formula = estimate~1,
                          method = "bootstrap",
                          nboot = 1000)
} else{ #to save time, we'll load saved test_submodel() output instead
  data("submodel_test")
}

submodel_test$pval
## [1] 0

This returns a p-value of 0 – but recall that we obtained this p-value with a parametric bootstrap which we've run with 1000 bootstrap iterations. Hence, we'll report \(p \leq 0.001\) rather than \(p = 0\). In any case, we have reasonably strong evidence of some difference in mean Shannon diversity over time, so we reject the null (intercept-only) model.

And there you have it! That's how to do hypothesis testing for diversity!

If you use our tools, please don't forget to cite them!