Simulation for Group Sequential Trials

Kaifeng Lu

12/15/2021

This R Markdown document illustrates the simulation tool for group sequential survival trials. This is useful for validating the analytic calculation, which might be inaccurate when the allocation ratio is not 1:1 or the hazard ratio is far from 1.

library(lrstat)

Consider a three-stage O’Brien-Fleming group sequential design with two interim looks conducted at 50% and 75% of the target total number of events. The first interim is for futility only, and the second interim is for efficacy only. The hazard rate of the control group is 0.95 per year. The hazard ratio of the experimental group to the control group is 0.3. The experimental versus control group randomization ratio is 3:1. The enrollment rate is 5 patients per month. The 2-year drop-out rate is 10%. The study uses a fixed follow-up design and each patient is to be followed up for 26 weeks. If we use an enrollment duration of 32 months, then the maximum number of events is expected to be 32.8.

lrstat(time=c(20, 25, 30, 35, 38.5), allocationRatioPlanned = 3, 
       accrualIntensity = 5, 
       lambda2 = 0.95/12, lambda1 = 0.3*0.95/12, 
       gamma1 = -log(1-0.1)/24, gamma2 = -log(1-0.1)/24, 
       accrualDuration = 32, followupTime = 6.5, fixedFollowup = TRUE)
##   time subjects  nevents nevents1  nevents2 ndropouts ndropouts1 ndropouts2
## 1 20.0      100 17.37244  8.91394  8.458504  2.116728   1.647680  0.4690486
## 2 25.0      125 22.49924 11.55918 10.940058  2.743292   2.136634  0.6066580
## 3 30.0      150 27.62603 14.20442 13.421612  3.369855   2.625588  0.7442674
## 4 35.0      160 31.95277 16.45992 15.492843  3.901625   3.042502  0.8591231
## 5 38.5      160 32.81148 16.92953 15.881948  4.010006   3.129306  0.8807001
##      uscore   vscore  logRankZ hazardRatioH0
## 1 -4.598872 2.996796 -2.656579             1
## 2 -5.951438 3.875556 -3.023117             1
## 3 -7.304005 4.754316 -3.349786             1
## 4 -8.438436 5.487095 -3.602390             1
## 5 -8.656427 5.624064 -3.650174             1

Suppose we run the trial for a target maximum number of 32 events. The trial will stop once 32 events have been observed or the trial is stopped early for futility or efficacy. Due to the fixed follow-up design, there might be situations where a total of 160 patients with each followed-up for 6.5 month do not yield 32 events, in which case, the trial will stop and we allocate all remaining alpha to the final look. The simulation below demonstrates that the study has the target power of 90% under the alternative hypothesis.

lrsim(kMax = 3, informationTime = c(0.5, 0.75, 1), 
      criticalValues = c(6, 2.34, 2.012), 
      futilityBounds = c(0.282, -6), 
      allocation1 = 3, allocation2 = 1,
      accrualTime = 0, accrualIntensity = 5, 
      piecewiseSurvivalTime = 0, 
      stratumFraction = 1, 
      lambda1 = 0.3*0.95/12, lambda2 = 0.95/12, 
      gamma1 = -log(1-0.1)/24, gamma2 = -log(1-0.1)/24, 
      accrualDuration = 34, followupTime = 6.5, 
      fixedFollowup = TRUE, 
      rho1 = 0, rho2 = 0, 
      plannedEvents = c(16, 24, 32), 
      maxNumberOfIterations = 1000, 
      maxNumberOfRawDatasetsPerStage = 0, 
      seed = 12345)
##                          stage 1 stage 2 stage 3
## cumulativeRejection        0.003   0.740   0.888
## cumulativeFutility         0.031   0.031   0.112
## numberOfEvents            16.000  23.981  30.795
## numberOfDropouts           2.029   2.955   3.745
## numberOfSubjects          93.911 131.654 158.485
## analysisTime              18.817  26.500  33.012
## overallReject              0.888                
## expectedNumberOfEvents    25.391                
## expectedNumberOfDropouts   3.131                
## expectedNumberOfSubjects 137.325                
## expectedStudyDuration     27.907

The simulation below shows that the probability of futility stopping under the null hypothesis is 62%.

lrsim(kMax = 3, informationTime = c(0.5, 0.75, 1), 
      criticalValues = c(6, 2.34, 2.012), 
      futilityBounds = c(0.282, -6), 
      allocation1 = 3, allocation2 = 1,
      accrualTime = 0, accrualIntensity = 5, 
      piecewiseSurvivalTime = 0, 
      stratumFraction = 1, 
      lambda1 = 0.95/12, lambda2 = 0.95/12, 
      gamma1 = -log(1-0.1)/24, gamma2 = -log(1-0.1)/24, 
      accrualDuration = 34, followupTime = 6.5, 
      fixedFollowup = TRUE, 
      rho1 = 0, rho2 = 0, 
      plannedEvents = c(16, 24, 32), 
      maxNumberOfIterations = 1000, 
      maxNumberOfRawDatasetsPerStage = 0, 
      seed = 12345)
##                          stage 1 stage 2 stage 3
## cumulativeRejection        0.000   0.013   0.029
## cumulativeFutility         0.617   0.617   0.971
## numberOfEvents            16.000  24.000  32.000
## numberOfDropouts           0.908   1.332   1.802
## numberOfSubjects          55.061  75.344  95.366
## analysisTime              11.043  15.124  19.148
## overallReject              0.029                
## expectedNumberOfEvents    22.024                
## expectedNumberOfDropouts   1.251                
## expectedNumberOfSubjects  70.135                
## expectedStudyDuration     14.072