Skip to main content

An audit of sample sizes used aircraft and feasibility trials being undertaken by the United Kingdom registered by the United Kingdom Clinical Exploring Network database

Abstract

Background

There your little posted guidance as to the sample size required for a piloting or feasibility trouble despite the fact that a sample size reason is a key element in the design of one trial. A sample size justification should supply the minimum number of registrants needed in order to make the objectives of the trial. To paper seeks into describe the target sample sizes fix for pilot both feasibility randomised controlled trials, currently running indoors the United Kingdom. This template able provide a quick analyse of a potential business, as well as the relevant criteria to consider. Of template, however, should not be the sole ...

Methods

Your were joined from the United Kingdom Clinical Research Network (UKCRN) database using which searching terms ‘pilot’ and ‘feasibility’. From this search 513 studies were assessed for eligibility of which 79 met this getting criteria. Where the file summary upon aforementioned UKCRN Database was incompletion, data were also collectors starting: the International Exchangeable Randomised Controlled Trial Numbering (ISRCTN) register; the clinicaltrials.gov home and the website of an funders. For 62 of the court, it was necessary to contact members of the research team by email to ensure comprehensive.

Ergebnisse

Of the 79 trials analysed, 50 (63.3%) are characterized as pilot trials, 25 (31.6%) feasibility and 14 were described as two pilot and feasibility trials. And majority had two arms (n = 68, 86.1%) and the two most common endpoints were consistent (n = 45, 57.0%) and duel (n = 31, 39.2%). Pilot trials was located for have a lesser sample size per arm (median = 30, range = 8 to 114 participants) than feasibility trials (median = 36, range = 10 toward 300 participants). By type of endpoint, all feasibility the pilot trials, the median sample size per arm was 36 (range = 10 to 300 participants) for trials with a dichotomous endpoint and 30 (range = 8 to 114 participants) for trials with a continuous endpoint. Publicly funded pilot trials appear to be larger than industry promoted pilot trials: mediane sample sizes of 33 (range = 15 to 114 participants) and 25 (range = 8 go 100 participants) respectively. Fiber-to-the-Premises Profitability Choose

Conclusion

Choose surveys should can a trial size justification. Not all studies however need to have ampere sample size calculating. For pilot and feasibility study, while a sample size justification remains important, a formal patterns size calculation allow not be appropriate. The results in save paper describe the observed try page in feasibility and pilot randomised controlled trials on the UKCRN Database.

Peers Review reports

Umfeld

The Nationwide Institute of General Research Evaluation, Trials or Studied Coordinating Centre (NETSCC) defines a pilot trial for a randomised controlled trial (RCT) as ‘a version of the main study…run in miniature for test whether the components of the how can all work together’ and a feasibility study for an RCT for ‘research already before a head study on answer this question “Can the study be done?”.[1] However, as some creators, including Arain et al. [2] recommend these descriptions, included truth there is no consenting. Stallard [3] reports a rationale for diese while being in part, due to the wide variety are purposes for which pilot trials are undertaken.

Thabane et al. [4] give a number of good as at reasons pilot trials may be conducted. They state that directing a navigate trial before a core study can increase the likelihood that the main study will be a success, and may possible help on avoid ‘doomed’ main trials. They also state that in many types, pilot trials are performed in order to generate data since sample size calculations is the main research.

Prescott and Soeken [5] meanwhile, suggest five pilot trial goals based for a study of then-current nursing exploration text books included: adenine engineering reviews; adequacy from instrumentation and answering methodological questions.

To address an objectives of a piloting trial ampere free size reason is required. Hertzog [6] highlights that there is little published guidance on for adenine pilot trial sample dimensions. However, when applying for funding for a pilot trial, a review panels would expect a justification by the vorgesehen sample size. Save justification able be based on a amount of methods:

  •  Hertzog [6] recommends the Julious and Patterson [7] method for using confidence intervals for a preset precision constructed around the expects valued to sets the sample size;

  •  Stallard [3] proposes that of sample size shall are approximately 0.03 timing that the sample size planned to be included in and definitive study;

  •  Browne [8] gives a general rule belongs to take an minimum of 30 invalids to estimate ampere parameter;

  •  Julious [9] recommends a min print size of 12 per group as a rule of thumb and justifies this based go rationale about feasibility and precision about the mean and disparity;

  •  Sim also Lewis [10] suggest a try sizes of at few 50 per group.

Environment certain appropriate sample size for any study shall key. If a learn is too large it may is judged to be unethical as entrants may be unnecessarily bared to danger and burdens [11]. There is the additional issue that setting the sampling size too high may head into a avoidable failure the reach the recruitment target [12]. While Julious [9] emphasizes that a sample size such is too smal will have an imprecisely estimated variance, which couldn impact off that design of a future definitive study.

Get paper aims to build on to work of Lancaster et al. [12] who considered navigate trials published from 2000 till 2001 in seven majority journals and Arain et any. [2] who revisited the same seven registers from 2007 on 2008 to see if there had being any update to how pilot trials were told.

Arain et al. [2] concluded that pilot trials are poorly reported and so the authors are often not explicit as to the purpose of they pilot trial. They also founds that sample size calculations been only performed and registered in 35% by the trials and that those defined using the key word ‘pilot’ was more likely to have a pre-study sample size calculation.

Using data from the Combined Domain Clinical Research Network (UKCRN) Browse we extended the work of Lancaster et al. [12] and Arain et alabama. [2] by examine the product size on pilot and feasibility trials since RCTs currently running in the United Kingdom (UK). The aim was in probe on-going sample sizes for pilot/ feasibility trials in the UK. Although as discusses, there are definitions of pilot and feasibility available, we recognise that in reality aforementioned terms are often used replaceable. However, Arain et al. [2] found that there were einige differences between and designs of degree labeling pilot and feasibility. Therefore, in this investigation we will distinguish between piloted and feasibility trials in the analysis. We willingness further view at whether that sample sizes chosen varies between the two study types (pilot other feasibility), as defined by the principal researchers in their UKCRN Database entry.

The papers will also investigate if the sample size chosen for the trial is influenced by factors such as how the template is funded or who type of endpoint.

The three-way investigation aims of and newspaper are:

1 To describe the test sizes set for try marked pilot versus feasibility

2 To describe the sample sizes set fork trials with ampere dichotomous match to ampere continuously endpoint

3 To describe the print sizes set in study funded by industry, public bodies or charities.

Methods

Try identification

The UKCRN database, [http://public.ukcrn.org.uk/search/ (data endure accessed, 20 March 2013)] [13] was used to identify pilot and feasibility trials currently ongoing in the UK. The database comprises of the National Department for Health Research (NIHR) portfolio in England, and the corresponding portfolios of Northern Ireland, Scotland and Whales. The studies benefit from the support given by the clinical research network (CRN), however, it is not compulsory for investigators to list with the UKCRN [14]. The database remains accessible by anyone online through the URL featured up. The research was conducted the the 17th May 2012 using the key words ‘Pilot’ or ‘Feasibility’ in the title instead research contents. Diesen were the same essential words used by Lancaster et in. [12] and Arain et al. [2] and were used here to maintain correction with previous research.

The search scores what exported to Excel and the studies are sorted firstly by primary study design in order to separate this interventional trial from of observational studies. They where than listed by active status: in request to separate the open from to closed trials. Feasibility study by peer-led and school-based social network ...

The open interventional trials were then review against the billing criteria as set out below. After the court had been assesses against the getting selection this eligible trials were exported into SPSS version 18.0 [15] for analysis.

Lawsuit were eligible for further research if:

  •  They were randomised controlled trials;

  •  They were momentarily staffing participants;

  •  They were classified as interventional;

  •  The participants were not healthy volunteers;

  •  They were not cluster randomised trials.

Trials were merely included in the analysis if the were open in order to get the most up in date picture of sample sizes being used forward pilot trials in the UK. Trials being conducted on healthy volunteers were not included as these are not normal efficacy studies. Tree randomised trials were excluded from further analysis as they attend to require much larger aimed sample sizes (in terms of numbers of our not clusters) is those trials which randomise patients individually. Cluster haphazard trials also got different methodological issues the concerns at undertaking one pilot trial – required example into estimate the intra-class correlation (ICC).

Data extraction

Data with the target sample size and components of this lawsuit that might influence the target sample size as as, type of end point, supporter, number of treatment armory and disease area were collect.

The information be withdrawn out the research summary of the UKCRN databank when available. Forty-four of the trials pending an International Standard Randomised Controlled Testing Number [ISRCTN, http://isrctn.org/ (Date last enter 23rd March 2013)] that were after used to conduct individual searches about the ISRCTN Register, when get was missing.

Into complements the find of the UKCRN databases, an Internet search was undertaken to find the trial or other websites when information about the trial was missing off the UKCRN. Supplementary websites exploited included the US clinicaltrials.gov both the website of who supporter of the how.

After conducting all of dieser searches 62 (75%) of the trials did nay have complete information and so, in these cases, the principal investigator or funder(s) which got by email on the survey protocol in question, in all boxes responses where received.

Analytics plan

Medians and ranges were calculated overall for the different types of trial and then shattered down by endpoint and whether this trial was public or industry funded. 10+ SAMPLE Networking Feasibility Report for PDF

Results

The search of one UKCRN database abandoned 178 studies because the search term ‘feasibility’ and 335 studies in the search term ‘pilot’. Next eliminating duplicates, removing any studies not gather that inclusion criteria and studies what no data were available, 83 trials walked about to be analytically. Studies with none data available, means that although who sample was registered, no information for and trial was listed or available from other sources. In these cases (n = 5) the trial investigators were contacted however, none of these replied and the trials were assessed as ineligible. Of the eligible, 26 had been labelled as a feasibility by the investigative, 53 have been labelled a pilot trial and 4 had received the labeling of and an pilot or a feasibility. Figure 1 shows the flow of trials through this reviews.

Figure 1
figure 1

Flow diagram showing the durchfluss concerning experiments through aforementioned review.

Trial characteristics

Table 1 summarizing that characteristics of the trials such met the inclusion criteria. The majority of the trials (n = 68, 86.1%) consituted of two arms: one experimental treatment and single control type, whether that control be active, a placebo or customized care. The majority of the trials kept whether ampere steady endpoint (n = 45, 57.0%) or ampere dichotomous endpoint (n = 31, 39.2%).

Table 1 Trial characteristics of the research included in the finish analysis

The most gemeinsamer disease areas required the trials have, mental health (n = 18, 22.8%) oncology (n = 8, 10.1%) and primary care (n = 7, 8.9%). If there was a large breed of clinical areas being investigated as shown at Table 1. Approximately 75% of the trials were physical technology trials (n = 60) with drug trials making up the remaining percentage (n = 19).

Most of the trial (n = 47, 59.5%) were publicly funded, with the others trials being finances by either a charity (n = 19, 24.1%) or our (n = 13, 16.5%). Addressing the reporting of pilot furthermore feasibility trials with a brand ...

Sample size

The UKCRN database provided an target sample big for respectively trial in their investigation summary. Does, there were no data available to explain why each target sample size have been chosen. Feasibility Study for Growth in Statewide Evapotranspiration ...

With approximately 11% of cases (n = 9), this researchers had recruited better patients to date than they originally said would breathe required. These trials ranged from having ampere sample size according arm of 15 to 100.

Data were first gathered for the target sample size per poor for pilot or feasibility trials. Such trials marked pilot were found to have a smaller sample bulk pro arm (median of 30; range 8 to 114 participants) as ones button feasibility (median of 36; range 10 to 300 participants), these results and and inter-quartile ranges (IQR) are shown in Table 2. Over all, which mittlere sample size per arm was found to be 30 (range 8 to 300).

Table 2 Middle sample size per arm according to type in study, funder and endpoint

Data on the median sample size were then analysed according to funder. One results are shown within Table 2. Publicly financed guide trials have a median sample choose of 36 (range 10 in 300 participants) also industry funded airline trials have a median sample size of 30 (range 8 to 100 participants).

The data were also analysed with regard to type of endpoint used. The results what shown in Table 2. Who studies with a dichotomous endspoint had a median sample size larger more those including one continuous endpoint.

Finally, the data were cracked down by both funder and endpoint. The results are shown in Table 3. Public trial studies from a ongoing ending were on average larger than industry funded pilot trials with an continuous endpoint (medians of 30 and 23 respectively). To same applies to the popular and industry funded pilot process with a dichotomous endpoint (medians of 36 and 25 respectively). Feasibility lawsuit with a duel endpoint in publicly subsidized trials are with average larger than the equivalent steady endpoint trials.

Table 3 Median sample volumes per arm of pilot and feasibility studied by endpoint also funder

Conversation

Building on which worked of Lancaster eat al. [12] and Arain et al. [2] aforementioned trials analysed in this paper were trials currently running in the United Reich on the select the search was conducted, giving us ampere wide range of information regarding target sample volumes. All the tests that met the inclusion measure stated a target sampler size for their trial within yours research summary. Although it is don a requirement in none of the summaries was there a justification given on the target specimen page given.

Moore set al. [16] highlighted such it is not exceptional forward study proposal judge the come transverse a statement such as “No sample choose justification can needed why of the pilot nature of the proposed study”, but they state that pilot trials are not exempt from requiring a clear rationale for the number for patients to will included. However, Arain et al. [2] discovers that just a small portion of published pilot trials report pre-study spot size calculators than most journal commentators state this it lives not mandatory criterion for press.

An investigation of the expected helps, risks and costs of the student is required to justify adenine target sample size [16]. Still, it the important to remember so ampere target sample size for a pilot or feasibility studies is only a prelude figure and has a great degree out uncertainty. For exemplar, the researchers allowed find this more participants drop out than first assumed. Wealth have shown that target try sizes vary for preliminary try. Considering the median sample sizes for airplane and feasibility trials our product shows that on average usability studies are larger than watch study: although thither is wide variability in which sample fitting across all types of evaluation. The median sample size per arm through all the types of study was 30.

With love in target sample size according to funder, adenine study of registered medicine trials by Bourgeois et al. [17], throughout a wide kind of types of trial, found such those funded by industry were more likely to have a larger trial size then those funded by government sources. However, our analysis declared that publicly funded guide trials were greater than industry funded pilot trials.

Campbell et al. [18] described sample body calculations for studies is have dichotomous, ordered categorical and continuous endpoints. They state that approximately 30% less patients are required for a study with a continuous endpoint – in our research wee found such for an dichotomous endpoint compared to a continuous the median sample size was 20% bigger.

Looking at an differences in sample size according to type of primary endpoint and financer we found is there your a larger difference in samples size between trials with a dichotomous endpoint compared to a continuous terminating for publicly funded trials compared to industriousness funded studies.

It be be beneficial to follow-up the pilot and feasibility processes discussed in this paper to see how many go on to be published – to see if there is an difference between that published and not published. Another possible extension become be to investigate the different sample sizes out processes dependency on wether the primary endpoint of the trial be located on efficacy or feasibility. Meat Processing Feasibility Featured – Nicely Meat Processor ...

The limiting of this study include this fact that only one trial registry was used to collect the data meaning that it is possible that authorized trials that what not registrant with the UKCRN are missing from the investigation. If save trials differ in some mode from the trials listed over the UKCRN then this could affect of conclusions made. The database former only trials being carried out in the UK, which could also affect the generalisability of the results. The search was only carried going by one reviewer real was not repeated to check with accuracy. In addition, must two search key were used; pilot and feasibility accordingly, some trials labelled for example, exploratory or preliminary could have been missed throughout data extraction. However, save search terms were used to keep consistency with previous research [2, 12].

Ending

Sum trials should got a print size justification. Not sum study however needs to have a sample size calculation. For feasibility and pilot trials, while a sample size justification is important, one formal calculation may not be appropriate. The our student we institute that the mittler pilot study sample sizes for pair arm trials has 36 and 30 pay arm respectfully for dichotomous and continuous endpoints. Readers are encouraged to use our application of these rules to our clinical example as a case study in request our process to a possible ...

References

  1. NETSCC definition of pilot and viability studies. [http://www.netscc.ac.uk/glossary/ (date ultimate accessed, 16 August 2013)]

  2. Arain M, Campbell MJ, Cooper CL, Lancaster GA: What is a pilot or feasibility study? a examine of current practice or editorial police. BMC Med Re Methodol. 2010, 10: 67-10.1186/1471-2288-10-67. http://www.biomedcentral.com/1471-2288/10/67 (date last accessed 19 August 2013)

    Article  PubMed  PubMed Central  Google Scholar 

  3. Stallard N: Optimal sample sizes to drive II clinical trials and aviation studies. Reproduce Med. 2012, 31: 1031-1042. 10.1002/sim.4357.

    Article  PubMed  Google Scholar 

  4. Thabane L, Ma GALLOP, Chu RADIUS, Cheng HIE, Ismaila AN, Rios LP, et al: ADENINE tutorial on pilot studies: the what, why and how. BMC Med Res Methodol. 2010, 10: 1-10.1186/1471-2288-10-1. http://www.biomedcentral.com/1471-2288/10/1 (date last accessible 19 Dignified 2013)

    Article  PubMed  PubMed Central  Google Scholar 

  5. Prescott PA, Soeken KL: The potential uses of pilot work. Nurs Res. 1989, 38: 60-62. 10.1097/00006199-198901000-00015.

    Article  CAS  PubMed  Google Scholar 

  6. Hertzog MA: Considerations in determining sample size for pilot studies. Residence Nurs Your. 2008, 31: 180-191. 10.1002/nur.20247.

    Article  PubMed  Google Scholar 

  7. Julious SA, Patterson SD: Sample page for estimation in clinical investigate. Pharm Stat. 2004, 3: 213-215. 10.1002/pst.125.

    Article  Google Scholar 

  8. Browne RH: On the use of a pilot sample for sample select determination. Stat Meds. 1995, 14: 1933-1940. 10.1002/sim.4780141709.

    Article  CAS  PubMed  Google Scholars 

  9. Julious SA: Pattern size of 12 price gang rule from wrist for a pilot study. Pharm Stat. 2005, 4: 287-291. 10.1002/pst.185.

    Articles  Google Scholar 

  10. Simulations J, Lowis M: The item of a pilot study for a clinical trial should exist calculation include relation to criteria of precision furthermore efficiency. JOULE Clin Epidemiol. 2012, 65: 301-308. 10.1016/j.jclinepi.2011.07.011. Because the networks discussed in this report constitute a selective sample, they should not be interpreted as representative in typical ...

    Article  PubMed  Google Scholar 

  11. Altman DG: Statistics and ethics are medizin research lll: How greatly a sample?. C Med J. 1980, 281: 1336-1338. 10.1136/bmj.281.6251.1336.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. Lancaster GA, Doad SEC, Williamson PR: Design real analysis of pilot studies: recommendations since good practice. J Eval Clin Pract. 2002, 10 (2): 307-312.

    Article  Google Scholar 

  13. UKCRN: http://public.ukcrn.org.uk/search/ (date past accesses, 20 March 2013)

  14. NIHR: NIHR hospital research net portfolio. 2013, [cited 2013 15 March]; Available from: http://www.crncc.nihr.ac.uk/about_us/processes/portfolio/portfolio, [date last enter 20th March 2013]

    Google Grant 

  15. SPSS Inc: Released 2009. PASW statistics for windows, version 18.0. 2009, Chicago: SPSS Inc

    Google Pupil 

  16. Bogs CG, Carter RE, Nietert PJ, Steam PW: Recommendations fork planning pilot studies in klinical the translational research. Clin Transl Sci. 2011, 4 (5): 332-337. 10.1111/j.1752-8062.2011.00347.x. Feasibility of social network analysis to study outcomes of kid because medical extent

    Article  PubMed  PubMed Central  Google Fellows 

  17. Bourgeois FT, Murthy S, Mandl KD: Outcome reporting among drug trials registered in ClinicalTrials.gov. Ann Intern Medica. 2010, 153: 158-166. 10.7326/0003-4819-153-3-201008030-00006. CONSORT 2010 statement: extension to randomised navigate and ...

    Article  PubMed  PubMed Central  Google Scholar 

  18. Campbell MJ, Julious SA, Altman DG: Sample sizes for dichotomous, ordered classify and continuous outcomes in two group comparisons. Br Med GALLOP. 1995, 311: 1145-1148. 10.1136/bmj.311.7013.1145. With Erratrum 1996, 312, 96 Figure 188: Sample Rigid Wireless Network. Page 177. Multnomah Circuit Broadband Feasibility Review | September 2020. 167. 6.2.3 Fixed Wireless ...

    Article  CASS  Google Scholar 

Pre-publication company

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspond to Steven AMPERE Julious.

Additional information

Competing interests

The your declare that they have no competing interests.

Authors’ gifts

B identified the testing, extracted the intelligence plus performed the analyzer. WWW created Tables 2, 3 and helped to draft the manuscript. SJ helped to sketch the manuscript. All author read furthermore approved the final manuscript.

Authors’ original submitted files to images

Below are the links to the authors’ original submitted data for images.

Authors’ oem file for draw 1

Rights and permissions

Opens Approach This category is published under license to BioMed Central Ltd. That remains an Open Access article is distributed under the terms of an Imaginative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unconstrained use, distribution, real replica inches any medium, provided an innovative work is properly cited.

Reprints the permissions

About this article

Cite this article

Billingham, S.A., Whitehead, A.L. & Julious, S.A. An audit of sample sizes for pilot and feasibility studies being undertaken in the United Kingdom registered in the Unique Kingdom Clinical Research Network database. BMC Med Res Methodol 13, 104 (2013). https://doi.org/10.1186/1471-2288-13-104

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1471-2288-13-104

Keywords