Challenges for Diagnostic Test Developers

A Preparedness Sample Repository to Facilitate Rapid Diagnostic Test Development and Deployment

Key points

  • During an outbreak, developers need to receive diagnostic test development and validation materials quickly.
  • The lack of relevant material and specimens delays response time and compromises the ability to validate tests.
  • A dedicated and centralized repository of samples can help laboratories rapidly respond to emerging and reemerging disease threats.

Challenges

In the early stages of an outbreak, some types of materials may not be available or are only available to a very limited group of developers. Diagnostic test development and validation require a rich and diverse inventory of both relevant clinical sample types (e.g., eye fluids, semen, cerebrospinal fluid) and pathogens collected from the affected patient populations, which are often in very short supply at the beginning of an outbreak. The lack of relevant material and clinical specimens for test development and validation may delay response time and compromise the ability of developers to validate tests with the goal of improving patient management and strengthening the public health response to emerging infectious diseases.

Access to test materials is delayed without dedicated and centralized logistical support. There are a number of challenges associated with collecting patient samples, starting with the need for Institutional Review Board (IRB) approval and possible requirements for informed consent. Other challenges include fulfilling export and import permits requirements, intellectual property considerations, reluctance from third parties to share samples, limitations on commercial use of the specimens, difficulties transferring materials (e.g., biosafety and biosecurity concerns), the process for generating material transfer agreements (MTAs), and identifying and coordinating available personnel and facilities to collect and manage samples in an emergency. All of these challenges become more acute when the outbreak begins outside the United States because access to clinical specimens may be restricted by international policies.

When available, test materials sourced from many different providers may have varying quality and sample characterization. The use of different samples without a "gold standard" method to assess their validity (confirm the presence of a pathogen, antibodies, or other biomarkers) may lead to a lack of comparability between samples obtained from different sources. Test materials of unknown quality and associated characterization may delay emergency use authorization (EUA) and the application of these tests in an emergency response.

Mock clinical samples, created by spiking a clinical matrix with the agent of interest, can sometimes be used as a substitute for natural clinical samples obtained from affected individuals. Where the emerging disease threats are known and the pathogens available, these could potentially be prepared in advance of an outbreak. However, in events where a new disease emerges, the inability to create, generate, and use contrived samples may cause delays in test performance development and validation.

CDC and other diagnostic test developers, including those in the private sector, currently lack access to sufficient numbers of samples, materials, and isolates of pathogens or related organisms (see Table 1) needed to rapidly mount emergency response efforts for emerging and reemerging disease threats. Currently, there is no centralized resource that can provide appropriate, well-characterized samples and materials that are essential for the development and validation of diagnostic tests during public health emergencies. A recent Government Accountability Office report recognized challenges faced by commercial developers of diagnostic tests for Zika. This report also identified the challenges associated with accessing well-characterized clinical samples and reference materials, as well as developing partnerships with international entities and obtaining appropriate permits to acquire samples.1 Well-characterized samples would include metadata such as age, sex, days post onset of symptoms, pregnancy status, tests that were performed on the specimen, and the results of those tests.

Table 1: Sample types and materials needed for test development

Sample Type
Reason Needed
Samples with high and low levels of pathogen or agent
Assess analytical sensitivity/limit of detection, test reproducibility
Samples from pre-symptomatic individuals
Assess test ability to diagnose before symptoms arise/low levels of pathogen or agent/limit of detection
Samples from patients who present with similar symptoms but are not infected with the pathogen of interest (from US and endemic population if external to US)
Assess analyte specificity/cross reactivity
Samples from patients with acute and convalescent infections
Assess ability of test to diagnose patients during and after infection/analytic sensitivity
Samples from patients of different ethnicities, ages, and genders
Assess ability of test to diagnose patients who may be infected
Samples from uninfected individuals from the same endemic region as the infected patients
Assess analytic specificity/cross reactivity
Quantified stocks of well-characterized analytes, organisms, and relevant antibodies
Materials that can be used to develop contrived samples
Common and specific interfering substances or cross reactivity pathogens
Materials that can be used to develop contrived samples
Material from uninfected or unexposed individuals (pooled or from individuals) to use as a matrix for spiking, negative controls, or contrived specimens
Materials that can be used to develop contrived samples
Stocks of common sample types, such as serum, urine, and plasma
Materials that can be used to develop contrived clinical samples
Content Source:
  1. United States Government Accountability Office. Report to Congressional Requestors. Emerging Infectious Diseases, Actions Needed to Address the Challenges of Responding to Zika Virus Disease Outbreaks. GAO-17-445, May 2017. https://www.gao.gov/assets/690/684835.pdf