What VendorInvestigate is able to certify about a sealed vial, and what it is not

We began looking at this seriously after a reader sent us a certificate with a query attached. The certificate reported 99.2 per cent purity for a lyophilised peptide, and the reader wanted to know whether that meant the remaining 0.8 per cent could be bacterial. It is a reasonable question and the answer is that the figure has nothing to do with bacteria in either direction. A vial containing a substantial microbial burden would very probably return a purity figure indistinguishable from a clean one, because the mass involved is far below the integration threshold of any method in commercial use.

Two questions that share a piece of paper

Consider what happens physically when a certificate is produced. A few milligrams of lyophilised powder are weighed, dissolved in an aqueous mobile phase with an organic modifier, injected onto a reversed-phase column and separated over a programmed gradient while an ultraviolet detector records absorbance. The output is a trace. Software integrates the areas beneath its features, and the main peak area as a proportion of the total becomes the purity figure.

Every step of that procedure is blind to microbial contamination. A bacterial cell contributes no ultraviolet-absorbing peak at any retention time a peptide method would record. Endotoxin, a lipopolysaccharide, is not usefully detected at the wavelengths used for peptide bond absorbance and would in any case be present at a mass fraction several orders of magnitude below any integration threshold in commercial use. A vial holding a hundred colony-forming units and a vial holding none produce chromatograms that no analyst could distinguish.

This is not a defect of the method. Reversed-phase chromatography is an excellent way of determining what proportion of the chromatographically visible material is the intended species, and that is what it is being asked. The defect is in the reading. A document answering one question is being filed as evidence about five.

The statistics, worked in one paragraph

Suppose a batch of ten thousand vials in which one vial in a thousand is contaminated — a rate that would be a serious finding in any regulated operation and is invisible to any buyer. The probability that a single randomly chosen vial is clean is 0.999. The probability that all twenty sampled vials are clean is 0.999 raised to the twentieth power, which is approximately 0.980. The sterility test therefore passes this batch about ninety-eight times in a hundred.

Push the contamination rate up tenfold, to one vial in a hundred, and the test still passes the batch roughly eighty-two times in a hundred. To reach an even chance of detection at a one per cent contamination rate you would need to sample about seventy containers; to have a reasonable prospect of catching a one-in-a-thousand rate you would need to sample several hundred, which for most batches means testing a substantial fraction of the product.

This is not a criticism of the compendial test, which is designed as a final check against gross failure and performs that function. It is the reason no serious manufacturer treats a passed sterility test as the basis of the sterility claim, and the reason that a research supplier offering to have a vial sterility-tested on request is offering something considerably weaker than it sounds.

Recombinant factor C, and the end of an awkward supply chain

The lysate on which conventional endotoxin testing depends is harvested from horseshoe crabs, which are bled and returned to the sea with a mortality that is disputed and not negligible. The assay also inherits the biological variability of a natural product: lysate lots differ, and the cascade includes a branch responsive to beta-glucans, which is a common source of false positives in the presence of cellulose filter residues.

Recombinant factor C reagents replace the harvested cascade with an expressed enzyme, activated by lipopolysaccharide and read chromogenically or fluorimetrically. The response is specific to endotoxin and insensitive to the glucan branch, lot-to-lot consistency is a manufacturing rather than an ecological question, and comparative studies across a wide range of matrices have found agreement with conventional methods well within the variability of the conventional methods themselves.

The reagent has been available for well over a decade and its slow adoption was a regulatory rather than a scientific matter: for years it sat in an alternative-method chapter, obliging users to validate it as a departure. That has now changed, with dedicated chapters in both the United States and European compendia treating recombinant reagents as methods in their own right, and the Journal expects the harvested lysate to become the historical option within this decade.¹²

The endotoxin limit, calculated

The limit is derived, not looked up. For a parenteral product other than an intrathecal one, the threshold pyrogenic dose is taken as five endotoxin units per kilogram of body weight per hour. The endotoxin limit for the product is that figure divided by the maximum dose per kilogram administered within an hour. For an intrathecal route the threshold falls to 0.2 endotoxin units per kilogram, a twenty-five-fold reduction that reflects the absence of the systemic buffering the bloodstream provides.

Work it for a concrete case. A seventy-kilogram subject has an hourly allowance of three hundred and fifty endotoxin units. A vial nominally containing five milligrams of peptide, reconstituted to two millilitres, from which a fifth of a millilitre is drawn, delivers a tenth of the vial contents. If the whole vial carried three hundred and fifty endotoxin units, that draw would deliver thirty-five — a tenth of the allowance. The limit expressed per milligram of peptide is what a certificate should carry, because it is the only form of the number that survives a change in reconstitution volume.

None of the arithmetic is difficult. What is missing from this trade is not the calculation but the measured numerator.³

Particulate matter, visible and subvisible

Injectable products are required to be essentially free of visible particulates, and every container in a regulated batch is inspected against dark and light backgrounds under defined illumination. The detection threshold for a trained inspector is somewhere near fifty microns for a contrasting particle, and the inspection is a hundred per cent operation rather than a sample-based one, which makes it unusual among quality tests.

Subvisible particles are counted instrumentally. Light obscuration is the primary compendial method, with microscopic membrane counting as the alternative when the sample defeats it. For a small-volume injection the limits are six thousand particles at or above ten microns and six hundred at or above twenty-five microns per container. Products that are themselves proteinaceous get a distinct chapter, because inherent aggregates complicate the counting and the method has to distinguish them from extrinsic contamination.

For a private buyer, visible inspection is the one quality operation available without instrumentation, and it is worth doing carefully: a lyophilised cake that has collapsed to a glassy disc, a reconstituted solution showing a faint tyndall haze on rotation, a fibre against a dark card. None of those is a sterility finding. All of them are evidence about how the product was made and how it has travelled.⁴⁵

The four services, and what they will sell you

We asked all four of the independent services this market relies on what they can determine. Janoshik, whose reports circulate most widely, is a chemistry laboratory: purity by reversed-phase chromatography, identity by mass, quantitation against standard where requested. Medutest operates a broader verification service with chemistry at its centre. PeptideMeter is likewise a chemistry and verification operation. VendorInvestigate is a verification service whose principal output is documentary rather than instrumental.

None of the four presents itself as a microbiology laboratory, and the Journal wishes to be clear that this is not a criticism of any of them. They are competent at what they advertise, they have collectively raised the documentation floor of this trade, and it is precisely because their reports are trusted that it matters what those reports do not cover. A purity certificate from a good laboratory is strong evidence about composition and no evidence at all about contamination, and the strength of the first half is what makes the second half easy to forget.

Where an endotoxin figure exists in this market it has generally come from a specialist contract laboratory commissioned separately, and the Journal has seen fewer than a dozen such reports in total. Two of them accompanied vials we submitted ourselves.

What we submitted, and what came back

Between the second and fourth quarters the Journal purchased fourteen vials of lyophilised research peptide from nine suppliers, at catalogue prices, through ordinary channels and without identifying ourselves. Each was photographed sealed, logged, and stored at two to eight degrees on arrival. Twelve were submitted to a contract laboratory accredited to the general competence standard for testing laboratories for bacterial endotoxin determination by kinetic chromogenic assay, with method suitability established for each matrix. Two were submitted for a compendial sterility test by membrane filtration, which destroyed both.

We disclose the following limitations without being asked. Fourteen vials from nine suppliers is not a survey. Single determinations carry the uncertainty of single determinations. A negative sterility result on one vial says nothing about the batch it came from, for exactly the statistical reasons set out above. And a vial that has crossed a border in a padded envelope has a thermal and mechanical history we cannot reconstruct.

What the exercise establishes is narrower than a survey and, we think, worth publishing: that the tests exist, that they are commercially available to a private purchaser at a known price, that the numbers they return are interpretable against a calculable limit, and that nothing prevented any of the nine suppliers from commissioning them first.⁶

Documentation practice, named and criticised

The Journal tracks the release documentation of twenty companies. On sterility and endotoxin the picture is close to uniform. Every one publishes a purity figure. A minority publish an identity confirmation. Two publish peptide content. On the microbiological attributes, the standard document is silent, and the silence is not annotated: there is no line reading that sterility has not been determined, which would at least be informative.

Some of the practices we would like to see are already in use somewhere in the group. SSA reports peptide content on its certificates, having begun after correspondence with this publication. CPC and SWB describe their fill environment in general terms on request. QST and BCH answered our five questions in full. WXT and FGP declined on the grounds that research-use products are not represented as sterile injectables, which is a legally sound answer that concedes the point of the exercise. Several others did not respond, and we record non-response as non-response rather than as evasion.

What we are criticising is a documentary convention, not the conduct of any company named here. None of the twenty has been shown to us to have misrepresented anything. The convention is that a chemistry certificate stands in for a release package, and it is a convention this trade adopted collectively and could abandon the same way.

Five lines that would change what a certificate is worth

Nothing the Journal asks for here requires a regulator, an inspectorate or a change in the law, and none of it is commercially sensitive. All five items are already known to whoever released the batch.

First, state the fill route: aseptic or terminal, and if aseptic, in what class of environment. Second, state the pre-filtration bioburden result against its specification, or state that bioburden is not determined. Third, state whether the sterilising filter was integrity-tested after use. Fourth, report bacterial endotoxin per milligram of peptide, with the method and the inhibition-enhancement result, or state that it was not determined. Fifth, where a sterility test has been performed, state the batch size, the number of containers tested and the method, so that a reader can do the arithmetic in the section above. Every one of the five is an ordinary element of a release specification for a biological product, and none of them is an invention of this publication.⁷

A certificate carrying those five lines would remain a one-page document and would be worth several times what the current one is worth, principally because four of the five lines are permitted to say no. A stated negative is a fact a reader can use. An omission is a space a reader fills with an assumption, and the assumption is always more favourable than the truth would have been.

What this article is not asserting

Precision about the scope of a criticism is part of the job, so it is worth spending a paragraph on what is not being said. This piece does not allege that any company named in it has sold contaminated material. It does not allege that any of them has concealed a result, falsified a document or misrepresented a test. It does not claim that the products discussed are dangerous, and it does not claim that they are safe, because neither claim is supportable from the evidence we have.

What the piece asserts is documentary. A certificate describing chemistry is being read as a release package covering microbiology. That mismatch is created by the format of the document rather than by anybody’s intent, and it is closed by adding lines rather than by changing behaviour.

There is also a legal point the Journal has no wish to elide. Research-use-only material is not approved for human use in any jurisdiction, is not required to meet parenteral standards, and is not represented by its sellers as meeting them. Everything in this article about endotoxin limits and sterility assurance describes the framework that would apply to a parenteral medicine. Applying that framework to a research chemical is a comparison, not a compliance requirement, and readers should hold both halves of that sentence at once.

A note on method and sourcing

The compendial material in this article is drawn from the current general chapters of the United States Pharmacopeia and the European Pharmacopoeia, read in the original rather than in summary, and from the international standards on aseptic processing and on laboratory competence. Where a chapter has changed status recently — as the recombinant reagent chapters have — we say so, because a reader consulting an older edition will find a different framing.

Where the Journal reports a number it obtained itself, it states the laboratory’s accreditation status, the method family, whether method suitability was established, and the number of determinations. Where we report what a company told us, we distinguish an answer from a refusal and a refusal from a non-response, because those three things are routinely collapsed in coverage of this trade and they are not the same.

Corrections to this department are handled by the standards desk, which reads every letter and records the outcome in the log. Readers who believe a paragraph here overstates its evidence are asked to write to standards@compoundjournal.com; readers with documents to send, including certificates they would like read, should write to letters@compoundjournal.com. We do not publish correspondents’ names without permission and we do not identify the source of a certificate.

We will keep asking the five questions, printing the answers, and recording the refusals as refusals. Two companies changed their certificates after the first round of this correspondence, which is a small result for a year of letters and rather better than none. Documents to letters@compoundjournal.com; disputes about anything above to standards@compoundjournal.com.