Reading a certificate for what it does not say

The Journal’s position on all this is narrow. We do not think every research vial should carry a pharmacopoeial release package; the economics are impossible and the product is not sold for administration. We do think a buyer is entitled to know which questions the document in their hand answers, and that the list of unanswered ones is short enough to print. That list, and a ten-minute procedure for working through it, is the practical content of this piece.

Water, counter-ion and the mass in the vial

A lyophilised peptide is not pure peptide even when it is chromatographically pure. It is a salt, usually of trifluoroacetic or acetic acid, containing residual water that a hygroscopic powder acquires readily, and sometimes residual solvent from purification. Three lines on a certificate address this and they are usually absent: water content, counter-ion identity and content, and residual solvent.

Water is determined by Karl Fischer titration or by loss on drying, and the pharmacopoeial methods for it are old, settled and inexpensive.¹ A peptide containing eight per cent water by mass contains eight per cent less peptide than its label implies, and the figure is not stable: it depends on how the vial was stoppered and how long it has been open. Counter-ion content is a larger contribution still for basic peptides purified in trifluoroacetic acid, where the counter-ion fraction can reach ten to twenty per cent of total mass.²

Put these together and the practical statement is the one this department repeats: the nominal mass on a research vial is an upper bound on the peptide it contains, not a value. A certificate that reports purity and is silent on water and counter-ion has told you the material is clean and nothing at all about how much of it there is.

What “conforms” conceals

A statement of conformity is a judgement, not a measurement, and the judgement depends on how the reporting party handles results that sit near a limit. If a specification requires not less than 98.0% and a measurement returns 97.9% with a method uncertainty of ±0.4%, does the batch conform? The answer depends entirely on a policy — whether the limit is applied to the measured value, or to the measured value adjusted for uncertainty, and in which direction. Metrological reporting practice has a settled answer here, which is that a result quoted without its uncertainty cannot be compared to a limit at all.³

The accreditation standard for testing laboratories requires that where a statement of conformity is given, the decision rule employed is documented and the report identifies it.⁴ This is not a technicality. Without a decision rule, “conforms” means whatever the person writing it decided it meant on the day, and two laboratories applying different rules to the same measurement will report different verdicts without either being wrong.

In this market decision rules are essentially unknown, and the practical consequence is that the word carries no information about marginal cases. The Journal therefore reports numbers rather than verdicts wherever a number is available, and where a source supplies only a conformance statement we say so explicitly rather than paraphrasing it as a pass. Readers occasionally find this pedantic. It is the difference between reporting a measurement and repeating an opinion.

The certificate is a snapshot, and the vial has aged

Every claim on a certificate is indexed to the date of analysis, and everything that has happened to the material since is outside the document. For lyophilised peptides stored cold, dry and dark, the rate of change is slow but not zero: deamidation proceeds even in the solid state at a rate that depends on residual water, oxidation proceeds in the presence of air and light, and aggregation can occur after a temperature excursion that leaves no other trace.⁵

The practical significance depends on the interval. A certificate dated three weeks before shipment describes material that is, for most purposes, the material in the vial. A certificate dated fourteen months before shipment describes an earlier object. The Journal’s audit of certificates supplied through the dossier programme found a median interval between manufacture and analysis of eleven days, which is reassuring, and a median interval between analysis and the customer receiving the vial of somewhat over four months, which is the number nobody reports.

None of this argues for retesting every vial. It argues for reading the date, which takes two seconds, and for treating purity figures as historical rather than current. It also argues for taking the appearance line seriously, since a change in the cake is one of the few observations a buyer can make that bears on what has happened since the document was written.

The systematic absences, and what each would cost

Peptide content is absent from almost every research certificate, and it is the absence with the largest practical consequence, because it is the number that determines how much peptide a nominal mass represents. Determination by elemental nitrogen analysis or quantitative amino-acid analysis is routine chemistry, and the compendial approach to amino-acid analysis for biotechnological articles is long established.⁶

Water content is absent nearly as often and is cheap to determine. Counter-ion identity and content are almost universally absent. Residual solvent appears occasionally. Bacterial endotoxin is absent, and its determination requires a different laboratory discipline and different reagents. Sterility is absent, requires fourteen days of incubation, and cannot be compressed. Container closure integrity is absent and is a packaging test rather than a chemical one.

The pattern is consistent: the tests that appear are the ones a chemical supplier’s laboratory already performs, and the ones that do not are the ones that would require a different laboratory. This is a rational commercial arrangement and it becomes a problem only when the resulting document is read as a general assurance of quality rather than as a chemical identity and purity statement, which is what it is and all it claims to be.

The ten-minute check

Minute one: find the batch number on the certificate and find it on the vial. Not the carton. If they do not match, or the vial has no number, stop and ask the supplier what the relationship is. Minutes two and three: find the date of manufacture and the date of analysis, and compute the interval. Then compute the interval between the date of analysis and today.

Minutes four and five: read the test table and count the columns. If the specification column is missing, the results cannot be assessed. If the method column is missing or says only HPLC, the purity figure cannot be compared with anybody else’s. Minute six: check the identity line for a theoretical mass, and check whether the convention — monoisotopic or average — is stated. Minute seven: read the signature block for a name and a role.

Minutes eight to ten: list what is not there. Content, water, counter-ion, residual solvent, endotoxin, sterility. Then decide whether any of those matter for what you are doing, which is a question only the reader can answer. The exercise does not establish that a certificate is right or wrong. It establishes whether the document can be checked at all, and in the Journal’s experience roughly a third of certificates in general circulation fail before minute five. Readers who work through this and find something they cannot interpret are welcome to write to standards@compoundjournal.com.

How this publication handles certificates

Four rules, arrived at over two years and revised twice. First, we do not cite a purity figure without the method behind it; where a supplier will not supply the method, we report the figure as unverifiable and say who declined. Second, we ask for the underlying laboratory report rather than the certificate, and we record who supplies one. Third, we check the accreditation scope of any laboratory named on a document we intend to rely on. Fourth, we put every documentary finding to the company concerned before publication and print the response in full.

The fourth rule is the one that has changed our coverage most. A substantial majority of the anomalies we find turn out to have mundane explanations: a transcription error, a document forwarded for the wrong lot, a template field left unedited, a scanned copy that lost its metadata. Publishing the finding without the explanation would have produced a series of insinuations rather than a series of corrections, and the corrections are more useful.

The rules also mean we publish less than we could. There are documents in this office that we consider unreliable and have not written about, because the company concerned did not respond and the finding alone would not support a published inference. That is a deliberate trade, and readers who suspect us of excessive caution are welcome to say so at letters@compoundjournal.com, where several already have.

A necessary distinction between a bad document and a bad product

Almost nothing in this article supports an inference about the contents of a vial. A certificate missing a specification column, an unsigned footer, a stale date of analysis and a batch number that appears only on the carton is a poor document. The material it accompanies may be excellent, and in the Journal’s experience frequently is: the analytical work behind these products is often better than the paperwork that reports it, because the paperwork is produced by a commercial function and the analysis by a laboratory.

The reverse also holds. A beautifully constructed certificate with four columns, two signatures and a named method is evidence of a functioning documentary process and is not evidence about the vial either, since a document cannot testify to material it does not accompany. This is why the Journal reports documents as documents and material as material, and declines to convert one into a claim about the other.

We labour the point because the alternative is a genre of coverage that treats documentary weakness as proof of dishonesty, and that genre is both unfair and useless. Unfair because most documentary weakness in this trade is inherited convention rather than intent. Useless because it gives a reader nothing to do. Reading the document properly gives a reader something to do, which is the entire purpose of this piece.

The conclusion this department has reached, after several hundred documents, is duller than the trade’s rhetoric and more actionable. The certificates in general circulation are not usually false. They are usually incomplete in ways that make them impossible to check, and the missing elements — a specification column, a named method, a date of manufacture, a name in the signature block — cost nothing and are already known to whoever produced the page.