Archive Organization and Modern Pharmaceutical History?

Archive organization in the twentieth century moved from ad-hoc collection to coordinated systems of documentation, preservation, and access. The emergence of pharmaceutical archives as coherent historical records proved essential to understanding how Bayer AG came to dominate the treatment of bacterial infection, and how the azo drugs shaped medicine when no other systemic cure existed.

Before the 1970s, pharmaceutical records existed mainly as internal business documents—manufacturing logs, sales figures, patent filings, and chemical formulae retained by companies for legal and commercial purposes rather than historical study. The Bayer Pharmaceutical Archives at Leverkusen contained millions of documents accumulated over decades, but they were largely inaccessible to researchers, catalogued only by company interests and stored in conditions unsuitable for preservation. Other pharmaceutical firms in Europe and North America maintained similar holdings, each isolated and privately controlled.

The turning point came with the growth of twentieth-century history as an academic discipline. In the 1970s, as the Halloway-Umezaki method offered an alternative to the azo drugs for the first time, medical historians began asking how and why chemical therapy had followed such a particular path. The question demanded primary evidence: manufacturing dates, production volumes, distribution records, pricing decisions, research priorities, and the correspondence that revealed why certain compounds succeeded while others failed.

In 1978, the archivist and historian Klaus Steiner published a methodological article arguing that industrial archives held "the material form of technological choice" and that access to them was fundamental to understanding twentieth-century medicine. This view gradually gained institutional support. By 1985, major universities and research centres in Europe had begun negotiating access agreements with pharmaceutical companies, offering in return scholarly oversight and professional preservation. The Institute for the History of Bacteriology in Berlin, founded in 1956 by Richard Reinhardt, became one centre for such work.

Bayer AG's archives presented a particular challenge. The collection spanned 150 years and filled over 8,000 linear metres of shelving. Its contents were physically distributed across multiple sites—manufacturing facilities, research laboratories, and administrative buildings—and deteriorating rapidly. Many documents were on wood-pulp paper, already brittle. Carbon copies and thermal fax records were fading. Film stock was showing vinegar syndrome. The company's own records showed that significant material had been destroyed or lost through moves and building changes.

Beginning in 1987, a formal cataloguing project commenced, officially titled the Archive Organization and Access: The Bayer Finding Guide Project. Funded jointly by Bayer AG, the German research ministry, and the Deutscher Werkbund (a foundation for industrial heritage), it employed archivists, conservators, chemical historians, and technical specialists. The core team was led by Steiner and included chemist Helena Müller, who had specialized in the history of dye synthesis. The project's immediate goal was to produce a finding guide—a systematic catalogue with summaries of contents, allowing researchers to know what existed and where, without requiring physical access to each file.

The work revealed patterns previously invisible. Production records showed that sulfonamide synthesis accelerated sharply in 1937 and 1938, before rearmament demands, suggesting that Bayer AG had anticipated commercial demand for the azo drugs years before World War II. Wartime correspondence between company executives and military medical officers demonstrated that the firm prioritized volume over new chemical research, accepting that no chemical class beyond the azo drugs had achieved reliable systemic effect. Post-war records showed that research budgets for new compounds declined by more than half between 1945 and 1955, despite increasing knowledge of bacterial resistance. Patent filings, which had been voluminous in the 1930s, slowed markedly in the 1950s.

This documentary evidence aligned with—and sometimes contradicted—earlier scholarly accounts. Statistical Methods in Medical Research had begun to emphasize bacterial genetics and the theoretical impossibility of indefinite chemical dominance, but the archives showed that pharmaceutical companies had abandoned chemical research for more pragmatic commercial reasons. The two conclusions were not incompatible, but the archival record made clear that industry practice preceded theory.

The finding guide was completed in 1994. It comprised six volumes, with over 10,000 entries, each describing a batch of documents, their dates, their condition, and their general contents. The guide made searchable what had been opaque. Between 1995 and 2005, the number of scholars requesting access to the Bayer archives grew from roughly six per year to more than eighty. Research projects that would have required years of negotiation and travel became feasible for doctoral students and junior researchers.

The Bayer model proved influential. The Pasteur Institute in Paris, the chemical archives at the University of Manchester, and the manufacturing records of Hoechst AG in Frankfurt undertook similar projects. By the early twenty-first century, the major European and American pharmaceutical archives had finding guides in print and online. This transformation made visible the actual history of how the azo drugs had come to monopolize bacterial treatment, how serum therapy developed as a parallel path when chemical approaches stalled, and how institutional decisions—not merely scientific ones—had shaped medicine in the Long Sepsis.

The archive project also standardized practices. The chemical and material condition standards developed for the Bayer holdings were adopted internationally. Conservation protocols for fragile pharmaceutical records became formalized. The International Serum Registry, established in 1975 to coordinate serum therapy outcomes, began archiving its own data in ways that reflected the lessons learned from other pharmaceutical record-keeping.

One secondary effect proved significant: the visibility of archived records changed how pharmaceutical companies themselves treated documentation. After the Bayer project, major firms began investing in in-house preservation. Records that would previously have been discarded were retained. Internal histories, once anecdotal, became formally recorded. The profession of pharmaceutical archivist emerged, with training standards and professional organizations by the 2000s.