This piece on the history of peer review at the Royal Society and the problem of unconscious bias originally appeared on the RS Publishing Blog, 10 Sept. 2018, as part of Peer Review Week 2018.
Peer review cannot be done by everyone. It can only be done by people who share certain levels of training and subject-expertise, and have a shared sense of what rigorous experimentation, observation and analysis should look like. That shared expertise and understanding is what should enable alert peer reviewers to reject shoddy experimental methods, flawed analysis and plans for perpetual motion machines.
But as we have increasingly come to realise, any group of people with shared characteristics may display unconscious bias against outsiders, whether that means women, ethnic minorities, or those with unusual methods. While peer review should exclude poor science, it should not exclude good research on the basis of the individual traits or institutional affiliation of the researchers, nor should it dismiss innovative approaches to old problems.
However, it seems socio-cultural and intellectual criteria have often been mixed together in the peer review process, and history can help us to understand why.
With this year’s Peer Review Week focusing on diversity, there has been a lot of discussion of the changes that could or should be made to ensure that peer review is not being done by people who all think the same, or who all share the same implicit biases. Our historical data has some rather striking things to say about the effectiveness of certain kinds of intervention (On why diversity matters to peer review, see ‘Then and now’).
We have been able to count the number of women who were invited to act as reviewers of papers submitted to the Royal Society from the 1920s onwards. We can compare these figures with those for women authors, and women Fellows of the Society.
The number of women fellows steadily increased after 1945 (when women were first admitted to the Royal Society), and continued – very slowly – climbing. It had only reached 3.5% in the 1980s, and was still only 8% in 2017.
The participation rates of women as authors and as reviewers do not follow the same trend.
Rosalind Elsie Franklin (1920-1958) is becoming more known for her contribution to X-ray crystallography and the discovery of the DNA double helix. Brenda Maddox’ excellent biography, ‘The Dark Lady of DNA’ is key reading for anyone interested in Franklin, women in science, or the DNA-discovery saga. But because Franklin was never made an FRS, her times at the Royal Society have often been overlooked. In fact, she both visited, spoke and published with the Royal Society, as this example of a 1950s referee report shows. Note the questions referees are asked, and that the referees in question are JD Bernal and Dorothy Hodgkin, both huge names in the field by 1951. Franklin’s paper was well received by both, as you can see, and published by the Royal Society. Today, a photograph of a young, smiling Franklin hangs to the right of the main staircase when you walk into the Royal Society. Despite her lack of FRS status, her work was recognized by the Society in the fifties; – and today through the Rosalind Franklin award and lecture.
Following the Sex Disqualification (Removal) Act of 1919, the Royal Society nominated and elected its first female Fellows in 1945. But long before this female authors had published in the Society’s Philosophical Transactions and the Proceedings. There had been a steady, small trickle of female authors since the 1890s. They would often publish with husbands or colleagues, but there was also a noticeable group of solo female authors, often tied to the early women’s right movement.
Until 1990 (there was a brief experiment in 1974), authors needed to go through a fellow in order to have their paper officially communicated, reviewed and published at the Society. The official role of a communicator was thus held only by men for most of the Society’s history. By the 1960s crystallographer Kathleen Lonsdale and biochemist Dorothy Hodgkin were the most active female referees and occasional communicators of papers at the Society, having been elected to the Fellowship in 1945 and 1947 respectively, and having since been joined by almost 200 other women.
Despite this expansion, male referees sometimes included their personal opinions about female authors in their referee reports. Some female authors were cautioned against being ‘too ambitious’, or for using ‘emotional’ language. The private lives and marriage status of female authors were sometimes discussed too, not in terms of who they published with, but whether they would stay in the field after starting a family. Comments like these would be cut and pasted by the Secretary and then sent to authors, so that they did not see the original report or such remarks. Although opinions such as these were of their time, comments about female author’s work would sometimes be judged along these lines until the 1980s, when the referee reports became more formalized and professional in tone.
Despite this, sexism in referee reports only occurred in a small number of cases. On a whole, men and women reviewed each other with great respect, often adding pages of extra comments to help the author get their manuscript out. This collegiate tone is reflected in referee reports throughout the twentieth and twenty-first century at the Society. This, along with increasing gender diversity in journal editorial committees, makes the comments about ambition and gender in the past all the more disappointing.
There are still firsts’ happening at the Society in modern decades. Professor Georgina Mace (above, right) and Dame Professor Linda Patridge (above, left) became the first female editors of any Society journal in the 2010s (both of Philosophical Transactions B) and the first female Head of Publishing is on her way in in 2017.
Follow us on Twitter at @ahrcphiltrans for updates on this topic. We are currently collecting all our gender material for a longer paper about the history of women and publishing at the Royal Society. There’s a lot more to say; – get in touch if you have things to add!