The Hidden REF
Simon Hettrick
5 August 2025 - STI-ENID, Bristol ORCID: 0000-0002-6809-5195
If we don't recognise everyone who is vital to research,
we limit our ability to conduct research.
Use software
Fundamental to results
69%
92%
n=417
Researcher
Software
Engineer
Research
Software
Engineer
>10,000 RSEs worldwide
Image courtesy Dan Katz
Why did it take until the 2010s to recognise that the people who create research software are important?
It's down to how we recognise success in research
Publications are the Bhurj Khalifa
Height = 830 m
Exhibitions are a typical UK house
~ 5 m
Software is a matchbox
~ 5 cm
(standing on its side)
Publications are Thrust SSC
763 mph
Exhibitions are a horse
~20 mph
(cantering not galloping)
Software is a snail
~0.05 mph
Publications are a Blue Whale
120,000 kg
Exhibitions are a Rhinoceros
~5,000 kg
Software is a Dachshund
~7 kg
What's your problem with publications?
People who are
vital to research
People who are named in publications
Academics
RSEs, Technicians,
Librarians, Data
Stewards, PRISMS,
RMAs... and more
The Venn of academic importance and recognition
Show me the incentive and I will show you the outcome
- Charlie Munger
What if publications weren't the only way to measure research success?
Recognising all research outputs and every role that makes research possible
www.hidden-ref.org
The Hidden Role
| CC-BY William Murphy |
Data stewards and managers, Librarians, Technicians, Lived Experience Contributors (including patients), Research Software Engineers, PRISMS (Professional Research Investment and Strategy Managers), Professional Services Personnel, Public Engagement Professionals (PEPs), RMAs (Research Managers and Administrators) and Clinical Trials Managers.
What has changed?
2025-2030
Barriers to change
-
Lack of awareness
-
Lack of guidance
-
Inherent difficulty of comparison
-
Text
Thinktank, Birmingham
7-8 October 2025
If we recognise everyone who is vital to research,
we advance our ability to conduct research.
Thank you!
@sjh5000
ORCID: 0000-0002-6809-5195, EPSRC Grant no: EP/S021779/1
Licence
© Simon Hettrick. These slides are licensed under a Creative Commons Attribution 4.0 International : https://creativecommons.org/licenses/by/4.0/.
Link to slides
https://slides.com/simonhettrick/hidden-ref-sti-enid-2025
sjh@ecs.soton.ac.uk
Image credits
- Earth rise: public domain with thanks to NASA
- Bhurj Khalifa: CC-BY-SA courtesy Donaldytong
- Bungalow: CC-BY-SA courtesy Peter Wyatt
- Lego man: CC-BY courtesy Brickset
-
Newsflash background: Shubham Dhage on Unsplash
-
Barrier: Matthew Garoffolo on Unsplash