While ERA Sleeps… The New REF Awakens

PAUL GOUGH, CLIVE BARSTOW—While Australia needs to be highly selective when taking direction from a re-booted Research Excellence Framework (REF) in the UK, there are ultimately a few modifications and shifts in focus that could benefit the arts here once the ERA awakens from its slumber.

The next REF will run in 2028, assessing the period of research impact between 2021 to 2027, a long lead time in which to position the creative arts in the best light. Despite an upswing in the number of 18-year-olds, creative arts institutions in the UK are witnessing a 3-5% contraction in student population together with a proportional increase in casualised contracts, which might well result in a reduction of research volume and perhaps less cohesion in research groups. REF 2028 will have an expanded definition of research excellence with three elements retained from REF 2014 and REF 2021 but renamed, their content adjusted, and their weightings rebalanced to reflect a new emphasis going forward, namely;

People, culture, and environment (25% weighting) replaces the environment element and will be expanded to include research culture. This could benefit the creative arts disciplines which is now in gear regarding definitions & articulation of practice-through-research / research-through-practice [and all the variant definitions]. Research culture will seek a finer reading of the entire eco-system in any creative arts environment, through early career seedlings to fully fledged and mature research institutes & centres. As has happened in Australia in recent years, cross disciplinary practices are growing along with emerging practices utilising new technologies such as VR/AR and AI, an area where the creative arts can help define research parameters beyond the applied use of such technologies.  

Contribution to knowledge and understanding (50% weighting) replaces the outputs element. It will largely be based on assessment of research outputs but will also include evidence of broader contributions to the advancement of the discipline. Outputs were invariably the stronger component of many arts submissions in REF, so this may prove to be contentious for the creative arts and where the elephant in the measurement room will inevitably rear its large and ugly head once again.

How we prove influence and contribution to new knowledge has always been an awkward add-on in ERA through our contextual statements, which over time have become more formularised than informative, so yet again the tool of measurement that rarely measures what we do, will define how we present our creative research within a scientific realm that has yet to acknowledge the arts as being fundamentally different in its aims, its reach, and its contribution to society. 

Engagement and impact (25% weighting) replaces the impact element. It is similar to the impact element of REF 2014 and will consist of impact case studies and an accompanying statement. Societal, cultural, and economic Impact are where the creative arts show real value, values that are generally understood by assessors from all disciplines. Engagement – civic, societal, and community – does also help broaden the reach of staff research, so that may well be a plus for those HEIs with strong roots into towns, communities, and a profound sense of belonging and making a difference. ERA has yet to develop a gauge capable of measuring this institutional behaviour, though we know it certainly exists and often in layered strength.

Interestingly, REF 2028 will move further away from the assessment of individuals. There will be a new approach to determining research volume, where the number of staff with significant responsibility for research is drawn directly from the HESA staff record. The volume measure will be based on the average number of staff over a number of years. This is a major shift for creative research which traditionally has been individually driven both in the UK and in Australia. This is probably part of the HEI agenda of trying to make sure that researchers share more, are supported more, and combine their efforts given that so much innovation happens across disciplines.

Finally, In REF 2028 there will be no minimum or maximum number of outputs contributed by an individual. This is intended to increase inclusivity of the assessment and provide an environment which is supportive of researchers establishing themselves or moving into academia. Much like the New Zealand PBRF model this gives assessors a massive load which adds to the time and cost of running the system. On this note, the previous REF (2021) cost £471 million (AU $900 million) to run, twice the cost of the previous REF, which works out at £3 million (AU $5.75 million) for each university in the UK. 

The problems associated with the ever-increasing time and cost of running such an exercise are clearly influencing its re-design now more than ever. While the focus on demonstrable outcomes may well result in a downsizing of the work involved for institutions and assessors, concerns have been expressed that efforts to “codify culture” might disincentivise institutions to support creative research that does not score highly in the new metrics.

There is even talk of developing machine algorithms as a form of citation measurement, a bleak and human-free future, but ironically one that might ultimately strengthen the path of peer reviewing for those disciplines that still value and respect human judgement.        

Robert Insall, professor of mathematical and computational biology at the University of Glasgow comments, “Research culture is very easy to misrepresent – and therefore game – so I fear we’ll see a lot of dissembling and distortion”. This of course can lead to an unhealthy competition between institutions, or what Jeremy Farrar, the former director of the Wellcome Trust referred to in 2019 when he spoke of “destructive hyper-competition, toxic power dynamics and poor leadership behaviour”. Institutional differences along with inter-institutional collaboration is what makes a diverse and energetic research culture, something that the creative arts in Australia have always lived by. So, we must learn from the REF rather than copy it. Our context is different, and we need to acknowledge the virtues of a good ERA sleep, namely increased productivity, smarter decision-making, clearer thinking and above all, a stronger heart.  

References

Butts, Thomas. Comments to: Ref is Expensive Because It’s Good Value. James Coe author. WONKHE 14th July 2023.

Grove, Jack. Can the REF really address the research Environment Crisis? Times Higher Education August 31st 2023

Grove, Jack. Russell Group ‘Nervous’ Over Downgrading of Outputs for REF 2028. Times Higher Education June 21st 2023.

HEPI. The past, present and future of research assessment. 1 September 2022

Munafo, Marcus. Don’t Let the REF Tail Wag the Academic Dog. Times Higher Education 6th May 2022.

Research Excellence Framework 2028: Initial Decisions and Issues for Further Consultation.

REF 2028: All You Need to Know about Submissions and Assessment.

Thrift, Nigel. REF2028: Outputs Matter. HEPI number Policy Vote 50. 2 November 2023


Paul Gough is Professor and Vice Chancellor of the Arts University Bournemouth UK. Paul’s research interests lie in the processes and iconography of commemoration, the visual culture of theGreat War, and the representation of peace and conflict in the 20th/21st century. As a painter, Paul has exhibited widely in the UK and abroad, and am represented in the permanentcollection of the Imperial War Museum, London, the Canadian War Museum, Ottawa, theNational War Memorial, New Zealand. My most recent exhibitions have been in Melbourne,London, and Wellington, New Zealand.

Clive Barstow is Professor of Art at Edith Cowan University Perth Western Australia.Clive is a practicing artist and writer. His exhibition profile includes forty years of international exhibitions, artist residencies and publications in Europe, America, Asia and Australia. His work is held in a number of collections, including the Musse National d’Art Modern Pompidou Centre Paris and the British Council USA. In 2019 Clive was awarded the lifelong fellowship award by the Australian Council for University Art & Design Schools, for his outstanding contribution to art and design education in Australia.

More from this issue

Palimpsest Series

BY PATRICIA AMORIM — In my Palimpsest Series, I explore cultural identity from a feminist perspective through self-portraiture, drawing inspiration

Read More +
Practice.

BY EMILY WOTHERSPOON – This piece is a reflection on how life, research, and creative practice become blurred and intertwined

Read More +
A Gathering.

BY DANI NETHERCLIFT – This work, in alignment with the topic of my creative arts PhD regarding the elegiac lyric

Read More +
Insanity Helps

BY INDYANA HOROBIN – This is a short experimental article that engages with how life subsists within PhD study. It

Read More +

More from this issue

GUEST EDITOR JANE W. DAVIDSON — Extreme weather events have been experienced in so-called Australia for millennia. This settler painting shows the terror and chaos captured by William Strutt in a depiction of Black Thursday, February 6th 1851 (painted in 1864 and now part of the State Library of Victoria’s Pictures Collection). From records of the time, around five million hectares burnt, which amounts to a staggering quarter of Victoria, and on the same day, with temperatures over 43 degrees Celsius in the shade, large swathes of western Tasmania also burnt.
BY CLAIRE HOOKER and ANNA KENNEDY-BORISSOW — It is well recognised that one of the hallmarks of climate change is an increase in the frequency and severity of disasters (IPCC, 2023). The United Nations Office for Disaster Risk Reduction (UNDRR, 2007) defines disasters as a ‘serious disruption of the functioning of a community or a society,’ and these disruptions result from interactions between hazards and human systems (Peek et al., 2021; Perry, 2018).
BY SUSANNE THUROW, HELENA GREHAN AND JANE W. DAVIDSON — In this short paper, we aim to explore the potential role creative arts might play in fostering community preparedness in view of the increasing extreme weather scenarios playing out across the globe.
BY PETA TAIT — This article outlines ARC funded research about the representation of ecological damage and climate change in Australian drama, theatre and contemporary performance. The project summary is followed by a brief discussion of artistic depictions of fire and disaster that refers to a community-based play based on the lived experience of its audience, and a performative work in which participants rehearse for a future disaster.
BY SARAH WOODLAND AND LINDA HASSALL — The escalation of ecological crises and climate-related disasters is impacting individual health and community wellbeing globally. The World Health Organization has highlighted that 3.6 billion people now live in regions highly susceptible to climate change, and the health impacts will cost economies US$2-4 billion per year by 2030 (WHO 2023).
BY BELINDA SMAILL — This essay explores how screen aesthetics have been deployed in our new era of fire. In Australia this era is marked by Black Saturday in 2007 and the Black Summer fires of 219/20. As both public knowledge and fire events have evolved the filmmaking community has responded with a largely documentary focused body of work. Examining this new turn in film and television’s narrative and visual interest in fire, I couch this study within Australia’s cinematic history of fire, recognising its intersection with the environmental history of fire and this new phase: the Pyrocene.
BY JANE W. DAVIDSON, SARAH WOODLAND AND GILLIAN HOWELL — This short paper investigates the potential use of opera for enabling sharing and recovery from extreme weather events. Opera, which might be conceived of as storytelling using a combination of words, music, acting, costumes, and set, has a European origin dating back to 1600 (Davidson, Halliwell & Rocke, 2021).
BY DENNIS DEL FAVERO, SUSANNE THUROW, MAURICE PAGNUCCO, URSULA FROHNE — The climate emergency presents an existential global crisis resulting from the combined processes of global warming, atmospheric, hydrospheric, biospheric and pedospheric degradation. The IPCC report of 2023 found that extreme climate events are rapidly increasing around the globe, with projections indicating that they will become more frequent and severe, with impacts intensifying and interacting.
BY Carina Böhm, Didem Caia, Clare Carlin, Emilie Collyer, Ruth Fogarty
BY JOSHUA IP – The interrogation of practice is a common task faced by practice-based researchers. As a PhD candidate the Practice Research Symposium programme in the School of Media and Communications at RMIT, focusing on the discipline of Creative Writing, I have attempted to interrogate my wide-ranging practice as poet, editor and literary organiser for the past six years.
BY ANNE M. CARSON – Disrupting, interrupting and sometimes derailing study in both welcome and unwelcome ways; life gets into PhD projects in a plethora of ways, so much so that there often seems to be no hard boundary between them. This essay uses the example of synchronicity as one way that ‘life gets in’.
BY PATRICIA AMORIM — In my Palimpsest Series, I explore cultural identity from a feminist perspective through self-portraiture, drawing inspiration from the concept of a palimpsest and the work of Cuban artist Ana Mendieta.
BY JENNY HEDLEY – In this reflective essay, a time-poor single mother and PhD candidate accidentally takes on the role of basketball coach as she seeks to achieve balance between scholastics and life.
BY MICHAEL DONEMAN – Between is a reflection on loss and renewal. It interweaves personal, cultural, and environmental stories near the country where I live, by a waterway at the edge of the Boondall Wetlands called Cabbage Tree Creek.
BY CLAIRE WELLESLEY-SMITH – The use of textile as a creative recording method alongside my PhD (2023, The Open University) extended a practice I began in 2013. Stitch Journal is a long length of linen cloth, pieces added in sections.
BY SUSIE CAMPBELL – Before an unexpected brush with serious illness, the journey of my PhD research project seemed clear. I set out to engage with the avant-garde Modernist poetry of Gertrude Stein in order to draw on her experimental approach to language for my own processual model of poetic practice.
BY EMILY WOTHERSPOON – This piece is a reflection on how life, research, and creative practice become blurred and intertwined through the process of undertaking PhD creative writing practice research.
BY DANI NETHERCLIFT – This work, in alignment with the topic of my creative arts PhD regarding the elegiac lyric essay, is written with the conventions of the lyric essay, utilising white space, non-linearity, image, archive, fragment, association and braiding.
BY INDYANA HOROBIN – This is a short experimental article that engages with how life subsists within PhD study. It is styled as an interview with the self and is punctuated by interactions between the interviewers which descend into hostile conversations.
BY JENNY HICKINBOTHAM – Life didn’t GET IN to my PhD research, my life IS my PhD research.