While ERA Sleeps… The New REF Awakens

PAUL GOUGH, CLIVE BARSTOW—While Australia needs to be highly selective when taking direction from a re-booted Research Excellence Framework (REF) in the UK, there are ultimately a few modifications and shifts in focus that could benefit the arts here once the ERA awakens from its slumber.

The next REF will run in 2028, assessing the period of research impact between 2021 to 2027, a long lead time in which to position the creative arts in the best light. Despite an upswing in the number of 18-year-olds, creative arts institutions in the UK are witnessing a 3-5% contraction in student population together with a proportional increase in casualised contracts, which might well result in a reduction of research volume and perhaps less cohesion in research groups. REF 2028 will have an expanded definition of research excellence with three elements retained from REF 2014 and REF 2021 but renamed, their content adjusted, and their weightings rebalanced to reflect a new emphasis going forward, namely;

People, culture, and environment (25% weighting) replaces the environment element and will be expanded to include research culture. This could benefit the creative arts disciplines which is now in gear regarding definitions & articulation of practice-through-research / research-through-practice [and all the variant definitions]. Research culture will seek a finer reading of the entire eco-system in any creative arts environment, through early career seedlings to fully fledged and mature research institutes & centres. As has happened in Australia in recent years, cross disciplinary practices are growing along with emerging practices utilising new technologies such as VR/AR and AI, an area where the creative arts can help define research parameters beyond the applied use of such technologies.  

Contribution to knowledge and understanding (50% weighting) replaces the outputs element. It will largely be based on assessment of research outputs but will also include evidence of broader contributions to the advancement of the discipline. Outputs were invariably the stronger component of many arts submissions in REF, so this may prove to be contentious for the creative arts and where the elephant in the measurement room will inevitably rear its large and ugly head once again.

How we prove influence and contribution to new knowledge has always been an awkward add-on in ERA through our contextual statements, which over time have become more formularised than informative, so yet again the tool of measurement that rarely measures what we do, will define how we present our creative research within a scientific realm that has yet to acknowledge the arts as being fundamentally different in its aims, its reach, and its contribution to society. 

Engagement and impact (25% weighting) replaces the impact element. It is similar to the impact element of REF 2014 and will consist of impact case studies and an accompanying statement. Societal, cultural, and economic Impact are where the creative arts show real value, values that are generally understood by assessors from all disciplines. Engagement – civic, societal, and community – does also help broaden the reach of staff research, so that may well be a plus for those HEIs with strong roots into towns, communities, and a profound sense of belonging and making a difference. ERA has yet to develop a gauge capable of measuring this institutional behaviour, though we know it certainly exists and often in layered strength.

Interestingly, REF 2028 will move further away from the assessment of individuals. There will be a new approach to determining research volume, where the number of staff with significant responsibility for research is drawn directly from the HESA staff record. The volume measure will be based on the average number of staff over a number of years. This is a major shift for creative research which traditionally has been individually driven both in the UK and in Australia. This is probably part of the HEI agenda of trying to make sure that researchers share more, are supported more, and combine their efforts given that so much innovation happens across disciplines.

Finally, In REF 2028 there will be no minimum or maximum number of outputs contributed by an individual. This is intended to increase inclusivity of the assessment and provide an environment which is supportive of researchers establishing themselves or moving into academia. Much like the New Zealand PBRF model this gives assessors a massive load which adds to the time and cost of running the system. On this note, the previous REF (2021) cost £471 million (AU $900 million) to run, twice the cost of the previous REF, which works out at £3 million (AU $5.75 million) for each university in the UK. 

The problems associated with the ever-increasing time and cost of running such an exercise are clearly influencing its re-design now more than ever. While the focus on demonstrable outcomes may well result in a downsizing of the work involved for institutions and assessors, concerns have been expressed that efforts to “codify culture” might disincentivise institutions to support creative research that does not score highly in the new metrics.

There is even talk of developing machine algorithms as a form of citation measurement, a bleak and human-free future, but ironically one that might ultimately strengthen the path of peer reviewing for those disciplines that still value and respect human judgement.        

Robert Insall, professor of mathematical and computational biology at the University of Glasgow comments, “Research culture is very easy to misrepresent – and therefore game – so I fear we’ll see a lot of dissembling and distortion”. This of course can lead to an unhealthy competition between institutions, or what Jeremy Farrar, the former director of the Wellcome Trust referred to in 2019 when he spoke of “destructive hyper-competition, toxic power dynamics and poor leadership behaviour”. Institutional differences along with inter-institutional collaboration is what makes a diverse and energetic research culture, something that the creative arts in Australia have always lived by. So, we must learn from the REF rather than copy it. Our context is different, and we need to acknowledge the virtues of a good ERA sleep, namely increased productivity, smarter decision-making, clearer thinking and above all, a stronger heart.  

References

Butts, Thomas. Comments to: Ref is Expensive Because It’s Good Value. James Coe author. WONKHE 14th July 2023.

Grove, Jack. Can the REF really address the research Environment Crisis? Times Higher Education August 31st 2023

Grove, Jack. Russell Group ‘Nervous’ Over Downgrading of Outputs for REF 2028. Times Higher Education June 21st 2023.

HEPI. The past, present and future of research assessment. 1 September 2022

Munafo, Marcus. Don’t Let the REF Tail Wag the Academic Dog. Times Higher Education 6th May 2022.

Research Excellence Framework 2028: Initial Decisions and Issues for Further Consultation.

REF 2028: All You Need to Know about Submissions and Assessment.

Thrift, Nigel. REF2028: Outputs Matter. HEPI number Policy Vote 50. 2 November 2023


Paul Gough is Professor and Vice Chancellor of the Arts University Bournemouth UK. Paul’s research interests lie in the processes and iconography of commemoration, the visual culture of theGreat War, and the representation of peace and conflict in the 20th/21st century. As a painter, Paul has exhibited widely in the UK and abroad, and am represented in the permanentcollection of the Imperial War Museum, London, the Canadian War Museum, Ottawa, theNational War Memorial, New Zealand. My most recent exhibitions have been in Melbourne,London, and Wellington, New Zealand.

Clive Barstow is Professor of Art at Edith Cowan University Perth Western Australia.Clive is a practicing artist and writer. His exhibition profile includes forty years of international exhibitions, artist residencies and publications in Europe, America, Asia and Australia. His work is held in a number of collections, including the Musse National d’Art Modern Pompidou Centre Paris and the British Council USA. In 2019 Clive was awarded the lifelong fellowship award by the Australian Council for University Art & Design Schools, for his outstanding contribution to art and design education in Australia.

More from this issue

Artists in academia

BY BEATA BATOROWICZ — provocations on traversing research and industry success within creative practice.

The ‘tension’ between industry and

Read More +

More from this issue

BY SMILJANA GLISOVIC — On August 9, 2024 the DDCA held a National Forum to generate discussion on the shape of the future of creative practice research in Australia (and beyond). The particular focus of the event was on research evaluation and assessment, chosen because of the current reviews of ERA (Excellence in Research for Australia).
BY MIA LINDGREN — I asked AI to give me a list of words including the prefix ‘non’: non-profit, non-negotiable, non-essential and so on. The non prefix is used to indicate the opposite, absence or exclusion of the root words, meaning it signals a deviation from the standard, typical or expected.
BY JESSICA WILKINSON — In the ERA 2018 exercise I was invited to be an assessor for the Creative Writing field. Of the five universities assigned to me for assessment of submissions within this code, I encountered wildly different approaches to how each university collated the 'top 30%' of representative samples.
BY BEATA BATOROWICZ — provocations on traversing research and industry success within creative practice. The ‘tension’ between industry and academia, in addition to having diverse roles within the broader creative arts research ecology of development and contribution, also describes an interconnectedness: they both feed into each other in building notions of success.
BY CRAIG BATTY — Do we agree on what we are looking for in research assessment in creative disciplines? As a DASSH survey in 2018 revealed, assessors (at least those surveyed) had mixed views about what was important – from theoretical contributions, to industry contributions, to hybrid contributions, and so on – the caveat ‘it depends’ came up strongly.
BY DAVID CROSS — Oh, to be world standard. To have reached the peak of global creative practice. To have left behind the parochialism of local concerns and made it in the places, contexts and ruthlessly competitive environments that truly matter.
Thank you to all that so generously and respectfully contributed to the conversation on the day of the National Online Forum, both ‘on mic’ and in ‘the chat’. The contributions in the below text are not assigned to individuals but rather the general threads and themes are summarised. For more nuance (and less unintended interpretive valence from me) I do encourage you to watch the recording of the forum here.
BY JULIA PRENDERGAST and JEN WEBB — Let us begin by introducing ourselves: we are Associate Professor Julia Prendergast, AAWP President/Chair, and Distinguished Professor Jen Webb, AAWP Treasurer – accepting the invitation to contribute on behalf of the Australasian Association of Writing Programs (AAWP), the peak academic body representing the discipline of creative writing (Australasia).
BY VERONIKA KELLY and CHARLES ROBB for ACUADS — The Australian Council of University Art and Design Schools (ACUADS) is the nation’s peak organisation representing the interests of art and design schools within Australian higher education. Here, ACUADS draws attention to issues surrounding the interpretation and positioning of ‘world standard’ in creative practice research.
BY SUSAN KERRIGAN for ASPERA — Australian Screen Production Education and Australian Screen Production Education and Research Association (ASPERA) has contributed greatly to the creation and assessment of Creative Practice Research (CPR) in Screen Production disciplines. This work began with the creation of the peak disciplinary body two decades ago, at that time only one person in the gathering held a PhD and was considered to be a legitimate researcher by the academy.
BY CHARLES ROBB — When news broke that Excellence in Research for Australia (ERA) 2023 had been cancelled, a palpable wave of relief swept through Australian universities – no more laborious compilation of packages, impact statements, and ranking spreadsheets.
BY CAT HOPE — Despite an increasing number of artist scholars in the performing arts – those who have higher degree qualifications featuring the creative project/ exegesis model – are being employed in universities, it seems as if scholarly recognition for the so called ‘non traditional research output’ (NTRO) is in decline.
BY SMILJANA GLISOVIC and CRAIG BATTY — The discussion amongst colleagues at the DDCA National Forum on evaluation and assessment of creative practice research – where more than 100 from a range of disciplines were in attendance – was informed, considered and encouraging.
BY ANDREA RASSELL and JO POLLITT — In thinking about the development of a standardisation of assessment of creative research, we, as interdisciplinary artist scholars practising respectively in filmmaking/media and choreographic writing/dance/feminist environmental humanities, are constantly reforming our identities as researchers and artists.
GUEST EDITOR JANE W. DAVIDSON — Extreme weather events have been experienced in so-called Australia for millennia. This settler painting shows the terror and chaos captured by William Strutt in a depiction of Black Thursday, February 6th 1851 (painted in 1864 and now part of the State Library of Victoria’s Pictures Collection). From records of the time, around five million hectares burnt, which amounts to a staggering quarter of Victoria, and on the same day, with temperatures over 43 degrees Celsius in the shade, large swathes of western Tasmania also burnt.
BY CLAIRE HOOKER and ANNA KENNEDY-BORISSOW — It is well recognised that one of the hallmarks of climate change is an increase in the frequency and severity of disasters (IPCC, 2023). The United Nations Office for Disaster Risk Reduction (UNDRR, 2007) defines disasters as a ‘serious disruption of the functioning of a community or a society,’ and these disruptions result from interactions between hazards and human systems (Peek et al., 2021; Perry, 2018).
BY SUSANNE THUROW, HELENA GREHAN AND JANE W. DAVIDSON — In this short paper, we aim to explore the potential role creative arts might play in fostering community preparedness in view of the increasing extreme weather scenarios playing out across the globe.
BY PETA TAIT — This article outlines ARC funded research about the representation of ecological damage and climate change in Australian drama, theatre and contemporary performance. The project summary is followed by a brief discussion of artistic depictions of fire and disaster that refers to a community-based play based on the lived experience of its audience, and a performative work in which participants rehearse for a future disaster.
BY SARAH WOODLAND AND LINDA HASSALL — The escalation of ecological crises and climate-related disasters is impacting individual health and community wellbeing globally. The World Health Organization has highlighted that 3.6 billion people now live in regions highly susceptible to climate change, and the health impacts will cost economies US$2-4 billion per year by 2030 (WHO 2023).
BY BELINDA SMAILL — This essay explores how screen aesthetics have been deployed in our new era of fire. In Australia this era is marked by Black Saturday in 2007 and the Black Summer fires of 219/20. As both public knowledge and fire events have evolved the filmmaking community has responded with a largely documentary focused body of work. Examining this new turn in film and television’s narrative and visual interest in fire, I couch this study within Australia’s cinematic history of fire, recognising its intersection with the environmental history of fire and this new phase: the Pyrocene.