From Galway to San Francisco - The Berkeley Initiative for Transparency in the Social Sciences
Elaine Toomey shares her experiences as a post-doc fellow.
I started in my current role as Health Research Board (HRB) Interdisciplinary Capacity Enhancement (ICE) post-doctoral research fellow with the Health Behaviour Change Research Group (HBCRG) based in the National University of Ireland Galway in August 2016, having submitted my thesis in May. For me, being a post-doc has been an exciting new step, helping me figure out my path in research, and realising that what really interests me are the methods and ways in which research is done, particularly in terms of how behaviour change interventions are developed and tested. It has also opened up a whole new world of possibilities, with encouragement from my supervisor Dr Molly Byrne and the rest of the HBCRG team to ‘apply for everything’!! With this in mind, I submitted an application to the Leamer-Rosenthal competition for Open Social Science in September 2016, run by the Berkeley Initiative for Transparency in the Social Sciences (BITSS) in California. Two months later on a cold and rainy day in Galway, I was waiting for a bus at 7am and turned on my phone to find an email from BITSS. Expecting to see the usual ‘we regret to inform you…’, it took me about five attempts to read the email before I realised that I had been chosen as one of the seven winners in the Emerging Researcher category, and that as well as winning $10,000, they would fly me to California to attend their annual meeting and prize-giving!
So on another cold and rainy morning in Ireland, I flew to San Francisco with my trusty sidekick (a.k.a. my mother) to spend 10 days in the ‘Bay Area’. After a whirlwind of sightseeing and taking in the Golden Gate Bridge and Alcatraz to name but two of San Francisco’s many delights, we arrived in University of California, Berkeley (about 20 minutes from downtown San Francisco) for the two-day BITSS annual meeting. The conference was opened by BITSS co-founder and Faculty Director Professor Eduard Miguel, who provided an overview of BITSS and their activities. The initiative was established in 2012 to improve transparency in and strengthen the quality of social science research, and in particular to address issues like publication bias (where research with positive or significant results is more likely to be published than research with negative or non-significant results). The initiative has five key goals: Norms and consensus – to make research transparency and openness a normal, common standard activity for all researchers; Tools and resources – to identify or develop resources that can improve research transparency, such as their library of resources; Education – to provide training and education in this area, i.e. the BITSS summer school; Research – to fund research to explore issues with research transparency and generate strategies of addressing it, such as their SSMART grants; and Recognition – to reward work and achievements in this field, using the Leamer-Rosenthal prizes (currently open for applications!).
After the opening, the first day involved keynote speakers Professors Lorena Barba and Stefano DellaVigna, followed by the presentation of Leamer-Rosenthal prizes and an open panel discussion with the prize-winners. Day two was even busier with presentations and talks from six different speakers and a roundtable discussion with journal editors. One of my personal highlights was a talk by Michele Nuijten from Tillburg University in the Netherlands (a fellow recipient of the Leamer-Rosenthal emerging researcher prize) on the development of Statcheck, a software package that can check the accuracy of p-values in journal publications. Overall, what struck me the most was the variety of backgrounds and research fields in the room, from mechanical and aerospace engineering (Professor Barba) to political science (Professor Gabriel Lenz), and the global nature of the contributions, with participants from Stockholm to the Democratic Republic of the Congo. I was also hugely impressed with the commitment of the BITSS team members, even making videos with the LR winners about their research and thoughts on future of open science – mine is available here!
For early career researchers (ECRs), it is particularly exciting that an initiative such as BITSS is developing and progressing at the same time as many of us are developing our own careers and finding our research feet. Transparency of research is vital regardless of what your area of focus is; it enhances the credibility and meaningfulness of your work, and enables users of the research to make more accurate conclusions. Furthermore, improving transparency also maximises the potential of your work for more effective dissemination – for example in health research, knowing more about what actually happened during an intervention to change physical activity (e.g. the training providers received), can assist others in translating your findings into real-life settings. Crucially, enhanced transparency and reproducibility reduces research waste by allowing us to learn more from what has been done already, enabling us to improve the design of the metaphorical wheel, rather than reinventing one. BITSS provides an opportunity for ECRs to become involved in so many ways; whether it’s using their vast library of free transparency resources, signing up for free training courses and workshops, or applying for research funding or awards. In terms of norms and consensus regarding research transparency, we are the next generation of researchers. It is therefore up to us to seize these opportunities and push to develop a culture of transparency and openness within research. Get involved or find out more at www.bitss.org.