Summary
The aim of this evaluation is to understand and assess the processes, impact, and value for money of the programme as a whole, now and in the future, capture key learning and demonstrate value for money and accountability to its stakeholders, and establish specific and generalisable learning to inform future AI Lab activity and other similar programmes.
The objectives of this evaluation are to:
- Gather and present objective and robust evidence of the processes, impacts and value for money of the AI Lab
- Identify lessons learned from the AI Lab to support the design and future delivery of the remaining ongoing AI Lab projects
- Use the evidence and conclusions to provide real learning to future AI programmes in public sector healthcare as well as the wider public sector
We will conduct a retrospective and prospective mixed-methods formative and summative evaluation, working with commissioners in evaluating the conception, progress, and evolution of the AI Lab in England. This will be delivered through the following complementary lines of enquiry organised around five Work Packages (WP0-WP4):
Key People
Cresswell is a social scientist with extensive experience in conducting formative evaluations of digitally enabled change and improvement programmes in healthcare with over 140 publications.
She is an expert in conducting evaluations of digital applications, having applied formative methods tin a variety of health and care settings (hospitals, primary care, and home). Bringing together stakeholders with varying perspectives is key to her ongoing work, where she examines how political, commercial, organisational, patient and healthcare workers' interests need to be aligned to transform health and care through safe and scalable technologies.
Expertise: Formative evaluation
Email: kathrin.cresswell@ed.ac.uk
Williams is Professor of Social Research on Technology. Since his appointment to lead UoE's successful bid under the ESRC Programme on Information and Communications Technology, Williams has acquired 30+ years' experience, through 60+ external awards, in leading large interdisciplinary research collaborations and conducting qualitative studies of the social shaping of technology. His personal research trajectory, in five books and 100+ papers, focuses on the technical and organisational dimensions of the design, implementation and use of IT-based systems, their usability/dependability and organisational outcomes.
Expertise: Science and technology studies
Email: r.williams@ed.ac.uk
Bernabeu is Professor of Computational Medicine. His research concerns the development of computational approaches capable of answering open questions in biomedicine and healthcare. He works closely with biologists, clinicians, and industry in problems of high relevance in both basic and clinical research, including@ a) the development of automated methods for eye and systemic disease diagnosis in retinal scans, b) the evaluation of AI systems supporting healthcare delivery in real clinical settings, c) the study of how the structural properties of tumour vasculature affect oxygen / drug transport, and d) the investigation of vascular remodelling during angiogenesis.
Expertise: Health Data Science and Artificial Intelligence
Dungey is an experienced health economist with an extensive background in evaluating service redesign, resource allocation and cost-benefit and effectiveness evaluation of interventions including digital health and quality improvement innovations. Her work spans NHSE, large acute trusts, NIHR, Commissioning Support Units and independent consultancy undertaking real-world health data research and analysis with application to strategic finance, economics, evaluation and data strategy from the point of data being recorded to its use for operational and strategic insight and research.
Expertise: Health economics
Email: sheena.dungey2@nhs.net
Eason's experience in evaluation and change has been gained through a career spanning the NHS, social care and the third sector. She has designed and led cross sector change programmes, ensuring robust stakeholder engagement, and embedded methods for continuous improvement. She has extensive experience of evaluation, working on the GDE programme and more recently a national evaluation of a new model of care for vulnerable young people. She currently leads on Improvement and Evaluation for AGEM's consultancy arm.
Expertise: evaluation and change management
Email: sally.eason1@nhs.net
Anderson is a professor of Dependable Systems at Edinburgh. He is particularly interested in socio-technical systems, resilience of such systems and how Social Science and Informatics provide a unique perspective on the conception, design, deployment and operation of computer-based systems.
Expertise: Ethics and Regulation
Email: s.anderson@ed.ac.uk
Mozaffar is a senior lecturer in innovation with a focus on digital transformation, building on her industrial experience and prior mixed-methods research with this team. She has an interdisciplinary reserach interest in digital transformation of health sector and its intersection with Innovation, Science and Technology, and Organisational Studies.
Expertise: Innovation, communities of practice, learning ecosystems
Email: hajar.mozaffar@ed.ac.uk
Contacts
Dr Kathrin Cresswell: Kathrin.cresswell@ed.ac.uk
Professor Robin Williams: R.Williams@ed.ac.uk
Key Collaborations
NHS Arden and Greater East Midlands Commissioning Support Unit
Timeline
Start Date: April 2024
End Date: March 2025
Duration: 12 Months
Scientific themes
Artificial Intelligence, Public Health
Methodology key words
Mixed-methods, Evaluation