 Thank you very much. This paper is based on the collective ideas of archivists, librarians, museum curators and ref research information specialists. That's why on your programmes there's four names, two of my colleagues couldn't be here today. It's very much in the spirit of collaboration as the theme of the conference is, and we're trying to collaborate more even within our own institution. It was conceived from our awareness of the increasingly complex information infrastructure that's supporting the ref and our wish to create a more joined up approach to what we're doing. I'll just move on to the next one. While ref in its current form may not stay with us for all that long, the function of supporting research is something that libraries and museums have been doing at Glasgow for centuries. Librarians since the 15th century, museum curators since the 19th century, archivists and research information managers only 20th century, so doing it not quite so long. There are increasingly more professionals joining the university services to support the ref, marketing, web designers, public engagement specialists, social media officers, all consuming the information that we as librarians, archivists and curators are putting out. And we're needing to find ways to communicate with them through their own channels, so social media is one of those. I would say that we don't necessarily have all the answers to the questions that we're going to raise in this paper, but we thought this would be a good forum to begin to discuss them. So, to give you some of the statistics on Glasgow, founded 1451, and we were 12th overall in the ref 2014. I'll not read all that out, you can see that for yourself. In line with other Russell group research intensive universities, we've been investing in refs related support, and as professionals in memory institutions, we need to find ways to interact with them. And to try and persuade them that there is more to the history of the university than just the five year, five or six year ref cycle. Our values at Glasgow, as per the strategy everybody's got them, passionate, professional and progressive, it's particularly the progressive one that we've been using to try to communicate with the wider teams to show that you can learn lessons from the past as we move forward. As RLUK has identified, there's a particular challenge in providing online systems to cover access to centuries of research. That's indeed what most RLUK members are working towards. The biggest challenge for us at Glasgow we feel is not delivering the online content, it's delivering it in an integrated, efficient, relevant, engaging way, and we'll give a few illustrations of what we're doing from our library archive and museum perspectives. For those of you based in universities, these sorts of tools will be very familiar to you. Publications repositories have been developed by all universities to put out their research data. The latest one to be developed for us is the impact repository. All of these are delivering truly excellent services to support the ref, but research started a long time before the ref and our combined institutional college and subject impact at Glasgow has been built since 1451 and recorded in our library archives and museums. How might we integrate the information from our catalogs into the publications repository is one question that we're beginning to look at. The collections held by almost all of us in this room have an impact on the ref in some way beyond our own institutions, but it isn't always easy to collate and pull that information together. That's assuming that society wants us to justify what we're doing to pull all that information to be able to justify why we have archives. While we might know who's visited us to use the archives, we can capture very little of the impact as that moves forward and what do they do with the knowledge that they uncover when they use their collections. What is very clear is that we're now moving from open collections to engaging collections and Jenny Chambers, head of public engagement at the Research Council's UK has recently spoken of moving from the research dissemination phase to a research engagement phase. So what can we as heritage professionals bring to support that? This is something very familiar to those of you at the National Archives. Preserving archives is important not just for the ref and to make information available for a very specific time. It's an important part of a democratic society. So as an archivist responsible for documenting the University of Glasgow's history, this year I've been working with my digital library colleagues to create an online archive for priority-born digital materials to enhance the ref 2020 submissions should it be in 2020. We'll be creating a pilot project of self-archiving, the communications office, press releases and filmmaking. Several efficiency drivers for doing this, not least because they adopted this procedure without really thinking, they adopted filmmaking without really thinking about the information management aspects to it. So we're kind of coming in to solve a problem, but also that will give us an end to create a digital repository for that filmmaking to permanently preserve it to sit and support the ref. So what else are we doing in the library to integrate and streamline to present our researchers and the research to the world more efficiently and engagingly? We're investing in linked data approaches, particularly looking at the person's linked data because there's such a confusing array of ways to present an individual researcher in the online world. We are working with the Hunterian, my colleague Maria will be talking about that, and with Axial on KEE new content management system to make object metadata interoperable with print archive catalogs and the repository and to maximise their own online discovery. We are also collaborating with Maria and our university research office to try to develop key performance indicators for how we as heritage services will be supporting online research dissemination and engagement. My final slide is, I want to talk about where I think my work is converging more with the work of Maria as a museum curator. Since 2006 the university archives have led a project called the University of Glasgow story which gives the context to the university's history from 1451 to the present. It started as a way of managing routine repetitive enquiries like who was the professor of chemistry in 1727 etc. It's been through several project phases and the underlying technology is clunky but based on the funding that was available at the time. In this new era of integration we are working for this to become a set of data that will be part of the wider library and museum systems and we are hoping that by integrating that past and present data we will be able to show the data from all our research in an interesting and more dynamic way. It will make it easier for the public to see how research today brings so many possibilities for humanity tomorrow. Is that often more easy to see how something from a hundred years ago has impacted on us today rather than saying this is the breakthrough science. It's sometimes easier to tell that story so our online users might be inspired to be the next James Watt or Adam Smith or today's equivalent or maybe a more modest ambition would be that they would wish to visit the university and its four star visitor attraction which is the Hunterian Museum. So that's over to Maria. You see we're trying to apply and practice the inter-institutional collaboration so we're doing a bit of a double act but it's also my own role which was created a few years ago is at the University of Glasgow but it's a joint one half between the Hunterian the museum and gallery and the other half within the School of Humanities in the College of Art, the HATI the Humanities Advanced Technology Information Institute and as Laura mentioned because my role is to be a little bit not just a split personality but really a go-between trying to increase the use of the collections it's very interesting to see today the different papers and panels how the collaborations both within and outside the university are making us rethink among other things the ref and the impact on different communities and users so university museums like the Hunterian are all rethinking in the new possibilities to make better use of their teaching and engage in new ways in the groundbreaking research they're undertaking so it's interesting to look at some of the specific ways in Glasgow we just moved to the Kelvin Hall project that you might have heard about which is a very large capital project that brought us in partnership the University of Glasgow and the Hunterian being one of the three partners the Moving Image Archive of the National Library of Scotland the other one and Glasgow Life which has both the Glasgow Museums and the Glasgow Sport Branch being the third one so having the town, gown, the civic, national and academic institutions collaborating together brought its own very interesting challenges and a lot of opportunities for example you will notice sport is there together with the museums which was quite a challenge for some of my curatorial colleagues and I mentioned the collection stress conference a few weeks ago that maybe throwing the sports hall the basketball and the dance studio that we have next to the collections and seeing the different kind of audiences maybe in the rack would be very interesting to watch it was the only thing that was tweeted from the rest of my talk so it will be interesting to see actually in practice this but apart from the sports it's also the collections of the three partners are being brought together in the open collections portal and that has created the need for more support and resources so we opened up a post to support this and we need much more in that direction as part of that it was also developing case studies and guidelines for assessing the ref because I think it's becoming already obvious not just from this panel but from some other comments in the conference and from your own experience nobody really knows that's why I made the Brexit but I hope it's not going to be as painful as that one, the next ref but the truth is nobody really knows exactly which direction it will take but what I don't know is that impact is here to stay and it's very important and I think one of the things we are trying to figure out in line with a lot of other institutions is what is the best way to use this not just something we all have to do but to also follow in the direction of doing impact engaging with audiences that we all feel is very important without stopping within the close refines of the ref only and still do that effectively so one of the ways for example is for us as Moira mentioned this collaboration with the library and the archive to integrate more integrated portals and manage and use our assets the Kelvin Hall you see chopped down version I'm afraid of the building it's only one third that has been developed from this vast gigantic building and the remaining two thirds we're putting a bit together at the moment there's one second shameless plug here I'm also coordinating as part of this collaboration the Scottish digital network on cultural heritage evaluation and digital resources so as part of that we're finishing our network activities after a few workshops with a symposium in Glasgow at the newly opened Kelvin Hall and because a lot of you are working in this area of digital cultural resources and trying to evaluate who uses them and how is at the very heart of our symposium and we just extended the calls for proposals there will be on a grid folder if you're interested in the details we have just in a few days if you want to submit one and join us in the conversation starting from here in Glasgow but moving on from that I wanted to very briefly to not take over my time mention two case studies that we have started exploring the ref impact and the use of the collection of the museum world so one of the exhibitions for example is one of my colleagues in the College of Arts of the French text and image studies Billy Grove, Professor Lawrence Grove has been working many years on the history of comics and the graphic communication and using special collections and the rest of the collections in Glasgow and beyond and a lot of his many years research resulted in an exhibition that closed a few months ago at the Hunterian Art Gallery in Glasgow and where we started collaborating and looking at the next ref again was trying to be a bit more strategic of how do we capture the impact to the visitors of the exhibition so you have started working with the ref this is just one of the ways and the areas of impact but trying to assess what the audience is actually getting out of maybe an hour or two of browsing an exhibition is quite complex and trying to do something that you feel is very close to the cultural institutions heart the academic one but also follow some of the ref requirements is not always very easy and one of the important things is to start planning about this at the very earliest possible start that you can do that so Billy's wider research had a specific aim and he's working a lot with building an academy about understanding comics the whole history of it he worked with a lot of different audiences but as far as the cultural heritage community is concerned with the specific exhibition it was important for him and I mentioned this for other researchers from your experience whichever side you're sitting or whether like me you had on trying to make the research more clear about what are the specific aims of an exhibition and for those of you putting exhibitions together you would know that this is standard anyway but trying to see how the wider research ties in with a specific exhibition the areas where the overlap was quite important so in this case was to raise awareness of the role of Glasgow and Scotland in the history and development of comics but also build an understanding among visitors about their everyday cultural reference and how we relevance and references and how we see them in our everyday lives but also try to break down some of the preconceptions about high and low art and try to expose existing and new audiences to this history and the importance of comics for the evaluation in this one we tried to evaluate the reach of the exhibition but mainly the visitors experience and we also wanted of course to see what was the impact of this so we used different methods and it was important we felt to talk face to face having interviews with our visitors and we are only starting an experimental small way with 50 people before and 50 people after they've been to the exhibition which we we think as a sample if you want to use these things if you want to do subgroup analysis afterwards you really need the larger one but we also use some of the comments from the visitors' book we had an online survey where there were additional users responding to this the social media and media coverage but also the different exhibition events that accompanied the exhibition we tried to analyse, evaluate and look at how this worked out even merchandising and how that worked in relation to the specific exhibition was also one of the indicators and all this worked more effectively because we're a university museum one of the greatest resources that our students so integrating the way Rachel was talking earlier on for example as part of a student work placement project for the museum studies was quite useful and this is one of the lessons learned afterwards for me that tried to explain the REF context to a graduate student requires quite a lot of effort and it's important to try to find the terminology and the language so it becomes the win-win situation we kept talking about in the morning some of the findings very quickly because we're still analysing some of the results it was interesting that people the before and after group for those of you who have worked in evaluation work these are really quite complex ideas all our collections and exhibitions related to them it's not very easy to analyse in this quite rigid before and after sort of splitting groups but because the REF quite clearly wants to see an indication that the specific research activity actually brought the kind of impact you are claiming at it we decided for different reasons to try this out as well that people had visited the exhibition they were likely for example to think in terms less likely in terms of stereotypes that we have they did suggest they did understand something about the importance of Glasgow in the origin of some of those artefacts they also challenged them in terms of the financial value they would attribute to some of the works of art you see a Lichtenstein we borrowed for example at the back there are some mentioned artefacts we had in the collection we tried to ask them to rank what kind of financial value but also personal value so there are some interesting results coming out of all of this but it was interesting for us as well to try to use the comic convention exhibition as also a test kind of lab testing a little bit environment and the case study to help us think ourselves strategically when we are working with all the different departments in the university from outside what are some of the guidelines what are some of the ways to not just do a successful exhibition but maybe a potential successful ref impact case study and do the two can they really work together at the same time effectively and successfully so this is another example that Moira did a lot of work with another of my colleagues from the School of Humanities this time Professor Tony Pollard who is a historian he is a conflicting historian and they worked a lot initially with welcome trust funding on the Erskine story and Erskine is one of the great hospitals just outside Glasgow where we have a very long history that we are celebrating the centenary this year it was one of the hospitals after first wall a lot of the soldiers were coming back to be rehabilitated and it was also because and that's the link with the University of Glasgow one of the professors of surgery Professor my QN was one of the first to work a lot on limb rehabilitation artificial limbs for the soldiers who were coming back from the war we collaborated with not just Erskine at the hospital and the charity but also the work that Moira and Tony did together was a lot with the volunteer and the charity that they have set up called also Erskine to try to put the exhibition together and bring different generations but also the families of the soldiers and the people who work there and this is one more of the examples where we're trying to look how the underlying research within the University of Glasgow can link with different communities and the impact it can have today and also using some of the comic invention example and experience to see how we can formulate our strategy for things like this project so just some wider lessons to from all of this work it's very important I think no matter what the political, academic and other economic drivers are to focus so much on the ref that it's we all have to do it's very important to not forget the importance of talking to your visitors and talking to your end-us anyway despite the fact that actually it's not necessarily the most resource efficient way to do that but it's a good ref impact case study for those of you who have dealt with this for example the impact on policy, getting testimonials the way the last if you look up Rachel mentioned it's actually up there on the web all the raw data getting testimonials for well-known figures academics and others or artists or getting people to also whether it's governmental bodies or other organisations to show what kind of impact your research has had on them easier if you have developed all these links much earlier on rather than getting the numbers required to talk just about public engagement but nevertheless I think it's a vital it's a very important part of our mission in all areas of cultural heritage so I think trying to combine quantitative and qualitative methods when you do that it's really very important there's a lot of talk about the next ref one of the things that have been floating around for example is that there will be increasing number of quantitative indicators performance indicators, downloads, numbers hits of how people are using the digital collections it might be the case or not, even if it's the case I think it's very important to not forget that you need the qualitative information there as well you need to talk to people also and record this in some ways and we saw in a very fascinating way with the keynote just before how they're dealing with the interviews of the survivors but you need to think and each institution way its own audience and its own means and capacity of how what's the best way to do this I'm just mentioning here that it's important just flagging the fact it's important to combine this information it's also very important to think as much as possible in real life to start thinking about impact not just ref related impact but how to evidence and record this as early as possible ideally we're talking about large funded research projects for example from the research project application stage not when the exhibition is sometimes the end process of a four or five year kind of long project so try to think what you think the impact will be and what would be a good way to evidence that and record it and what are the kind of audience this is a very useful questions to have I think very early on and discuss with your other partners it's also I found from experience clarifying what was the why the research project aims and clarifying what are the aims of the specific exhibition which might be an output of the project are not necessarily identical so trying to also get a consensus on some of these things we think is very important I don't have time to analyse we're looking at the rest of the last ref impact case studies and what's the relationship with memory institutions whether it was exhibitions like the examples I mentioned or creating online resources or other forms of engagement it's quite challenging to draw out the data on what exactly the role of the memory institutions will play because although it is free data it's available it's all up there actually trying to make sense reading between the lines is not always easy and it seems in some cases although there were cultural institutions involved in several of them it's not very clear how active at all they had and some of this issues that Moria mentioned earlier on but also other speakers but they need to more actively engage in these partnerships I think it's also coming up for some of you who are interested in all of this and are relatively new the public engagement website is up there because it's quite a lot of useful resources on some of the ways public engagement the forum took and also guidelines and some of the research projects and a lot of things you might want to look up so to finish off I think a lot of us are doing very important impact work anyway it's not always easy to fit this in the ref parameters but it's important for us to continue to do so while at the same time being a bit more strategic getting more informed as this is shaped up how would this effectively and efficiently fit in maybe a potential ref impact case study it's quite complex that form and type of impact this can have some of the children for example asking those 1000 questions from the survivors and what was the impact from listening to the interview would be so difficult to quantify or record in a way that makes sense but I think it's important for all of us collectively to talk and discuss maybe about the challenges that this process brings also I think the vocabulary somebody else mentioned this today the need for us to talk the same language whether it's for researchers to understand the impact language or whether it's for cultural heritage professionals students and the public understanding the ref language but also being more transparent about this whole process for our different kind of publics and communities I think it's also an important point this has created a lot of new roles within Glasgow but also in a lot of other places public engagement people knowledge exchange people, ref impact people recording all this and in some cases it's been added to promotion criteria but it still is another area that's problematic that although impact is very important needs to be valued it's slowly and not always happened yet it needs to also be integrated in the work we do not just in academia but also in the cultural heritage side so there's a lot of people some of them reflected some of those new roles that we wanted to thank not just our host for inviting this and the useful conversation and I'll just finish off there thank you very much