 All right, everybody, well let's go ahead and get started for today. Welcome to basic search strategies for systematic reviews. I'm going to drop a link in the chat really quickly. That's a PDF version of the slide deck that we're going to use today and we can send this out after the presentation today as well. I also want to drop a link in the chat for the YouTube session from last week's workshop. So our very introductory workshop for systematic reviews. But I'm going to give a chance for our team to introduce themselves today. We'll get set up and talk about what we're going to do and then we'll jump right in. Okay, I'll go ahead and introduce myself. My name is Alex Boucher. I am a research instructional librarian. I am the library's liaison to the entire College of Human and Biomedical Sciences, the Department of History, Latin American, Caribbean, and Latinx studies. Hi, everyone. My name is Carly Reason and I am the library liaison to most of the social sciences. Hi, everybody. My name is Lance Simpson. I am the library liaison to most of the College of Engineering, with the exception of Chemical and Biological Engineering, and also the Department of Biological Sciences. We are so excited to have you all here with us today. So a couple of quick things before we get started today. We are using Zoom again today to be a part of this. This is a virtual world we all live in now, so you're all familiar with Zoom. But just in case you haven't had a chance to be participatory in Zoom up to this point, we want you to feel comfortable to raise your hand during today's session. If you're on a desktop or laptop computer, you can do that by clicking the participants button there on the bottom of your screen. You'll see a list of all the lovely people that are here with us today, but you'll also see a raise hand option there at the bottom. The chat is going to be open so you can feel free to use that as well. If you're joining us from a mobile device today and you'd like to raise your hand virtually or join by chat, you have to tap your screen one time and then the more option will come available. One of those options will be chat and the other one will be raise hand. So if you'd like to do that, you're welcome to do that. And as Alex said earlier, you can see that red blinking light up in the corner of your screen. We are recording today's session, so please feel free if you do not want to be included in the video to turn your video off during the session today. But we will have a couple of spots for questions through the day, but you also should feel free to ask a question during the session as well. So one thing I always like to remind people when we get started for these. So we here at UA Libraries are here for you. So as we go through this, we're going to talk about developing a search strategy for systematic reviews. One of the most important things that we like to remind folks from UA Libraries is that you can reach out to us at any part of your systematic review process and we will be more than happy to talk through with you, do a research consultation, work through with you in developing some of these search strategies to show you some of the tools that we're going to talk about next week, but we are here for you. You can reach out to us anytime to set up an appointment for us to talk through that with you. So let's talk about what we're going to do today. So we've an ambitious agenda today, so a lot of fun things that we're going to do together. First, we're going to talk about defining and developing that search strategy. We're going to talk about identifying some of the relevant databases and understanding what to look for in a database whenever you're getting started. We're going to walk you through starting out with keyword searching and then going even deeper with using controlled vocabulary in your searches. We'll talk about citation trackers and how to use search alerts. We'll also talk about how to find grade literature. Last but not least, or kind of moving into last but not least, we'll talk about documenting those search strategies so that you can reproduce a search or so that someone can come behind you to reproduce your search. And then we'll talk about actually developing that strategy. And then of course we'll be wide open for questions at the end of the session today. And Alex, Carly and I are all reachable by email if you'd like to contact us after the session to ask questions as well. So I'm going to turn it on over to Alex to ask what makes a good systematic review search strategy. All right, great. So yes, I am going to talk a little bit about developing a search strategy for a systematic review. The subtitle of why keyword searching isn't enough is really just meant to hint at the fact that we think a good systematic review search strategy incorporates multiple methods of searching for articles and data, whether those are published articles or even unpublished articles. So we will kind of get into what makes a good systematic review search strategy. And like Lance said, this is something that we could help you out with specifically if you are working on your own systematic review. This is one area where we can be brought into consult. If you intended the first session of the workshop series, you'll know that we talked about developing a systematic review protocol. And within that systematic review protocol, you are documenting your search strategy. So what goes into that? What is a good systematic review search strategy? Next slide, Lance, please. So there will be multiple facets to a good search strategy. The first two things I have listed here are really interchangeable as far as which comes first. You may well identify relevant databases as the very first thing that you do, or you may start with what is sometimes called a scoping search. We talked a little bit about this last time, but a scoping search is basically sort of a fancy word for an exploratory search, sort of your first search for articles on your topic. So what you're trying to do with this are three things mainly. You're trying to determine, first of all, and at the most basic level, are there enough articles out there on my topic to justify or perform a systematic review. Like we talked about, it's hard to put a number on that, like how many articles do you need for a systematic review. And in a perfect world, you would like to find at least five, 20 articles in your initial scoping search. So you want to be able to find like, there are enough articles out there on this topic for me to do a systematic review. So the scoping search is usually just a simple keyword search on one of the more relevant databases or a few of the more relevant databases. So you're trying to find out if there are enough articles out there. And again, you may well use it to determine that your topic is a little bit too broad if there are just a gigantic amount of articles that seem to fit your inclusion criteria. And then third, this is more of a purely searching thing, but you can use the scoping search to start to develop a list of relevant keywords and subject headings. So for the audience for this, you don't know exactly what we were talking about with subject headings or controlled vocabulary or anything like that. I promise we will get to it and hopefully explain it in a very clear fashion, but it's just another manner of searching for articles. So when you're doing this, you are helping to kind of develop that list of things that you can use to search for articles. And again, with that, or interchangeably, you are identifying relevant databases. And then when you go back for your primary search, when the main search quote unquote starts, you'll be combining keyword searching with controlled vocabulary and subject heading searching. That is where you're really doing the most complex systematic searching. What you'll probably find is that the articles you found in your scoping search, the ones that seem relevant, probably work good articles that will show up in your final review. The more in depth search that you will eventually do, it's more complex and systematic because you are trying to make sure that you are not missing any articles, in addition to those articles that you found in your initial search. So outside of that, even after you've done the more complex searching, which we'll get into and explain, you're doing other things like tracking citations. You can track citations in a couple of different ways, one forward and one backward. And what I simply mean by that is backward citation searching, you can track down citations sources cited in a relevant article to see if those articles are also relevant and possibly useful. For forward citation searching, you can see what articles cited a specific article that you have already found and you might be using. So you can do citations tracking in a couple of different ways. Then depending on your topic, you may need to incorporate a strategy for searching the gray literature and what we mean by gray literature, if you're not familiar with that, basically unpublished studies or unpublished data. And finally, and we'll talk about all of these components as we go documenting your search should each step along the way that is important for a number of reasons, one to ensure reproducibility and transparency. And I also just maybe required by the by where you were submitting your systematic review to. So if we go back to what we talked about with what's keyword searching not quite being good enough. What we mean is basically that you should be incorporating multiple methods of searching to make sure that you find everything out there that would fit your inclusion criteria and everything out there that is relevant to your systematic review topic. Next slide please Lance. And with that, I believe we'll move on to Lance who will talk about identifying relevant databases. Thank you Alex. So, getting started with what Alex was just talking about getting your search strategy set up getting started with with where you're going to go from here. You want to first identify those relevant databases and you want to think about and understand how it is that those databases operate what capabilities do they have. Depending on the company that manages the database each database has got a different setup with what tools that it may have available to it but you want to know what those are. So getting started with what databases you should use or what databases you should start with. There's a couple of places that I would recommend starting out and one is the list of databases that we have through the University of Alabama database. So I've got a link here and for those that are just joining I'll drop this link back in the in the chat again with the slide deck but I've got links here to our a to z database listing. That's organized alphabetically by title but it's also organized by subject so if you're not sure where to start with with databases, this might be a great spot to go. Another if you attended last week or if you get a chance to watch our session for last week one of the strong points that we talked about was looking at other systematic reviews before you get started with those systematic reviews for your field. I specifically recommend taking a look at the methodologies and each of those systematic reviews and seeing which databases from your field are showing up the most in those. So you can get started with those databases to be able to move forward and that can give you a good idea to where to start. You also can start with some very broad citation indexes so that would include the Web of Science core collection which I have linked here and scopus as well. And last but not least you can contact your subject library and so I've got a link here with a list of all of the subject librarians here for UA libraries. You can reach out to us and we can work through with you to find specific specific databases that are for your subject. But I want you to think about it as you find those databases. I want you to take some time to explore around and see what tools are available to you through those databases. So as Alex talked about you're going to be digging really deep you're going to be looking for for a lot of very specific information about these databases and each of them have a very different set of tools that you can take a look at. So one thing I recommend is to create an account very first and foremost, always use your UA address or your UA email address whenever you do that. But you can create an account as soon as you get in that generally will allow you to be able to save searches to save citations as you go along. It also will sometimes open up a couple of additional features that are available. So one of the, or a few of the setup so that you can save and track your searches I've got listed as or databases that are provided through EBSCO or the National Library of Medicine, Elsevier, Clarivate and I'll mention a few of those as we go. They all have options to allow you to save your search history. So those are things that you want to be able to think about is, how can I save this you're going to want to reproduce the search and that's something that that Carly is going to talk about later is being able to reproduce your search. But you want to know what it is that you searched and when you searched it. You want to see how it is you can actually export references to citation managers or export references out. So each database has got a different way that it may do this, but you want to check and see what is the best way you can do this you can keep up with it with the articles that you're going to use in your final review to go forward. So the other tools and other things that you want to think about that we are actually going to talk a little further about this as we go along is how do you build search strings in the database. Does it allow you to be able to use multiple rows to build out your search string and I will illustrate what that looks like here in just a moment. What fields within a record, can you search how deep can you get into the record to be able to search. And then you use control vocabulary. Does the database have a the source that you can you can go to to see what specific control vocale, vocabulary terms, your database has access to that that you can do to more hone your search in. So if you're using a citation index I noted that here. If you use multiple databases and I always like to point this out because I work with with the College of Engineering. One of the discovery services that I use this engineering village engineering village has access to several different databases Web of Science is the same there's several databases that we have access to through that and each of those databases have their own control vocabulary. So you want to make sure and see how it is that you can search control vocabulary if you're searching multiple databases at the same time. How can you keep track and actually use the control vocabulary in those. How do you use the basic and advanced search option so what limiters what what what fields can you search in those. Also you want to look at how your database uses Boolean operators parentheses. I always put brackets and quotation marks in here as well because different databases handle all of these a little differently and again these are things that that we're going to talk about in just a moment. So you don't have to do all this wildcard searching work or spellings and I'll give the example so I triple E explore actually will recognize both American and British spellings for words so we'll automatically search those for you so you don't have to do quite as much wildcard using that particular database because it is set up to automatically do that some databases are set up to to automatically stem so they'll look for the the ends of words that they'll do that so you don't have to use wildcard searching but not all databases do that you want to know does the database that you're working in do you need to use that wildcard searching and we'll talk about what that looks like do you need to use that or what what set up do you need whenever you go forward. So basically, you want to take some time to understand how your database works and how it is that that you can feed information into your database that it can give you the proper results back. Alright, so we're going to turn it over now to Carly to talk about actual keyword searching. So once you kind of get started and you identify your databases and are thinking about starting your scoping search or really starting to search for for your resources. One of the ways we're most all familiar with searching is is general keyword searching so you open up the database and you see those search boxes and keyword searching works with natural language so when we think about our topic and we can brainstorm ideas of what language best represents are our topic. Those are the keywords that we are typing in the search box and most databases when you type in and when you're doing your keyword search the databases searching for these keywords in the record of the resource and so when you're searching for your database and open up the type if you select you know the title of the article, and it takes you to that page that has information like author and abstract, and, you know, subject headings and things like that. That page is called the record and so that page is where most databases are trying to decide how relevant your keywords are so that's the page that it's searching when it's populating your search results. There are a couple different ways and strategies that you can start to construct your keyword searches to be more robust and to capture more relevant data. So, you all might be familiar with some of these but I'm just going to go through some general keyword searching strategies to keep in mind when you are conducting your research. So, the first strategy is search operators and so these are those Boolean operators that and or and not so when you use and it's retrieving records that include all of your search terms. When you use the word or it's retrieving records that contain at least one of those terms and the term not will exclude terms. So capitalizing I have a little note here, capitalizing the operator the and or and not is just a best practice. As Lance was mentioning, each database works a little bit differently and so some databases, when you're conducting your search string they'll require you to, or they'll work best if they're in all capitals others don't require that as much so just kind of in general a best practices putting those operators in capital letters. The next strategy that you can be thinking about is using parentheses in your search string so parentheses specified the order of execution of your search string. So we have information with in parentheses is read first, and then information outside the parentheses is read next. So, an example we have here is composting and urban or city. And so we have urban or city in parentheses. So that search is going to be conducted first the database is going to pull up any articles that are talking about urban or city. And then the record of the of the resource, and then it's going to be looking for composting as it relates to those so your final search will have records that contain the word composting and urban, and also records that contain the words composting and urban or city. So this is a very small search string but I have an example a little bit later on that will show how large these search strings can get when you're conducting a systematic review. And so parentheses will be very important and helpful to your searches. So we have a couple other different strategies. The next on the next slide we have wild cards so these two of the some of the most common wild cards are using the question mark. And so this is useful when there are spelling variations for a word and you want to search for all variations at once. So the databases, as Lance mentioned earlier, you not all are going to be searching for term variations. So, if you have a word in this example we have behavior spelled two different ways so if you put that question mark in after the Oh, the database is going to search for behavior spelled or and behavior spelled. So thinking about when you're constructing your keywords and coming up with synonyms the question mark will help come up with those variations and spelling. And the next wild card that's frequently used as the asterisks and so this is called truncation. And this is used when you're looking for different endings of a word. So, for example, if you were to type, educate ED, you see a T with an asterisk after it the databases searching for educate education, educator educating, and so on. And so as you're searching and as you're trying to gather all of the resources that are talking about a particular topic or idea. So this truncation this asterisk symbol will be really helpful because it's going to be gathering more and more resources phrase searching is when you put quotation marks around a phrase so for example with social media. If you just left that without quotation marks the databases pulling up articles that are talking about social. It's also going to be pulling up articles that's talking about media, and it will also be pulling up articles that are talking about social media as a phrase side by side. But if you put quotation marks around the phrase the database will be will be looking for those two words side by side and so a lot of our research requires phrase searching and phrases and so if that if if your research or your topic does have phrases in them, quotation marks are going to help your search and help the database populate resources that are much more specific to your topic. And then we have a proximity limiter. So this there are a couple. There are a couple different ways to to structure a proximity limiter but basically this type of searching will retrieve records that contain your term your, your keyword within a number of words within one another so for example if I was to conduct a search for and then put the word near and then composting slash to this is retrieving records that contain the words city and composting with a maximum of two words in between. So, different databases have different ways to structure and to write proximity limiters. So this example is used is being used with the Cochran library or ProQuest platforms, or also Web of Science, but things databases like Ovid or Eric or other platforms might use a different way of structuring that that that keyword and in the proximity limiter. So again, these are some general tips to keep in mind when you're constructing your search strings with phrase with your keyword searching, but these all work a little bit differently and different databases and so again getting to know what you're working in and seeing how they structure and how they work best with these different strategies will help you gather more specific and more tailored data related to your to your topic. And McGill library has put together a really fantastic research guide that talks about not all databases but a lot of really most frequently used databases and they specify. You know what wildcards work in those databases, how does phrase searching work in those how does the proximity limiter work, and that link is in our at the end of our slides there's a resources page and that link to their website is included on there so you can go to the specific database to kind of explore how it works but there are a lot of great resources out there that exist that help walk you through kind of understanding how these might work with your specific database so that's one resource. And again if you have questions about this you can always reach out to your liaison and we can help kind of walk you through how exactly your database works in terms of some of these keywords searching strategies. Okay, I'm going to go ahead and talk a little bit about a different type of searching than keyword searching, which is control vocabulary using control vocabulary subjects searching and so on so forth. A couple of things with this one if you're completely new to this. It could be a little of two. I'm going to try to make it not obtuse, but please feel free to stop me and ask question or put a question to chat. Either one really. Second, when I'm talking about this. A lot of times I'll use the terms control vocabulary or or subject headings or subject terms or subject searching, and it may sound a little interchangeable. A control vocabulary system is a system that uses standardized and organized words in order to describe information sources and by information sources I mean articles books conference proceedings so on. So subject terms or subject headings are those standardized descriptive words that are assigned to information items. For your purposes what you need to know is that many, not all but many databases are organized this way. This is sort of the central organizing feature of many databases. Because of that, it can be the most efficient, effective organized way of searching those databases. Next slide please Lance. I say many databases use the system, but but not all do. I have a few examples here, and there are even some caveats with some of these examples. The Web of Science general collection does not really use a control vocabulary system I believe some of its individual component databases do. But the overall database the overall collection does not Google scholar does not use control vocabulary and this is not even a comprehensive list. There are some databases that do not use it. That is one thing when you're looking at databases and you are identifying databases and understand their capabilities like Lance was talking about. This is an important thing to figure out, does your database use a control vocabulary system, a subject heading system, the source and so on, because if they do that should change how you go ahead and search them. And the last bullet point is sort of flip, but are they like hashtags, kind of, I will oftentimes describe subject headings as hashtags to classes full of undergraduates when I do talk about subject headings the classes full of undergraduates. They are not really subject to hashtags, it's sort of a reductive way of looking at it but in some ways they are sort of like hashtags, they are words used to describe a certain topic or information, and a lot of times you can actually click on subject headings. And when you do that it will take you to all of the articles that have been tagged with that subject heading so in some sense they're sort of like hashtags will get into that more as we go on. Next slide please Lance. So, some examples of subject heading systems of control vocabulary systems and where they are on databases PubMed is a big one I teach PubMed quite a bit PubMed does have a subject heading system it's a little bit hidden away but if you're on the main page of PubMed. If you'll see under Explorer on sort of the bottom right hand side you'll see the mesh database. Mesh stands for the medical subject headings and that is their system. Next slide please. So, a couple more examples APA psych info. You will see this layout a lot with EBSCO host databases in this case at the very top you will see APA thesaurus of psychological index terms. This is another word in addition to things like subject headings that you will see often. So if you see that that will generally be their control vocabulary system. On the next slide, I believe we will be looking at Senol plus with full text, which is a help in nursing database and another EBSCO database in this case you will see instead of the source you will see Senol subject headings. So if you see those various things you can click on them and begin to explore their subject heading system. And that's when I will begin to talk about how you use these to actually search the databases. So next slide please. There are a lot of ways to describe this but but why do you use them. Again, going back to this is the way these databases are largely organized. So, searching by these can be the much more precise way to find your information. Keyword searching. So this is the strategies that Carly was talking about to really drill down a keyword search and make it much more precise. But a keyword search in its sort of natural state is sort of high variance, or there is a certain amount of randomness to it. And because of these databases when your keyword searching they are mostly just looking for the words that you put into them. So you have issues with spellings or related terms. And so there is a level of randomness to it with subject headings you sort of get away from that randomness to some extent and I'm going to show this through a quick example on PubMed. Let's look at the next slide. Okay, so here's an example. This is a very basic search on PubMed. I have just typed in high blood pressure I haven't even done like phrase searching none of that really matters. In this case you get 630,000 results. Of course, if you're doing a systematic review you're you're being much more specific with your searches. But these are the the articles that come back. Let's look at the next slide of an extremely related concept in fact pretty much the same thing high blood pressure hypertension basically the same thing different terms used to describe the different same thing. In this case you get 540,000 results. You'll see though that even though hypertension high blood pressure every much the same thing, searching for different words brings back different articles, because with keyword searching. These databases are smart and adaptable, but in the most basic state they are just looking for the words that you type in. So they often miss related terms, they will often miss related spellings, and it's, it's a little bit more random. If we can go to the next slide. This is the mesh database PubMed's control vocabulary system. So if you type in high blood pressure, what it will do is it will tell you to use the word hypertension. In fact, you could just click on the box next to hypertension and add it to PubMed search builder and then search PubMed and what would happen is you would find every article or information source on PubMed that has had the tag hypertension added to it. So because of that, you are getting rid of some of the variants. You know that every single article that comes back someone, something has gone through and said this article is about hypertension doesn't matter what term they used for it. This is about hypertension therefore we are going to give it this search subject heading, and then it will come up in that subject heading search. If we can go into the next slide. Instead of adding it to the search builder, I could click on it and we can see more about this subject heading. There are a couple of things with this one subject headings or the source systems are always hierarchical. So what that means is above hypertension in the hierarchy is things like cardiovascular disease and then eventually just diseases basically below it or more specific aspects of hypertension or just more specific illnesses, but also you have subheadings for each so I could search for hypertension and diet therapy or metabolism or mortality or any of those. Even below that you'll see a little button that says restrict to mesh major topic and I actually can show you in the next slide. You'll see that I have done that. And what this does is all 186,000 articles that come back have not only been tagged with hypertension, but they have been tagged with hypertension major topic. So what that means is hypertension isn't just an aspect of each of these articles. It is one of the primary focuses of the article. The reason why you still have 186,000 results is this is still a very broad search. So what you could do at this point are is add another subject heading or maybe two subject headings or like in the next slide. I have just added a keyword to it dash diet. So we have gone down 400 results. This is not the most precise and organized way of doing it because the most precise systematic way of doing it would be seeing if there's a subject heading for dash diet and including that in search. But this is a more precise way of searching for this topic than just typing in the keywords hypertension and dash diet. Because you just know that hypertension is a major focus of every single article in here. Again, if that doesn't make sense or if I haven't explained it well enough, please stop me with a question. I do have a few more things to talk about in relation to this. One of these is that I've been showing PubMed but subject heading systems and Lance or Carly could add something at some point are relatively similar on most databases. Maybe next slide and I can show a couple more quick things. Okay, so one this the picture on the right is what you will find what Carly was talking about the record page. In the record page of an article on pretty much any database, you will see keywords, but you will also see the subject headings. So, when I was talking about the scoping search using that to come up with keywords and subject headings that is one way that you can do this. When you go out and do a keyword search for your topic you will find articles and you can see the mesh terms. You can also click on these so I could click on the one that says dietary approaches to stop hypertension and if I did, I would get every single article in PubMed that has been tagged with that or indexed with that term. The other thing you might note and this can be a little bit different from database database is that in this case you'll see two things to subject headings that have asterisks by them and PubMed that means these are the major topics. These are the major concepts like they are more important to this article than weight loss or sodium, for example, you will see this like I said I'm pretty much every database so this is not just the PubMed thing. Next slide please. In fact I do not have any more slides we're going to pass it over to I believe Carly but I will just finish up by saying that the reason for using subject headings again is it's just a more organized way of searching. You can use it in combination with keyword searching as I did and in some databases like PubMed and other databases as well it's really the primary way of searching. In fact in a systematic review if you were using PubMed extensively the keyword searching is almost the secondary form of searching in a lot of ways. It's a way of making sure that you didn't miss anything or making sure that PubMed didn't miss anything and accidentally not give an article it's correct subject term, if that makes sense. So with that I will pass it on to I believe Carly. Great so once you've kind of identified keywords or and from there, the controlled vocabulary. Next, you can figure out how you're going to construct these in the database and so one way that you can start to search is with a strategy called field searching. And so this is telling the database exactly where to search for keywords in the record. And depending on your inclusion or exclusion criteria. Some will be more specific about where they where they conducted their search. So this is an example of the two ways to construct a field search. So, you'll see here we're in academic search premiere, we've put together our parentheses searching for test scores or grades or academic performance. And these are not subject terms these are just keywords and you can see on the right, the drop down box as title. What this means is that the database is looking for these terms, only in the title of the article. And you'll see in the second box we're looking for the same terms, but in the abstract of the abstract that's been provided on the record. And so some you'll see when you're looking at other systematic reviews. Some researchers are being incredibly specific about where they're searching for this specific language. And depending on different like Cochran or or Prisma, there might be different ways of how different field searching that you want to conduct or try searching so not all systematic reviews are only using a title or an abstract search. It's more dependent upon your research and the guidelines that you're looking at when you're conducting your systematic review. So here is one example where you can use those drop down tools on the database. And again, different databases are going to have these in different places or look a little bit different. On the next slide, we'll see an image of an entire search string that is using field searching instead of selecting the drop down fields and selecting title. You can see on this first line that TI that's standing that's that's representing title. And so if we put TI and then parentheses, we have this very long search string and this is coming from a published systematic review by Whiteman at all. And he this their research team is in this example is conducting a title search, but they're also they use that Boolean operator or and they're looking for these same terms in the abstract. And this is only one tiny piece of their entire search string. This actually I broke it up into these two kind of sections so you can look and see okay TI we have our title and then a B we have abstract. And this is actually put in one line like one of those boxes in the database, because they have additional lines of terms. So, if you have these very long keywords and controlled vocabulary that you're using these very long search strings, using these kind of abbreviated terms will help as you're constructing your search string. And again, different databases have different abbreviations for different ways of field searching so again that's one other thing that you want to be aware of. So TI is title and in this database that this this research team was looking at but it might be different in a different database. So, again, field searching is just one way to help you identify where in the record, the language and the words are being identified in. So that's, that's one search strategy that you can be thinking about the other search strategy on the next slide is something called search filters and so search filters are standardized search strategies so a search filter is it's also called a search hedge and so these are search strings that have been already developed and help define a certain criteria for your research so they're search strings that represent your research topic so they can help identify clinical concepts, they can help identify various levels of evidence like randomized control trials or systematic reviews or meta analysis, but there are these search strings that have been pre constructed that you can use to help with a systematic review. So they will help save time as you're conducting your search they can help you be more thorough because typically not always but some of these search filters have been gone through trials and have been tested to make sure that yes they are comprehensive and they are pulling as much data as possible. So, I don't have any examples on here of what these look like they look similar to the previous slide where we had that very long search string with parentheses and different wildcards. But there are many resources out there that will take you to these pre constructed pre defined search filters so on this slide we have Columbia University, the Irving Medical Center they have a whole list of different search hedges that you can use. And they really help optimize your search strategy. The National Library of Medicine has put together quite a few different search filters for different topics. They have, I'm not sure how many they have but they have quite a few that they have put together UAB libraries they have another page full of different search filters, as well as the University of Texas their School of Public Health has put together a very comprehensive page, specified by database. So, again, we kind of keep coming back to this point of how each database works a little bit differently. Search filters work differently, and are very unique and specific to a particular database. So on the next slide, we talk about how do you choose a search filter. So, the previous slide had links to help you find different search filters but how do you choose one that's most appropriate for your research. So, one you're thinking about how current is the search filter so language changes terms get added. So make sure that what you're looking at in the search filter you're using is the most current and the most up to date. Also be thinking about is the search filter designed for the database you are searching in. So again search filters are not interchangeable across databases. They are very specific to the database that you're looking in. And those resources that I have listed, specify which search filters are for what databases, and the reason why they're so specific to a database is what Alex was talking about is that they're using the controlled language on those. The control vocabulary for that specific database and so the controlled language that you might be using in PubMed might not transfer to APA like info they'll be very different ways of of constructing that controlled vocabulary. Again, the search filter is designed for the specific database. And then the other thing you can be thinking about is was the search filter tested so typically when you discover or identify the search filter that you are looking for there should be some information or some guidance of to how that was tested. And that will help you kind of determine how reliable you find that search filter to be. So those search search filters as well as field searching are two different ways it within the database to use the tools of the database to help you find more a more comprehensive search of the of information that you're looking for for your research. Awesome. Thanks, Carly. So I want to talk quickly about citation tracking and alerts and how to be able to kind of keep track with with some of the resources that you're looking at how to be able to kind of follow up with your searches. So once you've got your search train developed, you want to think about tracking the research and how it fits your search criteria. So I've listed a few databases here that will allow you to kind of walk through and be able to save your searches and to be able to get alerts for those searches. There's something I want to mention before I talk about saving those searches and getting alerts for those searches though, and that is being able to go backward and forward as Alex talked about earlier with citation tracking. So one of the important things and there are a lot of databases that allow this again you'll have to look for the specific database to see what how it's built and how it's built out, but many databases and I know that that quite a few of those with clarivate so within Web of Science I know that you can do this in PubMed with the Elsevier products like Scopus Science Direct, all of the databases through Engineering Village, you can actually look to see who else has cited a particular article and what articles this particular article has cited. So you can move backward and forward to be able to see what other research may be out there, what other search terms, so what subject headings may have been included with those articles. It's a good way to work in and kind of building out your search. I also I'll show you in just a moment how with a couple of these that you can track if there is a particular article that fit well with your research how you can track the citations for that. So with this, with these discovery services and with these tools, you can actually do some saving your searches and setting up search alerts for those. So I've got those listed out here, and they're linked out so many of those allow that the EBSCO databases, APA Sack Infos and all plus the NCBI databases PubMed, PubChem. So you can even look at that with Google Scholar as well so you can get alerts for searches that you've done or searches that you wanted to see what other resources have pinged with those searches. I've got an example here with these tools. So I have a few of these set up myself email alerts to be able to come through. So since I do a lot of things in engineering, I've got one down at the bottom here that you can see that I've used in the past. This is the full search string set out from that that I have set to ping whenever it comes through. So it pulls out and I'll point you'll note there's some brackets in there in the search string as well. And for engineering Village specifically it keeps it from searching related keywords I wanted just the phrase that I was looking for so that keeps those brackets in there. But I've got it set up to send me an email whenever any of these these come through. You can also set alerts for some of these for whenever they appear in another article. It's a great way to be able to keep track throughout your systematic review of how your search string is what other works may be pinging on your search string as you go through. And I did want to show you really quickly with Scopus and with Web of Science you can also look for a specific article. You can see when it's been cited so it continuing on through the process depending on how long the process is if you have an article that was really important to do what it is that you're looking for you can see what other works are citing it as you go forward. So let's pass it on over to Alex and talk about gray literature. Okay, I'm going to try to talk about this relatively briefly. We were getting a little close to one. So gray literature basically when I say gray literature what I what I'm talking about mostly is basically unpublished literature. For example, or literature that is published outside of traditional conduct commercial publishing so dissertations and theses conference proceedings unpublished clinical trials or unpublished trial data, government reports, patents, etc. Next slide please Lance. So basically, depending on your topic, you may well need to incorporate searching for a literature. That's something that you will decide or figure out when you're working on your search strategy. But then if you do decide that you need to search for gray literature, where to go to find it for one you can go to a number of places but a lot of gray literature you can find on either Google or Google Scholar. There are some examples link there are some specific custom Google searches that you can use. Then there are just some specific websites which you could just bookmark because they are very important for this open gray is good for European gray literature clinical trials.gov is a very self explanatory title. And there are also guides to where to find gray literature. You can also look at databases specifically, but like I was saying a lot of things are on Google so I thought I would give you a couple of quick tips for using Google. Because the thing to know with this is there is no way to search for gray literature on Google is systematically as you might on one of our databases. If you figure out how to use PubMed or sent all plus or psych info and you understand subject headings and keyword searching you can search in a very efficient systematic way. Google, you're never going to be able to search it in quite as efficient away but there are some things that you can do to make it a little easier. One is site searching a lot of the unpublished gray literature might be on dot gov sites. So a search for site dot gov along with your keywords would only find articles from dot gov sites. Or you could search for a specific site like CDC dot gov or HHS dot gov. The file type PDF is definitely not something you have to do but a lot of these reports are in PDF format. So that could be another way of doing this. Next slide please. A couple of other quick things that you might know is that a lot of things that you do on databases you can still do on Google phrase searching works parentheses work. I don't have an example of this in this search, but you could do parentheses with type two diabetes or diabetes mellitus it would work similarly to how it would on a normal database. In this case I'm searching just site CDC dot gov. So that way I only get things from that one specific website. And then the last couple of things, slightly advanced Google searching you might know about are just ways to narrow your searches down in title or all in title in title would have your search terms in the title of the article that comes back all in title and make it so that every search term you have has to be in the actual title of the article. So again, these are none of these are must but they are just ways of narrowing down your search on Google and being a little bit more precise because it is a little bit harder to be more systematic when you're doing a Google search. And the next slide I'll just show a couple of linked out resources. Oh, well actually sorry the advanced search screen Google hides the advanced search screen like it's sort of like an embarrassing uncle or something, but there is an advanced search on Google. On the previous page you would have seen there's a on the regular Google page there's a settings button. So right under the search bar settings. If you click on that you can click on advanced search, and the this page will open up which just has all of your options. Up at the top of the screen all of these are basically Boolean operators all of these words is and any of these words is or none of these words is not. And then you have the rest of it you can control the bottom of the screen. So again just the way of being more precise with your searches because it is difficult to find great literature. On my final slide for this again I just have a few examples of databases you can use a library databases or otherwise Scopus Web of Science site finder all good for conference proceedings abstracts and presentations and then for data. You can also find dissertations you have pro quest dissertations and theses ethos for dissertations from the Kingdom and you can also find dissertations and PCs on Google scholar. And that was sort of a condensed version but that is some of the things that you can do if you need decide that you need to find great literature for your systematic review. These are our last slides to document your searches so your systematic review it needs to include enough details about your search so that it's replicable. Important information to document are things like databases search the database time coverage, what search strategies to use for each database including search terms and filters and limiters. So the search was conducted and the number of results for each search strategy and you may also want to include the number of results after deduplicating the articles. The next slide has some strategies for documenting these so you can use research log so you can create a spreadsheet or a document to keep track of all your searching. I also have met people who like to use a PowerPoint slide so for each new search they create a slide so it's a more visual way of seeing and interacting with each new search. There's also a Prisma flow diagram and that image on is on the next slide and this is. Oh, that's on a couple other slides from here but this slide these these next couple slides here are just different ways to document your search. These are coming from Cornell University Library so you can see here. Different information you can include just in general what databases you're searching in kind of some of the general information and the further you get into it then how do you document each specific search string what number of search results are you getting in a specific database so you're keeping track of each search string you construct in that database. And the next slide is just another example of okay you are in. You're searching in database number two and you would copy and paste this and as an outline for database number three and these are different ways that you can keep track of your databases and your search strings and what search results you are populating. There are lots of resources like this out on the web this is just a few this link is listed in our resource page. And the last slide here is the Prisma flow diagram so this oftentimes is published or can be published in your final systematic review, and this helps you walk through records identified records after duplicates were removed and so on. So, it is one o'clock so I'm sorry everyone, we really ran, ran pretty quick but there's our resource page if you want to access any of these links. And we can stick around if anyone has any questions, but we also have our third workshop coming up and the link to that is on our slide here and we're happy to answer any questions you have in that session as well. So thank you all so much for attending and I'm sorry that we went right up to time.