 Things that we'd like to cover, just to get familiar with the definitions and the types of technical standards that are available. We have some major standards databases that we have available here and we'd like to make sure that you're aware of them. We'd like to help you develop effective standards searching strategies and to understand the basic structure of technical standards. So hopefully when we get to how Yong's part of the presentation, he'll be actually be able to show you some technical standards themselves as we use some of our resources. So when we define a standard, you use a standard definition like what's on the screen there and sometimes it just helps to bring out a couple of examples and one just showed up on the radio this morning. It was kind of interesting how they would like to develop some national standards on charging units or electric vehicles. So there we go. There's a standards in development right then and there and I'm sure that there are already some proposed ones on the table. So it's interesting to see that that's one good example of a standard that is good to promote an industry. If all the manufacturers of charging stations are interchangeable as far as what vehicle they will charge, you can see that that's a major gain. Another historical reference to a standard will be the standard gauge of a railroad. How far apart they put the rails of a railroad and you can understand that in the early days when there wasn't a standard people were generating train tracks for their economic region of the country in the United States anyway and they would often try to use that to the advantage of their particular region and they didn't care what other people were doing until their users started to demand up. Well, here I am in Buffalo and I need to get to San Francisco. How are you gonna get me there without changing trains every 100 miles or so? So these are the kind of things are often driven by necessity. Certain things like safety can be a concern or tolerances as far as this particular product has to be built in a certain way in order to make sure that it's safe and sorry about that, needed a little bit of a lubrication there. And so you can see that probably examples are a better way to define a standard and the whole idea of standards they can be broken down into different types and there are just so many ways to do this. These are just a few examples and so it could be by the type of standard by being at whether it is a product or a service, a process or a management standard. So a typical product might be something like an electric vehicle charger, a standard gauge for a railroad. It could be a process like I know some of the ISO standards they have certain processes in place or their management standard to rather famous as far as are you, is your company ISO certified? It's a very important way to break down the standards. They could also be a formal standard that's blessed off by some organization like the American National Standards Institute. They could be an informal standard that we often call that de facto something that becomes so common it just everybody does it. It could be a proprietary standard something that is a particular way a company produces a product and in that case, rather than sharing that standard they might have technical specifications that they're willing to share with clients. Yet another breakdown might be whether it's a current historical or a red line type standard. And by that I mean a current standard would be one that would be currently being used. A historical standard might be an earlier version of a standard and those can be very important at least in my experiences early on in my career I was at the University of South Carolina and all of the local law firms would come to the university to look at historical standards literature because they needed to know what the standard was at the time a particular structure was built or a product was made because they were in litigation over somebody getting hurt or something like that. You can see that where the historical standards can come into play and it all depends on what your work is and what you need to deal with. So you might be somebody that's redesigning something and you need to know what the standards were at the time that it was originally created. So you never know what you're gonna be facing in your careers. And then the red line standards. We found that there are a lot of faculty and postdocs and maybe returning students from industry that may be involved with the promulgation or creation of standards. And these are things so the red line standards are basically those drafts that show what the proposed changes are going to be. We could subscribe to those but at Carnegie Mellon we have not done so. So that's a very important thing to realize you'll be able to get current standards. We can order you historical standards if need be but to realize that red line standards might exist. We found that typically we just like the community to be involved with standards creation. And so this is a way of gaining access to the red line standards. People involved with creating them are certainly going to have access to them. Usually from the standards development organization the organization that actually produces them. And just a general question or of a trivia thing. This what you see on the screen right now are see if I can pull this out of the way. These are basically placards. They look like they're aluminum and they're actually in the floor of one of our buildings on campus. And can any of you possibly guess as to where they're at? Very good Linda. Yes. They are in the Mellon Institute in what I like to call the Batman lobby. It's basically the fourth floor of the Mellon Institute right in front of the Mellon Institute library. There's that big open area like a great space and it appeared in the one Batman movie and along the edges of that room you'll find all of these placards in the floor. And my wife was with me when we were visiting them and she decided to take a picture of every single one and sent them my way. So you can see some of the standard development organizations that are common like the American Society for Testing and Materials, the American Ceramic Society and the American Society of Mechanical Engineers. Let me see here. Linda spent a lot of time there getting her degree. Okay, very good. So you might be wondering who in the world creates all these standards? And so some of the ones that are more prominent here at Carnegie Mellon, ones that if you're in engineering and science and even like architecture, you might run into these. So these are basically all of these organizations are involved with producing standards. Some of them work with like an umbrella organization called ANSI, the American National Standards Institute and they get further ANSI approval on their standards. So these are the kind of things that you'll run across quite a bit. There are certain digital collections of these standards that we have carefully arranged over the years or access by our constituents. And I'll try to point those out here in a bit. So some of them you might be very familiar with already. Just a couple of examples. When I mentioned the American Society for Testing and Materials, very common. Whenever you have like test methods or ways of producing a particular material, whether it's a tile or basically anything that you run into a jersey barrier, there are standards for producing those. From there, you also have things like the International Code Council. They basically were the old Boca codes now in a modern organization that handles things on an international basis, including building codes. So our civil engineers and our school of architecture is very interested in that information. And then we have things like underwriter laboratories, just about any kind of an electronic gizmo that you plug into your wall has this strange little tag on the cord and it has like UL approved underwriter laboratories does an awful lot of approving of standard ways of producing certain types of equipment to make them safer, hopefully. And so we've arranged a number of databases at Carnegie Mellon that we think are very helpful, but we're always on the lookout for other strong possibilities that we should be obtaining. So the first one I'll mention up there is actually the ANSI IBR portal. These are things that are incorporated by reference in the United States Code of Federal Regulations. So if the government mentions them, ANSI provides access to them if they have access themselves and it's read only access, but at least you can read the standard. Standards can be kind of expensive. So it's nice to know that there's a link right on the library's research guide to this ANSI IBR portal, where you can check for things that you run into when you might be looking at the Code of Federal Regulations. ASTM Compass is a wonderful database of the ASTM standards and related literature that we provide, okay? And we'll probably be showing you where you will gain access to these standards. IEEE Explorer, it's a nice big set of IEEE's produced literature, including the standards that the IEEE puts out. MadCAD is a collection of standards of interest to architecture and civil engineering, including the ICC codes, things like a LEED certification and other things like the ASHRAE standards are in there as well. And so it's something that if you're in those particular areas where you have need to look at them to realize that it's something like MadCAD does exist. The NISO standards, dealing mostly with information science. And I know we have somebody in the, like the information systems area doing graduate work now. So NISO standards are something that you're probably gonna gain familiarity with. Similar to standards, and this is just another type of literature, very related. We have a product called Protocols IO. Protocols being more of the laboratory setting where standard methods or at least maybe a novel method, this is how I got my results to work out the way they did. And if you wanted to recreate my work or reproduce it, follow this protocol. So Protocols IO is a database, a shared database of researchers protocols that they put in place. And finally, the SAE Mobillus database includes the ground vehicle standards in our subscription to SAE Mobillus, SAE being the Society for Automotive Engineers. And when they think of automotive, think of things that go along the ground or in the air or in outer space. So we have thought and we would need a little bit of interest and championing of maybe expanding that to their aeronautical standards. That's something that we might consider for the university. We don't have that yet though. To stress how standards are so important, they're everywhere. And so just within about 10 minutes, walking around my office and in the Sorrel's Engineering and Science Library in our lounge, I ran into standards of showing up everywhere. So from the markers on my whiteboard in my office, that's basically dealt with how to produce these low odor markers, I guess, to in our lounge, we had an instant flow water heater that we don't use anymore, but it would heat our water back in the days when they couldn't figure out how to get us hot water there. And then our fire extinguisher is a UL listed fire extinguisher. And so both of those are basically UL standards that we work with here or that we live with in our work here. And then finally in the lower right, you see a pipe surprisingly coming from vinyl chloride. It's a polyvinyl chloride pipe. And the ASTM standard for producing pipe like that is printed right on the side of the pipe. So these are some of the ways that we run across standards just in our general day-to-day lives. This is a great little exercise if you need to introduce standards to youngsters or people that are just growing up, can be a fun way to just explore and look for them. I had a friend that did this with patents as well, products that's just around the house. Amazing how much time you can have a kid spend doing that. So kind of fun stuff. Now, the ASTM compass, this is an example of that one pipe that we were looking at. It was just simply a drain pipe in the library's lounge for the staff. You can see there's the standard right there and that how young will introduce you to the ASTM compass here in a little bit. But that's an example of once you know that number, they're pretty easy to look up. Just to the very front page of the standard and I'm just gonna breeze through that because again, that's something that how young will run into. How people discover standards. I thought this was a very important thing to just to discuss. In general, just literacy, literature searching in a database like Compendex, which is the comprehensive engineering index. Compendex actually indexes standards. They did this on purpose because so few good indexes to standards exist. So if you happen to be in the area of engineering and you're looking into any kind of literature, realize that when you search a database like Compendex, you're gonna not only get scholarly research articles and conference papers, but it might retrieve a interest of standards of interest to what you're working on. There could be references to standards in handbooks or specialized encyclopedias or other types of monographs or like how young and I were just in a presentation by a vendor about something called McGraw Hill Access Engineering. And there was a reference to a standard right in Access Engineering, which is a compilation of a whole bunch of digital handbooks. So sure, reasonable place to run into that. There could be just general research articles on the design of a particular product. And then you start mentioning the applicable standards right in the design article. You could be discussing things with colleagues or bosses and they mentioned that there should be a standard in place and they might actually know it by name and number. Product descriptions when you're sourcing materials for a design may mention that they adhere to a particular standard. There could be labels or items on cartons, labels on items or cartons that indicate what the standard underlying that thing is. And it's something that depending on your needs, you may want to look up. And then we also provide access to a standard supplier databases. There's a few that we use, one that we use a lot to acquire standards that we don't already have access to for people is called Tech Street, okay? Now I mentioned this guide. It's one of our research guides in the libraries. It's devoted to standards and I think we'll be sharing the slides with you but we'll make sure that you get the link to this particular thing but you can always look it up on the library's website. Go to our research guides and type in the word standards in the search bar and you'll be able to find it right away. And so it has hopefully some very helpful information. So certain things like our digital collections are listed there, autofind standards. If you need a standard that we don't own, okay? And hopefully we won't need a much, won't have much use for this last tab here much longer but I hope we're turning the corner there but there were some COVID-19 related standards that they made open access since these things can get rather pricey. And that was a good way to help everybody through that, okay? And I mentioned that there's literature that is similar. So things like codes, we already mentioned protocols, recommended practices. So things like that. So codes might be the boiler and pressure vessel codes or the international code council documents that they produce, standard ways of doing things. And they just simply don't call them standards, they call them codes, same idea. Recommended practices, they may be become a de facto type of standard, just a way to get things done that will ensure some kind of quality, okay? Regulations, regulations typically come from governments. So there's the United States Code of Federal Regulations, the CFR, and there are a lot of theirs, literature within these Code of Federal Regulations are just standard ways of doing things, okay? And they will often call upon standards that exist out in, from all these standards development organizations. So you'll find regulations referring to things like ASTM standards or things like an EPA test method. There are other organizations that come up with appropriate ways to test materials. And in this case, test methods for the EPA, how do you sample air or water or pollution or soil? And technical specifications may be more coming from a company that has technical specifications for a product, or it could be the Department of Defense is another very noted entity that produces technical specifications that we need to know about, okay? Well, just to get you thinking beyond just what is traditionally known as a standard, okay? And so we don't want you to feel alone after this, we know that you can't learn everything in an hour when it comes to standards of literature, but we do make ourselves available. And so you can see our contact information there or go to the library's website and there's an ask link to ask a question, okay? And I guess at this point, I'm gonna stop share and let Haoyang get set up. And does anybody have any questions at this time? All right, so you've got any questions? So let's just go ahead to our, in the next, I will introduce you to first our research guide about the standards. And next I will show you how to do the act, the search actually on the ASTM Compass database which Matt just introduced in the slides. So first let's, I'd like to introduce you to our library's main website. So it's very simple URL. So it's just library.cmu.edu. So after you are at the main webpage of the CMU library's website, then you will find there's a red banner here. So here are some of the quick links that have the most important resources in our libraries and also the services and programs. So the first one, you can see there's a research guide there, so let's just click that. So then you will open a new page. And as Matt just mentioned, we can just type the standard here and enter here. And then you can see that that's the standards research guide that we have at the CMU libraries. So if we just click that standard, and then you can see, so this is the main page of the standards research guide. So under the homepage, you can see some instructions about the navigation to help you navigate this standards research guide. And then it gives some important definitions and also the reason why we have the standards and also some additional information. And also you can see there are some additional like digital collections in our libraries and how to find the standards and how to request the standard we don't own. And also there are some COVID-19 related standards. So yeah, so here, this is how you can get access to our standards research guide and also to find help related to the standards. Okay, are there any questions so far about the standards research guide? Okay, so if there are no questions, I'm just going to next directly show you how to perform the most efficient searching strategies in the ASTM compass databases. So in order to visit the ASTM, we can just do the same thing here. And on the right-hand side, there's a search bar here. I can just type ASTM here. And then you can see here, so there's a quick link towards the ASTM compass. So as introduced previously by Matt, you can see the ASTM compass is a collection of the industry leading standards in the technical engineering information in a broad range of engineering disciplines. So let's just click that. And then it will redirect us to the main search page for the ASTM compass standards database. So here you can see this is the main interface, the search interface for the ASTM compass. And then you can see all of the relevant information. And if you are on off campus, it will ask you to login through the CMU identification to make sure that you are a CMU user. And then after you were logged in into the ASTM compass, you will actually see this, this Carnegie Mellon University library. So it means that you are already logged in to the CMU library authentication. Yeah. So next I'm just going to do a quick search here. And since we don't accept at the CMU libraries, we don't subscribe all of the compass because all of the standards, because the standards are quite expensive. So that's, so that to do the funding and budgets. So we are not able to subscribe at every standard they have available. So but we do have the all of the most important standards available for you to use and to conduct the research. And here next I'm just selecting the my subscription here. And then since robotics, I think it's a very emerging field right now. So I'm just going to do a quick search to find the standards related to the robots. Okay. So next the database is searching right now. And then you can see all of the searching results related to the robots. And on the left hand side, you can see additional refining options that can allow you to further refine your search to find the most relevant searching results. So you can refine the results based on the publisher and also the categories and also the technical committee and topic industry sector and ISC, ICS code. Yeah. So here we're just going to visit the first the top search result, which is the standard terminology for evaluating the response robots capabilities. So this is one of the important standards types, which is defining the terminology for certain areas of focus. So you can see here, this, that's how it usually looks like. So I'm just going to make sure that this is the fully, yeah, so this should be a good looking way. So then you can see here, so this is the basic format, how it looks like for actual standard. So on the top hand side, you can see the logo of the publishing unit, which is the ASTM International. And then you can see the title, which is the standard terminology for evaluating response robots capabilities. And then you can see some additional explanation about this standard. Yeah. And usually followed by the title is a general introduction to the standard. So you can see the robotics community, these ways to quantitatively measure whether a particular robot is capable of performing and reliable enough to perform specific missions. So that basically introduces the background of this standard. And you can also see some additional like introduction about the overall set of the standards addresses the robotic terminology, safety, maneuvering, terrains, and also and so on. So followed by the introduction, this is also give the standard will also give an overall coverage, also the scope of the standard. So you can see this terminology identifies them precisely defines the terms as used in the standard test methods and practices and guides for evaluating response robots. Intending for hazardous environments. So that gives a clear scope of the standards terminology. And next you can also follow by the scope, you have find the detailed. So that's the probably the most important part is the actual terminology definitions for the standards. For example, you can see all of the like the verbs and nouns that are related to the response robots capabilities. For example, the verb, the abstain means that a robot manufacturer or designated operator declaring not to perform a particular test or not to have the test result disseminated. And you can see another important terminology in the response robots capabilities, which is the aspect ratio, the ratio of width to height of an image produced by a camera system. Yeah, so, and also you can see there's another one is the image acuity, the measure of the resolving capability of the robot's camera system. Yeah, so you can see all of the important and the relevant terminologies in evaluating the response robots capabilities. Yeah, so you can, we can just move on quickly. And then you can see other important terminologies like the remote control and also the robot of course and also the sensor fusion. And yeah, so that's the general overall structure of the how the like the standards, the terminology looks like. So that's the overall structure of the terminology standards types. Are there any questions so far about this type of standard? Okay, so if there are no questions, we can actually see if you see on the, like the tap side, the top tap, you can see there are additional tabs. For example, the HTML would give you more like a web version of the standards. So you can see that's an alternative to the PDF version of the standards. And also that's the one you can see the related content. So that's basically it is similar to like, to a literature like a scholarly literature like a research article, they will usually have some related articles based on the references to that specific articles. So here you can see these are the standard references. So it contains a comprehensive list of citations to this standard. So these are all of the relevant standards that can, that are, yeah, that are related to this standard terminology for evaluating response robot capabilities. Here we can just take a quick look at the first one. So it's about the standard test methods for evaluating response robot sensing, visual acuity. I think we just saw that visual acuity in that standard terminology. Yeah, article. So here you can see here, so that's the full text of the standard test method for evaluating response robot sensing about the visual acuity. So you can see they generally follow the same similar formats like the previous one. You can see it has the publishing unit which is STM International on the top left-hand side. And then you can see the standard D title right below the publishing unit's logo and then the introduction. So you can see this standards is about the robotics community needs ways to measure whether a particular robot is capable of performing specific missions in unstructured and also often the hazardous environments. So it lays out a background for this standard and why they are designing this specific standard. Yeah, so that's the, and it also additionally introduces the comedy, the publishing units who are actually designing this, who already designed this standard. So it's the STM International Standards Comedy on Homeland Security applications, specify standards test methods and practices for evaluating individual robot capabilities. Yeah, and then it also lays out the importance and the significance of this standard. The overall suite of standards addresses critical subsystems of remotely operated response robots, including maneuvering, mobility, and also the safety and terminology. So yeah, so you can see, it also follows the same structure by first laying out the scope, the overall coverage of the standard. The purpose of this test method is to specify the apparatuses, procedures and the performance metrics necessary to quantitatively measure a robot's visual acuity as displayed to a remote operator or vision algorithm. So that's the, about the scope of this standard. And next, you can see this are also additional, like parameters and also additional, like a terminologists that are useful for this specific standard. Yeah, so you can also see there are some additional like notes. For example, it specifies that this standard does not purport to address all of the safety concerns if any associated with this use. So it also gives some limitations about this standard. Okay, so you can see the second one is some additional reference documents that this standard already refers to. For example, it refers to the STM standards, the terminology for evaluating the response robot capabilities that I just introduced in the last standard. And also it has some additional standards that are also relevant to this standard, like the photography electronic steel picture imaging. Yeah, so yeah, so next followed by the reference documents, you can see the terminology. So some additional terminology, like this following terms are used in this test method and are defined in the terminology. Yes, so followed by this terminologies, we can move on forward and then we can see the detailed summary of the test method performed for this standard. For example, you can see this test method uses standard symbols of incrementally small sizes built by robots from specified distances to measure the far field and also near field visual acuity of the each onboard camera. And next, you can see some additional justification and significance for the standards. For example, it says that the various levels of visual acuity are essential when they're remotely operating robots in unstructured and often hazardous environments. Yeah, so followed by the significance, they will also have some accompanying pictures because picture is always much better than the words itself because it can give you a direct sense of how this standard test is performed. So you can see there's a clear, like you can see a robot on the ground and then you can see a list of pictures that can test the robots, cameras, visual acuity. So you can see this is, the picture A is an example of a far field visual acuity chart as viewed by a robot six meters away and displayed on a remote operator interface. And then you can, so in the middle is the standard symbols to identify and are also called landlord's rings with gaps in any of eight different orientations. And also you can see on the right hand side, the photograph shows the QR codes are also used to evaluate the acuity of autonomous systems with imaging processing capabilities. So yeah, so these photographs are very helpful for the readers to understand the actual testing situation and also their surrounding environments. Yeah, so you can see additionally, there are some of the baseline image used for purposes of comparisons. So you can see these are different distance situations. You can see the three images of the same scene with the same image resolution. So you can see the top row shows field of view increasing from left to right. And while the bottom row shows acuity decreasing. Yeah, so you can see there's a clear resolution difference based on the distance. Yeah, so there are some additional images. And then you can see additional example. For example, this chart, this is showing a robot positioned in front of the visual acuity test apparatus. So you can see the robots on the ground and you can see the like a camera right above the robots and also the actual testing interface right in front of the robots. So this is a very straightforward and also very helps the readers to understand the actual circumstances, testing situations, yeah. So you can see there's additional terminologies including apparatus used in the testing environments. So yeah, so we can just move on. And then we can see also, you might encounter some relevant formula to calculate the percentage. For example, the percentage of human vision is 100 times the chart distance times tangent one over 60 degrees and divided by length or the green gap sides. So that's the formula to calculate the percentage of the human vision. And additionally, you can see some additional like drawings about the relative dimensions of the human readable symbol used to measure the visual acuity of systems. Yeah, so you can see this very helpful to help you dive into the actual testing situations. If you want to replicate that specific testing by yourself. Yeah, so there are some additional levels of acuity with the relative percentage of average human vision at various distances. Yeah, so yeah, so moving forward, we can also see some additional charts that are also relevant to this testing. And next you can see the actual procedures. Like for example, the procedure ensures that the apparatus and environmental conditions are set up properly according to the apparatus section six. And also to ensure that the robot system configuration has been identified and documented. Yeah, so these are some, just some additional like suggestions and tips about this testing specifically. Yeah, all right. So we can just move on and then we can see there's another section about the calculation of the results. So you get, for example, you can count and tablet the total number of successful repetitions and thoughts based on the results. And then you can see some additional formulas to calculate the horizontal and also the vertical field of view. Yeah. So yeah, so you can see and also followed by the calculations. It will also specify some precision and bias in the calculation and also the testing of the response robot's visual acuity. For example, about the precision of visual acuity tests. So the visual acuity test charts on quantized. So the measurement reported is the smallest line that can be read. So repeatability tests show that almost all operators will report one of two adjacent values. So yeah, so this also helpful to help you identify some like arrows and the positions about this test. Yes, it's also very helpful. And also some additional, some considerations about the bias. Yeah, and also some measurement uncertainties. Yeah, so followed by this, this will also include some appendixes. So this will include some additional terminologies and also the discussions that are relevant to this specific testing standard. Yeah. So yeah, so we can just move on forward to give a quick look at this additional terminologies. And after that, you can also see the tables and also figures in the appendixes. For example, the test results for sensors based on visual acuity. So it gives some example of their testing. Like for example, the robot A. So it has a test distance of six meters and average acuity of 3.9 millimeters and standard deviation with 0.0 millimeters. So this are some of test results for their standard testing. And also, this is also very helpful because it is basically like actual testing sheet that they used, the writers for this standards used to actually test their response robots. So you can see this is the design by the National Institute of Standards and Technology. And also you can see these standard test methods for response robots. And you can see, yeah. So this is actually a testing sheet that you can utilize if you are actually testing one of the response robots visual acuity. So you can see, you can write the robot make the model and all of the relevant information about the response robots. And also some accompanying images that are helpful for the testing. And also here are some actual detailed form that you can fill out to actually test the visual acuity of the response robots. So yeah, so that's how it looks like. The overall structure of the standard for the testing type, the testing standards type. So yeah, so this is basically concludes my parts about the introduction to the STM Compass Database and also the two main standards type include these terminology type and also the testing type of the STM.