 This is my co-speaker Karan Rudeja. He is a UX designer from Global. Hi everybody. We would like you to please put your phones on silent. That is, don't switch them off. Just put them on silent and sit back, enjoy and we hope you like this sensorial ride. So, if you have anything in your hands by any chance, just keep it aside for a second. Yeah, release your hands and then just sit back, calm yourself down, settle down. Close your eyes. Breathe out. Hear my voice. Hear the sounds inside the room. Feel your hands. Join your hands. Breathe in. Breathe out. Thanks a lot. Now you can open your eyes. Now you will find this little peanut or groundnut that may have been given to you. We would like you to eat it. So, this small little daily object that we find called the groundnut or the peanut. Hindi may they call it Moon Pali. It's very interesting because it's got color, texture, it's got this certain form. You can peel it in your hand and you open it up. It's got this sound and you can smell it and of course eat it. So, basically this small little object is in a way reaching out to all your senses. Next thing, what we have is a small sense test that we'll try to do with you. What we are going to do is that I'll show you a small video. A syllable is going to get repeated. Then I'm going to ask you what you're hearing and you can tell me about the show of your hands. This is the part where it goes like ba, ba, ba, ba. So, what are you actually hearing? It's the first or the second one. It's the first or the second one, can you please? Right. The next one, ba, ba, ba, ba. Was it the first or the second one? I'll do the first one again. I'll try. I hope I can do it as well as this guy did. But I want you to close your eyes. Ba, ba, ba, ba. Open your eyes. What were you hearing? So, that's what happens. The human senses are a little complex and you were getting information coming to your eyes, to my lip movement as well as this sound that was reaching your ears. And what happens is that when the brain is competing for both these information, it wants to make sense of what is happening in the environment and it immediately jumps to conclusions. So, you think that I'm saying ba, but actually I was saying ba. It's the same syllable. This effect is called the McGurk effect. So, we have another small thing that we can try. So, you will find a small candy on your seat or next to your seat. So, if you can just please open it and so, this might be a bit uncomfortable. So, what you need to do is you need to close your nose and without breathing chew the candy for like a few seconds and then open your nose. So, you might feel that once you open your nose, there is a difference in the sense of flavor that you have. So, what happens is that what we often think of as taste is a combination of what we actually taste and what we smell. So, these two little things are just to illustrate the point that as children we are taught that we have five senses and they have their own individual functions. But actually the perceptions that we have are actually made of multiple senses. So, what do you see affects what you hear also. So, this is. Next thing is a short story that I'll tell you which is which happened recently in my family and that was the moment when I got this realization that you know the senses are actually quite important to us and they affect you know decision making. My dad wanted to buy a dining table and he had this thing in mind like you see in hotels which have a stone top and he was really crazy about it running after it and one day all of us went to the mall, he found the dining table, he was very excited, he almost bounced on it, sat down and few minutes later he comes to me and tells me that I like the dining table, but I'm not going to buy it and I asked him why. He said that when I sat on it and I kept my hands on it, my forearm fell cold so I don't want to buy it and that was the moment where I realized that you know the sense of touch and the temperature was something that completely entirely changes the decision of going for that table and that's when I felt that you know these senses are a lot more important and we shouldn't probably take them for granted. So, let me take you back a little in time. Suppose these are the caveman children, we can probably call them boogers for now and their senses were very like you know good and proficient in comparison to us because they're survival dependent on these senses and because they would get like you know attacked by predators and all so they would always have to be on high alert and that's where these senses help them. Moving like fast forwarding in time, we have the zone act. The zone act are the people like us, the civilized kind so ones who are living in these urban artificially designed environments we don't have threats from predators, nobody's coming and attacking us and that's why we may have seen that you know our dependency on the various senses has kind of gone down which I'll elaborate through this graph. This is called the bandwidth of senses which is showing us that we are heavily dependent on sight, then touch, hearing, smell and finally taste. This is also showing the amount of information that your brain is getting at any particular second where sight being the maximum followed by the other senses and with this we can see that you know since this study was done on people like us like zone act we can in a way infer that because of this dependency and the way the biological evolution is happening the way design is also proceeding is also changing which is why we have seen this heavy reliance on screen and interaction design seems to be chasing screens for some reason. So for last I think few months like 6 months or 8 months we have been like exploring this domain of alternate senses and so we came across this interesting way of analyzing our daily interactions in terms of what senses they are catering to. So if you go to the next slide so this is the graph of cooking so you can see that cooking as an act involves all the senses so there is like sight, touch, smell whereas if you look at something like driving so it's heavily dependent on sight and sound so maybe on touch. So piggy bank is something very interesting where it's not really dependent on sight as such but you can sort of pick it up and feel the weight of the piggy bank or shake it and hear the sound and that sound and the weight informs you of the contents inside and the quantity inside then if you look at any of the mobile applications so most of them are obviously dependent on sight and maybe slightly on sound Just one last thing I want to add here is that so using this graph you can actually see whatever you are designing what all senses does it map to. Now designing for the other senses Yeah so for this we have a couple of interesting examples that illustrate how we can design with other senses So this is one of the projects that cater to majorly to the sense of taste This is a project that we both worked on along with two other people Okay we are super sorry the video isn't playing because of some technical glitch you can talk about. Okay so what this project does is that so right now we are creating a lot of digital information through our fitness bands and our mobile applications and every transaction that we do on payment portals So we are thinking about how this data can be experienced by people not just through numbers or through emails but through some other senses. So this is a project called Data Jelly we bought where it is a bought which asks you a certain information about you let's say you are attending a conference so it asks you certain questions like what are you here for what do you do like are you a designer are you an engineer these kinds of things and it takes that information and converts it into an abstract form which is then printed in the form of a jellybee which is an edible Indian sweet that is actually like then fried and dipped in sugar syrup and then you end up consuming it. So the idea is to in a way in an abstract form consume the data through taste through smell through touch and not just through sight I would have really enjoyed all of you seeing this video because that's where you actually get the sense of the project and if you actually want to see it happening in real please come to design up that's where we are showcasing on the 10th and 11th of November this project was initially showcased at Interact 2017 it was a recent HCI conference in Mumbai and this is Hitachi they are using Hitachi project yes we have you can also check out the website datajellybee.com meanwhile we have in the experiment that we are trying to investigate alternative ways of data consumption but up till now we have solved about 300 plus people it has been a fun journey because people come provide their data can be their professional profile the project was trying to capture the interaction pattern that people have when they come to conferences and they have a simple conversation and they would exchange like it's a small talk that happens so I'd probably come and say hi to Karan Gideja and I work as a UX designer out here and this is like I've worked for about two and a half years or something my interest career there so and so forth and I'm your other presenter or the visitor so she gets a certain idea of who I am and in this project DataJellybee what we've done the same thing where this entire profile gets captured and then it is in a way represented using a visualization which is borrowing the aesthetic from the patterns of rangoli and mandala which are in a way integrated to the Indian culture DataJellybee what this is the graph that would happen for like you can see that it since it's a food related project it will be equally high on parameters for all the sensors next project that I will show you is Sonic Bells which in which the person has a small weight and they're trying to show that there is a couple of activities that we do on a daily life they're taking the example of exercising where so you will see the activities that she's doing and the sounds that are being created by the phone they allow her and the group to understand so for this project this would be the mapping where size and touch are heavy and so is sound this is a project where people have taken this idea that whenever gas leaks happen and people can't see it they would induce little bit of an artificial smell inside so that people know that there is some sort of a threat or a danger and they've taken the same context and applied it to how we have our computers connected to the net and we are in a way potentially possibly it can get attacked by a threat or virus attack so this small device whenever it senses that you are getting attacked it releases fragrance and cryoscope this is the final project where what it does is that there is a small aluminum box and it is connected to the... the cryoscope is a haptic weather forecasted device it consists of an aluminum cube which is heated or cooled as far as forecasted temperature the users enter their location into a web app the cube then automatically adjusts to the forecasted temperature again it would be very high on touch and now you want to know why are we advocating this entire thing of designing for the sensors because we feel that as you saw in the previous framework of the graph that once your sensors are being mapped through the project they are a lot more engaging, a lot more emotional and a lot more experiential. So now the part about how actually we can go about doing this. So you might say that okay this is interesting but if we are to design with other sensors how can we do that so now the thing is we have spent a lot of time understanding how the sense of sight works and a lot of psychology and cognitive psychology has done research on that but we have to understand that the other sensors are fundamentally different from how sight works so if you are to design for them there will be certain different things that we should keep in mind and also one of the good things is that the other sensors allow us a certain key advantages that sight does not have. For example the other sensors like unlike sight where we are only seeing what is in front of our eyes something like smile or something like sound is something that we always hear wherever it's coming from. So we can actually utilize something like that nature of the senses and communicate information through less smell while you are already engaged on a screen so you can have to break your flow to complete that new information that is coming to you. Then the second thing is that this is in a way a limitation because our sensors sight is so tuned to understanding so much information but the other sensors are not that trained in accessing information so we have to keep in mind that if you are trying to communicate something through less smell it should be very simple something like binary states of right versus wrong or success versus failure or so for example something like success of a payment process or success of order can be communicated through a pleasant smell whereas failure can be communicated through unpleasant smell which is something that is happening in the background in a slightly abstract manner. Then the third thing is that as we saw in the beginning that all our perceptions are actually made of multiple senses so we can also think of designing for screens where there is maybe like one or two additional senses which are complimenting what is happening on the screen. And the fourth thing is mapping so although current will now turn on the Bluetooth speaker and now we will turn it off so you can see like certain even without knowing anything about the speaker you can know or you can detect which one is the turning on sound and which one is turning off because it is catering to certain basic human understanding of right we can fall in the pitch of the voice or the sound. So what are we mindful of these associations that we have for example smell is something that is very subjective so you have to be aware of these associations and design in sync with that. We will skip the ideas because we are short on time. We hope for some of this as a primer to designing for the other senses made sense to all of you. Thanks a lot for your attention I am Karan and this is Gaurav. We are host graduates from Media Design NID. Hope you have a nice day and enjoy the sessions to you. Thank you so much.