 Good evening everyone. I am Guruswamy. I work as a professor in an engineering college in Hyderabad, India and I have developed a few mobile applications for the kids who have hearing impaired. And to tell you frankly, when I go through all the sessions happening in FOS Asia, all are regarding to technology or regarding to the hardware. And myself and the previous speaker are the ones who are in the health sector. And I am very happy to say that I am the only, this is the only work which has been into SS2 technologies when compared to the other technological stuff. And I am glad like my work has been selected to FOS Asia because you know the technology has been used for the right path. And coming to me, I work with the college called BV Raju Institute of Technology which is along with Vishnu Education Centre. And you know, we have something called SS2 Technology Lab in our college. So this labs works with especially abled people. We work with visually impaired. We work with hearing impaired. We work with special kids. We go to autism schools. We work with old age homes also. And we work closely with hospitals. And I am the in charge for that lab which is called SS2 Technology Lab. So it's enabled. And this made me to work with some organization called SAHI. Do you have this? Okay. That pointer. Pointer. Yes. Okay. SAHI is Society to Aid Hearing Impair. The last one lets all here. This is an NGO which works with the hearing impaired people. So they do operation for that. So with all these combinations, I am able to present my work at FOS Asia which I feel it as a privilege to do it under open source. Now coming to this, all of you know hearing is very important sense which human should acquire. But unfortunately in India, 5 to 6% Indians have this hearing impairment. And most of them they have it at their childhood when they have it at birth. If that has not been, you know, if it has not been detected at the early stage, they may remain dumb. You know, practically we don't use dumb. We say it as hearing impaired. So they remain hearing impaired for the rest of the life. That's the most saddest thing. And you know, they pay for the rest of the life because of the Indian scenario, because of their poverty and all those stuff. Hearing plays a very important role in all of our society. And because whenever there is a hearing impairment, it's not like the, you know, whether you can hear sounds, whether it's low or not, it is totally, you know, you can't hear the sounds completely. There is something called cochlear implant operation which is going to happen. So this is all the hardware stuff which has been done. So we have a transmitter. The transmitter is there which receives the sound and after that it is going to, you know, process it. There is a processor. I think many people would have seen a white one which is being worn by the people who have hearing impaired. And, you know, the cochlear implant happens and there are a, you know, a tube of electrodes will be there which connects to the, which bypasses the nerves because they are not working. And they just come into this, they just get attached to the cochlea and after that we have the receiver. So what all the sounds are being there, they are being transmitted by the transmitter and receiver is somewhere inside our skull. They make a small joint and they attach it. So this is what being happening whenever you, so finally it comes like a look like this. This is your transmitter and this is your data processor and your receiver will be attached to this because of the magnet. So finally it looks like this. So basically this is called as cochlear implant operation which is generally done at a very early stage to the kids. So whenever it happens to, for the kids, what the students, what the kids do? The kids, you know, they can't, you know, they are used to the sign language. So they get, they will be always comfortable in the sign language. They don't, you know, after the operation they suddenly hear many sounds. So when they suddenly hear many sounds, they are just confused and they try to use the, you know, sign language. So we want to get them to the real world. In order to get them to the real world, we give something called audio verbal therapy which is being employed. In this, whenever, you know, in this audio verbal therapy, at the beginning stage of this audio verbal therapy, you know, there are certain words called pa, ba, ma. So where, you know, they just see the lips to be moving. They don't concentrate on the sounds. So this is how, you know, there is a, you know, the lady over here, she is a, she is a audio therapist and her name is Bhavani. She works with Apollo hospitals of India and I'll show you a small video like how the audio therapy is being given. It's all in my native language, Telugu. See, in order to make, you know, the things more simple. So, you know, you can see the lady singing a song. So telling about a story of a cow. So, you know, she's carrying a book and she's showing a cow over there and she's telling about the cow in a rhythmic way. So that's the therapy which is basically given and she's a senior teacher, special teacher of this school. So when I visited this school, I got an idea like why can't we digitalize it. So instead of keeping a book or a paper or something, so we thought of digitalizing it. We sat with all these people. We sat with specialized teacher. We sat with audiologist. We sat with, you know, the doctors and all those stuff. And with the help of all these people, we were able to develop few apps. So these are the total apps. These are the list of the applications, mobile applications which we have developed. And these applications were developed by using an open source software and it's very simple to build which is called as MIT App Inventor. Even a kid, you know, it is just like drag and drop. You don't have to code it really. The code generates automatically by itself. So these are the, you know, the app names. It's a bi-manor app. It's a sounds app where the sounds of the vehicles comes up where the sounds of different birds, fishes, boats, comes up. Same syllable length world. These are the apps which were, these are the names given by the special teachers. And finally, you know, we were able to build up these apps according to their interest because we are not specialized in the sounds or the system or the curriculum which is required. Now I'm coming to the other. I'm describing each app in more detail. You can see this one is bi-manor app. So you can see here cat, bat, rat. So you know what happens? The person, the kid comes and touches the, you know, it is like, so rat. A teacher, a manual teacher can pronounce rat, rat, rat for five times and she'll be very confused or she'll be very angry when she wants to repeat it for the six times. So you press it for ten to thousand times. It will be telling rat, rat, rat, cat, cat, bat, bat, bat and so on. So it makes the works of the teacher more simple and you know it makes the students to learn it again and again. The same way. It's van, can and fan. And the other one is pod, cot and dot. These are words given by, these are the words which are universally followed by this audio therapist and you know we got these words accordingly and we were able to do such a kind of app. This is a bi-manor app. Now coming to the LTL sounds. These are the, you know, the picture, the home or the first screen or the home screen looks like this so that, you know, we want to make it more attractive to the kids. And later, you know, when you press on this it's not like monkey going to come up. The sound of the monkey, how monkey shouts or makes noise is going to come. And the bird sound, the car horn sound or you know the horse running sound, the watch tick, tick sound is going to come. So these are the sounds, you know, they have to know all the sounds. So what practically the teacher does, whenever a car comes they say beep, beep, beep, beep. So they say it morally. But we want to show them practically or really, you know, reality like how the car horn is going to come up. Or how the horse runs. Whenever horse runs, we make sounds with our mouth. And but we want to really show like, whenever horse runs practically what is the sound going to come up. We want to bring the reality into picture rather than mimicking by human being. So after that, you know, this is another one, same syllable length word. So which was done, you know, according to the teachers, like whenever they cross first level they can go to the higher level level 2 and they can go to the highest level level 3. And this app has been done in a local language called Telugu and all the apps which we have done they were done in three languages because the therapy asked by the clients or the patients is either in English or Telugu or Hindi. And nowadays few international people from Middle East are coming and they are asking in Urdu also. So this app, you know, it's like in Telugu we go like kapu, cherry, tomato. So the words keeps on increasing. And after that, you know, kapu, basu, glassu. And you know, kukka, tokka, nakka. So they are all rhythmic kind of things. So which goes like this. So the levels, you can see this is a screen for the level 1. This is the screen for the level 2 and the level 3. So these are the apps being developed. And the other app, you know, early vocabulary app. So this app is being, as I said, it is done in the local language called Telugu and after that in English and the Hindi language also. And you know, whenever you go to the home screen what all you want to do whether you want to make them to learn about wake up or brushing or drink water or you can even test the kids on this app. You can provide some tests for them to for testing. So I'll show you a screen. So you know, this is wake up, which is in English. Up is missing here because of the screen problem. And after that, this one is in native language, my own mother tongue literally. And this is in Hindi, you know, Utho. So you can see, you know, all the things just wake up. So that's how it has been developed. And this one, all of you know, drink. So it is all in my, all the languages, all three languages we do it. So these are in different screens. And after that, you know, bath, we have it. So this is early vocabulary app. We have to tell them like I want to brush, I want to bath and all those stuff we have to train them. So there is another app like mono. This is same length one where the teachers, the special train teachers are classified into mono syllabic, dis syllabic and tricellabic according to difficulty levels. So this is the way, you know. So this is the mono syllabic one. This is cup. This is ant and fish. So they keep on increasing the levels kind of stuff. Mono syllabic we have done almost 41 screens for every sector. And this is the dis syllabic one, auto, apple and camel. These are the words which are given by the teachers itself, the specialized teachers, how they train them on the books. And later ice cream and lauri balloon. So it's ice, lauri and balloon. And this is the tricellabic word. So which is papaya, butterfly and bitter god. So and after that discriminate sounds. So these are the again, you know, we have made it into day cat bat. So they are all different. So they are discriminant one like door, board, board. These are the different things which we have developed. And discriminate, you know, we have done for three different ones. We have gone to different levels and we have done it. Not only this, we have developed something called mobile rhymes app. You know, this has been our own idea like why can't we develop them onto the mobiles. This is the rhymes app which has been developed in the local native language called Telugu. And after that this is the one which has been done in the English with taking few examples and after that there has been another one called color app. I thought like I'll show this app to you which has been very interesting. You can see here whenever something is pressed. Yeah, see all of you, you can see a girl talking there. So the teacher is specially required. We don't want professionals to speak. We want the kids to learn in such a way like their neighbor or the sister is teaching them. And they don't want male voice to be used there. They want female voice to be used because they are, you know, the training is mostly given by women. The teachers are all women. So they feel more attached for that. So you can see the colors. Whenever they touch the color, the color will be coming up or it will be spelt out. And you know, here this is an exercise where they can color the cake, you know, because it's the most attractive thing. They can color the cake with what all the color they require, the red, orange, green, blue and pink, yellow. So they can erase it and they can go for the next one. They take the cup and then we erase it and yeah, flower. We kept this also. This is the test. You know, paint with orange color. Whenever you press wrong color, it keeps on telling. Listen carefully. It's orange color. Unless you press orange, it will not go to the next screen. Listen carefully. It's yellow color. Paint the face with green color. Listen carefully. It's green color. Paint the apple fruit. Apple is obviously red in color. We don't get, you know, yellow apples or something. Listen carefully. Paint the apple. Paint the mango fruit. Mango is obviously yellow in color. Paint the mango fruit. Yes. This is what, you know, the Color Me app is going to show and you know, I want to show you because instead of showing the screen shot, I just want to show you how the storytelling app goes. Whenever storytelling app it has been done in three languages, native language of Telugu, Hindi and English again. So this is the screen. Grab it and the talk toys. That's all about English because we have to run. This is in Hindi language. This is in Telugu actually. Yes, they can exit this one also. What is the advantage of this instead of showing in the book and telling them. So the screens go past, the screens go on one after the other. It looks like watching a movie and they feel more attentive actually. So that's the major advantage of this. So you know what is the, you know instead of me speaking about how this app is going to work out, I have a video of a teacher who really wants to tell you like how this app has been really useful for them. She spoke in Telugu but I have kept the subtitles in English with the help of my friend Bonu. So she is the teacher who is working there and who has given us enough inputs in developing these kind of apps. So, you know, whenever they give auditory therapy, the stimulus is going to get increased. So whenever this stimulus increases. Yeah, what she says is like, you know, the kids are paying not interested towards learning from physical objects or books or coloring things. As it is a mobile, they feel like, yeah, mobile has games, it has visual effects. They feel like it's going to be very interesting. And not only teachers, you know, the parents are also very happy about it. They say that not only audio therapy or the speech therapy can be given at the hospitals or rehabilitation center, we can, by using this mobile app, we can, you know, use them at our own homes. So here is one of the experience of the parents who wants to speak to you. And this is a video of them. Yeah, this kid, all of you can see, she had, she had gone through cochlear implant. You can see the ear and the device. And she is, her name is Vaishnavi. She is of seven years old and they are bringing bringing her every day to the hospital for from one year onwards. Literally they are coming for last six years. So the father is repenting. Like if these kinds of apps are there before I would have trained her more and her future has been much better. She would have been in a normal school. So that was the experience shared by him. So you can go through subtitles. The Indian father and woman with their kids. So with this, you know, we were able to, you know, make the lives of many such kids in a better way. So with that, I'll come to the end of my presentation. Thank you all of you. Any questions to us? Yes. Yes, so first of all, how's the project? And so maybe this open source, right? Yes. Do you know of any other project that's, it's about based off of this project or adopt this project and develop it into some other project? Yes. You know, they have the people, the special teachers, how many projects in their mind. And this is the beginning actually. So they want to make it more complex. They want to make it into more testing. And we didn't place it in the Google store because we want to work with the students, take the feedback, revise it, revise it. There are many such cases like, you know, hearing impaired kids can be done. So there are many projects, you know. It's with the doctors. We have to sit with the doctors, special teachers, the audio therapist, and we have to work with them. It has spun off, inspired many other projects. Yes. Yes. It's just the beginning, I can say. We still have to go a long way. We have to make it more complex rather than simple. Yes. And now, you know, we are working with other, as a part of ATL, we are working with something called organ donation. We work with kidney patients and we monitor them whenever they come to the home by using open source. And we find out whether they have to go with medication or dialysis or they have to go for, you know, whenever there is a kidney failure, they have to go for transplantation and stuff. That is the other project which we are taking up by using open source itself. Any more questions to us? So I have used MIT App Inventor. You just require a Gmail account for that. And it's all drag and drop kind of thing. It's a Chales play which we made it serious. That's it. Our application oriented. Yes. Yes. Thanks for sharing. You mentioned in your very first slide that approximately 5% of kids are getting problems. Yes. And how many of them can do the job? Yes. Very good question actually. You know, 5 to 6% of the Indians, they have this hearing problem. So you know, it varies. The basic operation happens with 10 lakh Indian rupees. So the basic, you know, the government doesn't fund for this hearing implant. So they have to fund by itself. The Sahi, you know, Society to Aid Hearing Impait is a nonprofit organization which works mostly with a girl child because in India we have a scenario like, you know, they are mostly concentrated to boy kids rather than girl kids. It's like you get married somehow by paying heavy stuff whether visually impaired or hearing impaired, their life is settled. But the Sahi is supporting only girl child, mostly girl child according to their financial situation of the family. So, you know, they test the kid and they find out whether it is by cochlear implantation if he becomes normal. So they look at the financial status of the family and there will be continuous interviews to the patient because a lot of therapies have to go or keep on going because they hear the sounds at the slot whenever cochlear implants happen. So the parents taking care of the kid in giving therapies are bringing them back to the therapies to the hospital. So they consider many factors and they decide and they sponsor the kid for this operation. Actually, I have one side, single-sided use there, so I'm here for my left ear, so thank you in the last part. Yes, it's my pleasure always. No, it's a human sound. They don't want, you know, computer generated sound which is totally, you know, not natural, which doesn't suit the Indian environment. So if I want to because, you know, the way we pronounce, Indians pronounce is different. So we just want the kids to learn that kind of hearing rather than, you know, they should be able to communicate with others. If they communicate in other kind of ascent, then things would be different. They'll be treated as an alien in the crowd, that's the reason. Yes, I'm a professor. My student does all these recordings. And we find out whether the recordings are good or bad from the teachers, whether the voice is being prolonged or it is very fast. So I literally dedicated all my weekends for this, all holidays. I was working with hospitals on rainy days and stuff, taking the crowd of students with me. The two, I work in women college. I take women there so that they get more attached to the society and keep on working. Is it for maybe an image, like a brand? Yes. Does it select one of multiple possible pronunciation? Yes. You know, one app, they want a different Indian ascent to be done. Suppose, I have shown nine apps. One app is done by one particular voice. Second app is done by other kind of voice and stuff. Because, you know, it's all Indian ascent and there are two native Telugu languages ascent, which students should know, which the patient should be knowing to be said. Because, you know, we want to make them to understand different frequencies of the language. My frequency would be different. His frequency would be different. But, you know, the kid should not be, in a sense, like everyone's frequency would be only my voice based on this app. Thank you all.