 Thank you for taking this opportunity to speak. So I want to share it's a project that we built in 2018. It's an online delivery tool that we want to build. And although this is my topic today, but later in the Q&A, people want to know more about how we use technology to tackle coronavirus in East Asia. It's also welcome to X. But I think I still want to look back to this journey that how we try to build an online delivery tool and fail. So the project is called sense.tw. We want you can make a supplement of make sense.tw or nonsense.tw. So it's an issue policy mapping tool. And a little bit self-introduction. I was the product manager of sense.tw and also a longtime participant of GovZero Community from Taiwan. And I also want to give you an introduction on GovZero because we are a quite unique community. I know on this agenda introduced GovZero as an organization. But we actually, most of us see ourselves as a community that no one can represent. So what I'm going to say is my own interpretation on GovZero. I'm now representing this community and other participants may have different point of view. So I think GovZero is a city tech community that have multi-center. So no one center to decide what to do what and it's a project-based community. And it's also my understanding of GovZero city tech is not to make government sexy again or make government technology better. But it's from, it's very citizen driven and very activism. So sometimes we collaborate with product group industry and sometimes some project collaborate with the government. And we have really value open collaboration. They centralized, open at this forward. All projects are open source and everybody can contribute and have online to offline collaboration. So that leads to the project of CENSTRA TWA is a quite unique project that the government find, want to find some people in GovZero community to build an online deliberation tool. And for if people joined the last session, Alex analyzed some limitation of online deliberation tool. So at that time I was so excited to join this thing. My boss Haitian, he built the team as a startup team to build a new product. So we have one designer, three engineers and I was the product manager. And however, you can see the project results I'm listing here is not only a digital product. We, at the end of the day, we need to do write research report, write guidelines and host meetup instead of just build a digital tool. So I will explain why we need to do so many things. A part is we need to create a scenario for the tools. Another reason is that we need to fit the expectation from the government. So first of all, as a product manager, you need to understand the stakeholders and their goals. So, sorry, let me very briefly introduce this one. So in Taiwan, this is a government-sponsored project and we have a board of science and technology. They have three projects and one project lead by the society and technology communication team is, they want to have a bottom up deliberation on 2030 technology efficiency of Taiwan and they cut the deliberation into online, offline and extra meeting. In my team, we need to do the online deliberation part. However, the vision of the 2030 citizen assembly was soon canceled because of political reason. So then we become like, we need to have a bottom up communication platform for technology policy. So my team idea is that for online deliberation, we actually value more as the online community, those people who are really good at technology but there are not a professors in university or they are not the staff from large company like Google or Facebook that normally the government wouldn't invite them to join the technology policy meeting process. So we want to build that bridge from for online communities and the government. And the questions will be how to collect and organize and find insights from the scatter information online. And so, and then we also research on the existing mechanism and, wait, I'm sorry, there's a slide missing. Yeah, I don't know why it's missing. Oh, okay. So this is what the government see. They are like to finding the lucky one in all the online discussion. They couldn't find an insight. And those discussion are on so many different channel, Facebook, Twitter, in Taiwan, BBS forum. So when they say bottom up discussion, they actually want, they organize external insights and they actually don't care about the tools we are using or we're building, although we see ourselves as a product team. So then we research on what are the existing mechanism and where are the gaps. So this is a very brief introduction to the Taiwan online participation. So join the TW is more like on the top left is an online petition platform. And then after 5,000 petition, you will go to the government and the government needs to respond. And our digital minister, Audrey Tan, she founded participation offices network in the government to respond to that. And as another famous project, Kofi Taiwan is more in the middle that the citizen and government can both initiate discussion on it. And we also have some national assembly specific topic like energy or judicial reform. So we don't want to build another platform, like just another online forum for deliberation. So this is a petition website, online comments, just give you a look at it. And also in the open government participation officer meeting established by Audrey Tan, they use online posters to break down the policy into like problems, rigs, resources, solutions, questions, and to start a multi-stakeholder discussion. And also Paul is using the Taiwan. So many tools are used in Taiwan existing online participation method already. So what else can we do? Our conclusion is that we want a deeper and informed discussion because usually in online forum, people maybe just live like two sentence or less than 100 words to say their opinion. And we want to focus on extra meeting because our scope is technology policy, like nuclear power plan or AI, national AI strategy. And we want to bring the technology communities inside. For example, people who know blockchain maybe are the startup people instead of the traditional semi-conductor companies in Taiwan who have a larger voice in the government. It has better connections. So then our tour starting from testing a notation tour expert consultation meeting. Sorry, that's a little bit fat. So we modify an open source software call hypothesis. And the idea is that you can make annotations on a document. So we testing in the expert meeting. So the idea is that when the government wants to have a meeting and invite external experts to join the meeting, the expert can comment on the meeting document in advance and they can put reference in their suggestions on it. So everyone to participate in the meeting can be more prepared. But no one actually use it. And one reason is that those documents are sent only like three days before the meeting, the expert don't have time to prepare for it. And the second is just expert usually to make a point. They are not going to discuss. They already have their opinion. So our team also acts ourselves. Does the tour only serve for the government use or a deliberation tour should be a wider use that for more citizens? And what else can we do besides annotation? So that give us to, we want to re-identify challenges to generate community discussion. And it took us a whole week using Google Design Spring to do that. And so we draw this technology policy-making process in Taiwan, stories in Chinese, but the middle part is the expert meeting and the outside part is we want to help. Before the expert meeting in the government, how can online community form and organize their opinions? So that will be the questions trying to be how to organize and input technology community constructive insight in early policy-making process. So basically is when we talk to the communities like the drone players or like people working in AI or people working technology arts, they don't know how government works and the government felt that they don't know where to find them because they are not a foundation and they are not a company. So we want our tool to be a platform that the community can organize their opinions themselves and give to the government. And so we want the discussions to based on reference because like Wikipedia or online, we really rely on hyperlink and we want to break down arguments and support information so that people don't mix all the arguments together and we want to have a visual concept map. So, well, the idea is cool, but it's a little bit complicated. So we keep the original annotation one, but instead of only annotate one document, we allowed you to annotate several documents and make your annotation like the highlight here become a note or a card on this concept map. This is not a mind map because it's like an online post it with reference. So you can imagine that you're reading a book, you're reading the book and then you highlight one book and you take that highlight into a post it on the wall and then later you can link those highlight and your notes on different reference onto a visual map. So we use this like discuss like public money, public code and yeah, we build this product, but still no one use it because it's so hard to understand, it's so hard to use. People asking questions like for this map, we should start to look at it. So we realized that we need to create our own use cases and scenarios. So for example, we use this to organize a look of zero projects for the past five years. And we also give a discussion framework for people to generate online, online, not simultaneously collaboration. So people can follow like, online comments they don't have to discuss at the same time but they can put a post it at different time, follow the structure. So it will be like this. And we also organize offline meetup that when people discussing, we drawing the concept map in real time on the screen so that people in offline discussion, when other people are speaking, they can comment and put the reference on the map as well. And also we do this to the TV debates, live streaming debates on the nuclear power planes construction, so like this. And the good news is after create the scenarios, someone started use it and mostly our students under 22 or 25 years old, they really like this new idea and more people read and understand it but we still not do it user friendly enough and we had no time because it's a one year government project and we are running out of time. And still visual concept map is a new thinking model. That's why like young people accept it more and older generation felt it's very complicated to understand. So then we have to read it up and write report and research paper. And now because a government funding is closed, you couldn't find our website, you can only find our GitHub because we don't have the money to pay the servers anymore. So at least we have some research, like we really research how the technology communities and how the activists in Taiwan doing their advocacy and how today interact with the government. So we leave resources like persona journey map and this one on the screen is a surface blueprint. And so the last three minutes, I want to share the lesson we learned. First is, sorry, I tried to squeeze too many things here. As a girls and time loss are so different for our team and the government. So for the government, they have an agenda and they keep changing it. And for our team, we want to do an agile software development but the government doesn't take us as a product team. They take us more as the people to help them to collect what online community sink. So the government wants a pipeline or SLP that they can follow or they want some magical data analysis or AI tool that they can just use one click of a software and then this software will help them to analyze thousands of words on the internet and make it into understandable reports for them. Unfortunately, those things don't exist because the current data science can only tell you that people disagree with this policy. They're angry that they support this, but they couldn't tell you that how do you make a new strategy of AI education in Taiwan? And our team, at that time, we want to build the infrastructure. We want to build our models for the citizens to discuss and mobile themselves instead of collect the opinions for the government. So at the end, we need to finish our KPI. So we manually collect 50 online communities, discussion topics on Twitter, Facebook and Telegram and make it a report to the governments to close this case. So just a lot of mistakes I have made is also on tour development and also on project. I think we set the project scope fair and wrong and doesn't have a mutual understanding with our sponsor, which is a government agency. And it's also very hard to build a tool that you want to make it use for citizens instead of the government because activists actually don't trust the tools that sponsor by the government. They are worried that we may censor the information on it. And also on tour development, we put too much time on user research instead of increase our usability and do more iteration. And also another very important finding is that it's really hard to build a specific online delivery tool. Actually a tool built for business scenario and used by many people like Zoom or like X-Mine or other tools are better for this purpose. So we still do something. And something is we live some knowledge to the communities and to the government. And we also help to build a digital capacity in the government like teaching them how to use Google Drive or how to do the online remote meeting like what we're doing now. And we introduce how to participate in politics and technology policy process to the technology people. And sorry for a long presentation. Some takeaways here. So first is I think it's important to have a mutual understanding and set up a regional project scope with the government. And second is user research that's helped. But I think texting and iterations are more important. And then for every new tools, especially for new tools in democracy and in policy field, people are not that willing to try new technologies. So creating new cases to demonstrate that is very important. And lastly is although our project failed but you can self find all our design and our code open stores on GitHub. So at least we still have some impacts and there are some friends when they're building new tools, they're looking to our research. So yeah, that's my presentation and thank you for your listening. And as I say again, also welcome questions coronavirus in East Asia region.