 At a new technology that's making waves in the world with AI, ChatGPT. Now you may have heard of ChatGPT, it's a popular online chat spot. Both Erythie Will, leveraging their previous work and they should be paid. So could AI replace human jobs? It is possible that AI could replace some jobs currently done by humans. It is quite scary that ChatGPT can take over many different jobs such as lawyer, customer support and designer. In this video, I'm going to test out can ChatGPT actually go into past the product management interview at Google and actually land a job offer. So this is going to be a mock interview with ChatGPT. And as a hybrid manager from interview hundreds of product managers and also help hundreds of people land a dream job. I am going to pretend I am the hybrid manager and ChatGPT is the candidate for Google product manager position. And I asked ChatGPT five different kinds of questions including behavioral interview questions, technical, estimation, product design and system design. Let's see if it can pass. Make sure stay until the end of this video where we're going to share with you the moonshot idea created by ChatGPT. Hey guys, this is Dr. Nia CD, a director product and featured in Forbes. I've helped hundreds of people land a dream PM job offering in fan companies at Unicorn startup and continue to get promoted as a product leader. If you're interested in product management course, please go to PM, Accenture, Dio. In this channel, we talk about product management, investment and parenting. Make sure to subscribe to the channel, hit the bell button to be notified every time I turn on a new video every Wednesday. In my last video, I talked about whether ChatGPT can actually replace product management job. In this video, I gone interview ChatGPT and here are the four steps I took to do this mock interview with ChatGPT. First of all, I took the real life interview questions at fan companies such as Google, Meta, Microsoft and Amazon and use those questions to ask ChatGPT so that we know exactly the real life scenario look like. And actually those questions came from the 50% manager fan interviews database. You can go to this website and download and use it for your own mock interview practice as well. Second, I had my sample answers ready so that I'm going to compare the ChatGPT answers with my own answers. On top of that, I also have some of my royal followers who are software engineers to ask technical questions to ChatGPT. So I'm very excited to see it fail! The interview, well, let's see it fail or not. And then actually the sample answer came from the best product management sample answer to product design interview questions designed an Uber app for people with disabilities. You can check out this video right here. And then I compare this answer with the ChatGPT answer. Then number three, I check out all the five different kind of interview questions at Google and ask the exact five types and see if it can pass or not. And I already filmed a separate video. I talked about five different kind of interview questions in Google and what kind of sample answer you can use to pass those interviews. And here now let's interview our candidate ChatGPT. Hello, I am ChatGPT, a language model developed by OpenAI. I was created to answer a wide range of questions and provide helpful information to users. And I started telling him that background information. ChatGPT, you are interviewing for the Google product management position. Are you ready? And he is. First of all, I asked a behavior interview question. Why do you want to be a product manager at Google? Given Google has a unique culture, has its own pride, and let's see what ChatGPT says. And it gave me three answers. Actually, I asked ChatGPT to give me three answers, gave me those three answers in compassion for technology, collaborative environment, impact, and responsibilities. And actually, I love all three because this is actually what Google is proud of. And I definitely say this is the path to the interview. Of course, in real life, we go out for Google interview and combine it with yourself. But the answer ChatGPT has because ChatGPT doesn't have a personality at this moment. But all these reasons is really good. So if you go out for interviews with Google, you can just plug in yourself, but answer the three-body point you can't pass the behavior interview for sure. Then I asked this question. Why should we hire you as a product manager at Google? And the answer is also very good by ChatGPT. It's that highlight your relevant experience, demonstrate your knowledge of Google, and showcase your skills, demonstrate your passion and drive, and overall to answer the question and show your strong fit for the role and the company. So the guideline is also very good. Again, it didn't plug in personality because it doesn't have personality, but the answer is so good, I'm going to give you a pass. Actually, the next question is even harder, which is estimation question. So I asked ChatGPT this question. Please estimate the number of airplanes taking off from Miami International Airport. And it took us five different rounds to go back and forth to get the right answer. And the first job ChatGPT gave was kind of cheating. He Googled right away to understand how many passengers that Miami International Airport handles every single year. And then using a passenger divided by how many flights the passengers take and how many people the airplane can take. So actually the answer is kind of cheating because usually even if I myself live in Miami, or I don't know how many passengers Miami International Airport can handle. So therefore I told ChatGPT we cannot use this information. Please find a different way to estimate. And they cheated again and went online and searched the number of aircraft movement in the Miami International Airport. And actually I told him this cheating again. Do not use this data to create any answer. Please give me some common sense. Average people's answer, average people's knowledge we are searching online. And then it starts to get better. Because they start to estimate the number of gates in international airport and use the gate can estimate how many planes are handled by each gate. But it made an important mistake. There are 129 gates in Miami International Airport and saying that there are 129 airplanes taking off from each gate. Well, it's not one to run ratio for sure. So there are some mistakes in the ChatGPT answer. And they gave him some hints saying that well, there are more than one flight taking off per day, a per gate would you be able to have a better estimation. And specifically I told him that can you increase the number of flights airplanes and redo estimation because they will each airline can operate more than one flight. Then I asked him to not use any information. You cannot search this information. Please directly use common sense knowledge to do estimation. And they gave me this kind of answer. Estimated how many airlines actually operate through Miami International Airport. And they also said there are 100 airlines through Miami International Airport. One airline is said estimated to have one flight taking off. So therefore will be 100 flights taking off from Miami International Airport. So the estimation is also wrong. It should be more flight can be handled by one airline. And they continue getting very frustrated with it. It's so dumb actually. One is why one one ratio should increase the number of airplanes handled per airline and it started to increase. And then the answer gets better. Once it's increased it said well each airline can actually handle 10 flights. So 100 airlines can handle 1000 flights. Well the answers kind of get better. That's a little bit. But I'm not satisfied with this answer. Continue to ask the following question. Usually people do not know how many airlines are being handled by one single airport. Can use other ways. And then it started to get better. Giving the number of gates. But again it made another mistake. Well one gate will handle one flight per day. That's very wrong. It said 129 gates will handle 129 flights per day. It's also very wrong. So I got very like frustrated. And I asked him that hey please increase the number. And here is why. Because I believe each gate have more than one flight taking off in 24 hours. Can you increase the number of flights taking off per gate. And redo the estimation. And finally it started to give me a better answer. And it said each gate can handle 8 flights per 24 hours. Which means every 4 hours. And they can handle one flight. Which is kind of good. Because we also need to count the flight landing versus taking off. So roughly 6 per gate per 24 hours is kind of reasonable. And finally we got this answer. So therefore based on this performance. I'm going to give it a fail for the estimation question. It said too much back and forth. But eventually through my guidance and training it became better. Now the interview question gets even harder. Product design question. It's crazy. So design really requires lots of imagination. And understanding of human needs and users. And user pain point. Let's see what it does. And this time I asked a specific question. Hey, design an Uber app for blind people. Again please make sure you go to this video. We have the best answer to similar kind of product design interview questions. And then I compared the answer to my answer. The first time he answers the question. He took a system design. He directly went into technical design of Uber app for blind people. Which went into like conduct research. Specify interface. Use audio cases. Use haptic feedback. For product management interview during the product design question. You cannot jump into the conclusion. So therefore immediately it failed the interview. But I gave a second chance. I asked question differently. I asked hold on, hold on. Don't give me the solution. Please break down the customer segmentation for me. And it actually gave me really good answers. It broke down customer segmentation based on blind, visually impaired users. Carriers, a system which is inside the entire ecosystem. That's what I like about it. Other people involve not just different type of blind people. And it also has disability organization. Which is also very very important organization. And continue to talk about like advocacy group and drivers. Bingo is very important. When we design Uber app for people with disabilities. It's a two-sided marketplace. Which means that riders, they're drivers. You have to talk about both sides of marketplace. And I'm glad it came out with very broad stakeholders in this process. So that you're able to show the broader scope of thinking. And this product actually can pass it into based on the customer segmentation session. Then continue to ask the question. Hey, your customer segmentation is really good. Which one would you prioritize and why? And it's actually, I don't know. Within 45-minute job interview, we cannot work on everything. And it gave me the priority customer segmentation. Which is blind people or visually impaired people. And with very strong supporting evidence. And actually I really like it. Then ask the next question. Please provide the top three pain point. For the segmentation just prioritize. Which is visually impaired people. And the three pain point they gave is also pretty good. Accessibility, security, and safety communication. But I start to challenge chat GBT. Safety and security. Is it for blind people or for everybody? Because I feel it sounds like it's for everybody. But it comes back answers really good. Instead of falling saying that, Well, the pain point are specific to blind people of the Uber user. However, some of these pain point may be relevant to other user segmentation. As well. And then give me specific examples regarding why blind people really feel like. This is important pain point for them. The argument is actually very good. And it said the following for example said. These features may be even more critical for blind or visually impaired. Users who may feel more vulnerable. When they use right holding services. It's like great comeback. This is actually very, very smart. I was totally impressed regarding how it communicate with me. Amazing. Then I continue to ask chat GBT to prioritize all three pain points for me. To understand which one should we prioritize. And his answer is the following. It said accessibility is a critical path of blind and visually impaired users. And because of difficulty assessing the app. Not understanding the interface. Due to visually impairments without accessibility interface. We may not be able to look. Book of rights and use the app effectively. And also answers actually extremely good. If I personally go into interview. I will also prioritize the accessibility pain points for blind people as well. But I don't like how it's described. It sounds very robotic. Because when we go into product management interview. It's very critical. You need to bring the empathy of customers. Now he talks about it's robot. I don't think you can actually pass interview for the Google level. So therefore I asked chat GBT. Can you talk about those pain points with more customer empathy. And actually it became better. And then they use a more feeling type of words to describe the customer empathy. They may feel like the app is not designed with the needs in mind. And struggle to navigate its interface. Like everything is really good. Same three pain points. But with very emotional driven wording to make it as well. It has lots of strong customer empathy. I will give it a sum up for the description. Then I ask another question. When you prioritize this pain point. What kind of criteria would you use to select your pain points. Not just giving a blank answer. And the answer is actually extremely good. It's a severity, frequency, impact on user experience. Alignment with product goals. This is perfect. In the training. The free sample best answer to partner manager interview. Sample answer for design robot as for people with disabilities. I also use extremely similar framework. Just use different wording. For example, it says severity. And here we talk about the impact to users. It's the same thing that I said very well here. So definitely give a pass. It's very impressive so far. Then I ask, hey, give me three solutions for your prioritize pain point. And they start to make mistakes. And it actually gave me different kind of one solution per pain point. Which I do not like because I said for the prioritize solution. So therefore I asked Chachi because hey, stop. Stop giving me individual solutions. I just want to prioritize solutions. Which one would you design and give me three solutions. One of those has to be moonshot solutions. Guess what he says. And they gave me three solutions. And number one is voice driven interface. Number two, haptic interface. Then they gave me the moonshot idea, which is really good. The moonshot idea says a moonshot solution to address accessibility pain point for blind or visually impaired people would be to develop a variable technology device that can provide a fully immersive ride herding experience. The device would include the haptic vest to provide the user with directional feedback and alert and with the 3D audio systems that create a fully immersive audio experience. The device would also use advanced sensors and machine learning algorithms to provide real-time information about users' surroundings, provide relevant information about the ride such as driver location, estimate the time of arrival and upcoming terms. This is actually really good. So I definitely say it will pass the product design interview. This is crazy. And the fifth question I asked is the system design questions. Make it very technical. I asked, hey, please design the high-level system architecture diagram for Google Maps. And the first attempt wasn't very good. It's mainly talk about different technical components such as user interface, application server, data storage, and they started to guide it to have a better answer. And I said following, what type of data storage would you use? And it started to give me another generic answer. For example, it said, well, it really depends on what kind of data do you have. There are five different kind of data structures such as relational database, no SQL database, object storage. All of those are too generic. So I didn't really like it. If the interviewer probably failed this interviewer, but however, it's chat GBT, so give the second chance. I asked the follow-up question. So please estimate the kind of data and also the constraint of Google Maps. You need to think about your own constraint when you go into system design without telling the interviewer the variety of options. You need to be very specific. And it said, well, there are many different kind of data, seven different kind of data including geographical data, user data, real-time data, performance data, availability, scalability, security, and those are getting better and better. Actually, it's definitely improving. But when it's giving the constraints, only give me data types without giving me, hey, there's a size, the volume of the data. Of course, I can continue to dig in and ask you to give me the specific estimation and volume data that Google can handle and eventually lean into a system design question, leading to a better system design answer. However, we're doing this marketing interview only at 45 minutes. When we work with AI, chat GBT, and it didn't have the capability of, hey, let me try to use my common sense and knowledge to do estimation to have okay answer but doesn't have to accurate. Because whenever, when candidate go into interview, we need to use our own capabilities to create constraints, technical requirements, and different kind of scope changes, have a conversation with the interviewer. So therefore, I would say for system design, it kind of okay. So in general, I think it's actually cannot pass the Google interview but definitely impress me in terms of behavioral interview and the product design questions. So definitely whoever want to practice mock interviews, you gotta check out with chat GBT. Potentially, he can lead you to a better answer. You should definitely watch this next video where described in details will chat GBT replace product management job or not. Check out this video right here. If you like the content I make today, please make sure to like, share, and subscribe for more tips. This is Darkness City from PMExcelerator.io. I'm gonna see you next time.