My favorite interview questions from 100+ guests
29 Nov 2023 · 21 min
Lenny Rachitsky shares favorite interview questions from product leaders like Eika Dimiliano, Jeff Charles, Shashir Marotra, and Yuki Yamashita. Learn what these experts actually ask candidates to figure out if they can do the job.
Welcome to a very special episode of the podcast. Ever since I started this podcast, one of people's favorite segments continues to be the Lightning Round and in particular a question. I ask guests around their favorite interview question that they like to ask candidates and what they look for in a good answer. What we've done is we've picked my favorite interview questions that guests have shared. Out of over 100 guests on the podcast, we've got 17 of my favorite interview questions all combined in this one episode. You can use this episode anytime you are preparing to interview candidates, if you want to improve your existing interview questions, or if you're about to get interviewed and you want to prepare for the kinds of questions that you might get in the interview process. Before we dive in, let me tell you about our product called Senbird, the all in one communications API platform designed for both web and mobile apps. In a world saturated with multiple multichannel communication, product teams are discovering the effectiveness of In App communication. With sendbird, businesses can elevate their in App experience with decluttered and branded communication featuring AI powered chatbots, one way messages, chat, video calls and live stream capabilities all tailored for commerce, marketing and top tier support. Forward thinking companies such as Hinge, Patreon, Yahoo Accolade and more use sendbird to build in app communication experiences that drive engagement, conversion and retention. In App Communication has the highest conversion, highest engagement and highest satisfaction of any communication channel. And when it comes to investing in this channel, trust sendbird to take your in App communication experience to the next level. Start today with sendbird's free plan and as a listener of Lenny's podcast, you'll get an additional two months of unlimited usage and access to all premium features, including creating your very own generative AI chatbot. Visit sendbird.comlenny to begin your free journey. That's sendbird.comlenny this episode is brought to you by Eppo. Eppo is a next generation A B testing and feature management platform built by alums of Airbnb and Snowflake for modern growth teams. Companies like Twitch, Miro, ClickUp and DraftKings rely on Eppo to power their experiments. Experimentation is increasingly essential for driving growth and for understanding the performance of new features, and EPO helps you increase experimentation velocity while unlocking rigorous deep analysis in a way that no other commercial tool does. When I was at Airbnb, one of the things that I loved most was our experimentation platform where I could set up experiments easily, troubleshoot issues and analyze performance all on my own. Eppo does all that and more with Advanced statistical methods that can help you shave weeks off experiment time. An accessible UI for diving deeper into performance and out of the box reporting that helps you avoid annoying prolonged analytics cycles. EPO also makes it easy for to share experiment insights with your team, sparking new ideas for the A B testing flywheel. EPPO powers experimentation across every use case, including product growth, machine learning, monetization and email marketing. Check out eppo@geteppo.com Lenny and 10x your experiment velocity. That's get eppo.com Lenny first up, we've got Eike Dimiliano. Eika was head of product at Retool. She was also a PM at Stripe. Currently she's actually starting her own company. And so here's Eika sharing her favorite interview question.
To what do you attribute your success? And you can't say luck because, you know, I think humble people will always say luck in some way. And you know, I always kind of wanted it. Like did you, like how self aware are you basically? And I think, and how curious are you? And I think people have really sort of gone back and reflected on.
Why.
Are they where they are today? Really, really says a lot about how they think about the world.
Next up, we've got Jeff Charles, head of product at Ramp and also just happens to be one of the most popular episodes of the podcast.
I asked what's the hardest thing you've ever done? And I asked that because working at Ramp is hard. I want to understand like what hard means for them. I want to understand why it was hard. I want to understand how they overcame that difficulty, how they worked with other people to overcome that difficulty and how much agency they, they had in overcoming that. So it's a really, it's a really good sign around what is difficulty to them and how, how much work they put into overcoming that.
Next up, we've got Shashir Marotra, CEO and co founder of Coda. Funny enough, we posted this exact clip to TikTok and Instagram Reels and it blew up. It's one of the most popular clips we've ever put on our channels. By the way, did you know I have a TikTok and an Instagram channel? Just look up Lenny's podcast on TikTok or Instagram. Anyway, with that, here's Shashir Marocha sharing his favorite interview question.
It's a very simple question and it's a coded eigenquestion test. And the question is a group of scientists have invented a teleportation device. They've hired you Lenny to be their sort of business counterpart. Bring this to market product, kind of what this question actually worked well for any role, but say, could be a product manager for this thing, bring it to market. What do you do? That's the whole question, right? Usually people will start asking a bunch of questions and say, well, tell me more about this device. Like, what does it do? How does it work? And is it big? Is it small, Is it fast? Does it disintegrate things or not? Does it need a receiver and a sender? Does it safe? All these different questions come out, and at some point I'll just let those questions come out and at some point I'll say, okay, nice job generating all the questions. Turns out these scientists, they kind of hate talking to people and they're kind of annoyed by all your questions. And so they've decided that they will answer only two of your questions. And after that, they expect a plan. What two questions do you ask? And interestingly, all of a sudden, like the sharp, you know, product managers, engineers, like basically every role, they very quickly find, what are the two. One or two Eigen questions on this topic? And there's no right answer. But I'll tell you, like, one of my favorite ones as a product manager said, okay, if I had to ask two questions, the two questions I'd ask one is, is it safe enough for humans or not? And that was a like, a very, like, crisp way to get to like, just safety. How reliable is it? Didn't ask how reliable it is. How many bits in middle is it? Like, just tell me, is it safe enough for humans or not? And the second one is, is it more expensive? Capex or opex? Is it more expensive to buy them or to run them? And then he took those two questions and he said, like, just with those two questions, I can form these quadrants. You can say, oh, it's safe enough for humans and it's cheaper to. They're very cheap to buy but expensive to run. Then you probably run them like human fax machines. Like, you put them everywhere you can and you say, hey, look, it's expensive to use. But, like, you all have the ability to teleport anywhere you want, and this is how we're gonna run it. On the other hand, they're very expensive to buy but cheap to run. You probably have to place them very strategically, in which case what you probably do is replace airports. Is like, airports are pretty strategically placed in places where people are trying to. Trying to get, get around places. If it's not safe enough for humans, then you've got a whole different class of use cases where you go, value what goods are transported in very costly ways. And you know, people come up with like, you know, do you do the most expensive things or do you do like, you know, is, is teleporting, you know, people's replacement hearts? Is that like a, like a really demanding thing? So, but these two questions kind of, kind of get to the heart of it. The question's totally made up. Like, no teleportation device exists, at least not yet. And I find that people's ability to learn the method is significantly higher if it's low stakes. That question, by the way, if you ask a kid that question, the, you know, hey, new teleportation device, you know, you get, you get to ask two questions. Almost every kid will like, quickly get to two pretty good Eigen questions. Again, kids are incredibly good at simplifying these things down. It's actually a skill we like, remove from ourselves. Like, I'll see, I'll hear candidates tell me things Like, I guess I would ask them what size it is. And like, why would you ask them what size? What, what, what decision is that going to allow you to make? To, to know what size it is? And you know, sometimes I can explain it, sometimes not. Don't get hired.
But.
Yeah, but then actually the thing I'd say about it is there are questions kind of everywhere. I mean, you could, you could take any product out there. I'll, I'll do it with my kids a lot. And they'll say, you know, I was just riding with, with my younger daughter. And she said, you know, how come there's three gas stations like in the same corner? Why, why did, why do people do that? You know, that's a really, that's a really insightful observation. What's the Eigen question? How do you place a gas station? You can almost take anything and say, what is the question that really drives. Drives this answer.
This next interview question comes from Yuki Yamashita, chief product officer at Figma, also a former head of design at Uber.
Describe to me a time when you're part of a controversial product assistant, right? And what did you do? And all those things. And I think it's really revealing because if they can kind of like set up this conflict and understand why this problem is really important and represent both sides such that you can understand why that conflict existed in the first place, and they can do it in this kind of like even keeled way where you realize that they can take on These different perspectives, like, you start to learn a lot about that person, I think. Or sometimes I just ask them for basic things, like, okay, talk about kind of like a big problem that you worked on. And the thought experiment for me is always, like, coming out of that, do I feel compelled to work on that problem? Right. And no matter how boring it sounds on the surface, like, I think a really great product manager kind of like, cache something as, like, well, this is why it's so existential to us, and this is why it's so interesting and, like, really rally the troops. So that's kind of one big thing of, like, storytelling, communication. Because at the end of the day, like, so much of our job is around that.
Next you'll hear from Katie Dill, head of design at Stripe, Kari Sarnen, CEO of Linear, and Camille Hurst, product leader at Spotify, former product leader at Patreon, who all share the same favorite interview question.
Tell me what work you are most proud of. And the reason I ask that is because, well, it helps me understand their taste and their judgment, what motivates them, what work they view as good and as a good outcome. It also helps me understand a little bit about what they like to do and where their kind of, like, gravity pulls them.
I think usually I like to ask, what is the candidate most proud of and why, on their professional life or.
Otherwise, what they're most proud of and why.
But I think it's kind of gives you a little bit indication what the.
Person values and how they think about things. And also, I think it's always nice.
That people can share something they think they did really well and we can.
Spend time on it versus just asking.
Something more negative things.
I like to ask people to tell me about something they're really proud of that they accomplished, and take me through the process and talk to me about why they're proud of it. I find you can learn so much about a person's motivations, about their work ethic, about what they care about, like, what good looks like to them. And I think those are all really important things to understand about a person if you're going to work closely with them.
Next is Jay Z, head of product at webflow, former Airbnb colleague, sharing her favorite interview question.
I do like to do behavioral questions is really understanding, like, when they've been in challenging situations, when they've been in ambiguous situations, like, how do they navigate? Ambiguity is a big one for me because at the end of the day, like, the PM job is really ambiguous. Like, it's really Hard to describe on a piece of paper all the things that you're going to encounter. Good answers are people who put structure and a way forward through the ambiguity. Like that's what you look for. Like you want your PM to not just be like, oh no, we're swimming in ambiguity, but like actually put a path forward. I think also looking for people who are like seeking help, seeking those inputs as opposed to being like this is the way. This is very clear because again, the chances of whatever path you chart out for any product for anything that you're doing is like the right path from the first time that you do it. So rare. And so I want to see someone be able to like get those inputs, be able to like say like this is the path, this is how I like learn why, you know, I put this path together. And then going back to a lot of the stuff I think we touched upon in this, this podcast is like, what are the little milestones that make you say, hey, is this working? Is this not working? And then make you either make a different decision. Seeing people do that really well is a big thing to look for.
Next up is Noah Weiss, Chief product officer at Slack.
What unfair secrets have you learned to improve the velocity and energy level of a product team? And when I say unfair in secret, I usually mean like not something that you probably read on like a medium post, but like what did you learn, how did you learn it and how does it work and how do you apply it? You also just get amazing, interesting like bits of inspiration from asking that.
This next question comes from the very solitary voice of Ben Williams, former VP of product at Snyk and now an advisor to product led growth startups.
Fast forward three years, what's different about you then? A lot of people will default to telling you where they aspire to be in terms of role or title. But what I'm really looking for is signals of humility, of self awareness around areas of personal and professional growth. So people who can be open about where they think they need to work on to grow themselves as people. I love that. Also just generally throughout interviews I'm looking for curiosity. So day to day good PMs will be asking why as much as my 6 year old son does, which is a lot. So I'll try and discern that through the course of the conversation. So not really a question, but something I'm looking for. And then maybe I want to flip it because building on something that Adam Fishman was saying, his theme of evaluating the people dimension of folks, you're potentially going to work with when you're interviewing with a company. And this was a question I got asked myself recently by a candidate which I just thought was brilliant. And that was tell me about the diversity, equity, inclusion and belonging initiatives that you've recently personally been involved with. And that it just felt like a really great way for them to be able to test alignment of their personal values with those of someone they'd be working with really closely. So I love that.
Next up is Meltem Koran Berkowitz, head of growth and a very early employee at Deal.
What would your siblings say about you? It's very telling if they have siblings. If they don't, I will say, what will your parents say about you? But it's very telling what you think other people think of you.
What do you look for in their answer that gives you a sign that they're a good candidate or not?
I look for sincerity and self awareness. Like your siblings are never. I mean, I love my sister, but she'll probably should talk me a lot. And being aware of that is very important. Like if someone's like, my siblings will say I'm very organized and that I'm the one that brings our family together, like, that's probably a bullshit answer. But if they're like, oh yeah, like they'll say these weird things about me that shows a little bit of like self awareness and humbleness that I want to see in a person.
Next is Paige Costello, co head of Product management and also head of AI at Asana.
I like to ask, tell me about a time something went wrong. What was it? What did you do about it? Yada yada. And effectively the question gets that when, when the product failed, when something about the team didn't work, just things that go wrong. Because that's what happens when you're doing this work and evaluating people's mindset and the way they talk about it and the way they relate to evaluating the situation. I think it's a great question. Really tells you a lot about how people think and how they perceive themselves when things are not working. Well.
We are in the final stretch now. There's only five more interview questions to go. Next up is Nikhil Singhal, VP of product at Facebook, also one of the most popular episodes of the podcast.
What's something that everyone takes for granted that you think is essentially hogwash or inaccurate? You know, sometimes I'll ask a manager, look, you've managed, you know, hundreds of people in your career. What's conventional wisdom that you bet against that you have found is accurately, actually inaccurate? And you could do that for what do people think about AI that's inaccurate that everyone believes you could do that for, you know, domains you can do all kinds of things. I'm always looking to, for people to break this sort of interview mindset. So everyone always prepares for interviews and then their entire conversation is predicting what you think you want me to say. And as a result, you can have high quality people that you dismiss because they weren't genuine. There's no way to answer that question without being genuinely opinionated, because it starts with what is the thing that you think I want to hear? And then tell me why it's inaccurate. So when I break that wall, I'm testing, is this person authentic? Because sometimes I'm dismissing them because they gave me, they told me nothing new. But I don't want the interview process to penalize them. And this was my save question.
This next question comes from Ayo Omogello, chief product officer at Carbon Health, former product lead at Square, and also a former founder.
Tell me something you did that worked.
Out, but not for the reason that.
You thought it would work, or tell me something you did that was a good decision that didn't work. A lot of like, my process is just teasing out introspection. It's just like, are you a person who is reflective about, like, the decisions you've made and why they worked and why they did not, and incorporating that into your model so you make different decisions next time.
Next up is Scott Belsky, chief strategy officer at Adobe, former chief product officer of Adobe, also former founder of Behance.
I like asking about something people have learned about themselves that reveal the limitation in how they work. You know, it's a way to test like, introspection and when this person hits their limits or struggles, can they be open and introspective or are they going to blame and point fingers? So I do ask that. I also like the question, like, do you consider yourself lucky? I think it's a fascinating question because it also, you know, some people who are super insecure about, you know, where, where they are and how they got there might decline admitting luck. You know, those who are comfortable should admit that they were lucky. I mean, I think the truth is we're all very lucky and, and certainly privileged. And, you know, I just think that that's always an interesting conversation.
Our penultimate interview question comes from Lauren Isford, head of growth at Notion, former head of growth at Airtable.
Tell me about a time that you delivered something that was impactful I'm looking for someone to help me understand how they define impact and what it means to them. I think a good answer for growth practitioner is intrinsic motivation about having an impact on the business.
Our final interview question is actually advice for doing reference calls, which comes after finding someone great through your interview process. And this comes from Paul Adams, chief product officer at Intercom with his killer Irish accent.
I had to do referral calls. So, like, you're interviewing someone, you want to give them the job. And they've got referees. And of course the referees that have are like the best people that they ever worked with and their favorite managers. So this question is, what feedback will I be giving this person in their first performance review? That's an amazing question because the person can't dodge it. You know there's an answer and it's incredibly enlightening.
And it's a wrap. Thank you so much for listening. I hope you found this valuable. Leave a comment either on the newsletter post or in the YouTube comments or even on Twitter. Let me know what you think. If there's a great response, we'll continue to do this. If not, will never do this again. All right, thank you. Enjoy.
More from Lenny


How Meta designed Muse: an AI agent people actually want to talk to | Alex Cornell (Design Director)


Why every company now needs to think and operate like a lab team | Josh Woodward (Google Labs, Gemini, AI Studio)


Jev: 8 real use cases for the fastest, cheapest model I’ve ever used | John Lindquist


The grief, loneliness, and burnout sweeping through the tech industry right now | Molly Graham






