IBM's AI for detecting neurological state

Bandwidth for Changelog is provided by Fastly. Learn more@fastly.com we move fast and fix things here at Changelog because of Rollbar. Check them out@robar.com and we're hosted on Linode servers. Head to linode.com changelog. Welcome to Practical AI, a weekly podcast about making artificial intelligence practical, productive and accessible to everyone. This is where conversations around AI mach, machine learning and data science happen. Join the community and slack with us around various topics of the show@changelog.com community. Follow us on Twitter. We're @practicalai FM. And now onto the show.

Well, hey Chris, how you doing?

I'm doing fine. How's it going today, Daniel?

It's going really well. I'm still in the midst of grading for my Purdue class, but I'm. I see the finish line. So how about, how about with you.

Just started the new job at Lockheed Martin a couple of weeks ago and have been heads down in that. And obviously the holiday season is coming up with the family, so great time of year.

Yeah, definitely. So today we actually have two guests from IBM Healthcare. I'm really excited that Ajay Rajuro and Guillermo Cecchi are joining us. Welcome, guys.

Hey. Hi.

Hi, Chris. Hello, Daniel.

So, as I mentioned, they're both with IBM Healthcare. So Rajay is a VP of IBM Healthcare and Life Sciences Research. Guillermo is a principal researcher of computational psychiatry and neuroimaging. And so I'm really excited to hear about what they have to tell us here on Practical AI today and how AI is related to health care and psychiatry and mental health. It's going to be a really exciting show. But before we jump into those things, I'd love to give our guests a chance to introduce themselves and give us a little bit of background about how they eventually got to this place of integrating AI and healthcare and psychiatry. So, Ajay, do you want to start us out?

Sure. Thanks for the opportunity to chat. This is Ajay. I am leading our healthcare and life science research portfolio at IBM. I just completed 20 years working at IBM.

Congratulations.

Thank you. My background is in molecular structural biology. Prior to coming to IBM, I was a postdoctoral scientist at Memorial Sloan Kettering Cancer Center. But that was a while ago and moving to IBM, a lot of my research interest has become entirely computational. So the work that I do now is actually at the intersection of healthcare biology and all things information technology.

It's really interesting how you've kind of gone through that path and eventually landed at all of these integrations of computation and, and it. I'm Excited to hear more. Guillermo, do you want to give us a brief intro? How did you get eventually into this world of computational psychiatry?

Well, my background is in physics and neuroscience, but I was always interested in philosophy. And then after completing my PhD, I did a fellowship in psychiatry before coming to IBM. So naturally, mental health became very clear, really, for me, an intersection between all of my interests. So this is what I'm doing now, just trying to understand how we put together mental health with AI.

And so how did you really decide that mental health was a good target to start using AI technologies on?

Well, one clear reason is that mental health needs it, right? So if you look at the daily practice of mental health, it's very constrained by the fact that you have neurologists, psychiatrists, healthcare providers that need to make judgments about the mental state of a patient or a prospective possible patient. And the way it's done today relies to a large extent, among other things, on the interaction between the patient and the person, the clinician who evaluates them. That interaction is to a very large extent, determined by language patterns. So how the patient is speaking to the clinician. And outside of mental health, we have an incredible wealth of tools to study language that at the moment, unfortunately, are not being used for the purpose of helping clinicians doing the evaluation, actually, in the end, helping patients to have better health care. So it's a really dire need of help from mental health practitioners, and that's perhaps the main motivation.

Yeah. It's interesting that you brought up the idea of analyzing language, because actually, when this topic was first brought up to me, I guess it wasn't the first thing that came to my mind. I was thinking, oh, we're studying mental health computationally. Maybe we're studying brain waves or something like that. But from what you've said, is the motivation to combine, like you said, these NLP techniques and AI and with language as related to mental health, is that really spawning from the patterns that you've seen in clinics, that they're using language as a primary means to measure and identify mental health issues. Is that the primary motivation, or was it because maybe you also are able to get data more easily than some other ways or something?

Well, yes, of course. It's in principle easier to get speech data and language data in general, because we don't need any special machines to do that. But fundamentally, you were talking about brainwaves. Well, speech is a brainwave, and it's very important because it is important for our behavior. It's one of the most essential tools that we humans use to interact with the world and with each other. And it's a very clear way in which most psychiatric conditions, but even neurological conditions are expressed. So disrupted patterns of behavior go hand in hand with disruptive patterns of language. So in some cases it's obvious, like in psychosis, it's directly mapped to language. But we see that even in conditions such as Parkinson's, there is a clear trace of the disease in the language patterns that are produced by the patients. And in other cases, even the language patterns that can be or cannot be processed by the patients. So it's more than just the availability of data. It's really at the core of what defines a mental dysfunction.

So, A.J. could you tell us kind of how you're tying together this process, these techniques of using NLP for speech into kind of a practical. I mean, what is your. Your goal here? What are you actually trying to produce in terms of usability?

Yeah, so we should really talk about how this becomes very practical, but just examine the context first. The clinical encounter that used to occur entirely in the clinic, where the individual, let's say a patient is actually coming with a scheduled appointment, is meeting with an expert practitioner, and they're having a dialogue or a clinical exam, and a clinical evidence is gathered in the course of that discussion. It may be through a physical exam or a psychiatric evaluation, as Guillermo was explaining. So that's a typical clinical encounter. It used to be that that was the only way in which you, the practitioner, would know something about the patient. But what has occurred in the last decade or so is with the availability of many, many different forms of technology, including audio recording of speech, we are actually able to take the evidence gathering from the clinic to something that is of similar quality but outside the clinic. And it allows the observations to move from an episodic encounter in the clinic to possibly a more continuous measurement that is occurring in addition, outside the clinic as well, in the life of the person.

So this is not necessarily a clinician that is using this mobile app that you're talking about. So this is used outside the clinic by non medical personnel, non medical people between clinic visits. Is that accurate?

It is being used by a clinician, let's say, to do a research study involving human subjects, but instead of just observing and recording while in the clinic, the clinician is actually able to use technologies like a speech recording device on a phone to actually observe outside the clinic as well.

So it's still under the direction of the clinician there, essentially. But is it fair to say that the person who is Being measured is also using it outside the clinic's environment between sessions.

Right.

The sessions could be anytime during the day, could be initiated by the subject, and a conversation is happening. It could be a monologue or a dialogue that is getting recorded and then being analyzed by the techniques that Guillermo will describe. But it extends the observation window from the 20 minutes or 30 minutes in the clinic to the entire day, from in the clinic premises to wherever the subject is. And as we all know, when you have a mental health condition, sometimes even showing up for an appointment in the clinic is not something that will achieve 100% compliance. So extending the observation physical location as well as time window allows better participation. And of course, the mental health status of the individual is not constant. Right. So let's say you have the opportunity to initiate a conversation with the mobile app and record it. You would do it in instances where you want that to be captured, and that when it is not in the clinic, doing it in this manner actually allows the subject to actually provide more information about their condition that may or may not always be reproduced in the clinic.

Yeah, I think you brought up a few really good points here. I know that in previous shows and in my conversations outside of the show, when I'm talking about AI and healthcare, a number of things come up. The first being like, well, we don't want people, you know, just using a smartphone app to diagnose themselves and not going to a doctor. So we don't want to kind of get rid of doctors or automate them away. But there's also, you know, privacy concerns. So it sounds like that, you know, in your case, you're not just like having a recording of all conversations at all point to improve diagnosis. But they are kind of like clinical sessions, but you're recording them at the participant's indication throughout, you know, between clinical visits. But then also it's being reviewed by a doctor. Right. Do you view this as kind of like an augmentation to the. To the doctor's current workflow or, you know, or something kind of that couldn't turn into a completely different workflow for helping diagnose and treat and measure mental health?

You're right. It is actually very thought out, deployed really as an augmentation to how the clinician observes and. And makes decisions for the patient or subject. It is with informed consent, and it is with the ability of the participant to turn the observation on or off. Right. So it is not always on, and the participant is actually deciding when they want to actually allow the observation to take place. And after the observation is done. So let's say the conversation you are now having, if I had subjected this conversation through that consent, after I am done speaking, me as a subject, I'll get to review what it is that has actually been observed from this. And then I choose whether the clinician is now being provided this input or not. So every session therefore has that rigor of consent.

So that's fascinating to me. Just kind of as I'm trying to imagine if I had this app on my device going around through daily life, I'm curious, curious, how do people choose to turn it on and off? You know, in terms of the. If you're looking at lots of different use cases, do people tend to have it on most of the time, kind of knowing that that's recording, does it make them nervous? Does it change their behavior? I'm trying to imagine if I was that patient, how I would react to having this tool.

Right. So, you know, we have done some analysis with retrospective data that means sessions that have previously been recorded already in a clinician's office, for example, and built the analysis methodology based on such retrospective data. And then we moved into the very carefully constructed prospective studies that you're asking about. In the prospective studies, not only is the individual first informed what it is that every session will be about and how they have to participate, but for each session they are actually taking some steps. For example, in one study, the technology is actually deployed as an app on the phone and they are actually starting the app. The app will actually prompt them with certain questions. Then Guillermo can walk you through actually what the example questions are and what an example session is like. So it's initiated by the individual and they go through it. It may be a few minutes, five minutes, ten minutes, and then they conclude the session. And that's the information that then gets used to analyze.

Yeah, I'd love to turn to Guillermo, actually, on that same point. I was already thinking of kind of a follow up to this in terms of on the technical side, the people that are actually, you know, implementing the technical, you know, the models and the interaction of the models with the app and all of that. It sounds like there's a real importance between those technical people and the doctor's expertise, like you just mentioned, kind of developing this, a question and answer session. Could you speak more to that interaction and the importance of that, Guillermo?

Yeah, it's a great point. And it's something that we have developed very carefully in all the studies that we have published and we are conducting. We are working very close to clinicians, psychiatrists, and neurologists. And that's very important, both because we want to eventually what we develop be adopted by the field of mental health, but also because we are interacting in a very productive way. We can think of this in two parallel avenues. One is the typical AI big data science approach. We try to create features of all colors and shapes and throw them against the wall and see what sticks. But at the same time, of course, you know, the space of features is, for all practical purposes, infinite. So you always need knowledge. Right. So at the same time, what we are doing is by interacting with clinicians and biomedical researchers, we are trying to, you know, open up their minds and trying to understand how the. The features and the symptoms that they have found to be most relevant can be turned into algorithms. Right. So I can give you a very concrete example of both. Right. In the first case, when we create features, we have results showing that we can discriminate Parkinsonian patients that are on the medication levodopa or off the medication, using features that include frequency components of the voice that are not detectable by the human ear, but they are still there because the drug affects is psychoactive, so affects your nervous system and, of course, trivially affects your voice. On the other side, we study psychosis. And one essential component of what defines a psychotic state of a person is what psychiatrists call flight of ideas. And that is the notion that these patients may be talking about something and very dramatically jump the topic to something completely unrelated. So what we did there was to, using NLP techniques, create an algorithm that will detect those jumps using a technique called semantic embedding that is very commonly used in nlp. So this is one way in which we interact between both worlds. So learn and formalize, as much as possible decades or even centuries of knowledge in psychiatry, psychology, neurology, and at the same time, trying to leverage all the power of AI, nlp, signal processing, and computer science in general. So I hope that that gives you an idea.

Yeah, definitely. So, following up on what you were just saying, Guillermo, it sounds like a ton of different knowledge from psychiatry that you're trying to kind of infuse in these algorithms and these techniques. It sounds like there's a bunch of different applicable NLP techniques. Like you were just talking about semantic embedding and other things. I was wondering if you could just walk us through, like, what the data is, like that you're actually gathering as far as both the features you're using for inferences and also the training. For example, you know, if you're getting audio, does that mean you're kind of gathering the audio in this question and answer sort of session and then converting, you know, doing kind of speech to text. So using a first model to get the text, and then the text is input features to other models that do, like the semantic embeddings or other things. Could you give us a little bit of a sense of that data flow and the structure and type of data?

Absolutely, yes. So we work, as Ajay was saying, with either clinical interviews or speech samples that are gathered, having clinical evaluation in mind. So we have monologue speech samples, we have written text in some cases, and we also have dialogue in other cases. And the context is that we either have semi structured clinical interviews that seem to be the most effective. And by semi structured, I mean it's not following a very precise flow of structure, flow of questions and follow up. It's not trying to nudge the patient into talking about something and expressing themselves. In other cases we have monologue with anchor subjects in some cases can be very short and we typically target naturalistic samples. So for instance, we ask the patients to talk about typical day in their life or how their week was, or where they would like to go for vacation. Because the idea is that with those type of prompts, we can reuse them, as Ajay was saying, on weekly or even daily basis, so we can monitor their state. Then what we do with the data is, of course, we have, in the case of speech, we have the audio files and we process them as such. We extract voice features that are very well established in the field of voice processing. We extract features related to, for instance, the pause distribution between words, the phoneme structure, something that's called the vowel space. It's how you pronounce your vowels that might be different, for instance, across different accents, even in the same language. And then on the lexical side, we extract the expected low level features so we can parse sentences into their grammatical components. So we can understand how verbs and nouns and adjectives are used and where in a sentence. And that has shown to be important in center conditions. We also extract, as I was saying, the idea of semantic embedding. So that allows us to take a word for sentence and have a notion of how similar that word is to other words. We can use target words that are of interest for the particular condition and understand how the patient is in their discourse, is getting closer in meaning or farther in meaning for center certain concepts that are relevant. And then we also extract higher level features and those are more aligned with As I was saying, concepts from psychiatry, just to give you an example, we have algorithms that can measure how metaphorical the content of a phrase is, and that is relevant in psychosis because one of the symptoms of psychosis is a disruption of your appreciation of metaphors, both in terms of how you understand them and how you produce them. So that gives you an idea of the full spectrum of features that we analyze, we study from the audio and from the text side of language.

So, Guillermo, that is quite a list of features that you're extracting, kind of going from the phoneme structure, vowel, pronunciation, accents, a lot of the lexical stuff you just covered. Are there certain patterns that you have found through the data that have been more relevant than others that you're noticing? Seem to be weighted heavier in your, in your analysis through nlp, are there things that are sticking out as particularly important or has that been established?

Well, what I would say is that language, and even more speech production is such a complex phenomenon, right? It's, it's, it's so, you know, we know from computer science how difficult it is to deal with it, how difficult it produce coherent language. It's, it comes natural for us humans to do it, but any, you know, any disruption in, in the health of your brain will have immediately an effect in language. So like I said, even for conditions that are considered, traditionally have been considered motor disorders of Parkinson's, we know, and we found, and we are not the only ones, we found very clear effects in language and even in content, right? So even if you have something that supposedly is a motor dysfunction, the content of what you're producing as you speak is affected. So we can talk about harmful maybe of features that seem to be popping up often. And one is like the one I mentioned that we originally developed for psychosis, the idea of measuring flight of ideas as semantic coherence. That seems to be useful to analyze different conditions and even situations in which, for instance, a patient may take a psychoactive drug like ecstasy or methamphetamine. But if I had to answer your question, I would say that every single aspect of language is affected or differently, but it's affected because again, language is a very complex phenomenon that involves many, many different aspects of brain function. So any tiny disruption will have an effect.

Another interesting thing that Guillermo focused on early enough and been very instructive for us is to really emphasize the spontaneous production of speech. So basically not go in the direction of some rote answer, but rather have the individual, you know, create an answer pre existing context. An answer doesn't exist in that person's mind yet. So that spontaneous production is actually eliciting some of these features that he's describing. You know, it's enhancing the visibility of those features quite well. So Guillerma, maybe you want to describe actually the picture test, which really is. Is a very nice spontaneous production.

Yes. Yeah, that's a very good example. So we are studying actually a number of conditions using this approach that was initially developed decades ago to study cognitive decline. And you can look it up. It's called the cookie theft task. And there are variations of that. And essentially you're shown a picture, it's a drawing, it's a hand drawing of a typical 1940s, 1950s Americana household situation. There is someone who seems to be a mother doing the dishes, but she seems to be absent minded. And there are two kids, a girl and a boy, and the boy is standing on the stool trying to get a cookie from a jar. So the task is just to describe that in your own words. It's something that takes two, three minutes at most, is very natural. And variations of that can be used to be repeated very often so you don't get bored. And what happens is that when you analyze the content of that description of the task, what you say, what type of words you use, but also the structure, even the syntax of what you are saying, how you're constructing the sentences, and how florid or how simplified your speech is, that contains a huge amount of information about your cognitive state. And that has been used by manual raters, like I said, over decades to have an estimate of your cognitive state. But now we can do that in a completely automated way. And we have shown that we can infer the clinical scales that are produced by the human evaluators with a very high accuracy, with the advantage that we can do this remotely. And like I said, we can do this at very high frequency and without having to bring the patient to the hospital or the clinician to the house of the patient. And it has value that goes even beyond the idea of measuring or estimating cognitive decline, because it can be applied to many other conditions. Because, as I was saying, even something that on the surface looks so natural as having such a picture requires a huge amount of brain real estate. And any failure will leave an imprint in the way that you perform this task.

I think that leads into a question that's been kind of in the back of my mind through this whole conversation. I mean, you've mentioned that the way in which you gather data and kind of the spontaneity of it is really important. And that immediately kind of leads me to think about bias in data, both in terms of the way that you gather it. But you've also already mentioned like accents and language variety and that sort of thing. And we've already seen kind of, you know, disasters in health care scenarios where maybe you're trying to like, you know, diagnose skin lesions or something, and your data only has data from like light skinned people or something. And I would guess that the same sorts of things exist in language in the sense that like both education level maybe, but also regional accents, you know, second language speaking, people not speaking in their first language. All of those things kind of come into play when we start thinking about language. And I know IBM has also done a lot of work around fairness and bias. I was wondering if that has entered into this work yet or is it something that you want to kind of probe further in the future?

So yes, of course we take that into consideration and we try to account for those, I don't know, to call them biases. But there's the context of the person is the personal context and the even maybe the group context. Now we have several cases in which we can track the patient over time. And for those, we have the best way of accounting for variations because we have the history of the patient. So in some of the studies that we have conducted, we know that if we didn't have the story, the context of the person, we could not get any result, trivially speaking. For instance, if you don't know that the person is a male or female, the acoustic content would be confounded. Right. So when possible, we try to precisely have studies that track the individual and that accounts to a large extent for those biases, as you mentioned. But also it's really part of one of the goals that we are pursuing is that the possibility of personalizing the evaluation and eventually the treatment for a person. So just being able to track someone on a daily basis, that is taking a certain medication or following a certain treatment, it's one of the ultimate goals that we want to do. And in those cases we have ways to account for the biases, but this is much easier to account for the individual biases.

So, Ajay, curious, can you kind of describe what the output looks like here? Are we really talking about, you know, is there one diagnosis or do you have multiple diagnosis as an output? And what is your, what do your models look like to support that output? Is it different models for each diagnosis or one model to rule them all as you Might say, what is that output? And how are you structuring your models to get to that output?

Sure, yeah. Actually, just to continue for a second on the issue of language and bias, the retrospective work that Guillermo has done, he already looked at several different languages and people speaking in their native languages, English versus Spanish versus Portuguese and so on. So I think that's very important to actually think of this science, as well as its eventual use, as being close to what the person already experiences and not actually take the person into some new territory where that distortion or bias is actually more pronounced. So I think that's a research goal that we have to maintain, is to actually make the technology work for the person and not the other way around. So that is a quest that we are continuing on. But the retrospective work already shows us that that actually is possible. So we are encouraged by the fact that we should be able to bring these technologies into different languages. Okay, so to your question of how does results actually get reported and exactly what are we describing in that report? First, I would say that this is not really diagnosis. There's nothing clinically diagnosis like that is being generated here. Rather, what we are doing is surfacing features that the clinician is already trained to look for and make sure that those features are actually visible to the clinician. So the diagnosis and possible help to the patient, whether it is in terms of diagnosing or in terms of treating, is being done by the licensed expert practitioner. So all that we are doing is using this tool. We are making sure that the patient's own experience is being captured sufficiently well. Features that are clinically relevant, like the ones that Kishan was describing, are actually being captured and surfaced. And it is on the basis of those features that a trained practitioner would actually then be prompted to do what they are trained to and licensed to do already. So this is augmentation is not attempting to do what the practitioner does already, which is diagnose and treat. So the report actually has both graphical as well as. As well as numerical and textual form of these features being surfaced, whether they are in a graph. So the disjoint thoughts that Guillermo is talking of can typically be presented in a graph form. And so you either have disjoint graphs or extremely complex graph that is actually demonstrating the complexity of the word choices and the context that the person is talking about. And a trained psychiatrist is actually then able to look at that, and as they're accustomed to use those features to actually then be able to make better decisions. So the most easy way in which this might get used is for screening purposes. So you're actually getting a psychiatrist in the future, might actually be getting this kind of report just to keep tabs on what is happening in life of a person who needs to be watched. And you're using that to actually just watch and screen. And when it gets to a threshold of some concern, you're actually indeed intervening the practitioner at that point, intervening and doing what they're trained to do. But now you actually have extended the observation to life of the person and you're able to observe more thoroughly and act upon it before it becomes catastrophic. Right. So I think that's the more likely usage here. Diagnosing and treating by itself is actually the hardest problem and that we really need to have practitioners do.

Yeah, yeah. I think that that brings things together really well and gives us a lot of great context for the use. And as we kind of wrap up here for. For the episode, I'd love to, first off, just thank you guys for working on some application of AI that. That really is making a positive difference for people. That's something that. That Chris and I always, you know, want to promote as much as we can. But I'd love to just get. Get you guys to share as we kind of wrap up what you're excited about as far as either results that you have now or maybe next steps that you're going to. And then also for listeners who are maybe more interested about this subject, either on the NLP side or the. Or the application side, where can they find out more about your work or the techniques that you're using? So if you guys could give us a little bit of that perspective, that'd be great.

Well, I have to say that what is keeping me up at night with excitement is work that we are developing around doing something similar to what we were describing, but in the context of therapy, therapy sessions with again, the same idea of expanding and providing additional tools to the therapist to track the evolution of a patient that is undergoing some type of therapy and being able to integrate information from different sources that are relevant to the particular individual that is undergoing this therapy. I think this is one of our next frontiers. And it's challenging, but at the same time very exciting.

And you know what excites me the most about this is a lot of the mental health as well as neurological conditions that individuals experience has really been either not attended to or been misdiagnosed and not the right kind of help provided or provided only in bursts and in acute situations, but not really more continuously. What we are Witnessing through this work, as well as all other things that are happening with Internet of Things and how technology is intersecting with our daily lives, is a change that we are seeing and experiencing where the technology actually allows us to do things in a different way. But in this case, going from episodic encounters in the clinic to a continuous measurement done in the convenience of your home and in your daily routine, what that does is actually brings attention and allows practitioners to actually address real issues that are beyond what is happening in the clinic. So it might extend the reach of help that people get. And that is a change that is such a huge change for the positive because the unmet needs for mental health are huge. And using these kinds of technologies, one is actually able to hopefully increase the aperture through which these needs are addressed. So that change, I think, is very much for the positive. And you know, people who do experience these conditions, whether it is anxiety, depression, cognitive decline, they need that help. And we are conceivably moving in a direction where that that becomes possible for them.

Well, Ajay and Guillermo, thank you very, very much for coming onto this episode. We will definitely put links to your papers out in the show notes so that our listeners can access those. If people want to find out more or reach out to you, how would you like them to reach out to you?

So one place to get to is the IBM Healthcare and Life Science research website which features a lot of our breaking scientific news, including the work that Guillermo is talking of. And that's just@research.IBM.com healthcareandlifesciences and that's a good place to go.

Fantastic. Thank you both for coming on the show. Wish you very well in this work. Goodbye.

Thank you. A pleasure talking to you.

All right, thank you for tuning into this episode of Practically I. If you enjoyed this show, do us a favor. Go on itunes, give us a rating, go in your podcast app and favorite it. If you are on Twitter or social network, share a link with a friend. Whatever you gotta do. Share the show with a friend if you enjoyed it. And bandwidth for changelog is provided by fastly. Learn more@fastly.com and we catch our airs before our users do here at changelog because of robar. Check them out@roar.com changelog and we're hosted on Linode Cloud Servers. Head to lino.com changelog check them out. Support this show. This episode is hosted by Daniel White Knack and Chris Benson. Editing is done by Tim Smith. The music is by Break Master Cylinder and you can find more shows just like this. @Change Law.com when you go there, pop in your email address. Get our weekly email keeping you up to date with the news and podcasts for developers in your inbox every single week. Thanks for tuning in. We'll see you next week.

I'm Tim Smith, and my show Away from Keyboard explores the human side of creative work.

You'll hear stories, sometimes deeply personal, about.

The triumphs and struggles of doing what you love.

Jumping off into the abyss is kind of my skill, and so I'm not.

Saying that it's not scary.

I'm saying that perhaps my skill is.

Just not being able to estimate how scary it will be.

New episodes premiere every other Wednesday. Find the show@changelog.com afk or wherever you listen to podcasts.