BoneChat #56 - AI-tool for quickly evaluating bulk candidates for a new role using voice samples.

All right, welcome to Bone chat discussion number 56 with Adam Hochek at Echo. And he's going to blow our minds with a new tool, a new AI tool for assessing talent. And it probably has other applications, but I'm going to hand it over to Adam. It's all yours.

Thank you. Thanks. Thank you for having me. Tiger and Mark, thank you for the introduction to this group. I appreciate being.

It's a little hard to hear.

Oh, let me. Oh good, I'm glad you told me. Let me just. My volume. Is that better now?

Better.

Okay, perfect. Good. Yeah. So Echo is a little over three years old. Just a little introduction. I'm the founder and CEO of Echo. We, we're a deep tech company. We, we do, we do voice analysis and we do both emotions, psychometrics and even behavioral patterns on that. And so what I, I'll just show, I'll have a few slides and I'm going to go right into a demo to show how we work. So screen and tell us along the.

Way, Adam, kind of what the impetus for the idea and how did you start it? Because that's always fascinating everybody.

Yeah, sure, yeah. So we, I, I had a background in speech, been working in speech, did research in it, developed a lot in user interfaces with speech. Early days and later. And then I later got into, into machine learning, natural language understanding. And that's, that's what kind of brought me into this space. And what I realized was, hey, that, and it's very interesting that a lot of the emotion detection that was out there coming from universities, well known universities and open source was really very limited. If you use the same data set, it worked great. But as you, if you varied the data set, the performance dropped tremendously. So I realized there was a lot of opportunity there that things were, you know, that there was an opportunity. So that's kind of how I got into it. Now as, as Echo as a company, we evolved over these three years. We first did, and that's what I'll show today. We first did a lot with, with understanding speech and then generating psychometrics. But what we did initially was we wanted to map it into popular like earlier talking about Meyer, Briggs, Disc, Campbell, Hexico, Hogan, all these other psychological inventories. What then we realized was, well, we thought that would be helpful to give a more holistic view of a candidate in terms of how they'll fit into environment, how they'll work, are they, you know, they work well in teams, are they more an individual type, introvert, extrovert and so on it goes on. We actually detect about 100 plus traits today. And then we realized, well, we're, we're actually creating more work because the these for a recruiter to understand all these psychometrics was a task in itself. So, so we then decided, which is what I'll show, to make a simpler system that would automate the interviewing process and give simple metrics to the recruiter. So it takes a lot of the work off their hands. So as you know like 30% of employees will either are bad hires, will leave within usually six months is the stats. So it's quite high. Part of that we believe is because they don't. It's not just your skills, but it's more than the skills, it's the environment. So we recognize that as a big issue. So what we do is we have a really initial step of pre screening which I won't show today. But what this pre screening is if the candidate, for example, those are the questions like are you willing to work hybrid work on premise or move to a location, possibly a salary range, just a pre screening if they qualify or not. Because there's no point in going through all this process if they're not.

That part is written or that part is verbal.

That part is actually it's both written and verbal. So they, it's like a form. So they could fill out a multiple choice or they could speak to it both ways and it's usually short and it's the recruiter that makes it up for each job, whatever the requirements are. And then once that's done and if they qualify the pre qualification, then they go to the interview process and that's what I'll be showing. There's two sides to the interview process. There's the recruiter side where the recruiter puts in the job requirements and also these soft skills, the personality types that they're looking for. And then the other side of it is the candidate. So they send the candidates the link and then the candidate participates in this automated interview with the AI system. And then finally the recruiter gets all the metrics of their performance and they see ranking of who had the best match for based on the job requirements. And I should say if anyone has questions along the way, just oh yeah, okay, great. Yeah. Okay then. So yeah, these are the two sides. So the recruiter does the job description, personality criterion, publishes the job posting and the candidate fills in basic details. They upload their resume and they complete the interview. What we do is the questions are asked based on the job requirements that the Recruiter put in the candidate's resume and their personality traits and emotions. That's how we, that's how the questions are. So if we see for example the, there may be a need that the recruiter put that they have to work in a stressful environment, then there may be those that will be measured and it would come into the questions. Let's see now this is the point where I want to go to the interview and show the system. So let me see if I can pull this off and I'm logged in here. This is the, this is the recruiter's dashboard and here I'm not going to get into all the details, but they can create a new job role. They put the title language, they can put the, the, the type of tone of the interview because this is more general, so professional or casual friendly the domain of the interview. They put the job description here. And then more importantly they put either the number of questions or the time limit for the interview. So if they wanted all interviews to be for example, three questions, then they select that. Or if they want a one hour interview, they can also put it in, in time.

And when we're kind of Adam is the diminishing returns of number of questions and time.

So in other words, like I didn't quite follow.

I'm sorry, I'm sorry. So if at some point the system can create a personality or an emotional signature based on three questions. You don't need 30.

Exactly. Yes. That's what's so interesting. In fact, it's really the psychometrics and the emotions. We only need 60 seconds.

Wow.

It gets a little bit more granular and perhaps a little closer to accuracy, but really within 60 seconds it's reading the person's emotions and personality.

That's really one question then.

That's really one question. The difference here is. Good point. Yeah. So the, the difference here is why we have more questions is because it's also looking at their experience and asking them questions about that, how you know, what their experience has been like. So it's also collecting data about them that gets transcribed and put into a report for the recruiter. But as far as yeah, psychometrics and emotions, that's. And then lastly they put in here we broke them up into six groups right now the type of these are the personality traits, psychometrics and emotion that into stress, pressure, professional competency, work styles, etc. And then we, and then we also have the ability to select the voice type for the agent to ask what kind of voice it wants to Use. And that's basically it. And once that's done, they can actually email this out to candidates. And so let me show that part. So.

Adam, I've got a quick question.

Yeah, please.

So, so you're talking about, you know, taking 60 seconds to measure, you know, a person's emotions. How much does, you know what. What they're experiencing right now? You know, they had a bad day, they had, you know, an argument with their spouse, you know, they had a death in the family. How much does that change the answers that you get?

Great question. Yeah. So it's based. It. The. The things that really change are the emotions, the psychological traits as far as, like, creativity, an organized person, agreeable openness. All those are really consistent. They do change over long periods of time. We're talking months, a week, sometimes weeks, but months, typically, some of them print even over many years. But the emotional traits are what would change. Like if they're angry, sad, whatever it may be, those type of emotions will vary with, like, if they're having a bad day, but their psychological traits will not. And maybe just for anyone who's. I won't get deep into it, but it's a common question. So the way we develop this, we're. We're language agnostic, so we use tones of the voice to determine the traits, which is really fascinating. We. We actually trained our. We worked with other companies to collect the data. We didn't do that on our own, but we shared the effort. But we used. We. What we did, just so it's understood is we had various. They call them inventories in the psychological work of. Of tests that they participated in. We used the scores on those tests to understand what they were, what their traits were. And then we also did voice samples of them. And that's how we built our models. And we built it using a dozen languages. What I. I'm happy to say we were. We have found that we have worked just as well with languages that we did not train on, based on the tones. Fascinating.

Hired psychotherapist and therapist turned writer turned business person. And I think this is truly fascinating. I'm wondering, are there roles where this.

Works less well, you know, less well.

For a surgeon than for a lab assistant, for example?

I. I would not say so. The key is, really, is the dis. I think the challenge is, is that one has to define the right metrics to look at and to seek and that this will look for those metrics that that person. Those traits that that person. Individual has and look to see how well they Match. If they overlook or they ignore one or, you know, they just didn't pay enough attention to it, that could be, or that could be one issue. Another thing is, for example, we have traits like leadership and the type of leader or their growth potential. These may not have been important initially, but later in their career they may become more important. So we believe that there's another market for evaluation and for growth within a company for assessment that, that could be done periodically in someone's career. So you wouldn't want to just go with what they had during the hiring time.

Special.

Thank you.

Remember when, as a, working as a pilot in the military when you would fly with some people and you would get like a strange noise in the engine or transmission or some yellow caution light would come on, people would sometimes act a little differently and you wanted somebody that would stay cool and you know, rational and, and not go into tunnel vision and get weird or anything. And then later on in my medical career watching surgeons in the operating room, especially trauma surgeons, I detected that there were certain personality types that just, you know, we're actually, it's almost like time slowed down, they got better when this, when the bad stuff happened and then others didn't and they were like those pilots that you didn't want to fly with. So that's probably something that you could easily measure, wouldn't it be?

It's true. And that's something we're, we're looking into. It's, we were looking at it as it's a occupation risk, high risk jobs and again that comes into the medical field as well for you know, stressful nurses, doctors, surgeons, so on in stress situations or as you said Mark, in, in like pilots and other law enforcement, other things where you need to see your, not only general like the trait of the person inherently they're, they're calmer under stressful situation, that's one thing. But also their alertness for the day. Maybe they, you know, maybe they, you know, are sleepy and tired or you know, whatever the situation may be and they're not as alert that day. That's another thing that we're looking at that to do a check in before taking on that, you know, the role for that day. But that's still, we've talked about it, we haven't actually and we, we've done some testing on it, but we haven't yet moved forward with that as a product and.

Thanks.

Sure. And then I'll continue here. I'm looking at another screen here just to, so let me go to. I Believe I could just go to rate so way. Okay, so this was. These were pre created job roles and requirements that that the. This is the recruiter's dashboard. And so they can see for example the job description they had, you know perform interpret diagnostics, imaging, whatever good to have other skills. And then they can invite someone from the dashboard that's candidates or they could post the link out to a website or put it in an email. So there's multiple ways and then these are the candidates that they had. These are. We'll see this better once I go through it. But those are the six group areas that I showed earlier. The soft skills, professional competencies, work style, personality, stress and pressure, cultural, organizational fit and career growth. Those are the six and then that's not specified if they didn't select it and then they can actually see I'll go through one just. I don't let's go through one just to see what the view looks like. So they looked if the recruiter wants to then they get on their dashboard. These. This would be like a typical report. It would say give you a little bit about the overall score on the interview. It would give you the things like the tone, clarity, empathy. Those just general metrics of the interview that we measure as well. And then we get into the specific traits those six areas. So for example job compatibility, professional competency. Well this one scored low. These are just samples. But the professional competencies look at things like cognitive ability, communication, problem solving, leadership. That's the type of those. Are these the traits under the professional competencies? And we give a score for each one of these and then if I look at look at a couple others. Some of these scores like work style and ethics for example work approach. Some of these are are not just one on one level there's a opposite. So are they proactive or reactive? So they're they're opposite. So they'll both in two colors. Proactive reactive 66% proactive team collaborative. This person is more independent than collaborative. But they do have a score of some collaboration and work ethic and integrity to others. We can continue just to. Let's jump to for example stress and pressure. So stress response, resilient, sensitive work life balance. In other words so they appreciate other things. There are other small traits that go to build these traits are they open, adaptable and all that will come into that into their work like pressure handling under stress and recovery. That's another thing their resilience to. To the pressure. Some people can recover very quickly whereas others take a longer Time and then we do similar things for cultural fit and so on. Sorry. Give an example of how. So the resilience bit. Walk us through if you don't mind an example of that. Somebody who doesn't make the cut and what, what exactly is being measured. So pull out my list here because there's so many traits. But for example, I, I don't to be. I have some idea. I'm probably going to miss some of these traits. But resilience, so would be their emotional stability, coping ability, how they cope with things. Their energy level is part of their resilience. Like if they could be a low energy person. So energy, all these little sub traits are what helps and they're weighted. But these sub traits are what comprises their resilience to for example, work in a stressful situation. Let me just, I'm checking emotional stability, emotional state also is another thing. Not the state in which they're in at that moment is another factor. So that's more immediate. And then their stress control is another sub trait. How well they control their stress. And I'm sorry, you're getting all of.

This from voice or voice and questions.

Actually this is all from the voice for the psychometrics. It's all from the tones.

We're dying to see the demo.

Yes, you are.

It's fascinating.

Let me, let me do that. I'll be happy to. And then we could continue.

So why don't you do a demo on Tiger?

No, no, no, please don't.

It's. I'll be happy to do.

I got my wheel turning. I mean a lot for startups you want, you want people that are work urgently high stress areas. Resiliency.

Resilience.

Yeah, I mean that problem solving. You probably can't do problem solving with voice, but man, you could dial it in for a startup job. Really?

Yes, yes.

That brings up a question I have. Adam.

The.

Shoot the damn thing.

Oh, okay.

When you're using the, the voice to analyze this, it doesn't matter what the answer is. Is that what you're saying? I mean, I can, I can answer completely wrong and you guys get everything you need out of it.

But that's where the questions come in too is it's asking you, for example. Okay, we'll see it in a minute. But like, tell me more about that experience that you had with your, you know, that difficulty in your last job and why. Or tell me why you felt you performed very well in managing your group. What were some of the challenges? So there are questions that are related to the Job, not. So it's a combination of these three main factors. Emotions, psychological traits and the responses. And the job requirement, of course. But the responses to the questions that are generated and I'm sorry, I clicked the wrong.

To answer Eric's question. While you're looking for that, you know, you can score high on your voice with all the right traits. But if you say I know nothing about engineering whatsoever, then I think that's going to come out, you know, if you're not a good fit for the job.

Exactly.

No, you have a great tone. Those words turn into text.

Yep, that's right. So it's really a combination of both, you know, of the psychometrics matching and then you have the job match as well. The experience, the situations, the projects. And I just sent myself. Let's just give me a second here. Hopefully. Yep, got it. So I got something. I'll just put it up here. Something like this. I got an email, it gave me the interview link. So if I click the interview link. Oh, I'm sorry. Yes, this. That's right. So it tells me this is what the. So this is the candidate. It just gives them a summary of, you know, you're going to be five questions. I'm not going to go through all five. It's, it's. And it's a little challenging for me because it's an area. Sorry, not from. You know, you have to. I actually have to have a resume so I could pretend I'm someone and give some. Something sensible as if I'm a radiologist. So I will. I have a resume up on my other screen. Just to pretend. Yeah, just to give something. Okay. So what I'll do here is just say this is Natasha Watson and. I'll use my email again. And then we proceed. There'll be a little. Okay, so first thing it's going to do is ask me to submit Natasha's resume. So I'll do that. Here we go. So I drag and drop the resume to.

So this is the link the candidate would be getting.

Yes.

Would drop their resume into the little box. Okay.

And then I click. Click to proceed to interview. Hopefully. Yeah, there's a. There is a problem. Let me do it like this because I'm on a. My system. Here we go. I'll just do it like that. Now that should take it. There we go. Yes. Sometimes my system on a Linux system. I am your AI interview assistant. To get started, please give us an introduction of yourself. Okay, so just one second. Okay, so I go ahead now and I say, hi, I'm Natasha Watson. I am applying for this radiologist position. I've received my doctorate in medicine from Columbia University in 2018 and prior to that I was at Howard University, my undergraduate in biology. I've been working and presently am at Presbyterian Hospital in New York as a radiologist. I've been there since 2018 when I graduated. I think my key values are I'm very accurate with my diagnosis and treatment plans. I work well with physicians and collaboration well. I've got a lot of experience with imaging tools and software and CT scans and I am also fluent in both English and Spanish. We're going to be improving this response time, but this is something we're working on, so we'll be.

So that progress bar that we just saw was just kind of specific instance.

Where you had to adapt your imaging techniques or approach based on. On a patient's unique needs or circumstances. I'm sorry.

No, no, keep going. I didn't want to.

Okay. Yeah. So this would be the kind of question. So it's. It starts going a little deeper into, you know, like something like this, which was, you know, describe a specific instance where you had to adapt your imaging techniques or approach based on a patient's unique needs or circumstances. Really out of my element here to speak to this, but I'll make something up. So let's just say I'll do one more here. So. Well, quite often the. In radiology, sometimes the images are not clear. There's certain areas of particular interest that we would like to see. So I will ensure that the images are detailed enough for the areas of concern. And I'll also confer with the doctors what they're looking for, particularly what their concerns are when I present the images. Oh, and then it does ask. We do. Right now we're saying 40 seconds as the minimum time. So I'll just continue. And so sometimes I'll use. Also, besides echoes, we'll also. We. I am able to conduct MRIs, CAT scans and also present those images to the medical team to repeal. Can you provide an example of a specific case where you had to adjust the imaging technique, such as choosing between X rays, MRIs or CAT scans based on the patient's condition or the doctor's request. Request. I'll probably leave it at this because this is, you know, goes more into it and if I gave better answers, I think it would go. It would be, you know, it would go deeper into those. But this should give some of the idea. Let me see. I had this, unfortunately, was five questions. So I won't be, I don't want to take up the time just kind of mimicking what this radiologist. But based on that we would then get what we saw back here in the dashboard. It would then show as a radiologist this. Oh, I'm already there, that's one. It would then show that this, this new, this, this one here. Natasha Watson if we look here once it would be complete it would say email verified. It's not ready to view because it's not complete. Once I complete the interview it would show up and scores would be presented for each of these categories of the psychological traits.

So this is all done remotely through the AI Correct. And whatever you program to beforehand. So you could do one candidate or 100 candidates.

That's absolutely correct Mark. And that's really what's time saving for, for a recruiter is this could be done in parallel like I said you could, you could be sending this out to 100, 200 candidates pre screen get the ones who qualify and then from that list get the responses and then here the recruiter could pick the top five, the top 10 ranked candidates that match the requirements and then that, that would shortlist them for the, for a human then to, to interview the short list. We're not trying to be the whole process. I should say that we feel that yeah, people want to still meet.

What.

What kind of, what kind of positions or roles do you feel this would be most efficient at or most useful for would it in a professional positions? Positions that are more sort of quantitative or more qualitative. You know, I mean talking about a radiologist is one thing, talking about a marketing person is another thing.

So, so the general skills would be. Yes, so it's true. But the, the skills that you look for is, are like for example their communication skills for a marketing person, their creativity, their innovation perhaps those are some of the traits that we would, we that are used under the hood, so to speak. We used to report all of these and then we said it's just over because it's over a hundred, it's overwhelming. And we found that we almost had to train them to explain each of these skills. But so, so to answer the question, we believe that the traits that we have will work across all the job positions if, if they're as far as the environment, you know, stressful, non stressful is common. Innovative leadership independence, collaborative communication, openness, inquisitive wanting to learn or someone who's not. So they're kind of general in a way. But it's important to say what what, what the team or what the job is looking for.

It looks to me like it'll evaluate any role mark, but it's just the way. But you've got to pre select the right questions. Like, like you said marketing, you're looking for creativity, innovation, communication skills. You wouldn't do that with a lab tech maybe.

Correct.

It's. There's a little front end work to sort of dial in the right traits that you're looking for. But yeah, it can work anywhere that. Now I had a question. If you, if you send it out to 100 people, let's say say 80, fill out the, the voice survey, will it. Do you have an analytical tool that, that compares the 80 candidates that come back?

Yeah, that's what I was Exactly. So this is what this would do. So you would see a dashboard. This is like the recruiters dashboard. This is prioritized but you would see which ones had the best match. I can go to another one.

This is really, really good tool for bulk recruiting for larger companies.

I think we agree, you know, we, we were really trying to find where we fit in best. Where I think where we are is bulk to take large numbers and to shortlist it, which is the time consuming process. And then what's nice about it is the recruiter or the actual, the company that's doing the hiring will now can see some report and get an idea of that candidate before they come in to have the face to face or you know, online interview. So it's helpful.

Yeah, yeah, I can see, I can see the buyer of this would be the head of HR in a large company to give the tool to their internal recruiters who because they're completely overwhelmed, they put out jobs on LinkedIn and Indeed. And they just end up with thousands of resumes and you know, they have no idea. You know, they can't, there's, it's, they can't even. First of all, it's an HR person doesn't really know what a marketing person does. And, and then second thing, they, they get too many resumes to even figure out what to pre screen. I see that all the time. They go into the black hole. And I've heard they use bots for keyword searches.

Yes, yep.

So, but this would be way better than using bots.

That's right. That's exactly. I think this, this is taking a much more comprehensive view of the person. Not just keywords and, and not just their skills. More than that.

What is the, is it a monthly subscription?

Yeah, so it is a monthly subscription. And I'll just show that last little bit. I think it's here. Where did I put it? No, is this. I just had. Oh, here. I'll just throw up the PDF as less so I did. So. So what we do, our cost comes out. We do a monthly subscription. You one could subscribe. It's. It's not in terms per candidate. You buying blocks of candidates that you want to do 100, you know, a thousand, whatever it may be, depending. We have different block offerings and we are starting price though comes out to $25 per candidate and exactly our benefits no longer. You know, it's not a sequential process like we talked about. You could send these all out in bulk to any number of people. And it gives you both hard measures, both on some of the hard skills and soft skills in the interview process.

How many. How many clients do you have right now?

We have close eight right now and we're expanding. Yeah, we got a few in the pipe, but eight at the moment. Yeah.

Have you thought about sending out kind of a freemium version where you get the first 5 or 10 free?

We do that and actually that's what I put here. You can, if anyone's interested on this call or at any time if you email, just say you're interested in the trial to recruit. Recruiter at Echo AI will send you. We. We have that coupon you saw maybe earlier. We'll send a coupon and then we can give you whatever X number of processing that one wants to do without charge. So that's an option.

Have you talked to the military?

You know, I haven't. I have that in mind. I've really. We. We. I tried to make some connections. I just didn't at first. But I think it's a great area. We. We got. Actually there was a. An open request for proposals not from the US military, actually from the Chilean army. We applied for that just because one of our people are team members is in Chile. We did not, you know, we weren't selected, but we believe it. It could be good. And what we had positioned it for was not for combat, for training. Because training could be, from what I understood, could be also stressful and demanding combat training and situational training. So that's where we were. We were proposing to initially do it as part of the training program to introduce it to see who could work. But as you said earlier, you know, in noisy environments, in stress conditions.

Wow. Yeah. Another thought is health care. So right now my mother is. Is kind of has early dementia and she has a cognitive review every 30 days. And it's a, it's a nightmare. It's, you know, I've got to be there live. And we do it on a video call and there's a tele nurse on the other side and they ask questions and then they give her, you know, a dementia score at the end. And I mean, Jesus would be so much easier. What did you have for breakfast? You know, who's the president? You know, and, and it would, it would even tell the emotional state of the person, you know, be way better than what the nurse can do.

And it's a great area. And that's where we see it eventually expanding into. We've been doing anxiety, stress and depression and we're working on Parkinson's and Alzheimer. We're not there yet. The problem is we need more data to validate it. But we think we got a, we'll be there in the coming months. And it's great, as you said, tiger, that it's a great check in because people could check in more frequently.

You get a baseline that you can see if you're going up and down every month.

Yeah, I think I took up, I don't, I'm sorry, I mean, time wise, I just. See, so.

Oh, no, no, good, perfect.

I got, I got some more questions.

Oh, okay. Always.

I'm sorry. So to the example that you were giving there, you, you were answering questions as if you were a radiologist, but you're not. What would your scores have come out? Would you have gotten all zeros? Because it says, hey, this guy was bullshitting.

Well, it looks. So two things I'm looking at, you know, I'm looking at the resume and reading a few things from there, but it would look again at my, the questions and the answers to them. That's, they, you know, that's one level of metric. In other words, the skills, the experience, that's at one level that, that's measured. But at the emotional and psychological level, it's really, it, it will just report on it. It doesn't care if I'm not skilled in radiology, know nothing about it. It's still going to say maybe, okay, this is an open, adaptive person, whatever, and, and that's all it's going to report. Could have been the same report for, you know, a computer scientist or whatever. Yeah, right.

So, so that's, that's one part of it. But the other part is, hey, do you know what the heck you're talking about? Would it have caught on that you didn't have a clue? You Were just reading off a resume.

That's part of the, The. Yeah. So that's. Again, that's. I could be doing that, but I could also be doing that in. And in a live interview. Right. A face of a zoom interview. I could be doing that. Maybe not.

Eric's asking is there's hard skills and then there's soft skills. This is more of a soft skill tool.

You know.

Yeah. They're assuming you graduate from radiology school. You know, you know what you're doing. It's really a soft. It's a, it's more of a cultural fit tool, I think, which is the harder part. I mean, that's why people leave after six months. It's. It's not that they're not qualified. I think I only hired one person in my entire career that was not qualified. He couldn't run HP machines that he said he could. But.

So.

So the other question I have is what would you guess would be your rate of, you know, I guess, false negatives on here you have someone who comes in who, who could really be the perfect person for the position. But, but this didn't measure it right. What. What is the rate of.

Yeah.

How often does it get it wrong?

So our. We're typically at 80% accurate. This is a big, this opens up a big topic in a way because psychology is kind of the science and the art and, and, and, and there's a big questions to it. And. But we're at 80% or better. We feel we're better. And, and no one, as far as we. We've looked for it, we haven't seen research done. We did internally. I'll just say one thing. We did internally with 20 people. We gave them three different big five tests. The ocean, big five five, openness, conscientiousness. And we found that none of them were consistent with their results. Over. Across. Generally across everyone. What with the voice, what we find is there's consistency. So if you. And we did this over. Not one. One time we did this over. I think that was done over eight weeks, six or eight weeks after that. And we saw it once a week. And we saw that the voice was consistent and the written tests were not consistent, both not consistent over time and also not consistent relative to the others. That's about the best I could, you know, answer. I mean, it gets more involved.

But yeah, sure, it's very interesting. And you know, I come from the engineering side, so the mistakes are. Are a little bit different kind of mistakes for me than, than, you know, the Soft skill kind of things. So that's, that's, you know, I asked Mark the other day, I said, how, how are these things kind of validated? And what you're saying is that that's difficult.

It really is. And, and the thing is, is that. Yeah, so even psychologists don't necessarily agree on, always on the same thing. And also, but more so for interviews, what happens is it's subjectivity, whereas we're not subject. You know, the AI is not subjective. It doesn't care how the person looks, whether, you know, if their accent doesn't matter. It's what their personality is. That's what it's reporting on. So in a way it's, it's much more objective. Do well.

And that would be nice because it would, it would, you know, help us eliminate our, you know, biases which, which would lead to mistakes on our part.

So, yes, very, very cool.

Is there a way that this could be programmed such that it, it would be able to tell if, hey, will I be able to get along with this person? Well, I like that. Can it do anything like that?

We've talked about it. It's an interesting area because you need to look at, let's say, for example, you could hire someone for a team and you could do the team's overall psychometrics, take each individual average amount and say, this is the makeup of this team. Now, do you want to hire with the same type? And this is another open question. Do you want to hire someone with the same kind of personality that fits right in, or do you want someone who will change the team, maybe bring more innovation or more management skills? Yeah, exactly. So that's a hard area as to how you want to do it. It's a. Something we're thinking about, but it still needs more work.

Really good question. Is cultural. Cultural fit. And I worked for a company and we were trying to hire people on the opposite. We did the wheel. I don't know what that was called, but we were trying to hire people that are complimentary skills. They would ask questions the other people wouldn't ask. That's really interesting. Another, Another idea popped in my head. I have a theory that all that the psychoanalysis, psychology world is going to all go to AI agents and the future. And I mean, I've got a friend I used to play tennis with and he was. His specialty is sex addicts and he literally did video calls with sex addicts all day long. And he charged, you know, full rate. And. But he, this, this would be better than him. I mean, Couldn't you have a. Couldn't you have an agent that just checked in on, you know, patient once a month and.

Precisely. Yes. And I could say the same is true for recruiter. Right now we're targeting recruiters, making their life easier and shortlisting and all that, which the therapist could do also. But I could also see at some point, and then the recruiting firm may not need as many recruiters because this could do a lot of the legwork. I could also see down the line that companies, especially larger ones, would just go with something like this and cut out the recruiting recruiters costs. Usually it's 15, 20%, whatever, you know, that's the numbers I know. And they could cut that out and they could then just use something like this and then bring them in for the final interview or two. So. Yes.

So I have a question.

I'm sorry. Go ahead.

Yeah, hi, this is. I'm not on video. How does this work with sociopaths? Because they're pretty good at disguising themselves.

What, what this makes it. What's very difficult to fool with this system is they might be able to disguise, but it's with the words with tones. It's very hard to. It's really hard to. Because we're looking at very different things. Like, we look at the frequency of the tone, the hesitations, the pitch changes in the voice, the formants, the resonating tones, the fundamental secondary tones, all these things. Things like also certain vowel sounds, the. The duration of it. These are like features that we're looking at. It's very hard for someone to know what to control to portray a particular type.

So the reason I asked the question, particularly salespeople, you know, that's where you can find a sociopath. And, you know, you want to talk about a cultural, you know, atomic bomb, it's a sociopath getting into the organization. They just destroy it. So if there's a way to identify that type of person, you know, ahead of time, that would be absolutely huge. I think everybody in this call has encountered at least one sociopath their careers. And there's. It's just a horrible event. And then just a couple of observations. So I use some software called Weltry. And what Weltry does, it measures my heart rate variability. And it's amazingly accurate in showing me just how tired I am getting sick. All kinds of interesting things. Then the second comment is about Professor Marston. Do people on the call know who Professor Marston was?

I. I don't.

Okay, so he's the one who Came up with the first lie detector. Okay. And he was absolutely, you know, he. This is early 1900s, 1910 or so and he was a professor. And interestingly enough he, he had a nice taste in women as well. And he was married but he decided to bring a grad student woman into their relationship. And then after he kind of got shown out of the academic institution, he decided to write a comic book Wonder Woman Lasso of Truth. That came from his lie detector. So picking up on physical findings to tell the truth. So just kind of throwing that one out.

That's interesting. Very interesting.

The psychopath question is excellent. So can you. I know it's based on machine learning. Can you teach the machine learning? Can you give it Charles Manson and David Koresh and a bunch of people and basically say, you know these. They're extending their vowels and this is a marker psychopath.

We could. And I would, I don't know the statistics on it. We would have to say, you know, it's really a question. It's something we would do. I think at, at the early stage we're in. We're going to go for the larger market. But if it is. Yeah. Then there's no reason we can't.

Let's just use softer language instead of psychopath.

Yeah.

A lot of salespeople don't tell the truth. Can you. Can you detect people that are kind of loose with the truth versus people that are objective?

It. We. We don't at this point. Yeah. We would have to. That would work on that. Yeah. That's. There's a lot.

Well, you can always improve.

Yeah. One thing we do do and we're going to add that we, we actually there we got interest in it as a standalone but we want to integrate it in is we do. I'll just mention it because it's. We do fake voice detection. So with the emerging of AI voices and replication, we can, we can. We have very high accuracy there. We're at 93% accuracy in detecting the human to, to AI generated which is one and also human to human. We've looked at impostors and we, we can also detect that they probably know.

That Natasha sounds like a male.

Yes. Something's up. But, but the, the problem came up which I I, it was. I, I was only aware of it recently is a lot of, A lot of job candidates, especially abroad. It happens. India is a big market and a lot of companies hire the large Fortune 5000 have a big portion of their team from there. What they do is they have sophisticated ways in which they are doing AI voice generation. And then they find out that there's another person answering those technical questions. And so they want to determine on the same voice call is it the same person or not? It's just a binary that we do. But there, as I said, we. Yeah, that came up.

Interesting. It's amazing how voice has such a signature. It's incredible.

Definitely.

Well, this is. We've gone a full hour. This has been. This has been great. Thank you.

My pleasure. Thank you.

Yeah, we got one more.

Sure. Very good. Thanks.

Thanks for. Thanks for it all. Thanks, Tiger.

Appreciate it.

Yeah. Yes, thank you. Good stuff. Well, we're gonna dive deep. I'm gonna tell some people about this tool.

Please do. And if you want, you know, the. Did you get it or I should have put it in the chat. The recruiter at Echo a just email there interested in. And then we can get that. I'll just type it in.

Yeah, type it in now. So we'll have it.

Thanks, everybody.

Yeah, thanks for bringing Mark. This is.

It's fascinating.

It's. I mean, the world's changing so fast. It's. And these tools, there's tools like this all over the. They just pop up. There it is@Echo AI. All right. Well, thanks.

Oh, my pleasure. And Mark, I'm sorry if I, you know, we were supposed to both. You were to present, too, today, so.

I. Oh, I don't think so.

No, no, this was. This was all you.

Oh, it was okay.

I mean, I might have been a backup, but. No, this was really. I am a symposium on February 11 entitled Using AI in your medical practice Increasing efficiency and saving time. And I've got a couple of large language computer scientists and the chief of orthopedics from Kaiser Permanente and a couple of other AI interested physicians, because, I mean, there's a lot out there. Like Tiger said, it's moving so fast. How do we bring a tool that is actually usable, applicable, you know, that you can sort of ingest without, you know, redoing your practice, as it were, or hiring somebody. And it's again, saving time and increasing efficiency because there's a lot of this going to be. It's going to be coming at us hard and fast. And, you know, busy people don't have time necessarily to shop everywhere. And there's no Amazon yet for AI. Thank you.

Thank you very much. I appreciate it.

Christmas.

Happy holidays, everyone.

Thanks.

Thanks. Bye.