30 Aug 2022 · 42 min
A Practical AI podcast episode ("Privacy in the age of AI") in which hosts Chris Benson (Lockheed Martin) and Daniel Whitenack (SIL International) discuss privacy tradeoffs for AI practitioners. They cover principles such as data minimization and de-identification, concrete risks (model parameter leakage, exposed booking IDs on boarding passes), and technical/operational mitigations including edge processing, pseudonymization/masking, randomization/differential privacy, and federated learning. The episode closes with community/tool notes (Stable Diffusion on Hugging Face, spaCy FLOoRET, FPGA workshop).
Chapters
I think when people talk about data now in terms of data that affects personalization and identification. I think the argument to be made now by any data scientist or AI practitioner is the argument on what you need and why you need it, and being able to justify that going forward. In general, there are many exceptions to that, obviously. But yes, I think the burden has changed to us to show not only why we need it and what we need it for, but why that's a good thing and why it does not cause damage unintentionally. And so it's we we've come a far cry from the early collect everything. Only intelligence agencies these days collect absolutely everything. You know the way the world works now.
Welcome to Practical AI, a weekly podcast making artificial intelligence practical, productive and accessible to everyone. Subscribe now if you haven't already. Head to PracticalAI FM for all the ways. Special thanks to our partners at Fastly for delivering our shows super fast to wherever you listen. Check them out@fastly.com and to our friends at Fly IO we deploy our app servers close to our users and you can too. Learn more@flyeio.
Well, welcome to another fully connected episode of the Practical AI podcast. This is where Chris and I keep you fully connected with everything that's going on in the AI community. We'll discuss some recent AI issues or news and dig into some learning resources to help you level up your machine learning game. I'm Daniel Wynak. I'm a data scientist with SIL International and I'm joined as always by my co host Chris Benson, who is a tech strategist with Lockheed Martin. How you doing Chris?
Doing very well, Daniel. It's a good day. I'm looking forward to having a fun conversation with you. Hope our listeners are too.
Yeah. Have you been flying much recently for listeners? Chris is a pilot. Have you been up in the air very much?
I did. We took a vacation with my daughter a little while back and I did a lot of flying for that. And then ironically that you asked this today. Tonight pilots have to do what's called currency flying to keep your night rating going every three months. Tonight is the night going to go fly tonight after a couple a little while after dark and do some night landings. Always enjoy those. The lights are beautiful.
Well, in terms of some of the things that I'd like to discuss today, this might seem like a random question, but I think it's relevant. So I know you're doing these certifications and other things and you've got to keep things up if you were told that the FAA or whoever they wanted to. To have a camera mounted in your plane and monitor all of your. Whatever is going on in the cockpit during each of your flights to judge whether you were a good pilot or not. And there would be constant monitoring of you, maybe an AI model identifying certain things you did wrong or something. How would that make you feel?
Oh, not good at all. Not good at all. I mean, aside from all of the. The moments where maybe where maybe I take liberties that the FAA wouldn't. Wouldn't go for just in general, you know, every bad landing noticed, you know, that kind of thing.
Every right.
Oh, boy. Yeah, that doesn't appeal to me at all. It would feel like a fairly substantial invasion of my privacy.
Yeah, but I think one could argue that if you wanted to know and certify only pilots that did the right things, a certain percentage of time or something, I guess there is a sort of. In that case, there's maybe a balance between, hey, on one side I'm going to make an argument about some type of safety over privacy or accuracy over privacy or something like that. And on the other end, of course, it's a natural. Maybe what most people would consider in this sort of hyperbolic situation, most people would consider an invasion of. Of privacy.
Yeah, I think there's a balance to be struck there, certainly. I mean, when you raise public safety, that's a legitimate concern. But I know that it is a topic that in the use case that you brought up, pilots do talk about that, because with current technologies, the oversight is becoming increasing for pilots. And I think that that's very important when, like, if you are an airline pilot and you have passengers in the back, that's super important for me. I worry about do I really need that level of oversight if I'm doing the mountain flying that I do? I tend to do low mountain flying in lower areas. But if I were to pass a hiker on a ridge top without realizing they were there, technically, I would be breaking a regulation and I could get in trouble. And frankly, I think that might be like a step too far. So I think the privacy. The privacy concerns are something we need to figure our way through. I'm guessing that there's an AI angle going on this one.
Yeah, I think that I bring up this topic and in these episodes, it's just you and I, of course, we get a chance to discuss some of the things on our mind. And this has been one of the things on my mind recently. Not so much the cameras in the cockpit sort of Scenario because I'm not a pilot, but general sort of privacy concerns and thinking about, even for my own team, what are the balances that we need to strike and where are the privacy concerns within our own workflows in terms of making sure that we're comfortable and responsible with the ways in which we're handling data, the data that we're feeding into our models, the types of data that we're storing in certain places. And that sort of thing has definitely been on our mind recently. I don't know. So when I got into this stuff. I don't know if we've talked about this, Chris, but whenever you got into things like this. But when I got into this sort of stuff, it was sort of the beginning of data sciencey hype. Not so much the AI hype yet. Right. Like there was this hype around sort of data science is the new thing. And so getting a job as a data scientist. And I remember at that time there's sort of this thinking, well, you don't know what data you're going to need, so just make sure you store it all and you have it all. That was kind of the mindset. I remember very distinctly at the time. That was the mindset. How do you think that mindset, maybe do you relate to that? And how do you think that's shifted over time?
Oh, I remember that you're showing your age, Daniel, by the way, because that certainly changed dramatically over the last couple of decades. When you talk about those early days of data science and everyone was pioneering their way through that, and yes, you were trying to find data to use and there often wasn't enough data around. And when you found it, you collected all you could to combine with others. And obviously today things are somewhat different. And with the capabilities it is, privacy and things like data bias and such as that, and they're all interrelated, has changed the landscape dramatically, especially when you consider all the use cases out there.
Yeah, I bring this up because let's just say that we want to strive for privacy or a reasonable amount of privacy. Let's make that argument first. There's probably a separate argument of like, well, maybe we don't need the privacy that a lot of people are after. Maybe that's another discussion. But let's assume that we're striving for some level of privacy. I would say the first thing that comes to my mind in terms of making something, quote, private is if you don't collect or store the data, then that's just about as private as you can get now maybe there's like other logs and certain things that we maybe wouldn't think immediately of as data that are revealing certain things. But I think one principle is I even saw this term. So I was looking through several things leading up to this. One of them that I look at occasionally is Google has this responsible AI practices page and they use this term data minimization, which I know probably listeners are thinking, well, what would we have to learn from Google about privacy? Because they know everything and have all the data. So it's kind of interesting to think about Google talking about data minimization. But I find this term interesting in the sense of like one way to improve privacy is to just plain not have data. Have you been in those sorts of discussions within your career around like, do we actually need to store this data or should we not store it? Those sorts of conversations?
Yeah, I think the. I think the burden has. Has flipped to the opposite side from those early days that you talked about. I think when people talk about data now in terms of data that affects personalization and identification, I think the argument to be made now by any data scientist or AI practitioner is the argument on what you need and why you need it and being able to justify that going forward. In general, I would say there are many exceptions to that, obviously. But yes, I think the burden has changed to us to show not only why we need it and what we need it for, but why that's a good thing and why it does not cause damage unintentionally. And so it's. We've come a far cry from the early collect everything data is, I think only, only in, only intelligence agencies these days collect absolutely everything. You know, the way things, the way the world works now.
Yeah, I think there has been a shift. I think there, there are a lot more conversations going on about, within companies talking about whether they should store certain pieces of data. Maybe about a user, let's say a name or a location, something that is useful in maybe marketing purposes or whatever it is. Do we really need to store that to do our marketing the way that we want to do our marketing? That's a question that comes up probably. And it comes up, I think in relation to Facebook and others have. Or meta or whatever I should refer to them as they've changed their APIs and other things to where you don't get some of that data in many scenarios. So maybe some of that is just we don't even get it anymore. But I think that as much as I love hugging face and the Hugging Face Hub and that community. I think there is this sort of shift with the recent AI, more AI related hype around what are all the AI data sets we can create. There's definitely bias concerns that have come up with that. I think there's probably privacy concerns as well though. I remember very distinctly, I tried to actually find if there was a blog post about this or something. But I remember Jim Cluecar who used to work for Immuta, I attended a talk by him and he showed how you could reconstruct a real person's face from the parameters of a facial recognition model because the parameter space was so large. So there's a very large model, there's a lot of information encoded in the parameters of that model. And he could reconstruct or he showed some research where someone did I forget the exact details, but you could reconstruct something from that. So even these very, very large models that are released and the parameter spaces of those models could even have privacy concerns. So I think this sort of proliferation of like, let's get all the data sets on the hub, let's get all the models on the hub. I think that Overall is like 90. I don't know, I don't want to put a percentage of it, but I think overall it's a very, very good thing. And obviously I think if you've listened to this show very much, you know how much I love that effort. But I think with it there's sort of this maybe a shift back in thinking towards like, let's accumulate all the data, let's release all the models. And these models themselves may even have sort of certainly bias concerns, but privacy concerns as well within them. So yeah, that's one thing that I don't know, I don't really have a definitive statement on, but I've been thinking about as, as I've seen the community grow around that, you know, you raise.
A really important point in terms of the implications of what, what you just described. And that's the fact that, that as the capabilities are evolving over time, the way we're choosing to make evaluations about how our privacy is affected is also changing. So it's not, it's not a static decision. It's a decision where if you look back a few years and look at where it's at, you're like, I'm okay with that. You know. You know, I could see that they're not going back, but at this point the sophistication level is becoming so much higher. And the fact that you can do that reconstruction that you just described makes one reevaluate. And then if you add in the fact that there are also considerations like who is it that's doing it and why and what, and that changes depending on who it is. We all are making decisions every day about what privacy compromises we're willing to make. And we all have different profiles in that capacity. If you choose to install security cameras like the doorbells that everyone has now, and you now know that every time you walk in and out of your front door, you're on camera and it's recognizing, it has a model there, it knows who you are, it's recognizing you even before anything is done with the data. And we've all made, and I've made that choice. I have a nest on my doorbell and I have other devices around my house that know who I am. So there's some level of that, but it also depends on whether or not I have some level of control of that data in terms of its usage, what the, what the rights that I have as a, as a consumer are, and whether or not it's from a public sector perspective or a private sector perspective. So all those are considerations that we can, we can delve into.
So, Chris, the first term that I had run across that I wanted to bring up was that term data minimization, which is, you know, maybe you do need data to do something, maybe you don't. That's one consideration with privacy is certainly the, the easiest way to deal with the privacy concern is to not have the data. I think though, many cases, either we step into a project and data exists already and is maybe stored within our organization, or we have some data set that we're interested in working with that maybe we don't know what the identifying information within that data set is or the privacy concerns with it. The next term that I ran across as I was sort of probing this space was data de identification. I was reading blog from again Immuta, which I think we've had Amuda on the show before here and they've of course done a lot of thinking in this space, but they have a nice blog post which we can link in the show notes about data de identification. And they talk about various sort of pieces of data that you might want to de identify within data sets. I think for practicality's purposes, I'll just mention a few of those since this is practical AI. So they have a long list that I won't read all of them, but they talk about names, dates, telephone numbers. Those are probably Ones that would be immediately assumed, maybe ones that people might not be, you know, thinking about immediately would be a device identifier or serial number. So like, maybe that's a Mac address, or maybe that's like a browser fingerprint. Web URLs might. Might be identifying. Like there's such a proliferation of analytics data within URLs these days. That's one thing I was thinking about. Like the, you know, all the query strings that are added onto a URL to track you in various ways, or like there could an account ID in some URL or something like that, which is something that could happen. And they list out a bunch more. But those are the types of, when we refer to identifiers, the types of identifiers that we have in mind. As you sort of look at that list, Chris, do these things come up in your mindset in data sets that you work with?
Absolutely. Going through the process of trying to get them removed to de. Identify them, while not losing the potential value of what you're trying to create from a model. Because, I mean, let's face it, many of the models we create, humans, are central to the output to the inferences of those models. And so if you're going to deal with humans, you're going to be dealing with these identifying traits. But if you take out too many too much, sometimes you run the risk of the model not being able to be productive even for the best use. So it's a bit of a challenge for the data scientist of today to try to. There's this balance of a bunch of hard things that we need to accomplish from an ethical standpoint, and we do the best we can with the tooling available.
Yeah. I also think that the person giving you their data needs to have agency to give you their data. Right. But I also think that the general public doesn't understand the implications of some of the data that they might give you. So I think that you, as maybe a practitioner in the AI space, probably could also not just assume, because the user gave me this, it's going to be okay, or at least not have any issues if I use this identifying field or something. I listen to a podcast about the. We talk about the boarding pass thing. This is another flight thing.
I don't think so. Go for it.
So I listened to. I think this was another Darknet Diaries. I love that podcast. I've mentioned it a couple times on the show, but what had happened was people, they go on a trip and they post a picture of their boarding pass on Instagram or something like, I'm going on my vacation, look at my boarding pass or whatever. It's very common hashtag, boarding pass. Well, there was a guy that said there's got to be something on this boarding pass that is like the airline doesn't tell you that your boarding pass is a security risk and should be private. Right. And so people post them all. But what this guy learned was that the booking id, so it was like a Qantas flight. Right. And he saw the booking ID was on the boarding pass. And what's interesting is that he found, I think it was the Australian Prime Minister posted a picture of one of his boarding passes somewhere he was going. So he took the booking ID from the Australian Prime Minister, took it to the Qantas website, and turns out all you needed was the booking ID and a bit of personal information like your name, where you were from, which is obviously all public record for a Prime Minister. And he just logged right into Qantas as the Prime Minister of Australia. Of course, at that point the flight had already happened. But then he was like, well, I wonder what else is here? And then he just did page view source on the logged in Qantas site. And in the source of the page there was a JSON field which included all the info about the account holder, including passport number, phone number, et cetera. And of course the podcast is really great. Maybe I'll link that in the show notes too. But it's like, who would have thought that posting a picture of a boarding pass, which the airline doesn't tell you is a security risk. But obviously there was a security risk there and a privacy concern because there's sort of passport information and such. But people, sometimes the companies don't even understand how people might put this data together, which I guess influences like maybe the scope of the concern here and how you really want to consider both data minimization and data de. Identification, at least in some, in many cases, yeah.
You really raised the point about the burden being on us as the data scientists, data scientists of goodwill and good ethics. Because the general public doesn't understand a lot of these things. I mean, any of these documents. The whole purpose of a boarding pass is to identify you as the rightful user of that airline seat and to admit you to the plane and such. So by definition it's an ID thing. And anything that serves an identification purpose should be treated pretty carefully. It's hard to do today for the public, not only in the context of how data can be used in an AI context, but just in the broader world, there's so many opportunities for data leakage that affects us in that personal way. I have gotten probably more insight into that than most people because of two things. A, I'm in this world that we're talking about, you know, AIML and data science, but I'm also in the defense industry and we go through classes about how to protect yourself because of, for obvious reasons, you know, with nefarious folks out there. And so there's so many opportunities. So it really does raise the need for the data science and the AIML community kind of step up to meet those needs because you can abuse it and you can, you can use it, you can get away with what you want to get away with, probably in many cases, but that hurts us all in the long run. It causes harm not only to others, but to ourselves in this industry. So definitely something to be thinking about in every possible part of your life that has any form of identification associated.
Yeah, there's a big concern here, but there is a lot of good thinking and tooling around this sort of de identification side of things as well. In the Immuta article, they talk about, okay, well, if we assume that, as you mentioned, us as practitioners want to be responsible with the data that we're processing and the way that we're handling it. One scenario, let's say that we couldn't do or didn't do data minimization, right? We have data, we need to use it for a specific purpose. But we also are maybe concerned, maybe it's text fields and we're concerned that there's names or phone numbers, these sorts of things, account numbers. Maybe it's individual structured data, but maybe it's just raw data. And we don't exactly know there are de identifying methods out there. So of course, this is a lot easier probably. I mean, in the language space, if you're using English for an example, you have an advantage because you could, for example, take a named entity recognition model and figure out where the names are and replace the names with pseudonyms, right? So for your AI model, it probably doesn't even care what the name is, right, as long as it's a name. So you can sort of do pseudonyms or fake phone numbers and this sort of thing, or hash certain fields or obfuscate them in certain ways. So that's like this, using a replace type of method for these fields, you could, you know, just identify them. I know there's Python tooling I've used. I forget what the update is on the best one to Use we've used one called Scrub a Dub. I think there's Python libraries to like find these things and identify them or replace them. The Immuta article emphasizes this type of, you know, masking or pseudonyms and that sort of thing. And it probably again depends on the data type. Maybe if you've got an image with people's faces in it, maybe that's a different scenario than if you have sort of a text field with a name in it and you can replace the name. It's maybe more difficult to replace. I mean there are ways. Now of course, maybe this is another positive use of the deepfake sort of methods. You can replace faces and images and that sort of thing. But there's probably certain methodologies like facial recognition, which by their very nature are identifying methodologies. So you don't want, the whole point of facial recognition is to identify someone. So there's probably a range of scenarios as well where if I'm just trying to do predict a marketing campaign or something like that, maybe the sort of obfuscation and masking methods are really relevant. If I'm actually though trying to identify a face for a security reason in my building or something, I am actually trying to identify someone. And that probably brings up other issues of how you log that and store that identification, which we can talk about.
Yeah, it gets complicated in that way, in that kind of going back. Building on your last point a little bit there, it goes back to the use case, it goes back to who is, who is using that data. Is the government that you happen to be fall under in whatever country you're in. Are they looking for facial recognition or is this your, your Nest doorbell and you've made an accommodation. It's pretty crucial and it's pretty hard. One of the, from a identification standpoint, your, I think your, your airline example a few minutes ago was really pertinent in that it's very easy for user who may be making a choice about offer to misunderstand that they may look at the data that they're giving up and go this is okay, this isn't too much. But if the, the model creator is combining that data that they've chosen to give up with other data, a lot of privacy can be, can be compromised by combining different data types together. That may not be part of that, that initial thing. It may be something that you already have available or from another source. So it gets, it gets challenging.
The challenge that you brought up Chris around, I guess the expectations of users of how their data is going to be used or combined with other things. It's a really challenging one that can get really complicated. Like I'm thinking of, even in my own scenario, we've had discussions before because maybe we've got a recording from someone across the world, some language recording in our archives, right. And they, they gave permission for that data to be used or collected and stored in the archive for language documentation purposes or something like that. Maybe we no longer have access to that person, so we can't get their explicit permission to use that in any other way, even though we know well this would be useful to add to an AI data set. Like so we're talking about that all the time internally on our team is like when the data collect was collected. That's a very crucial time to.
Help.
The company express to the user how their data is going to be used and have the user understand and have agency over that. But also that brings up the additional point that yeah, you could give them a long list with a terms and conditions thing that no one's going to read. Right. Is that really giving them control over how their data is being used? Because for any reasonable person, you could assume that they're not going to read through all that, Right?
Everyone will assume they're not going to read it. But the lawyers involved.
Of course, but the lawyers, yeah, the.
Lawyers are assuming they've read every word. I mean, you raise a great point. I confess I probably shouldn't do it in such a public way, but I have agreed to many terms and conditions where I have not read the full verbiage. There might have been more than a few where I didn't read any of the verbiage. And so we are often making these choices of convenience that may have some fairly long term repercussions.
As you're pointing out, the other kind of major category within the data de identification that Immuta brings up, and actually many other places do as well, I think including that Google responsible AI practices is something having to do with randomization and differential privacy. So a case of this that we've been talking about internally is if we have a device in the field, right, and we're gathering either text, audio, video, one choice for us would be to send all of that audio back to a central location, store it in S3 and do a bunch of things with that. Right. That's probably the worst case scenario because now we've got just recordings of audio from some random place and maybe people don't know, hopefully they knew that they were getting recorded and understood what was happening. But still, that's a very hard situation because you actually got the raw data and it's sent to a central location. I think one thing in that scenario that is a best practice is if you can do any of that processing at the edge, if you can push your models out to the edge, and let's say I'm doing transcription of the audio and then I'm detecting something about what is said in the audio. Maybe I don't even want to send the transcript back. I just want to send metadata back about like, hey, I did a transcription and I'm not sending the audio, I'm not sending the transcription. And of course, that's a much better scenario because the audio is staying on the device, the model was run at the edge, and the only thing you're sending back is metadata. Of course, that's still probably a tricky situation because you're knowing maybe something was said at a certain time at a location from a device which brings up this randomization piece. Right? So the other thing you can do is take those messages that you would send back to the central location and randomize their timestamps or their ordering or that sort of thing to where. For example, if someone said something that had political implications at a certain time at a location, whoever had access to that central source of data, they couldn't really tie it back to a certain location at a certain time and maybe identify the person that said that and persecute them for saying that. So this sort of randomization comes and it can take be taken as far as this idea of differential privacy, which offers a mathematical guarantee around sort of privacy and the masking of direct identifiers. And that's come up also with federated learning. So I think the edge computing side of this comes in and actually to a lot of benefit to the privacy situation. If you're able to do things at the edge and the things that you're confident communicating over a network are randomized in some way, there's some guarantee around privacy. And maybe you're just communicating metadata and not the raw data that stays at the edge. So that, of course, makes infrastructure a lot harder to deal with, but it's overall a better situation.
As you were saying that I'm struck with the fact that it takes a good actor to be willing to do these things. By way of example, you know, so many of the laws that we have and both here in the United States and in other countries are not sufficient to kind of enforce these things that we're talking about here in this Episode as good practices and as ethical practices. I know that here, where I'm at physically in the state of Georgia, I can record a phone call legally, and only one party of the phone call has to know it's being recorded, and that's me as the recorder. So I can record a phone call without the other person having any knowledge that that call is being recorded. And that data is data that I have available to me. It has their voice, it may, who knows what they say on the call. Kind of going back to your point about political comments, whatever, and how I use that data, what I'm getting at is as we kind of build this ethical framework as good actors in the data science community, we really need to find ways of using, of having these techniques kind of acknowledged beyond our community and being able to be integrated in as best practices in a legal framework to help enforce it. Because I know I'm not going to do anything nefarious, and I know you're not going to do anything nefarious. But there are a few people out there that might do something that is nefarious, and it raises a fairly challenging kind of enforcement or compliance concern in terms of implementing these techniques that are going to be necessary for us to be responsible with this data going forward.
Yeah. And I think that as a person that builds tools that maybe various clients will use, one thing, like if you're in that situation, like if you're creating software products that might be used by a variety of organizations, I think it's your sort of duty to take into account how you can ensure that your software product isn't going to be used for malicious purposes, rather than assuming or writing in a terms and conditions or a licensing agreement that you agree not to do this. So, for example, like in that scenario of communicating audio back to a central place, if you only make it possible for your software product to communicate metadata back to a cloud location, I mean, someone could hack it and maybe do something else, but at least you're making it much harder. Whereas if you make it to where there's an option to send the audio back as well, well, then you're in a whole nother scenario where people could do all sorts of things with that. So I think that also understanding what might be possible, whether you think you are working with good actors or bad actors, is within the sort of duties of us as practitioners to think, because even our managers or executives that are promoting the things that we build, they might not understand the implications of what could be done with what we're building. So Some, at some point we have to kind of own that and hope that over time the sort of regulations and guidance we get from maybe governing bodies or other, other places is, will catch up to where the technology is.
That's a great point you're making and that is do what you have the ability to do to kind of police the set of circumstances that are out there. So if you, if you don't have a strong legal framework to fall back on, that will protect your users. In that capacity as a data scientist, being, you know, being able to say, well, this is the software I'm going to give you, this is the, this is the capability that I will provide. And eliminating some of those, some of those cases that could be used nefariously is really important. I would love to hear examples from our listeners about how they might be doing some of these things and maybe share some of their ideas with us on some of our social media outlets for the show. Because this is important. Our community is leading the way in the sense of how to affect privacy. With all of these new technologies coming through and all of the capabilities that AI has surged forward on in the last few years, we're the vanguard, we're the tip of the spear.
Yeah, I totally agree. Well, in the last few minutes here it may be worth just quickly mentioning a learning resource and maybe a couple things happening in the AI community. One interesting thing, Chris, I wanted to mention before we close out here is that you can now run this stable diffusion model on a hugging face space which is one of these recent text to image models that does really amazing things when you put in variety of text. So I just. In our Slack channel I sent you a message. I put in two cool guys recording an AI podcast and maybe I can post this in our show notes or something. But they don't look like Chris and.
I, but looks cooler than we are.
In a couple of the photos they're wearing sunglasses. Maybe we should consider that. I do notice that there's a trend where at least three of them, one of the guys is bald and the other one is not bald.
Well, I have very short hair.
Maybe I should shave my head. And we need one bald guy and another. Yeah, also there's some interesting text going on to Ko's Kojika.
I don't even know what that means.
Yeah, anyway, very interesting. AI generated two cool guys recording an AI podcast. But they have other examples too. Like a small cabin on top of a snowy mountain in the style of Disney art station. An insect robot preparing a delicious meal. So Anyway, something to play with. If you don't have access to the OpenAI Dall E2 model yet and you're on the wait list, wait no longer. You can use Stable diffusion on Hugging face and have some fun there. I also saw a pretty cool release from Spacy from the NLP world. They've been on the podcast before, but they released Flooret which is an extended version of FastText which uses Bloom embedding. So Bloom was this huge language model that a collaborative effort and a big language model that came out recently and Spacy has implemented this sort of combination of fasttext embeddings and Bloom embeddings which is efficient and built right into the Spacy ecosystem. And I'm excited to try those things out where this will allow you to compare words to other words and see their similarities, but also build models on top of these embeddings which could allow you to do things like text classification or named entity recognition and these sorts of things. These are really the building blocks of modern NLP or these embeddings. It's interesting these combine both word and subword embeddings which could handle misspellings or rare occurrences of words and that sort of thing. So really cool effort from Spacy to make this sort of cutting edge NLP building block really an easy to use piece of their really user friendly packaging. So really cool to see that. The last thing that I saw, which is more of a learning resource is I see there's an upcoming intel workshop on FPGAs which seems pretty interesting to me. I'll link that in the show notes. I don't know anything about FPGAs but I hear them mentioned occasionally and so maybe I'll join the workshop and find out some more.
Sounds good. It looks interesting and I will say without jumping into detail, there's a lot of really cool things happening in that space with hardware and processors and single board computers right now and so a lot of new AI capabilities are are coming out by various companies. So yeah, I would imagine this workshop is a pretty cool place to go.
Cool. Well thanks Chris. It's been a fun discussion. Let's think more about our privacy and I promise I won't install a camera in the cockpit of your plane.
Thank goodness. Oh boy. Thanks Daniel. On that note.
All right, see you Chris.
Talk to you later. Foreign.
That is our show for this week if you dig it. Don't forget to subscribe. Head to PracticalAI FM for all the ways and if Practical AI has benefited your life pay it forward by sharing the show with a friend or a colleague. Word of mouth is the number one way people find shows like ours. Thanks again to Fastly for fronting our static assets to fly IO for back in our dynamic requests to Breakmaster Cylinder for the Beats, and to you for listening. We appreciate you. That's all for now. We'll talk to you again on the next one.
More from LARRUZ


Ep 882: Rogue AI Agents: Why Breakouts are Happening More and How Companies Should Prepare (Replay)


Ep 881: Faster AI Agents, Fewer Human Coworkers: The Overly Productive Future of Managing Agents? (Replay)


Ep 879: New: OpenAI Presence. Has The AI Customer Service Takeover Finally Arrived? (Replay)




