Jeremy Howard recommends learning deep learning by training and fine-tuning models on your own data. Start with fast.ai's free course, then scrape images, clean them, fine-tune a model, and study what it gets right and wrong. Become an expert by applying it to something you actually care about.
Questions this video answers
August 28, 2019.
Yes — Jeremy Howard says "Everything we do is free."
About four minutes.
Teddy bear, grizzly bear, and brown bear.
He said it "recently won the COGX award for AI courses as being the best in the world."
Chapters
So what advice do you have for someone who wants to get started in deep learning?
Train lots of models, that's how you learn it. So like, so I would, you know, I think it's not just me, I think our course is very good, but also lots of people independently have said it's very good. It recently won the COGX award for AI courses as being the best in the world. I'd say come to our course course fast AI. And the thing I keep on harping on in my lessons is train models. Print out the inputs to the models, print out to the outputs to the models. Like study, you know, change the inputs a bit, look at how the outputs vary. Just run lots of experiments to get an intuitive understanding of what's going on, to get hooked.
Do you think, you mentioned training, do you think just running the models inference, if we talk about getting started.
No, you've got to fine tune the models. So that's the critical thing because at that point you now have a model that's in your domain area. So there's no point running somebody else's model because it's not your model. So it only takes five minutes to fine tune a model for the data you care about. And in lesson two of the course, we teach you how to create your own data set from scratch by scripting Google Image Search and we show you how to actually create a web application running online. So I create one in the course that differentiates between a teddy bear, a grizzly bear and a brown bear and it does it with basically 100% accuracy. Took me about four minutes to scrape the images from Google Search from the script. There's little graphical widgets we have in the notebook that help you clean up the data set. There's other widgets that help you study the results to see where the errors are happening. And so now we've got over a thousand replies in our share your work here thread of students saying, here's the thing I built. And so there's people who like. And a lot of them are state of the art. Like somebody said, oh, I tried looking at Devangarri characters and I couldn't believe it. The thing that came out was more accurate than the best academic paper after lesson one. And then there's others which are just more kind of fun. Like somebody was doing Trinidad and Tobago hummingbirds. She said, that's kind of their national bird. And Susie's got something that can now classify Trinidad and Tobago hummingbirds. So yeah, train models, fine tune models with your data set and then study Their inputs and outputs.
How much is fast AI courses free?
Everything we do is free. We have no revenue sources of any kind. It's just a service to the community.
You're a saint. Okay. Once a person understands the basics, trains a bunch of models, if we look at the scale of years, what advice do you have for someone wanting to eventually become an expert?
Train lots of models. Specifically train lots of models in your domain area. So an expert, what? Right? We don't need more expert like create slightly evolutionary research in areas that everybody's studying. We need experts at using deep learning to diagnose malaria. Or we need experts at using deep learning to analyze language to study media bias. So we need experts in analyzing fisheries to identify problem areas in the ocean. That's what we need. So become the expert in your passion area. And this is a tool which you can use for just about anything. And you'll be able to do that thing better than other people, particularly by combining it with your passion and domain expertise.
So that's really interesting. Even if you do want to innovate on transfer learning or active learning, your thought is, I mean, it's one I certainly share, is you also need to find a domain or data set that you actually really care for.
Right. If you're not working on a real problem that you understand, how do you know if you're doing it any good? How do you know if your results are good? How do you know if you're getting bad results? Why you're getting bad results? Is it a problem with the data? How do you know you're doing anything useful? Yeah, the only. To me, the only really interesting research is not the only, but the vast majority of interesting research is like try and solve an actual problem and solve it really well.
