A lecture on machine learning strategy for improving deep learning systems. When a cat detector plateaus at 90% accuracy, dozens of possible fixes exist, but most waste months on the wrong ones. This course teaches which improvements actually work, drawn from shipping real products.
Hi, welcome to this course on how.
To structure your machine learning project that is on machine learning strategy.
I hope that through this course you learn how to much more quickly and.
Efficiently get your machine learning systems working.
So what is machine learning strategy? Let's start with a motivating example. Let's say you are working on your CAD classifier and after working it for some time you've gotten your system to have 90% accuracy, but this isn't good.
Enough for your application.
You might then have a lot of.
Ideas for how to improve your system. For example, you might think, well, let's collect more data, more training data.
Or you might say, maybe your training.
Set isn't diverse enough yet. You should collect images of cats in more diverse poses. Or maybe a more diverse set of negative examples.
Or maybe you want to train the.
Algorithm longer with gradient descents.
Or maybe you want to try a.
Different optimization algorithm like the atom optimization algorithm.
Or maybe try a bigger network or a smaller network. Or maybe you want to try dropout.
Or maybe L2 regularization.
Or maybe you want to change the.
Network architecture, such as try new activation functions, change number of hidden units, and so on and so on.
When trying to improve a deep learning system, you often have a lot of.
Ideas for things you could try.
And the problem is that if you choose poorly, it's entirely possible you end up spending six months charging in some direction only to realize after six months.
That that didn't do any good.
For example, I've seen some teams spend literally six months collecting more data only to realize after six months that it.
Barely improved the performance of their system.
So assuming you don't have six months to waste on your problem, won't it be nice if you had quick and effective ways to figure out which of.
All of these ideas and maybe even other ideas are worth pursuing and which ones you can safely discard?
So what I hope to do in this course is teach you a number.
Of strategies, that is ways of analyzing.
A machine learning problem that help point.
You in the direction of the most promising things to try.
What I'll do in this course is also share with you a number of.
Lessons I've learned through building and shipping, you know, large number of deep learning.
Products and I think these materials are.
Actually quite unique to this course. I don't see a lot of these ideas being taught in universities deep learning courses.
For example, it turns out also that.
Machine learning strategy is changing in the era of deep learning because the things you could do are now different with deep learning algorithms than with previous generation of machine learning algorithms, but I hope.
That these ideas will help you become.
Much more effective at getting your deep learning systems to work.
