端到端的机器学习项目

端到端的机器学习项目

主要步骤：

1. Frame the problem and look at the big picture
2. Get the data
3. Explore the data to gain insight
4. Prepare the data to better expose the underlying data patterns to Machine Learning algorithms
5. Explore many different models and short-list the best ones
6. Fine-tune your models and combine them into a great solution
7. Present your solution
8. Launch, monitor, and maintarin your system

1. Frame the Problem and Look at the Big Picture

1. Define the object in bussiness terms
2. How will your solution be used?
3. What are the current solutions/workarounds(if any?)
4. How should you frame this problem (supervised/unsupervised, online/offline, etc.)?
5. How should performance be measured?
6. Is the performance measure alighed with bussiness objective?
7. What would be the minimum performance needed to reach the bussiness objective?
8. What are comparable problem? Can you reuse experience or tools?
9. Is human expertise available?
10. How would you solve the problem manually?
11. List the assumptions you (or others) have made so far?
12. Verify assumptions if possible

2. Get the Data

Note: automate as much as possible so you can easily get flesh data.

1. List the data you need and how much you need
2. Find and document where you can get that data
3. Check how much space it will take
4. Check legal obligations, and get authorizati