mlflow
Hyperparameter tuning and optimization is a powerful tool in the field of AutoML. Tuning these configurations can dramatically improve model performance. However, hyperparameter tuning can be computationally expensive and slow.
^ h yperparameter调整和优化是AutoML领域的有力工具。 调整这些配置可以大大提高模型性能。 但是,超参数调整在计算上可能既昂贵又缓慢。
If you have a large network like VGG, Resnet, etc. trying out every parameter exhaustively and then choosing the best parameter is computationally intensive because in hyperparameter tuning we use various configurations. To do that, we need a principle approach to choose the best parameter.
如果您有一个大型网络(如VGG,Resnet等),则要穷尽地尝试每个参数,然后选择最佳参数会占用大量计算资源,因为在超参数调整中,我们使用了各种配置。 为此,我们需要一种原则方法来选择最佳参数。
Hyperparameter tuning creates complex workflows involving testing many hyperparameter settings, generating lots of models, and iterating on an ML pipeline. To simplify tracking and reproducibility for tuning workflows, we use MLflow, an open-source platform to help and manage the complete machine learning lifecycle.
超参数 调整会创建复杂的工作流程,其中包括测试许多超参数设置,生成大量模型以及在ML管道上进行迭代。 为了简化跟踪和调整工作流程的可重复性,我们使用MLflow (一个开放源代码平台)来帮助和管理整个机器学习生命周期。
![Image for post](https://img-service.csdnimg.cn/img_convert/a02d9e274d5a770c3f902da281c51bca.png)
How can I find the best version of this model?
如何找到该模型的最佳版本?
How to track all the information and document of each model trained?
如何跟踪每个训练过的模型的所有信息和文档?
How do we do that efficiently?
我们如何有效地做到这一点?
MLflow makes this process much more efficient and convenient!!
MLflow使此过程更加高效和便捷!!
Let’s start
开始吧
什么是MLflow? (What is MLflow?)
MLfow is a python package developed by databricks that is defined as an open-source platform for the machine learning lifecycle. There are three pillars around mlflow ().
MLfow是由databricks开发的python软件包,被定义为机器学习生命周期的开源平台。 mlflow()周围有三个Struts。
![Image for post](https://img-service.csdnimg.cn/img_convert/004a761253bdda883dbdd96b8e8c99f2.png)
Their documentation has a nice tutorial to explain the component of mlflow. Mlflow lets you log parameters and metrics whic