Addressing Class Imbalance in Federated Learning: AAAI 2021

 这篇算是研究FL与Class Imbalance比较早的论文吧?

In this work, we propose a monitoring scheme that can infer the composition of training data for each FL round, and design a new loss function – Ratio Loss to mitigate the impact of the imbalance.

(那如果我们放宽条件,直接就可以得到训练数据的组成呢?不能总是被别人的提出的框框限制住呀)

设计一个monitor,当发现类别不平衡时就应用Ratio Loss? 

咱也看不懂他是怎么设计的monitor,咱就假设可以知道想要的信息(类别分布)了,然后Ratio Loss是啥呢?

 好像就是在Loss前面加了个Ratio?

感觉论文的Ratio Loss这部分篇幅比较小,没有着重分析。

结论:肯定是不能顺着他的路继续研究怎么推断Client的类别分布了,太难了。既然类别分布信息这么重要,我们就假定我们可以知道吧。在研究FL的Global Imbalance问题时,训练数据的分布信息很重要。

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 2
    评论
Multi-objective evolutionary federated learning (MEFL) is a machine learning approach that combines the principles of multi-objective optimization and federated learning. Multi-objective optimization is a technique that aims to optimize multiple objectives simultaneously, while federated learning is a decentralized machine learning approach that allows multiple devices to train a model collaboratively without sharing their data. MEFL is designed to overcome the limitations of traditional federated learning approaches, which often suffer from issues related to privacy, communication, and scalability. By using multi-objective optimization, MEFL can optimize the performance of the federated learning algorithm while also addressing these issues. MEFL works by dividing the optimization problem into multiple objectives, such as minimizing the loss function, reducing communication costs, and preserving privacy. A genetic algorithm is then used to optimize these objectives simultaneously, producing a set of Pareto-optimal solutions that represent the trade-offs between the different objectives. These Pareto-optimal solutions can then be used to select the best model for deployment, depending on the specific requirements of the application. MEFL has been shown to be effective in a wide range of applications, including image classification, natural language processing, and speech recognition. Overall, MEFL represents a promising approach to federated learning that can improve the privacy, communication, and scalability of the algorithm while also optimizing its performance.
评论 2
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值