如何提升GPU利用率 在使用fit_generator时

核心思想就是要减少读写次数,尽量提前尽可能的load数据,减少存储空间的交互,减少聚合过程

以下文字来源于Low GPU usage by Keras / Tensorflow? - Stack Overflowicon-default.png?t=M4ADhttps://stackoverflow.com/questions/44563418/low-gpu-usage-by-keras-tensorflow

The most possible scenarios are:

  • If you have a huge dataset, take a look at the disk read/write rates; if you are accessing your hard-disk frequently, most probably you need to change they way you are dealing with the dataset to reduce number of disk access

  • Use the memory to pre-load everything as much as possible.

  • If you are using a restful API or any similar services, make sure that you do not wait much for receiving what you need. For restful services, the number of requests per second might be limited (check your network usage via nmon/Task manager)

  • Make sure you do not use swap space in any case!

  • Reduce the overhead of preprocessing by any means (e.g. using cache, faster libraries, etc.)

  • Play with the bach_size (however, it is said that higher values (>512) for batch size might have negative effects on accuracy)

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值