运行lora-scripts训练时看到日志警告如下:
WARNING Detected kernel version 4.18.0, which is below the recommended minimum of other.py:349
5.5.0; this can cause the process to hang. It is recommended to upgrade the
kernel to the minimum version or higher.
根据stderr: AssertionError: Main process was not first可知,可以运行accelerate env
看看情况。
$accelerate env
__init__.py:102: RequestsDependencyWarning: urllib3 (1.26.16) or chardet (5.0.0)/charset_normalizer (2.0.12) doesn't match a supported version!
warnings.warn("urllib3 ({}) or chardet ({})/charset_normalizer ({}) doesn't match a supported "
The cache for model files in Transformers v4.22.0 has been updated. Migrating your old cache. This is a one-time only operation. You can interrupt this and resume the migration later on by calling `transformers.utils.move_cache()`.
0it [00:00, ?it/s]
Copy-and-paste the text below in your GitHub issue
- `Accelerate` version: 0.33.0
- Platform: Linux-4.18.0-....
从日志内容可知,4.18.0就是指linux kernel的版本。