DeepSpeed 搭建碰到的问题

 Windows 系统来做一些前沿开发,估计连微软自家的孩子们也都鄙视,在Win 11下搭建Deepspeed 环境,遇到

PS C:\WINDOWS\system32> pip install deepspeed
Collecting deepspeed
  Downloading deepspeed-0.9.0.tar.gz (764 kB)
     ---------------------------------------- 764.8/764.8 kB 530.6 kB/s eta 0:00:00
  Preparing metadata (setup.py) ... error
  error: subprocess-exited-with-error

  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> [13 lines of output]
      Traceback (most recent call last):
        File "", line 2, in
        File "", line 34, in
        File "C:\Users\xxx\AppData\Local\Temp\pip-install-00r36i09\deepspeed_c2d6830aa4af4aceac78cd26b4dd9a4e\setup.py", line 157, in
          abort(f"Unable to pre-compile {op_name}")
        File "C:\Users\xxx\AppData\Local\Temp\pip-install-00r36i09\deepspeed_c2d6830aa4af4aceac78cd26b4dd9a4e\setup.py", line 51, in abort
          assert False, msg
      AssertionError: Unable to pre-compile async_io
      DS_BUILD_OPS=1
      [93m [WARNING] [0m async_io requires the dev libaio .so object and headers but these were not found.
      [93m [WARNING] [0m If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
      [93m [WARNING] [0m One can disable async_io with DS_BUILD_AIO=0
      [31m [ERROR] [0m Unable to pre-compile async_io
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

找了GPT来帮助,仅提示了需要安装libaio。但事实上在Github项目下找到类似的问题,最终在windows上也没解决:

https://github.com/microsoft/DeepSpeed/issues/1401

你可能感兴趣的:(windows,linux,github)