lyang

请教, torchrun 多卡启动大模型,可以用 fastapi 调用吗

  •  
  •   lyang · May 17, 2024 · 1157 views
    This topic created in 762 days ago, the information mentioned may be changed or developed.

    如题,可以把 fastapi 写进代码里面,torchrun 调用吗

    还是通过 torchrun 读取数据库接口等信息,fastapi 写入数据库读取结果

    No Comments Yet
    About   ·   Help   ·   Advertise   ·   Blog   ·   API   ·   FAQ   ·   Solana   ·   1034 Online   Highest 6679   ·     Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 · 29ms · UTC 18:20 · PVG 02:20 · LAX 11:20 · JFK 14:20
    ♥ Do have faith in what you're doing.