Code

Parallel batched requests#3

Code

Merged

Contextualist merged 1 commit intomainContextualist/lone-arena:mainfrom feat-generate-batchContextualist/lone-arena:feat-generate-batchCopy head branch name to clipboardFeb 5, 2024

+51-15

Commits

Commits on Feb 5, 2024

• Add batching of prompt requests per model.

  Show description for a4cea86
  

  bjj

  authored and

  Contextualist

  committed
  a4cea86

  Copy full SHA for a4cea86