Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit history

Commits on Apr 26, 2024

• fix: pydantic deprecation warning

  abetlen

  committed
  fcfea66View commit details

  Copy full SHA for fcfea66

  View code at this pointBrowse repository at this point

Commits on Apr 23, 2024

• feat(server): Provide ability to dynamically allocate all threads if desired using `-1` (#1364)

  sean-bailey

  authored
  53ebcc8View commit details

  Copy full SHA for 53ebcc8

  View code at this pointBrowse repository at this point

Commits on Apr 17, 2024

• feat: add `disable_ping_events` flag (#1257)

  Show description for b73c73c
  khimaros

  authored
  b73c73cView commit details

  Copy full SHA for b73c73c

  View code at this pointBrowse repository at this point

• feat: Use all available CPUs for batch processing (#1345)

  

  ddh0

  authored and

  abetlen

  committed
  c96b2daView commit details

  Copy full SHA for c96b2da

  View code at this pointBrowse repository at this point

Commits on Apr 10, 2024

• feat: Add support for yaml based configs

  abetlen

  committed
  060bfa6View commit details

  Copy full SHA for 060bfa6

  View code at this pointBrowse repository at this point

Commits on Apr 1, 2024

• feat: add support for KV cache quantization options (#1307)

  Show description for f165048
  

  Limour-dev

  and

  abetlen

  authored
  f165048View commit details

  Copy full SHA for f165048

  View code at this pointBrowse repository at this point

Commits on Mar 31, 2024

• feat: Add logprobs support to chat completions (#1311)

  Show description for aa9f1ae
  

  windspirit95

  and

  abetlen

  authored
  aa9f1aeView commit details

  Copy full SHA for aa9f1ae

  View code at this pointBrowse repository at this point

Commits on Mar 23, 2024

• fix(server): minor type fixes

  abetlen

  committed
  d11ccc3View commit details

  Copy full SHA for d11ccc3

  View code at this pointBrowse repository at this point

Commits on Mar 19, 2024

• docs: Add chat examples to openapi ui

  abetlen

  committed
  f7decc9View commit details

  Copy full SHA for f7decc9

  View code at this pointBrowse repository at this point

Commits on Mar 9, 2024

• feat: Add endpoints for tokenize, detokenize and count tokens (#1136)

  Show description for c139f8b
  

  felipelo

  and

  abetlen

  authored
  c139f8bView commit details

  Copy full SHA for c139f8b

  View code at this pointBrowse repository at this point

Commits on Feb 28, 2024

• misc: Format

  abetlen

  committed
  727d60cView commit details

  Copy full SHA for 727d60c

  View code at this pointBrowse repository at this point

• feat: Update llama.cpp

  abetlen

  committed
  0d37ce5View commit details

  Copy full SHA for 0d37ce5

  View code at this pointBrowse repository at this point

Commits on Feb 26, 2024

• feat(server): Add support for pulling models from Huggingface Hub (#1222)

  Show description for 4d574bd
  abetlen

  authored
  4d574bdView commit details

  Copy full SHA for 4d574bd

  View code at this pointBrowse repository at this point

• fix: remove prematurely commited change

  abetlen

  committed
  dcf38f6View commit details

  Copy full SHA for dcf38f6

  View code at this pointBrowse repository at this point

Commits on Feb 25, 2024

• feat: Update llama.cpp

  abetlen

  committed
  2292af5View commit details

  Copy full SHA for 2292af5

  View code at this pointBrowse repository at this point

Commits on Feb 17, 2024

• feat: Update llama.cpp

  abetlen

  committed
  fdce078View commit details

  Copy full SHA for fdce078

  View code at this pointBrowse repository at this point

Commits on Feb 15, 2024

• fix: Use '\n' seperator for EventSourceResponse (#1188)

  Show description for ea1f88d
  

  khimaros

  and

  abetlen

  authored
  ea1f88dView commit details

  Copy full SHA for ea1f88d

  View code at this pointBrowse repository at this point

Commits on Feb 8, 2024

• fix: broken import

  abetlen

  committed
  85d3374View commit details

  Copy full SHA for 85d3374

  View code at this pointBrowse repository at this point

• feat: Integrate functionary v1.4 and v2 models + add custom tokenizer support to Llama class (#1078)

  Show description for 9018270
  

  jeffrey-fong

  and

  abetlen

  authored
  9018270View commit details

  Copy full SHA for 9018270

  View code at this pointBrowse repository at this point

Commits on Jan 31, 2024

• Add speculative decoding (#1120)

  Show description for fb762a6
  abetlen

  authored
  fb762a6View commit details

  Copy full SHA for fb762a6

  View code at this pointBrowse repository at this point

Commits on Jan 29, 2024

• Automatically set chat format from gguf (#1110)

  Show description for da003d8
  abetlen

  authored
  da003d8View commit details

  Copy full SHA for da003d8

  View code at this pointBrowse repository at this point

Commits on Jan 25, 2024

• feat(server): include llama-cpp-python version in openapi spec

  abetlen

  committed
  cde7514View commit details

  Copy full SHA for cde7514

  View code at this pointBrowse repository at this point

Commits on Jan 21, 2024

• fix: pass chat handler not chat formatter for huggingface autotokenizer and tokenizer_config formats.

  abetlen

  committed
  24f3945View commit details

  Copy full SHA for 24f3945

  View code at this pointBrowse repository at this point

Commits on Jan 19, 2024

• Fix python3.8 support

  abetlen

  committed
  141293aView commit details

  Copy full SHA for 141293a

  View code at this pointBrowse repository at this point

• feat: Add ability to load chat format from huggingface autotokenizer or tokenizer_config.json files.

  abetlen

  committed
  b8fc1c7View commit details

  Copy full SHA for b8fc1c7

  View code at this pointBrowse repository at this point

Commits on Jan 18, 2024

• Offload KQV by default

  abetlen

  committed
  48c3b77View commit details

  Copy full SHA for 48c3b77

  View code at this pointBrowse repository at this point

Commits on Jan 16, 2024

• fix(cli): allow passing n_ctx=0 to openAI API server args to use model n_ctx_train field per #1015 (#1093)

  K-Mistele

  authored
  9c36688View commit details

  Copy full SHA for 9c36688

  View code at this pointBrowse repository at this point

• Support Accept text/event-stream in chat and completion endpoints, resolves #1083 (#1088)

  Show description for cfb7da9
  

  3 peopleauthored
  cfb7da9View commit details

  Copy full SHA for cfb7da9

  View code at this pointBrowse repository at this point

Commits on Jan 15, 2024

• Add split_mode option. Closes #1085

  abetlen

  committed
  84615adView commit details

  Copy full SHA for 84615ad

  View code at this pointBrowse repository at this point

• Implement GGUF metadata KV overrides (#1011)

  Show description for 76aafa6
  

  phiharri

  and

  abetlen

  authored
  76aafa6View commit details

  Copy full SHA for 76aafa6

  View code at this pointBrowse repository at this point

Commits on Dec 22, 2023

• docs: add server config docs

  abetlen

  committed
  522aecbView commit details

  Copy full SHA for 522aecb

  View code at this pointBrowse repository at this point

• server: Support none defaulting to infinity for completions (#111)

  Show description for 4b01a87
  

  swg

  and

  abetlen

  authored
  4b01a87View commit details

  Copy full SHA for 4b01a87

  View code at this pointBrowse repository at this point

• [Feat] Multi model support (#931)

  Show description for 12b7f2f
  

  D4ve-R

  and

  abetlen

  authored
  12b7f2fView commit details

  Copy full SHA for 12b7f2f

  View code at this pointBrowse repository at this point

Commits on Dec 21, 2023

• Implement openai api compatible authentication (#1010)

  docmeth02

  authored
  33cc623View commit details

  Copy full SHA for 33cc623

  View code at this pointBrowse repository at this point

Commits on Dec 18, 2023

• Add offload_kqv option to llama and server

  abetlen

  committed
  095c650View commit details

  Copy full SHA for 095c650

  View code at this pointBrowse repository at this point