Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
Accelerator
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Type
/
to search
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
fredatgithub
/
llama-cpp-python
Public
forked from
abetlen/llama-cpp-python
Notifications
You must be signed in to change notification settings
Fork
0
Star
0
Code
Pull requests
0
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Pull requests
Actions
Projects
Security and quality
Insights
Commits
Breadcrumbs
History for
llama-cpp-python
tests
on
main
User selector
All users
All time
Commit history
Commits on Jun 1, 2026
fix: clear prompt for recurrent / hybrid models when only a partial prefix matches (#2108)
Show description for cdb7a75
avion23
and
Ralf Waldukat
authored
cdb7a75
View commit details
Copy full SHA for cdb7a75
View code at this point
Browse repository at this point
Commits on May 8, 2026
fix: configure n_seq_max for batched embeddings (#2206)
Show description for 128c331
abetlen
authored
128c331
View commit details
Copy full SHA for 128c331
View code at this point
Browse repository at this point
Commits on May 4, 2026
fix(_internals): use n_tokens0 offset when enabling last-token logits in add_sequence (#2205)
Show description for 90e8df9
Anai-Guo
authored
90e8df9
View commit details
Copy full SHA for 90e8df9
View code at this point
Browse repository at this point
Commits on Mar 25, 2026
fix: handle embedding models without KV memory (#2160)
Show description for ac59e5a
abetlen
authored
ac59e5a
View commit details
Copy full SHA for ac59e5a
View code at this point
Browse repository at this point
Commits on Mar 23, 2026
fix: Qwen 3.5 support (#2152)
Show description for 11e7a55
abetlen
authored
11e7a55
View commit details
Copy full SHA for 11e7a55
View code at this point
Browse repository at this point
feat: Update llama.cpp to ggerganov/llama.cpp@49bfddeca18e62fa3d39114a23e9fcbdf8a22388 (#2151)
Show description for 18aa31e
abetlen
authored
18aa31e
View commit details
Copy full SHA for 18aa31e
View code at this point
Browse repository at this point
Commits on Mar 22, 2026
misc: Add Ruff formatting (#2148)
Show description for a9b4a06
abetlen
authored
a9b4a06
View commit details
Copy full SHA for a9b4a06
View code at this point
Browse repository at this point
Commits on Jul 5, 2025
fix: Update reference to in Llama.embed. Closes #2037
abetlen
committed
9e5a4ea
View commit details
Copy full SHA for 9e5a4ea
View code at this point
Browse repository at this point
Commits on Sep 19, 2024
fix: Fix memory allocation of ndarray (#1704)
Show description for 22cedad
xu-song
and
abetlen
authored
22cedad
View commit details
Copy full SHA for 22cedad
View code at this point
Browse repository at this point
feat: Update sampling API for llama.cpp (#1742)
Show description for f8fcb3e
abetlen
authored
f8fcb3e
View commit details
Copy full SHA for f8fcb3e
View code at this point
Browse repository at this point
Commits on Jun 4, 2024
fix: Avoid duplicate special tokens in chat formats (#1439)
Show description for 027f7bc
CISC
and
abetlen
authored
027f7bc
View commit details
Copy full SHA for 027f7bc
View code at this point
Browse repository at this point
Commits on Apr 30, 2024
feat: Update llama.cpp
abetlen
committed
97fb860
View commit details
Copy full SHA for 97fb860
View code at this point
Browse repository at this point
Commits on Feb 26, 2024
feat: Update llama.cpp
abetlen
committed
cbbcd88
View commit details
Copy full SHA for cbbcd88
View code at this point
Browse repository at this point
Commits on Feb 21, 2024
feat(low-level-api): Improve API static type-safety and performance (#1205)
abetlen
authored
7f51b60
View commit details
Copy full SHA for 7f51b60
View code at this point
Browse repository at this point
Commits on Feb 8, 2024
misc: rename grammar test
abetlen
committed
2ef7ba3
View commit details
Copy full SHA for 2ef7ba3
View code at this point
Browse repository at this point
Commits on Jan 31, 2024
Add speculative decoding (#1120)
Show description for fb762a6
abetlen
authored
fb762a6
View commit details
Copy full SHA for fb762a6
View code at this point
Browse repository at this point
Commits on Jan 29, 2024
Add chat format test.
abetlen
committed
9ae5819
View commit details
Copy full SHA for 9ae5819
View code at this point
Browse repository at this point
Commits on Jan 22, 2024
fix: from_json_schema oneof/anyof bug. Closes #1097
abetlen
committed
d3f5528
View commit details
Copy full SHA for d3f5528
View code at this point
Browse repository at this point
Commits on Jan 19, 2024
feat: Add ability to load chat format from huggingface autotokenizer or tokenizer_config.json files.
abetlen
committed
b8fc1c7
View commit details
Copy full SHA for b8fc1c7
View code at this point
Browse repository at this point
Commits on Jan 17, 2024
Integration of Jinja2 Templating (#875)
Show description for 6bfe98b
teleprint-me
authored
6bfe98b
View commit details
Copy full SHA for 6bfe98b
View code at this point
Browse repository at this point
Commits on Jan 15, 2024
Fix Pydantic model parsing (#1087)
DeNeutoy
authored
c689ccc
View commit details
Copy full SHA for c689ccc
View code at this point
Browse repository at this point
Commits on Dec 16, 2023
Fix logits_to_logprobs for 2-D and 3-D logits (#1002)
Show description for 5a89446
kddubey
authored
5a89446
View commit details
Copy full SHA for 5a89446
View code at this point
Browse repository at this point
Commits on Nov 22, 2023
tests: add mock_kv_cache placeholder functions
abetlen
committed
9515467
View commit details
Copy full SHA for 9515467
View code at this point
Browse repository at this point
tests: avoid constantly reallocating logits
abetlen
committed
0ea2444
View commit details
Copy full SHA for 0ea2444
View code at this point
Browse repository at this point
tests: don't mock sampling functions
abetlen
committed
0a7e05b
View commit details
Copy full SHA for 0a7e05b
View code at this point
Browse repository at this point
Commits on Nov 21, 2023
Use mock_llama for all tests
abetlen
committed
d7388f1
View commit details
Copy full SHA for d7388f1
View code at this point
Browse repository at this point
Do not set `grammar` to `None` for new `LlamaGrammar` objects (#834)
Show description for c21edb6
mthuurne
authored
c21edb6
View commit details
Copy full SHA for c21edb6
View code at this point
Browse repository at this point
tests: Improve llama.cpp mock
abetlen
committed
3dc21b2
View commit details
Copy full SHA for 3dc21b2
View code at this point
Browse repository at this point
Commits on Nov 20, 2023
Update llama.cpp
abetlen
committed
2c2afa3
View commit details
Copy full SHA for 2c2afa3
View code at this point
Browse repository at this point
Commits on Nov 10, 2023
Fix tests
abetlen
committed
e32ecb0
View commit details
Copy full SHA for e32ecb0
View code at this point
Browse repository at this point
Commits on Nov 6, 2023
Refactor Llama class internals
abetlen
committed
e214a58
View commit details
Copy full SHA for e214a58
View code at this point
Browse repository at this point
Commits on Nov 3, 2023
Migrate inference to llama_batch and llama_decode api (#795)
Show description for ab028cb
abetlen
and
antoine-lizee
authored
ab028cb
View commit details
Copy full SHA for ab028cb
View code at this point
Browse repository at this point
Commits on Nov 2, 2023
fix: tokenization of special characters: (#850)
Show description for 4d4e0f1
antoine-lizee
authored and
abetlen
committed
4d4e0f1
View commit details
Copy full SHA for 4d4e0f1
View code at this point
Browse repository at this point
Commits on Oct 19, 2023
Enable finish reason tests
abetlen
committed
ef03d77
View commit details
Copy full SHA for ef03d77
View code at this point
Browse repository at this point
Re-enable tests completion function
abetlen
committed
cbeef36
View commit details
Copy full SHA for cbeef36
View code at this point
Browse repository at this point
Previous
Next
You can’t perform that action at this time.