Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
Accelerator
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Type
/
to search
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
AmesianX
/
llama-cpp-python
Public
forked from
abetlen/llama-cpp-python
Notifications
You must be signed in to change notification settings
Fork
0
Star
0
Code
Pull requests
0
Projects
Security and quality
0
Insights
Additional navigation options
Code
Pull requests
Projects
Security and quality
Insights
Commits
Branch selector
main
User selector
All users
All time
Commit history
Commits on Mar 30, 2026
feat(server): add model-load chat_template_kwargs (#2168)
abetlen
authored
7257ba9
View commit details
Copy full SHA for 7257ba9
Browse repository at this point
Commits on Mar 29, 2026
ci: publish release wheels as py3-none (#2166)
Show description for 7613aca
abetlen
authored
7613aca
View commit details
Copy full SHA for 7613aca
Browse repository at this point
fix(ci): publish distinct manylinux and musllinux cpu wheels (#2165)
Show description for fcd932a
abetlen
authored
fcd932a
View commit details
Copy full SHA for fcd932a
Browse repository at this point
Commits on Mar 25, 2026
Bump version to 0.3.19 (#2162)
abetlen
authored
f54421b
View commit details
Copy full SHA for f54421b
Browse repository at this point
feat: Update llama.cpp to ggerganov/llama.cpp@c0159f9c1f874da15e94f371d136f5920b4b5335 (#2161)
Show description for c670222
abetlen
authored
c670222
View commit details
Copy full SHA for c670222
Browse repository at this point
fix: handle embedding models without KV memory (#2160)
Show description for ac59e5a
abetlen
authored
ac59e5a
View commit details
Copy full SHA for ac59e5a
Browse repository at this point
fix(ci): reduce CUDA binary wheel size only including cubins for current arches and one PTX target for forward compatibility (#2158)
Show description for 5f9c231
abetlen
authored
5f9c231
View commit details
Copy full SHA for 5f9c231
Browse repository at this point
Commits on Mar 24, 2026
chore: bump version (#2157)
abetlen
authored
d6f46a5
View commit details
Copy full SHA for d6f46a5
Browse repository at this point
feat: expose attention_type parameter in Llama.__init__ (#2143)
Show description for 7b38c31
3 people
authored
7b38c31
View commit details
Copy full SHA for 7b38c31
Browse repository at this point
fix(ci): docker build workflow (#2156)
Show description for ccc6bc0
abetlen
authored
ccc6bc0
View commit details
Copy full SHA for ccc6bc0
Browse repository at this point
fix(ci): cuda wheel workflow (#2155)
Show description for 909ebf1
abetlen
authored
909ebf1
View commit details
Copy full SHA for 909ebf1
Browse repository at this point
fix(ci): release wheel workflow (#2154)
Show description for f0391c5
abetlen
authored
f0391c5
View commit details
Copy full SHA for f0391c5
Browse repository at this point
Commits on Mar 23, 2026
chore: Bump version (#2153)
abetlen
authored
a6b1807
View commit details
Copy full SHA for a6b1807
Browse repository at this point
fix: Qwen 3.5 support (#2152)
Show description for 11e7a55
abetlen
authored
11e7a55
View commit details
Copy full SHA for 11e7a55
Browse repository at this point
ci: add riscv64 wheel builds to release workflow (#2139)
Show description for e1f8ac0
gounthar
and
abetlen
authored
e1f8ac0
View commit details
Copy full SHA for e1f8ac0
Browse repository at this point
feat: Update llama.cpp to ggerganov/llama.cpp@49bfddeca18e62fa3d39114a23e9fcbdf8a22388 (#2151)
Show description for 18aa31e
abetlen
authored
18aa31e
View commit details
Copy full SHA for 18aa31e
Browse repository at this point
Commits on Mar 22, 2026
misc: Add Ruff formatting (#2148)
Show description for a9b4a06
abetlen
authored
a9b4a06
View commit details
Copy full SHA for a9b4a06
Browse repository at this point
fix(ci): Fix macos tests, support both Intel and Apple Silicon testing (#2150)
Show description for 9f661ff
abetlen
authored
9f661ff
View commit details
Copy full SHA for 9f661ff
Browse repository at this point
fix(ci): Rename `huggingface-cli` to `hf` (#2149)
Show description for ca3b00a
abetlen
authored
ca3b00a
View commit details
Copy full SHA for ca3b00a
Browse repository at this point
Commits on Aug 15, 2025
chore: Bump version
abetlen
committed
c37132b
View commit details
Copy full SHA for c37132b
Browse repository at this point
feat: Update llama.cpp
abetlen
committed
ce6fd8b
View commit details
Copy full SHA for ce6fd8b
Browse repository at this point
Commits on Aug 7, 2025
chore: Bump version
abetlen
committed
dfc9bf5
View commit details
Copy full SHA for dfc9bf5
Browse repository at this point
fix: rename op_offloat to op_offload in llama.py (#2046)
sergey21000
authored
30ddd56
View commit details
Copy full SHA for 30ddd56
Browse repository at this point
feat: Add gpt-oss chat format support through strftime_now in chat format by @iamlemec
abetlen
committed
af63792
View commit details
Copy full SHA for af63792
Browse repository at this point
misc: Add Python 3.13 classifier tag
abetlen
committed
68e89e8
View commit details
Copy full SHA for 68e89e8
Browse repository at this point
misc: Update pypi downloads badge
abetlen
committed
d12ca47
View commit details
Copy full SHA for d12ca47
Browse repository at this point
feat: Update llama.cpp
abetlen
committed
4f26028
View commit details
Copy full SHA for 4f26028
Browse repository at this point
Commits on Jul 18, 2025
chore: Bump version
abetlen
committed
e1af05f
View commit details
Copy full SHA for e1af05f
Browse repository at this point
Commits on Jul 16, 2025
feat: Update llama.cpp
abetlen
committed
95292e3
View commit details
Copy full SHA for 95292e3
Browse repository at this point
Commits on Jul 15, 2025
chore: Bump version
abetlen
committed
d9749cb
View commit details
Copy full SHA for d9749cb
Browse repository at this point
fix: Better chat format for Qwen2.5-VL (#2040)
alcoftTAO
authored
c8579d7
View commit details
Copy full SHA for c8579d7
Browse repository at this point
feat: Update llama.cpp
abetlen
committed
a99fd21
View commit details
Copy full SHA for a99fd21
Browse repository at this point
Commits on Jul 6, 2025
fix(ci): Fix macos cpu builds
abetlen
committed
cce4887
View commit details
Copy full SHA for cce4887
Browse repository at this point
chore: Bump version
abetlen
committed
8866fbd
View commit details
Copy full SHA for 8866fbd
Browse repository at this point
fix(ci): Temporarily disable windows cuda wheels
abetlen
committed
98fda8c
View commit details
Copy full SHA for 98fda8c
Browse repository at this point
Previous
Next
You can’t perform that action at this time.