Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
Accelerator
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Type
/
to search
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
fredatgithub
/
llama-cpp-python
Public
forked from
abetlen/llama-cpp-python
Notifications
You must be signed in to change notification settings
Fork
0
Star
0
Code
Pull requests
0
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Pull requests
Actions
Projects
Security and quality
Insights
Commits
Breadcrumbs
History for
llama-cpp-python
examples
on
main
User selector
All users
All time
Commit history
Commits on Jun 9, 2026
feat(example): support server video inputs and Gemma text tool calls (#2291)
Show description for 051dda2
abetlen
authored
051dda2
View commit details
Copy full SHA for 051dda2
View code at this point
Browse repository at this point
Commits on Jun 8, 2026
fix(example): correct GPT-OSS tool calling config for server example (#2289)
abetlen
authored
e8191f0
View commit details
Copy full SHA for e8191f0
View code at this point
Browse repository at this point
fix(example): support multi-step Responses tool streaming (#2288)
Show description for d4ac2c2
abetlen
authored
d4ac2c2
View commit details
Copy full SHA for d4ac2c2
View code at this point
Browse repository at this point
fix(example): derive streaming response parser boundaries from schema (#2287)
abetlen
authored
411e0f4
View commit details
Copy full SHA for 411e0f4
View code at this point
Browse repository at this point
fix(example): avoid duplicate streamed response deltas (#2285)
abetlen
authored
a72325b
View commit details
Copy full SHA for a72325b
View code at this point
Browse repository at this point
Commits on Jun 7, 2026
feat(example): align server MTP support with llama.cpp (#2283)
Show description for fddee27
abetlen
authored
fddee27
View commit details
Copy full SHA for fddee27
View code at this point
Browse repository at this point
feat(example): add OpenAI-compatible embeddings endpoint (#2281)
Show description for fe927bd
abetlen
authored
fe927bd
View commit details
Copy full SHA for fe927bd
View code at this point
Browse repository at this point
feat: update llama.cpp to ggml-org/llama.cpp@465b1f0e7 (#2278)
abetlen
authored
cf18830
View commit details
Copy full SHA for cf18830
View code at this point
Browse repository at this point
feat(example): Updated server example (batch processing, `/v1/responses` api, response parsing) (#2174)
Show description for 66635a0
abetlen
authored
66635a0
View commit details
Copy full SHA for 66635a0
View code at this point
Browse repository at this point
Commits on Jun 6, 2026
docs: add Gemma 4 QAT Colab notebook (#2276)
Show description for 7f16fe1
abetlen
authored
7f16fe1
View commit details
Copy full SHA for 7f16fe1
View code at this point
Browse repository at this point
Commits on Jun 5, 2026
docs: fix Gemma 4 Colab notebook (#2275)
Show description for 7a2a36d
abetlen
authored
7a2a36d
View commit details
Copy full SHA for 7a2a36d
View code at this point
Browse repository at this point
docs: add Gemma 4 Colab notebook (#2274)
abetlen
authored
8949066
View commit details
Copy full SHA for 8949066
View code at this point
Browse repository at this point
Commits on Apr 3, 2026
fix(misc): replace deprecated llama.cpp references (#2170)
Show description for 08e088c
abetlen
authored
08e088c
View commit details
Copy full SHA for 08e088c
View code at this point
Browse repository at this point
Commits on Mar 23, 2026
fix: Qwen 3.5 support (#2152)
Show description for 11e7a55
abetlen
authored
11e7a55
View commit details
Copy full SHA for 11e7a55
View code at this point
Browse repository at this point
Commits on Dec 6, 2024
fix(examples): Refactor Batching notebook to use new sampler chain API (#1793)
Show description for d610477
lukestanley
authored
d610477
View commit details
Copy full SHA for d610477
View code at this point
Browse repository at this point
Commits on Jul 9, 2024
fix(misc): Format
abetlen
committed
c1ae815
View commit details
Copy full SHA for c1ae815
View code at this point
Browse repository at this point
Commits on Jun 13, 2024
feat: Support SPM infill (#1492)
Show description for dbcf64c
CISC
and
abetlen
authored
dbcf64c
View commit details
Copy full SHA for dbcf64c
View code at this point
Browse repository at this point
Commits on May 17, 2024
example: LLM inference with Ray Serve (#1465)
rgerganov
authored
03f171e
View commit details
Copy full SHA for 03f171e
View code at this point
Browse repository at this point
Commits on Apr 28, 2024
examples: fix quantize example (#1387)
Show description for e6bbfb8
iyubondyrev
authored
e6bbfb8
View commit details
Copy full SHA for e6bbfb8
View code at this point
Browse repository at this point
Commits on Apr 10, 2024
feat: Add support for yaml based configs
abetlen
committed
060bfa6
View commit details
Copy full SHA for 060bfa6
View code at this point
Browse repository at this point
Commits on Feb 26, 2024
docs: Update multimodal example
abetlen
committed
79c649c
View commit details
Copy full SHA for 79c649c
View code at this point
Browse repository at this point
docs: Update multimodal example
abetlen
committed
bf315ee
View commit details
Copy full SHA for bf315ee
View code at this point
Browse repository at this point
docs(examples): Add huggingface pull example
abetlen
committed
252e1ff
View commit details
Copy full SHA for 252e1ff
View code at this point
Browse repository at this point
docs(examples): Add gradio chat example
abetlen
committed
bd4ec2e
View commit details
Copy full SHA for bd4ec2e
View code at this point
Browse repository at this point
Commits on Feb 23, 2024
docs: Update Functionary OpenAI Server Readme (#1193)
Show description for bce6dc0
jeffrey-fong
authored
bce6dc0
View commit details
Copy full SHA for bce6dc0
View code at this point
Browse repository at this point
Commits on Feb 12, 2024
feat: Generic chatml Function Calling (#957)
Show description for 153a004
abetlen
authored
153a004
View commit details
Copy full SHA for 153a004
View code at this point
Browse repository at this point
Commits on Jan 31, 2024
fix: Run server command. Closes #1143
abetlen
committed
2b37d8e
View commit details
Copy full SHA for 2b37d8e
View code at this point
Browse repository at this point
Commits on Jan 15, 2024
Fix low_level_api_chat_cpp example to match current API (#1086)
Show description for 1eaace8
aniljava
and
Anil Pathak
authored
1eaace8
View commit details
Copy full SHA for 1eaace8
View code at this point
Browse repository at this point
Commits on Dec 18, 2023
Update low_level_api_llama_cpp.py to match current API (#1023)
jsoma
authored
cfd698c
View commit details
Copy full SHA for cfd698c
View code at this point
Browse repository at this point
Commits on Nov 20, 2023
bug fixing (#925)
zocainViken
authored
6dde6bd
View commit details
Copy full SHA for 6dde6bd
View code at this point
Browse repository at this point
Commits on Nov 10, 2023
Update Functions notebook
abetlen
committed
74167bd
View commit details
Copy full SHA for 74167bd
View code at this point
Browse repository at this point
Update Functions notebook example
abetlen
committed
85ead98
View commit details
Copy full SHA for 85ead98
View code at this point
Browse repository at this point
Update functionary for new OpenAI API
abetlen
committed
1b376c6
View commit details
Copy full SHA for 1b376c6
View code at this point
Browse repository at this point
Commits on Nov 8, 2023
Update Multimodal notebook
abetlen
committed
598780f
View commit details
Copy full SHA for 598780f
View code at this point
Browse repository at this point
Multimodal Support (Llava 1.5) (#821)
Show description for aab74f0
damian0815
and
abetlen
authored
aab74f0
View commit details
Copy full SHA for aab74f0
View code at this point
Browse repository at this point
Previous
Next
You can’t perform that action at this time.