Skip to content
View avifenesh's full-sized avatar
🦥
Just hanging around
🦥
Just hanging around

Highlights

  • Pro

Organizations

@aws @amazon-contributing @valkey-io

Block or report avifenesh

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
avifenesh/README.md

Hey, I'm Avi 👋

I like machines close to the metal and results you can measure. By day I build in-memory data systems at AWS ElastiCache; the rest of the time I train and compress small fast models, write CUDA, and maintain open-source tools people actually run.

Research notes and working papers live at avifenesh.ai. Issues, questions, and counterexamples are always welcome.

ML research

  • bw24 — from-scratch Rust + CUDA inference engine for one Blackwell GPU. Bit-exact by construction; runs four model families above llama.cpp on the same rig, plain and speculative decode both.
  • hqmtp — MTP draft-head lab. A 212M drafter distilled to 85% of its teacher's chain acceptance at ~13% of the draft compute. The negative results stay in the ledger.
  • Working papers: small-vocabulary MTP heads · prune, heal, quantize — methods, failed arms, and evidence in the open.
  • In review upstream: NVFP4 quantization at llama.cpp, hybrid-KV loads at vLLM and LMCache.

Maintaining

  • Valkey GLIDE — the official multi-language Valkey/Redis client. Rust core, Java/JNI, Node/N-API; 131 PRs authored, 410 reviewed, plus releases and the support that starts after the code works.
  • valkey-skills — official AI skills for the Valkey ecosystem. Started it, maintain it.
  • agent-sh — my org: an ecosystem of tools for agent-assisted development, working across Claude Code, Codex, OpenCode, Cursor, and Kiro.
  • glide-mq — Node.js queue on Valkey Streams with a Rust N-API core, plus adapters for Hono, Fastify, Hapi, NestJS and a dashboard.
  • Also around: RustOwl (runtime, memory, and CI work) and ChatGPT Desktop for Linux (Wayland input, accessibility, packaging).

Systems

  • Valkey — core contributor; sync-from-replica replication in review. On the side: CRIU copy-on-write live-migration research — under 50 ms of freeze while migrating a 200 GB loaded instance.
  • FlowFabric — durable-execution engine in Rust for Valkey, Postgres, and SQLite: lease-safe workers, waitpoints, budgets.
  • layout-audit — DWARF memory-layout analysis: padding, layout diffs, size budgets for C/C++/Rust/Go.
  • scrump — format-aware secret scrubber for binary capture artifacts: perf.data, core dumps, nsys traces, JFR.
  • ocaml-valkey — OCaml 5 + Eio Valkey client, published on opam.

Agents

  • agnix — linter and language server for AI agent configs: 432 rules with autofixes, a GitHub Action, an MCP server, and editor plugins.
  • computer-use-linux / agent-workspace-linux — Linux desktop control over MCP, and isolated agent-owned desktops so an agent never has to touch your real machine.
  • eigen — local agent daemon in Go: resumable sessions, multi-provider routing, memory, observability.

Elsewhere

If something here saved you time, sponsoring helps me keep doing it.

Pinned Loading

  1. bw24 bw24 Public

    From-scratch Rust+CUDA inference engine, bit-exact by construction — NVFP4, MoE, MTP speculative decoding, tuned against measured limits of one RTX 5090 Laptop (sm_120a).

    Rust 264 31

  2. hqmtp hqmtp Public

    MTP draft-head research harness for Qwen3.5-9B: StudentSV compact drafter, chain distillation to 85% of teacher acceptance at 13% of draft compute, and the negative-result ledgers behind it. Measur…

    Python 1

  3. agent-sh/agnix agent-sh/agnix Public

    The missing linter and lsp for AI coding assistants. Validate CLAUDE.md, AGENTS.md, SKILL.md, hooks, MCP. Plugin for all major IDEs included, with autofixes.

    Rust 342 29

  4. agent-sh/agent-workspace-linux agent-sh/agent-workspace-linux Public

    Isolated Linux desktop workspaces for AI agents — a hidden, agent-owned desktop and browser over MCP, so an agent can do GUI and web work without touching your real desktop.

    Rust 69 7

  5. glide-mq glide-mq Public

    High-performance message queue for Node.js — Valkey/Redis Streams with Rust-native NAPI bindings

    TypeScript 92 1

  6. agent-sh/computer-use-linux agent-sh/computer-use-linux Public

    Linux desktop control over MCP — AT-SPI, GNOME Shell, Wayland portals, ydotool

    Rust 270 31