quant.cpp (latest)

Published 2026-04-08 21:48:37 +00:00 by imagebuilder

Installation

docker pull git.lukko.de/lukko.de/quant.cpp:latest
sha256:626b3212bbb6e02ad23b5fc99125e6faa2bf6580a2474c3773a8e040f0f6ba06

About this package

LLM inference with 7x longer context — pure C, zero dependencies

Image layers

ADD alpine-minirootfs-3.20.9-x86_64.tar.gz / # buildkit
CMD ["/bin/sh"]
COPY --from=builder /src/build/quant /usr/local/bin/quant
COPY --from=builder /src/build/quant-server /usr/local/bin/quant-server
RUN mkdir -p /models

Labels

Key Value
com.lukko.build.fingerprint 89f9e6e3c36a3479
com.lukko.build.imagename quant.cpp
org.opencontainers.image.description LLM inference with 7x longer context — pure C, zero dependencies
org.opencontainers.image.revision 4d8952c4d5fe1b636d22fdb3dd6e4efd467f5485
org.opencontainers.image.source https://github.com/quantumaikr/quant.cpp
org.opencontainers.image.title quant.cpp
Details
Container
2026-04-08 21:48:37 +00:00
0
OCI / Docker
linux/amd64
4.9 MiB
Versions (2) View all
latest 2026-04-08
89f9e6e3c36a3479 2026-04-08