public

Repositories

3

Projects Packages

9

text-embeddings-inference (cpu-latest)

Published 2026-05-31 12:32:41 +00:00 by qwolff

Installation

Pull the image from the command line:

docker pull code.podesta.ai/public/text-embeddings-inference:cpu-latest

Digest

sha256:fff7c5e020a771257ac79b277faec9ab9bc7a33b2f38015fbf0f3471e3ae44d1

For more information on the Container registry, see the documentation.

About this package

A blazing fast inference solution for text embeddings models

Image layers

# debian.sh --arch 'amd64' out/ 'bookworm' '@1775433600'

ENV HUGGINGFACE_HUB_CACHE=/data PORT=80 MKL_ENABLE_INSTRUCTIONS=AVX512_E4 RAYON_NUM_THREADS=8 LD_PRELOAD=/usr/local/libfakeintel.so LD_LIBRARY_PATH=/usr/local/lib

RUN /bin/sh -c apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y --no-install-recommends libomp-dev ca-certificates libssl-dev curl && rm -rf /var/lib/apt/lists/* # buildkit

COPY /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_intel_lp64.so.2 /usr/local/lib/libmkl_intel_lp64.so.2 # buildkit

COPY /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_intel_thread.so.2 /usr/local/lib/libmkl_intel_thread.so.2 # buildkit

COPY /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_core.so.2 /usr/local/lib/libmkl_core.so.2 # buildkit

COPY /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_vml_def.so.2 /usr/local/lib/libmkl_vml_def.so.2 # buildkit

COPY /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_def.so.2 /usr/local/lib/libmkl_def.so.2 # buildkit

COPY /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_vml_avx2.so.2 /usr/local/lib/libmkl_vml_avx2.so.2 # buildkit

COPY /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_vml_avx512.so.2 /usr/local/lib/libmkl_vml_avx512.so.2 # buildkit

COPY /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_avx2.so.2 /usr/local/lib/libmkl_avx2.so.2 # buildkit

COPY /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_avx512.so.2 /usr/local/lib/libmkl_avx512.so.2 # buildkit

COPY /usr/src/libfakeintel.so /usr/local/libfakeintel.so # buildkit

COPY /usr/src/target/release/text-embeddings-router /usr/local/bin/text-embeddings-router # buildkit

ENTRYPOINT ["text-embeddings-router"]

CMD ["--json-output"]

Labels

Key	Value
org.opencontainers.image.created	2026-04-15T10:18:04.660Z
org.opencontainers.image.description	A blazing fast inference solution for text embeddings models
org.opencontainers.image.licenses	Apache-2.0
org.opencontainers.image.revision	5bc4d889c38cf9c75e63617d62779bc0f6628b23
org.opencontainers.image.source	https://github.com/huggingface/text-embeddings-inference
org.opencontainers.image.title	text-embeddings-inference
org.opencontainers.image.url	https://github.com/huggingface/text-embeddings-inference
org.opencontainers.image.version	cpu-latest

Details

Container

2026-05-31 12:32:41 +00:00

0

OCI / Docker

linux/amd64

Apache-2.0

Project website

Repository website

228 MiB

Versions (1) View all

cpu-latest 2026-05-31