text-embeddings-inference (cpu-latest)
Published 2026-07-06 04:01:50 +00:00 by qwolff
Installation
docker pull code.podesta.ai/public/text-embeddings-inference:cpu-latestsha256:e41eb76c5cca73ad3d6a888eca7680494249547ef38d22eb461321299bde3632About this package
A blazing fast inference solution for text embeddings models
Image layers
| # debian.sh --arch 'amd64' out/ 'bookworm' '@1781049600' |
| ENV HUGGINGFACE_HUB_CACHE=/data PORT=80 MKL_ENABLE_INSTRUCTIONS=AVX512_E4 RAYON_NUM_THREADS=8 LD_PRELOAD=/usr/local/libfakeintel.so LD_LIBRARY_PATH=/usr/local/lib |
| RUN /bin/sh -c apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y --no-install-recommends libomp-dev ca-certificates libssl-dev curl && rm -rf /var/lib/apt/lists/* # buildkit |
| COPY /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_intel_lp64.so.2 /usr/local/lib/libmkl_intel_lp64.so.2 # buildkit |
| COPY /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_intel_thread.so.2 /usr/local/lib/libmkl_intel_thread.so.2 # buildkit |
| COPY /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_core.so.2 /usr/local/lib/libmkl_core.so.2 # buildkit |
| COPY /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_vml_def.so.2 /usr/local/lib/libmkl_vml_def.so.2 # buildkit |
| COPY /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_def.so.2 /usr/local/lib/libmkl_def.so.2 # buildkit |
| COPY /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_vml_avx2.so.2 /usr/local/lib/libmkl_vml_avx2.so.2 # buildkit |
| COPY /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_vml_avx512.so.2 /usr/local/lib/libmkl_vml_avx512.so.2 # buildkit |
| COPY /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_avx2.so.2 /usr/local/lib/libmkl_avx2.so.2 # buildkit |
| COPY /opt/intel/oneapi/mkl/latest/lib/intel64/libmkl_avx512.so.2 /usr/local/lib/libmkl_avx512.so.2 # buildkit |
| COPY /usr/src/libfakeintel.so /usr/local/libfakeintel.so # buildkit |
| COPY /usr/src/target/release/text-embeddings-router /usr/local/bin/text-embeddings-router # buildkit |
| ENTRYPOINT ["text-embeddings-router"] |
| CMD ["--json-output"] |
Labels
| Key | Value |
|---|---|
| org.opencontainers.image.created | 2026-06-22T18:34:49.788Z |
| org.opencontainers.image.description | A blazing fast inference solution for text embeddings models |
| org.opencontainers.image.licenses | Apache-2.0 |
| org.opencontainers.image.revision | f9a0643efb091b2a95dd40f22ce82c5d30b04205 |
| org.opencontainers.image.source | https://github.com/huggingface/text-embeddings-inference |
| org.opencontainers.image.title | text-embeddings-inference |
| org.opencontainers.image.url | https://github.com/huggingface/text-embeddings-inference |
| org.opencontainers.image.version | cpu-latest |
Details
2026-07-06 04:01:50 +00:00
Versions (1)
View all
Container
0
OCI / Docker
linux/amd64
Apache-2.0
228 MiB
cpu-latest
2026-07-06