Image-Text-to-Text
Transformers
Safetensors
kimi_k3
feature-extraction
compressed-tensors
custom_code
Instructions to use moonshotai/Kimi-K3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries TransformersHow to use moonshotai/Kimi-K3 with Transformers:
from transformers import pipeline
pipe = pipeline("image-text-to-text", model="moonshotai/Kimi-K3", trust_remote_code=True)
python
from transformers import AutoModel
model = AutoModel.from_pretrained("moonshotai/Kimi-K3", trust_remote_code=True, device_map="auto")
- Notebooks Google ColabKaggle- Local Apps Settings vLLMHow to use moonshotai/Kimi-K3 with vLLM:
Install from pip and serve model
pip install vllm
vllm serve "moonshotai/Kimi-K3"
curl -X POST "http://localhost:8000/v1/completions" \
-H "Content-Type: application/json" \
--data '{
"model": "moonshotai/Kimi-K3",
"prompt": "Once upon a time,",
"max_tokens": 512,
"temperature": 0.5
}'
Use Docker
docker model run hf.co/moonshotai/Kimi-K3
SGLangHow to use moonshotai/Kimi-K3 with SGLang:
Install from pip and serve model
pip install sglang
python3 -m sglang.launch_server \
--model-path "moonshotai/Kimi-K3" \
--host 0.0.0.0 \
--port 30000
curl -X POST "http://localhost:30000/v1/completions" \
-H "Content-Type: application/json" \
--data '{
"model": "moonshotai/Kimi-K3",
"prompt": "Once upon a time,",
"max_tokens": 512,
"temperature": 0.5
}'
Use Docker images
docker run --gpus all \
--shm-size 32g \
-p 30000:30000 \
-v ~/.cache/huggingface:/root/.cache/huggingface \
--env "HF_TOKEN=<secret>" \
--ipc=host \
lmsysorg/sglang:latest \
python3 -m sglang.launch_server \
--model-path "moonshotai/Kimi-K3" \
--host 0.0.0.0 \
--port 30000
curl -X POST "http://localhost:30000/v1/completions" \
-H "Content-Type: application/json" \
--data '{
"model": "moonshotai/Kimi-K3",
"prompt": "Once upon a time,",
"max_tokens": 512,
"temperature": 0.5
}'
Docker Model RunnerHow to use moonshotai/Kimi-K3 with Docker Model Runner:
docker model run hf.co/moonshotai/Kimi-K3
| Kimi K3 License | | | Copyright (c) 2026 Moonshot AI | | | Permission is hereby granted, free of charge, to any person (the "Licensee") | | | obtaining a copy of this software — including the model weights, parameters, | | | configuration files, inference and training code, and associated documentation | | | (collectively, the "Software") — to deal in the Software without restriction. | | | This includes, without limitation, the rights to use, copy, modify, merge, | | | publish, distribute, sublicense, and/or sell copies of the Software; to run, | | | deploy, fine-tune, or otherwise modify the Software and create derivative works | | | from it; and to permit persons to whom the Software is furnished to do so, in | | | each case subject to the following conditions: | | | 1. The above copyright notice and this permission notice shall be included in | | | all copies or substantial portions of the Software. Licensee's use of the | | | Software must comply with applicable laws and regulations. | | | 2. "Model as a Service" means giving a third party access to language model | | | inference or fine-tuning (e.g., via API) in a manner that allows such third | | | party to exercise meaningful control over the inputs, parameters, or training | | | data. This does not include (a) end-user products with model capabilities solely | | | embedded within specific features or harnesses, or (b) mere relaying of requests | | | to models hosted by others. | | | If the Licensee or any of its affiliates operates a Model as a Service business, | | | and the aggregate revenue of the Licensee and its affiliates exceeds 20 million | | | US dollars (or the equivalent in other currencies) in total over any consecutive | | | 12 months, the Licensee must enter into a separate agreement with Moonshot AI | | | before using the Software or its derivative works for any commercial purpose. | | | 3. If the Software (or any derivative works thereof) is used for any of the | | | Licensee's commercial products or services that have more than 100 million | | | monthly active users, or more than 20 million US dollars (or equivalent in other | | | currencies) in monthly revenue, "Kimi K3" must be prominently displayed on the | | | user interface of such product or service. | | | 4. The requirements set forth in Sections 2 and 3 do not apply to: (a) internal | | | use of the Software, defined as any use that does not make the Software, its | | | outputs, or its underlying capabilities available to third parties; or (b) any | | | use of the Software accessed through Moonshot AI's official products or | | | certified inference partners. | | | 5. THE SOFTWARE AND ANY OUTPUT AND RESULTS THEREFROM ARE PROVIDED ON AN “AS IS” | | | BASIS, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT | | | LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE | | | AND NONINFRINGEMENT. IN NO EVENT SHALL MOONSHOT AI OR ITS AFFILIATES OR | | | COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER | | | IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN | | | CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE. | | | For any questions regarding this license, please contact license@moonshot.ai. |