Go to home
Back
2
1

tinyllama-vllm

:

Use the Pull Tag button to download this ModelKit.

Or, read our KitOps documentation to learn how to use kit unpack --filter to download only the components you need.

ModelKit Tag Metadata
Digest
Author
oyedele temitope
Date added
Size
2.6MB
Total pulls
2
Package
Name
tinyllama-vllm
Version
1.0.0
Authors
oyedele temitope
Description
TinyLlama 1.1B Chat model with vLLM serving
Model
Name
tinyllama-chat
Path
./model
License
N/A
Parts
N/A
Parameters
N/A
Codebases
./serve.py
vLLM FastAPI serving wrapper
./requirements.txt
Python dependencies
Docs
./README.md
Deployment instructions