llama3-8b
:When you push a ModelKit to Jozu Hub, we generate container definitions to simplify and speed deployment locally or to a shared environment.
For more information and examples of Kubernetes init containers and custom-built containers, please see our documentation.
Deployment Platform
Execute the command below to run this ModelKit Container with docker.
docker run -it --rm -p 8000:8000 "jozu.ml/jozu/llama3-8b/basic:8B-instruct-q5_0"