DistilGPT-2 Model Kit

This ModelKit contains DistilGPT-2, a lightweight language model suitable for text generation tasks.

Model Details

• Model: DistilGPT-2
• Size: ~350MB
• Architecture: GPT-2 distilled
• Use Case: Text generation, completion

Usage with VLLM

python -m vllm.entrypoints.openai.api_server \
  --model ./distilgpt2 \
  --host 0.0.0.0 \
  --port 8000