FastChat
Quick Start Guide
Note: AI_MODEL should stay default
unless there is a folder in prompts
specific to the model that you're using. You can also create one and add your own prompts.
Update your agent settings
- Set
AI_MODEL
tovicuna
for Vicuna. - Set
AI_PROVIDER_URI
tohttp://localhost:8000
, or the URI of your FastChat server. - Set
MODEL_PATH
to the path of your model (for docker containersmodels/
is mapped to/model
)