You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Add cli option to auto-format input text with config_sentence_transformers.json prompt settings (if provided) before toknizing.
Motivation
A lot of models now expect a prompt prefix so enabling the server-side handle of this allows clients to become model "model-agnostic". We have trouble changing between models since we must support the custom prompt for each specific model on the client side. Server side via config would remove this entriely.
Your contribution
Happy to do the PR myself just want to make sure this would be a welcome contribution