chat_prompt_templates
1.0.0
Collection of Basic Prompt Templates for Various Chat LLMs | Chat LLM 的基础提示模板集合
Motivation: The basic prompt template will significantly affect the effectiveness of instruction following. Models of different architectures may use different prompt templates during training. However, at present, these templates can be challenging to locate; sometimes they are embedded in example codes, hidden within GitHub issues, or occasionally found in official blogs...
动机: 基础提示模板会显著影响指令跟随的效果。不同架构的模型在训练时可能使用不同的提示模板。然而，目前这些模板往往难以找到；有时它们嵌入在示例代码中，有时隐藏在 GitHub 问题中，有时偶尔在官方博客中发现...
Note
Chat Markup Language is the mainstream, eg. HuggingFace's transformers, OpenAI's tiktoken.
Chat Markup Language 是主流格式，例如 HuggingFace's transformers, OpenAI's tiktoken。
(Alphabetical order by architecture)
（按架构名称的字典序排列）
template = """<reserved_195>{query}<reserved_196>"""template = """<|system|>
You are ChatGLM3, a large language model trained by Zhipu.AI. Follow the user's instructions carefully. Respond using markdown.
<|user|>
{query}
<|assistant|>
"""template = """<bos><start_of_turn>user
{query}<end_of_turn>
<start_of_turn>model"""template = """<|im_start|>system
You are a helpful assistant.<|im_end|>
<|im_start|>user
{query}<|im_end|>
<|im_start|>assistant
"""template = """<s>[INST] <<SYS>>
You are a helpful, respectful and honest assistant.
<</SYS>> {query} [/INST] Sure, I'd be happy to help. Here is the answer:"""Sure, I'd be happy to help. Here is the answer: avoids verbose model outputs.template = """Instruct: {query}nOutput:"""
# or template = """Alice: {query}nBob:"""template = """<|im_start|>system
You are a helpful assistant.<|im_end|>
<|im_start|>user
{query}<|im_end|>
<|im_start|>assistant
"""<|im_end|> or <|endoftext|>, you can remove texts after them or use stop parameter like:# Using vLLM interface
payload = json.dumps({
"prompt": query,
"n": 1,
"stop": ["<|endoftext|>", "<|im_end|>"],
})template = """<|im_start|>system
{system_message}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant"""template = """<|begin_of_text|><|start_header_id|>system<|end_header_id|>
You are a helpful AI assistant.<|eot_id|><|start_header_id|>user<|end_header_id|>
{query}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
"""template = 
