Ollama models of NousResearch/Hermes-2-Pro-Mistral-7B-GGUF.
$ ollama run adrienbrault/nous-hermes2pro:Q4_0 'Hey!'
Hello! How can I help you today? If you have any questions or need assistance, feel free to ask.
There are -tools and -json tags with the recommended system prompt for function calling and json mode.
You provide the tools with the user message:
$ ollama run adrienbrault/nous-hermes2pro:Q4_0-tools "<tools>$(cat examples/tool-stock.json)</tools>
Fetch the stock fundamentals data for Tesla (TSLA)"
<tool_call>
{"arguments": {"symbol": "TSLA"}, "name": "get_stock_fundamentals"}
</tool_call>
Or a schema for the json mode:
$ ollama run adrienbrault/nous-hermes2pro:Q4_0-json "<schema>$(cat examples/user-schema.json)</schema>
Adrien Brault was born in 1991"
{"firstName": "Adrien", "lastName": "Brault", "age": 30}
List of available tags:
- adrienbrault/nous-hermes2pro:2_K
- adrienbrault/nous-hermes2pro:2_K-json
- adrienbrault/nous-hermes2pro:2_K-tools
- adrienbrault/nous-hermes2pro:3_K_L
- adrienbrault/nous-hermes2pro:3_K_L-json
- adrienbrault/nous-hermes2pro:3_K_L-tools
- adrienbrault/nous-hermes2pro:3_K_M
- adrienbrault/nous-hermes2pro:3_K_M-json
- adrienbrault/nous-hermes2pro:3_K_M-tools