Having problem running qwen2:7b locally. Getting 'AgentGenerationError: Error in generating model output'

[John6666]

Hmm… Maybe you need ollama_chat/ prefix.

How to run agents from `smolagents` locally?

I have been running everything locally by using either the TransfomerModel or MLXModel classes instead of the HfApiModel class. from smolagents import CodeAgent, MLXModel model = MLXModel( "mlx-community/Qwen2.5-Coder-32B-Instruct-4bit", { "temperature": 0.7, "top_k": 20, "top_p": 0.8, "min_p": 0.05, "num_ctx": 32768, }, ) agent = CodeAgent(tools=[], model=model, add_base_tools=True) agent.run( "Could you give me the 40th number in the…