Use this topic for any question about Chapter 2 of the course.

@sgugger How to use a local VLM like llava via ollama in LiteLLMModel? I tried: from smolagents import LiteLLMModel, CodeAgent model = LiteLLMModel( model_id=“ollama/llava:7b”, # Or try other Ollama-supported models api_base=“ http://127.0.0.1:11434 ”, # Default Ollama local server num_ctx=81…

Ok, i just had to change flatten_messages_as_text = False in LiteLLMModel.

Can I somehow avoid using HfApiModel? How can I use the local models? I did not find explanation in any place. It asks me to buy the paid track for HF. And I just want to try out the smolagent framework.

Yea. Only on documents or on Hugging Face Discord. [image] Avoiding the usage of HfApiModel and using local model - `smolagents` Beginners There are several methods, but you can use TransformersModel instead of HfApiModel and it will work. When using large models, powerful…

Hi everyone, very tiny issue at page Chat Templates - Hugging Face LLM Course it seems the link " Here’s a guide on ChatML ." is not the good one. Maybe this is the one? openai-python/chatml.md at release-v0.28.0 · openai/openai-python · GitHub thank you for this outsanding course.

Getting error for from smolagents import CodeAgent, DuckDuckGoSearchTool, HfApiModel agent = CodeAgent(tools=[DuckDuckGoSearchTool()], model=HfApiModel()) agent.run(“Search for the best music recommendations for a party at the Wayne’s mansion.”) Error is:- Error in generating model output: 402…

I think this is the 402 error. You also can avoid it by using a local model or another company’s API. [image] Hugging Face Payment Error 402 & You've Exceeded Monthly Quota Languages at Hugging Face Whenever I want generate a response from the api it shows payment error 40…

[image] I am confused why even if i didn’t use the mask,but model still gave me the same output.That is some different from the demo.

Does Chapter 2 provides a notebook on Huggingface platform to test build and test the agents or agent flows? I was not able to find one in chapter 1 as well.

I use m1 pro mac, and I encounter a problem. [image]

Chapter 2 questions

Course

John6666 May 21, 2025, 5:12am 104

I think this is the 402 error. You also can avoid it by using a local model or another company’s API.

Topic		Replies	Views
Chapter 3 questions Course	160	11601	March 7, 2026
Ai Agents course error in running the Smolagent example Course	14	2085	June 2, 2025
Chapter 1 questions Course	116	30190	February 16, 2026
Chapter 7 questions Course	124	11228	February 24, 2026
Transformers v3.0.0 is out! 🤗Transformers	0	2007	July 7, 2020

Chapter 2 questions

Related topics