Inference API returns 504 error for Llama-3.2-3B-Instruct & google/gemma-2-2b-it

[aisvarya-adeseye]

Llama used to work for me, but it suddenly stops working, I have not exhausted my inference endpoint limit and I have been granted access by Llama to access the model. The gemma has the same issue

[John6666]

It’s been like this for a while now. Probably everyone.

Constant 503 error for several days when running LLAMA 3.1

Hi all. Earlier this month I wrote a script incorporating LLAMA 3.1, and it worked well (with timeouts, etc), but for the past week whenever I try to access LLAMA 3.1 at all I get a 503 error (including for short simple requests, like HF’s sample code). Any idea what the problem may be? I do indeed have Pro.

[aisvarya-adeseye]

I see. Thanks for the info.

[sxruh]

Also getting this 503 error when running /black-forest-labs/FLUX.1-schnell