bug: Gemma 3 Models are using CPU

[mageeagle]

Jan version

0.6.0

Describe the Bug

I tried loading the Gemma 3 models after the update and noticed that has much slower token generation speed, and saw that it uses the CPU instead. I tried loading other models and they are fine. This happens on both the 4b and 12b versions, I didn't try the other versions. GPU Layers are at 100.

Steps to Reproduce

Download the Gemma3 models, load and tell it to generate a test message.

Screenshots / Logs

What is your OS?

• MacOS
• Windows
• Linux

[yukkidev]

I agree that the text generation is much slower compared to the speeds I was getting beforehand. Also I noticed "System Monitor" was moved into the settings, but it throws an error when attempting to open it so I'm not able to see what's bottlenecking.

[david-menloai]

hi @mageeagle can you please help check if GPU is enabled here?

[david-menloai]

hi @yukkidev may I know if you're using the latested version v0.6.1?

[mageeagle]

hi @mageeagle can you please help check if GPU is enabled here?

Yes it is, as stated, other models are all fine.