And any HuggingFace model with config.json. Intel i9-13900K (AVX2) Qwen2.5-7B 4‑bit ~15‑25 tok/s Intel i7-1260P (AVX2) Qwen2.5-3B 4‑bit ~20‑35 tok/s AMD Ryzen 9 7950X (AVX2) Qwen2.5-7B 4‑bit ~18‑30 ...
Multiple prompts at once: Enter each prompt on a new line (newline-separated). Word wrapping does not count towards this. Negative Prompt: Put words or phrases into this box to tell the AI to exclude ...