Model Guides
Step-by-step setup guides for specific AI models on dedicated GPU servers. From LLM deployment to vision model hosting and speech model hosting, each guide includes configuration, optimisation tips, and GPU recommendations.
RTX 4090 24GB for Qwen 2.5 14B: The Best 14B Experience on Consumer Silicon
Qwen 2.5 14B FP8 fits the RTX 4090 24GB with KV headroom for 32k context, hits 110 t/s decode, and outperforms much larger generalist models on math and code.
RTX 4090 24GB for Qwen 2.5 32B AWQ: Tight Fit, Frontier-Class Reasoning
Qwen 2.5 32B AWQ INT4 squeezes onto an RTX 4090 24GB at ~18GB - the most capable reasoning model that…
RTX 4090 24GB for Qwen 2.5 7B: FP16, FP8 and Long Context Deployment
Qwen 2.5 7B on the RTX 4090 24GB - FP16 fits comfortably, FP8 leaves 17GB for KV, and AWQ INT4…
RTX 4090 24GB for Qwen 2.5 Coder 14B: The Best Self-Hosted Code Assistant on One Card
Qwen 2.5 Coder 14B FP8 fits the RTX 4090 24GB at 14GB of weights, hits 110 t/s decode with 32k…
RTX 4090 24GB for Qwen 2.5 Coder 32B: GPT-4o-Tier Code Completion on One Card
Qwen 2.5 Coder 32B AWQ INT4 squeezes onto an RTX 4090 24GB at ~18GB - HumanEval 92.7 matches GPT-4o on…
RTX 4090 24GB for Qwen 2.5-VL 7B: OCR, Charts, Video and Throughput
Qwen 2.5-VL 7B on the RTX 4090 24GB - 7.5GB FP8 footprint, 180ms image encode, 150 t/s decode, native video…
RTX 4090 24GB for Codestral 22B: Mistral’s Code Specialist on a Single Card
Codestral 22B AWQ INT4 fits the RTX 4090 24GB at ~13GB - 80 t/s decode, 32k context, native FIM, 80+…
RTX 4090 24GB for Yi-34B: AWQ INT4 Bilingual Deployment at the VRAM Edge
Yi-34B-Chat AWQ INT4 on the RTX 4090 24GB - 19GB weights with FP8 KV essential, 55 t/s decode, 12k workable…
RTX 4090 24GB for DeepSeek-Coder-V2-Lite: 16B MoE, 2.4B Active, 145 t/s
DeepSeek-Coder-V2-Lite-Instruct on the RTX 4090 24GB - 16B MoE with just 2.4B active params, FP8 fits at 16GB, 120 t/s…
RTX 4090 24GB for Gemma 2 27B: Google’s Flagship Open Model on a Single Card
Gemma 2 27B AWQ INT4 fits the RTX 4090 24GB at ~14GB - 75 tokens/sec at 8k context with full…
Explore GPU Hosting Solutions
From the blog to your next deployment — pick the right platform for your workload.
Dedicated GPU Hosting
Bare-metal servers with a dedicated GPU, NVMe, full root access, and 1Gbps networking from our UK datacenter.
Browse GPU ServersOpen Source LLM Hosting
Deploy LLaMA, Mistral, DeepSeek, and more on dedicated hardware with no per-token API fees.
Explore LLM HostingVision Model Hosting
Deploy YOLO, PaddleOCR, Stable Diffusion, and other vision models on GPU-accelerated servers.
Explore Vision HostingSpeech Model Hosting
Deploy Whisper, Coqui, Bark, and other speech models with low-latency inference.
Explore Speech HostingMultimodal Model Hosting
Vision-language models, audio-language models — deploy multimodal AI on dedicated GPUs.
Explore MultimodalTokens/sec Benchmarks
Real-world tokens per second data across every GPU we offer, tested on popular LLMs.
View BenchmarksReady to deploy your AI workload?
Dedicated GPU servers from our UK datacenter. NVMe storage, 1Gbps networking, full root access.
65 Victory Avenue
PE7 1XU, England
GPUAIR © All Rights Reserved.