Getting Started With Local AI Setup
Getting Started With Local AI Setup
Build the Ultimate Local AI Workflow
Kyle Cook
Web Dev Simplified
Table of Contents
Introduction
What To Expect
Basic Install
Why Choose Local AI?
How LLMs Work
What Is a Model
What Makes LLMs Special
How LLMs Run On Hardware
The Model Landscape
Model Families and Naming
Finding Models On Hugging Face
Model Types By Task
Dense Models, MoE, And MTP
Model Formats And Runtimes
Hardware, Quantization, And Performance
Matching Models To Your Hardware
Understanding Quantization
Will This Model Fit?
Model Configuration
Measuring Local Inference
Developer Tool Integrations
LM Studio API Mode
Configuring Developer Tools
VS Code And Agent Mode
Connecting Pi
Remote Access With LM Studio
Remote Access Overview
Remote Models With LM Link
Remote Access With Tailscale
Running Models In The Cloud