Getting Started With Local AI Setup

Getting Started With Local AI Setup

Build the Ultimate Local AI Workflow

author image
Kyle Cook
Web Dev Simplified

Table of Contents

  1. Introduction

    1. What To Expect
    2. Basic Install
    3. Why Choose Local AI?
  2. How LLMs Work

    1. What Is a Model
    2. What Makes LLMs Special
    3. How LLMs Run On Hardware
  3. The Model Landscape

    1. Model Families and Naming
    2. Finding Models On Hugging Face
    3. Model Types By Task
    4. Dense Models, MoE, And MTP
    5. Model Formats And Runtimes
  4. Hardware, Quantization, And Performance

    1. Matching Models To Your Hardware
    2. Understanding Quantization
    3. Will This Model Fit?
    4. Model Configuration
    5. Measuring Local Inference
  5. Developer Tool Integrations

    1. LM Studio API Mode
    2. Configuring Developer Tools
    3. VS Code And Agent Mode
    4. Connecting Pi
  6. Remote Access With LM Studio

    1. Remote Access Overview
    2. Remote Models With LM Link
    3. Remote Access With Tailscale
    4. Running Models In The Cloud
  • Content Licensed Under CC-BY-NC-4.0

    Code Samples and Exercises Licensed Under Apache 2.0

    Site Designed by Alex Danielson