Local LLMs on Linux.
AppImage or tar.gz. CUDA on NVIDIA. The simplest local AI you can self-host.
Linux is where local AI workflows live for a lot of developers , GPU drivers are cleaner, package management is simpler, and there's no telemetry layer sitting between you and the kernel. tailor. ships as an AppImage that runs on any modern distro, with the same agentic features, document chat, and local API as the Mac and Windows builds.
Distributions tested
Ubuntu 22.04 and 24.04 LTS. Debian 12 (Bookworm). Fedora 38, 39, 40. Pop!_OS 22.04. Arch (current). Anything with glibc 2.34+ and a recent X11 or Wayland session should work , the AppImage bundles its own dependencies otherwise.
GPU acceleration
NVIDIA: CUDA picked up automatically if you have a recent driver. CPU-only fallback always available and works on any 64-bit Linux. ROCm and Vulkan acceleration for AMD/Intel GPUs are on the roadmap , for now those run on the CPU path.
Installation
Two distribution formats: a tar.gz with desktop file and icons, or an AppImage. Download the .AppImage, chmod +x, run. The app self-contains its dependencies. Optional: integrate into your menu with appimaged or gear-lever. Native .deb and .rpm packages are on the roadmap.
Questions
--appimage-extract-and-run as a workaround.