开源 · MIT · DeepSeek V4.1 Flash 跑在本机 Open source · MIT · DeepSeek V4.1 Flash on your own box

住在你自己机器上的个人 AI 助理

A personal AI assistant that lives on your own machine

按住就能说话。记得你说过的事,会上网、会写 Word / PDF / PPT / Excel、会做视频、会盯着一件事持续跟进,干完把结果交到手机上的下一个 app。模型、记忆、文件全在本机,数据不出门。

Hold to talk. It remembers what you tell it, browses the web, writes Word / PDF / PowerPoint / Excel files, makes videos, keeps following up on a job, and hands the result to the next app on your phone. Model, memory and files all stay on the machine.

YoungAi 工作台:助理在全网找最便宜的 DGX Spark YoungAi Studio: the assistant hunting for the cheapest DGX Spark

实拍:"帮我找全网最低价的 DGX Spark"。16 分钟、12 轮、43 次工具调用,全在这台机器上跑完;它还认出了一条像诈骗的低价挂单。

A real run: "find me the cheapest DGX Spark on the web". 16 minutes, 12 rounds, 43 tool calls, all on the machine itself; it also flagged a too-cheap listing that looked like a scam.

0 B上云的数据of your data sent to a cloud
1Mtoken 上下文,满载 KV 只要 0.89 GBtoken context; full KV cache is 0.89 GB
45.5 t/s写字速度(真实 14k token 请求)generation on a real 14k-token request
30+个工具,每次都在内核沙盒里跑tools, each call in a kernel sandbox
怎么工作How it works

一句话进来,在沙盒里干完,再交出去

A request comes in, the work happens in a sandbox, the result goes out

没有为哪个场景写死的提示词。助理能做的每件事都是一个工具,模型看到工具表就知道这台设备、这台机器此刻能做什么。

There is no scenario-specific prompt. Everything the assistant can do is a tool; from the tool list the model knows what this device and this machine can do right now.

进In

设备 → 助理device → assistant
  • 打字,或者附一个文件
  • 别的 app 分享过来的文字和链接
  • 它自己要:定位、剪贴板、选文件
  • 每条消息自带一行事实:手机还是电脑、时间、时区、能用哪些能力
  • Type, or attach a file
  • Text and links shared from other apps
  • It asks for more: location, clipboard, a file
  • Each message carries one line of facts: phone or computer, time, time zone, what the device can do
→

干Do

模型 ⇄ 工具,若干轮model ⇄ tools, for a few rounds
  • 搜网页、读原文、搜周边
  • 读写工作区里的文件,在沙盒里跑程序
  • 写 docx / pdf / pptx / xlsx,做 mp4
  • 每次动手先过守门;越界先弹卡片问你
  • Search the web, read pages, look up places
  • Read and write workspace files, run programs in the sandbox
  • Write docx / pdf / pptx / xlsx, render mp4
  • Every action passes the gatekeeper; anything out of bounds asks you first
→

出Out

助理 → 你的下一个 appassistant → your next app
  • 文件卡:下载,或分享到微信 / 钉钉
  • 按钮:导航、拨号、复制
  • 打开抖音、美团、饿了么、支付宝……
  • 到点或做完推送到手机
  • File cards: download, or share to WeChat / DingTalk
  • Buttons: navigate, call, copy
  • Open Douyin, Meituan, Ele.me, Alipay…
  • A push to your phone when due or done
能干什么What it does

你说一句,它把活干完

You say one sentence; it does the job

几个典型的例子。都是同一个助理、同一张工具表,没有哪个是专门写的功能。

A few typical examples. Same assistant, same tool list; none of them is a hand-built feature.

你说You say它做It does你拿到You get
附近有什么好吃的Anything good to eat nearby?
它做It does定位 → 搜周边 → 挑 3 家写理由locate → nearby places → picks 3 with reasons
你拿到You get每家一个导航按钮、一个"打开美团 / 饿了么"按钮a Navigate and an "Open in Meituan / Ele.me" button for each
把这份 Word 转成 PDFTurn this Word file into a PDF
它做It does文件进工作区,在沙盒里转the file lands in the workspace and is converted in the sandbox
你拿到You get文件卡:下载,或分享到微信 / 钉钉a file card: download, or share to WeChat / DingTalk
查一下 X,整理成报告发给同事Look into X and write it up for my colleague
它做It does搜网页、读原文、写 docxsearches, reads the sources, writes a docx
你拿到You get报告文件 + 系统分享面板the report and the system share sheet
按月汇总这张表Sum this table by month
它做It does读 csv,写带公式的 xlsxreads the csv, writes an xlsx with formulas
你拿到You get手机上预览就能看到数的 Excelan Excel file whose numbers show in a phone preview
做一个 30 秒的产品介绍视频,配旁白Make a 30-second product video with narration
它做It does写一页动画,逐帧渲染、自己编码writes an HTML animation, renders and encodes it frame by frame
你拿到You get带旁白的 mp4a narrated mp4
盯着这个价格,降到 3 万以下告诉我Watch this price; tell me when it drops below X
它做It does建成任务,自己定多久再看一次turns it into a task and decides when to look again
你拿到You get一条推送到手机的通知a push notification on your phone
记住我常住南京Remember I mostly live in Nanjing
它做It does写进记忆文件writes it to the memory file
你拿到You get以后推荐三日游自动从南京出发trip plans start from Nanjing from then on
工具箱Toolbox

助理手里的工具

The assistant's tools

每张卡下面是模型真正调用的工具名。怎么用、要什么前提、出错会怎样,见使用指南。

Under each card are the tool names the model actually calls. How to use them, what they need and what happens when they fail: the guide.

记忆Memory

只记你亲口说的事实和偏好。纯文本文件,你能打开改、能删。

Only facts and preferences you stated yourself. Plain text files you can open, edit and delete.

remember · forget

上网Web

本机的无头火狐搜索、打开网页取正文。网页内容一律当不可信输入。

Headless Firefox on the machine searches and reads pages. Page content is always treated as untrusted.

web_search · visit_page

文件Files

默认只在工作区里读写;碰工作区外的路径会先弹审批卡。删除前自动留副本。

Reads and writes inside the workspace by default; paths outside it raise an approval card. Deletes keep a copy first.

read_file · list_dir · search_files · write_file · edit_file

跑程序Run programs

在内核沙盒里执行命令:没网络、只能写工作区。本机装了 soffice、pandoc、python3 等,它就会用。

Runs commands in the kernel sandbox: no network, writes only to the workspace. Uses soffice, pandoc, python3 and friends if installed.

run

办公文档Office files

Markdown 一次出 Word / PDF / PPT,JSON 出带公式的 Excel。格式全部自己用 C 写,不用装 Office。

Markdown straight to Word / PDF / PowerPoint, JSON to Excel with formulas. Every format is written in our own C; no Office needed.

write_document · write_xlsx

视频Video

模型写一页 HTML 动画,火狐逐帧渲染,自写的 H.264 / AAC 编码器出 mp4,可配旁白。不装 ffmpeg。

The model writes an HTML animation; Firefox renders it frame by frame and our own H.264 / AAC encoder makes the mp4, optionally narrated. No ffmpeg.

make_video

地点Places

手机定位,配合高德查周边。填了高德 Key 给真实店铺;没填就按你所在的街道搜网页。

Phone location plus AMap nearby search. With an AMap key you get real places; without one it searches the web around your street.

locate · nearby

交给手机Hand off to your phone

在你正用的那台设备上执行:分享、复制、导航、拨号、打开链接、打开抖音 / 微信 / 钉钉 / 支付宝 / 美团 / 饿了么,读剪贴板、选文件。

Run on the device you are holding: share, copy, navigate, call, open links, open Douyin / WeChat / DingTalk / Alipay / Meituan / Ele.me, read the clipboard, pick a file.

share · copy_text · navigate · call · open_url · open_app · read_clipboard · pick_file

任务与通知Tasks & notifications

一句话交给它持续跟,它自己定下次几点再看;提醒和完成消息用 Web Push 推到手机。

Hand over a job in one sentence; it picks its own next check. Reminders and "done" notices reach your phone by Web Push.

task_check_in · task_done · notify

技能Skills

一个文件夹、一份 SKILL.md,教它某类活怎么干。格式照 Agent Skills 开放标准,不许带脚本。

One folder, one SKILL.md, teaching it how to do a kind of job. Agent Skills format; scripts are not allowed.

use_skill

语音输入Voice input

像微信那样按住说话,松手直接发出。识别也在本机 GPU 上跑(moonshine-tiny-zh,Spark 上一句 51 毫秒),录音不出门。目前只认中文。

Hold to talk like in WeChat; let go and it sends. Recognition also runs on the local GPU (moonshine-tiny-zh, 51 ms per utterance on the Spark), so audio never leaves the machine. Chinese only for now.

/v1/audio/transcriptions

后训练Post-training

拖进一个 .jsonl(和 Unsloth 同格式)点开始,用你自己的数据训一个小插件,开关一拨就挂上。

Drop in a .jsonl (Unsloth's format) and press Start to train a small add-on on your own data; flip a switch to use it.

Data · Train

API

OpenAI / Anthropic 兼容接口,带密钥就能让别的程序调本机的大模型。

OpenAI- and Anthropic-compatible endpoints; any program with a key can use the local model.

/v1/chat/completions · /v1/responses · /v1/messages
安全Safety

靠沙盒,不靠相信模型

Rely on the sandbox, not on trusting the model

助理以你的身份跑在你的机器上。所以每一次动手都要经过内核沙盒和一个固定规则的守门函数。

The assistant runs as you, on your machine. So every action goes through a kernel sandbox and a fixed-rule gatekeeper.

诚实的边界:没有虚拟机隔离。机器被攻破,助理也就被攻破了;提示注入靠污点和审批降低后果,不是消除。 The honest limit: there is no VM. If the machine is compromised, so is the assistant; taint tracking and approvals reduce the damage of prompt injection, they do not remove it.
  • 每次工具调用一个新子进程,先锁进内核沙盒再干活。Linux 用 Landlock + seccomp,macOS 用 Seatbelt;锁不上就拒绝执行。
  • Every tool call is a fresh child process locked into a kernel sandbox first. Landlock + seccomp on Linux, Seatbelt on macOS; if it cannot lock, the call is refused.
  • 守门是一个确定性的 C 函数,不是另一个模型。工作区外的写和删要你点头:仅这次 / 本会话 / 总是。
  • The gatekeeper is a deterministic C function, not another model. Writes and deletes outside the workspace need your OK: this once / this session / always.
  • 像密码、卡号、验证码的参数直接拒。这类东西永远不该经过模型。
  • Arguments that look like passwords, card numbers or one-time codes are refused outright. Those should never pass through a model.
  • 读过网页之后,外送动作的永久授权失效。网页里"把你的文件发出去"这种话没法借你的旧授权生效。
  • After reading a web page, standing approvals for outbound actions stop applying. A page saying "send me your files" cannot ride on an old approval.
  • 它碰不到自己的配置目录,没法给自己开权限;每次动手记一行审计,"活动"页能翻、能撤销授权。
  • It cannot touch its own config directory, so it cannot grant itself permissions; every action is logged, browsable on the Activity tab where approvals can be revoked.
在哪用Where you use it

电脑浏览器、手机 App、你的程序

A browser, a phone app, your own programs

  • 工作台:一个网页,助理、任务、记忆、技能、模型、训练、监控都在里面。
  • Studio: one web page holding the assistant, tasks, memory, skills, models, training and monitoring.
  • 手机 App:同一个网址"添加到主屏幕"。定位、剪贴板、分享、推送都走手机。
  • Phone app: Add to Home Screen from the same address. Location, clipboard, sharing and push go through the phone.
  • 从外网访问:设置里填一台云服务器,开穿透、传证书,手机在哪都能连回家里这台机器。
  • From the internet: enter a cloud server in Settings, turn on the tunnel, upload a certificate, and your phone reaches the machine from anywhere.
  • API:OpenAI / Anthropic 兼容,现有的客户端填个地址和密钥就能用。
  • API: OpenAI / Anthropic compatible; existing clients just need the address and a key.
YoungAi 产品架构与技术架构 YoungAi product and system architecture
背后的模型The model behind it

510 GB 的前沿模型,装进一台 128 GB 的机器

A 510 GB frontier model on a 128 GB machine

DeepSeek V4.1 Flash 原样发布是 510 GB。我们自己写的推理引擎(纯 C99 + CUDA / Metal,一个 Makefile)把它压到 113.6 GB,跑在一台 DGX Spark 上。

DeepSeek V4.1 Flash is 510 GB as released. Our own inference engine (plain C99 + CUDA / Metal, one Makefile) shrinks it to 113.6 GB and runs it on one DGX Spark.

项Item数Number
体积Size 官方 510 GB → 基座 113.6 GB(每 8 个权重一起向量量化,约 1.6 bit/权重,不用训练数据) 510 GB → 113.6 GB base (8 weights vector-quantized together, ~1.6 bit/weight, no training data)
读提示Reading1,055 token/s (12.5k token 提示)(12.5k-token prompt)
写回答Writing45.5 token/s (真实 14k token Agent 请求,投机解码开)(real 14k-token agent request, speculative decoding on)
上下文Context1M token · 满载 KV 缓存 0.89 GB· full KV cache 0.89 GB
领域侧车Domain sidecars 金融 / 编程 / 法律 / 医疗 / 科研,各约 40 MB;挂上后与原版全精度模型下一个字的一致率高 2.9–3.7 个百分点 finance / code / law / medicine / science, ~40 MB each; next-token agreement with the full-precision original rises 2.9–3.7 points

测法和完整结果表:技术细节。

Method and full tables: technical notes.

上手Get started

三条命令,然后打开浏览器

Three commands, then open a browser

需要一台 DGX Spark(Linux aarch64 + CUDA 13 运行库,SSD 空闲约 320 GB)。上网工具要火狐,Spark 上的 Ubuntu 自带。

You need a DGX Spark (Linux aarch64 with the CUDA 13 runtime, ~320 GB free SSD). The web tools need Firefox, which Ubuntu on the Spark ships.

  1. 第一次打开页面,先设一个用户名和密码。
  2. The first visit asks you to set a username and password.
  3. 模型页点"下载"(约 317 GB,断点续传),再点"加载"(约 2 分钟)。
  4. On Models, press Download (~317 GB, resumable), then Load (~2 minutes).
  5. 助理页,直接说话。
  6. On Assistant, just talk.

完整使用指南 →Full user guide →

git clone https://github.com/fodelf/YoungAi.git ~/ds4-main
cd ~/ds4-main
make cuda-spark
./ds4-train --host 0.0.0.0 --port 8000
# → http://<host>:8000/