Claude Duet opens in preview, Mistral ships Voxtral 3, DeepSeek open-sources DeepInfer, OpenAI adds a 12-hour prompt cache
Window · 2026.10.20 06:43 – 10.22 06:43 KST
Here's today's news. Anthropic opened a waitlist for Claude Duet, an agent app that comes to you first with what needs attention. It starts with Pro and Max users in the US. Mistral released Voxtral 3: four speech recognition and synthesis models plus a voice agent SDK.
DeepSeek open-sourced DeepInfer, the inference engine behind its own API, under Apache 2.0. OpenAI added an option to keep API prompt caches for at least 12 hours.
At a glance
- 01 Claude Duet: Anthropic's agent app that flags what matters and asks before it acts Anthropic Waitlist
- 02 Voxtral 3: four Mistral speech models and a voice agent SDK Mistral AI Preview
- 03 DeepInfer: DeepSeek open-sources the inference engine behind its production service under Apache 2.0 DeepSeek Beta
- 04 OpenAI's 12-hour prompt cache: cached-input pricing even when requests are hours apart OpenAI GA
Today's items
Claude Duet: Anthropic's agent app that flags what matters and asks before it acts
What is it?
Claude Duet is a separate app where Claude reaches out first. Every morning it sends a short brief on what matters across your connected apps (Gmail, Slack, QuickBooks and others). Tasks you hand it keep running on its own virtual machine and browser, so your laptop can be off. It runs on Opus 5.5 and pulls in the memory, skills and connectors from your existing Claude account. It's on iOS, Android and claude.ai.
Why does it matter?
Before it sends a message, pays, signs or deletes anything, it shows you exactly what it will do and waits for approval. Trading securities and moving money between accounts are off-limits even if you approve. Credentials follow the Managed Agents design, so it never sees your passwords, and a dedicated classifier blocks card numbers and government IDs from leaking. If you're building an assistant-style agent, the safeguards are worth reading as a reference design. Note that its background checks, which run every few hours, count against your plan's usage limits.
Maturity
WaitlistResearch preview, open only through a waitlist for US Pro and Max subscribers. Anthropic says it can still misjudge what's urgent.
How to track it
- Rollout: watch claude.com for the waitlist expanding beyond the US or to Team and Enterprise plans.
- Safety design: read the detailed safety write-up Anthropic says it will publish in the coming days.
- Usage: see how much of the Pro and Max limits the background checks eat, from early user reports.
Voxtral 3: four Mistral speech models and a voice agent SDK
What is it?
Voxtral 3 is a family of speech models: three transcription (STT) models (Small Transcribe 3, the 4B Mini Transcribe 3, and Mini Transcribe Realtime 3) and one text-to-speech model, Mini TTS 3. A voice agent SDK built on LiveKit ties listening, reasoning and speaking into one stream. Transcription covers 50+ languages, with speaker diarization and hints for domain terms.
Why does it matter?
It's cheap: batch transcription runs $0.0035 to $0.004 per minute, realtime $0.008 per minute, and TTS $13 per million characters. Mistral says Small Transcribe 3 beats Whisper, Scribe v2 and Gemini 3.5 Transcribe on multilingual FLEURSVendor claim, with realtime latency under 500msVendor claim. If speech costs dominate your product, as in call centers or meeting notes, it's worth a comparison. EU endpoints and on-prem deployment help teams with data residency rules.
Maturity
PreviewYou can call it on the Mistral API today, but several outlets describe it as a public preview. The announcement doesn't say whether weights will be released.
How to track it
- Independent evals: check whether Voxtral 3 shows up on the Artificial Analysis speech leaderboards.
- Weights: watch the mistralai org on Hugging Face for Voxtral 3 checkpoints.
- SDK: follow GitHub releases for the voice agent SDK and any new Korean voice presets.
DeepInfer: DeepSeek open-sources the inference engine behind its production service under Apache 2.0
What is it?
DeepInfer is the inference framework DeepSeek runs behind its own API. It started from vLLM and was heavily reworked, adding DeepSeek's own kernels (FlashMLA, DeepGEMM, DeepEP), expert parallelism (spreading an MoE model's experts across GPUs), structured outputs and speculative decoding. For now it supports only DeepSeek-V4.1-Flash and runs on NVIDIA SM100 (Blackwell) and Huawei Ascend 950.
export DEEPINFER_ACCELERATOR=nvidia
./build.sh
python examples/offline_inference.pyWhy does it matter?
You get to read, in code, how a large MoE model is served at production scale. DeepSeek says a single cluster handles 155 trillion tokens a dayVendor claim. KV cache management, prefill/decode disaggregation and load balancing across replicas are left out, though, and Hopper and older GPUs aren't supported. Treat it as a design reference for teams running their own inference stack rather than something to drop into production.
Maturity
BetaThe code is public but covers offline inference only; pieces a full service needs are missing, so we're calling it beta.
How to track it
- Missing pieces: watch GitHub for the KV cache system and load-balancing code.
- Coverage: check the README for models beyond V4.1-Flash or Hopper support.
- vLLM and SGLang: see whether community engines pick up DeepInfer's optimizations in their PRs.
OpenAI's 12-hour prompt cache: cached-input pricing even when requests are hours apart
What is it?
In the OpenAI Responses API you can now pick a 12-hour minimum lifetime for prompt caches. On GPT-5.6 and later, set prompt_cache_options.ttl to "12h"; the default is "30m". You can mix both in one request, for example 12 hours for shared instructions and 30 minutes for recent turns.
Why does it matter?
Agents that run all day often go hours between requests, so their caches kept expiring. A 12-hour cache write costs 2.5x normal input (1.25x for 30 minutes), but reads cost 0.1x (0.05x on GPT-6.1 Sol). If long instructions and tool definitions get reused several times a day, you save. Put a 12-hour TTL on content you only reuse once or twice and you lose money.
Maturity
GAGenerally available in the Responses API. Chat Completions and models before GPT-5.6 keep using prompt_cache_retention.
How to track it
- Pricing: watch the API pricing page for changes to 12-hour cache-write rates per model.
- Scope: check the docs for the 12-hour option reaching Chat Completions or the Agents API.
- Measure: compare hit rates and cost before and after in the prompt caching dashboard.
Bottom line
Research log
Sources checked (✓ checked / – nothing relevant / ✕ could not access)
- ✓X @claudeai, claude.com blog — Claude Duet research preview (Oct 21) confirmed → selected. Same-day Claude Security continuous scanning beta (Enterprise) and HCLTech partnership skipped for space
- ✓Anthropic newsroom — Nothing new beyond the Oct 18 public benefit fund announcement
- ✓GitHub releases anthropics/claude-code — v2.1.306 (Oct 21 03:16 UTC) seen; skipped since yesterday covered through 2.1.305
- ✓X @OpenAIDevs, OpenAI prompt caching docs — 12-hour cache option (Oct 20) confirmed → selected
- ✓X @sama — Oct 21 post on Aleksander Madry returning (personnel news) — skipped
- ✓GitHub releases openai/codex — Only 0.164.0 alphas — skipped
- ✓Mistral news, X @MistralAI — Voxtral 3 (Oct 20) confirmed → selected
- ✓GeekNews, GitHub deepseek-ai — DeepInfer release (Oct 20) confirmed → selected. Krafton Raon-1 mini preview skipped: no primary source found
- ✓PyTorch blog, AWS — TorchNeuron (PyTorch backend for Trainium) public beta on Oct 20 confirmed; skipped this issue because it overlaps yesterday's TorchTPU item
- ✓aiweekly Oct 21 edition — Voxtral, TorchNeuron, Clairic, Gemini on Android Auto checked. Sage-A1.5 and Simular Agent S4 skipped: no primary source found. Funding and personnel stories skipped
- –Cloudflare Clairic — Announced Oct 19, outside the window; only secondary coverage seen
- –Google, Gemini API changelog, X @GoogleDeepMind, @OfficialLoganK — Personal Gemini on Android Auto (Oct 20) is a consumer feature — skipped. No new developer launches
- ✓X @karpathy — Latest post is an Oct 12 opinion thread. No new tools or repos (newest GitHub repo is from March)
- ✓X @simonw, @_akhaliq, @deepseek_ai, @Alibaba_Qwen — No new tool releases in the last 48 hours (simonw shared a fork of his RTS game)
- ✕Other X accounts (@thsottiaux, @reach_vb, @bcherny, @ylecun, etc.), LinkedIn — Not read this run
- ✕TechCrunch, The Verge (direct) — site: search didn't return dated article lists; covered via aiweekly and WebSearch instead
Generated: