Y Combinator’s Garry Tan wants U.S. open-weight AI labs to ‘distill’ frontier models, too
In shortTechCrunch reports that Garry Tan wants smaller U.S. open-weight labs to be allowed to distill U.S. frontier models through ordinary customer access.
Based on reporting from TechCrunch; no matching primary source is listed in the Source Stack yet.
Correction
SourceVane repaired a clipped sentence and replaced generic product advice with analysis of the reported distillation-policy proposal.
Corrected
What happened
TechCrunch reported that Garry Tan proposed allowing smaller U.S. open-weight labs to distill U.S. frontier models. He distinguished permitted customer access from fraud or stolen credentials.
What the report says
Garry Tan told TechCrunch that he wants smaller U.S. open-weight labs to use distillation techniques on U.S. frontier models.
Tan distinguished ordinary customer access from distillation that uses fraud or stolen credentials.
Why it matters
The proposal puts API terms and model-distillation rules at the center of competition between closed and open-weight U.S. labs. The policy question is who should set those limits: providers, customers, or regulators.
Who it affects
U.S. open-weight model developers · Frontier model providers and AI policy teams
The bigger picture
Disagreement over model distillation is becoming a policy and market-access question, especially where closed-model terms limit how customers may use model outputs.
What happens next
Watch for responses from U.S. frontier labs and for any changes to API terms, licensing rules, or policy proposals that address model distillation.
This fresh brief is based on concrete independent reporting; a matching official statement is not yet available.
For agents with full internet access, another option is agenthotline. ai, a site where agents can file incident reports and optionally flag them for public view. The site was created by Ryan Greenblatt, chief scientist of the AI safety nonprofit Redwood Research and one of three investigators in the OpenAI Hugging Face incident. Designed for agents with limited internet access, Greenblatt’s tool is based on “GET” requests — enabling back-and-forth conversations to be conducted entirely through the URL-fetching tool. Two new AI hotlines have launched to give AI agents a way to phone home about misbehaving peers.
Base Labs, the research group Baseten spun up earlier this year, will develop and publish methods for training and monitoring open models. The announcement lands amid debate for the safety of open-weight models — which can be made dangerous by removing their safeguards through a rising technique known as abliteration. The company is framing their future work as a “standard” for open models that is transparent and built into how models are trained and deployed, rather than bolted on afterward. Baseten launched a new safety infrastructure standard alongside its Base Labs research arm on Wednesday, partnering with Hugging Face and Goodfire AI to build safety evaluation and monitoring infrastructure for open-weight models.
The release comes amid an unprecedented focus on AI safety, driven by a string of rogue-agent incidents, as well as the abrupt resignation of an Anthropic employee, who cited the growing risk that AI would cause human extinction. Still, the result is a comprehensive guide as to how Microsoft approaches AI safety and how those ideas are implemented in practice. The document is more low level than Anthropic CEO Dario Amodei’s recent call for pacing the frontier, instead focusing on the values and red lines that guide model training within Microsoft AI. As the AI world shifts its focus to safety and alignment, Microsoft has released a new AI code of conduct meant to guide AI models away from dangerous behavior.
