Open weights, gatekeepers, and the responsibility of engineers and executives
If your company uses or buys AI, the dispute over openness vs. control isn’t academic, it changes risk profiles, vendor bargaining power, and even geopolitical exposure. At the Ai4 conference in Las Vegas, framed the debate in clear, divergent ways: Geoffrey Hinton, Fei‑Fei Li, and Andrew Ng agreed that concentration of power is dangerous and that regulation is needed, but they differed sharply on how openness should be preserved or constrained.
The panel and the shared diagnosis
Geoffrey Hinton, a pioneer of deep learning and 2023 Turing Award winner, Fei‑Fei Li, a leader in computer vision and AI policy at Stanford, and Andrew Ng, Coursera co‑founder, staged a practical argument about an old tension made newly urgent. All three warned against letting a small set of firms act as gatekeepers on advanced AI, and all three said public regulation will be necessary to steer development toward societal benefit.
“What we want to do is develop AI in a direction that helps people, and regulation will help us do that, ” Geoffrey Hinton said at the Ai4 panel, adding that decisions about AI shouldn’t be left solely to high‑profile CEOs.
Where they split
- Hinton: wary of open weights. He made a technical distinction between open‑source code and open weights, arguing the latter lowers the barrier to harmful reuse. “Open source is great. You show people the code, and lots of people look at the lines of code and say, ‘Oh, there’s a bug.’ Open weights means you train a big model and then you give people the weights. That’s very different, ” he said, and warned that open weights make it easier to repurpose foundation models for misuse: “I was against open [weights] because it makes it so easy for people to take these big foundation models, which are very expensive to train, and for much less money train them to do bad things like cyber attacks.” He also conceded the landscape has changed: “I think that battle’s been lost. We now have open‑weight models, so the barrier to lots of people getting these big models, which was the cost of training foundation models, that barrier has disappeared. It’s too late.”
- Andrew Ng: promote openness to avoid gatekeepers and preserve competitiveness. Ng emphasized openness as an antidote to centralized control and as a source of national soft power. “I don’t want there to be gatekeepers, ” he said, adding, “If I were to try to give one prescription, it would be to promote openness.” He warned that openness (and the ability to build open‑source AI) is a competitive advantage and a soft‑power lever: “It turns out that AI is a tremendous source of soft power. You can see the way China’s model has tremendous accomplishment with Africa, for example.” He worried that lobbying and fear‑driven regulation could hamper American open‑source AI at a strategic cost: “My worry is because of all the lobbying in the U.S. and the fear‑mongering, building open‑source AI in America is struggling to compete with open‑weight models coming out of China, and my worry is that if China figures out a fundamentally more cost‑efficient way to build AI, then things that are more cost‑efficient have a fundamental business adoption advantage.”
- Fei‑Fei Li: reject a binary choice, advocate layered openness. Li urged nuance over absolutism: “It’s very dangerous to make this a dichotomy between complete openness all the way to complete closedness, ” she said, recommending different levels of openness for research, education, and commercial use. She invoked public‑private infrastructure metaphors, like the Human Genome Project, to argue that openness and controlled systems can coexist: “We need some levels of openness, both in scientific discovery, in education, in global partnership, as well as lucrative business models for entrepreneurs. But we also will accept closed‑source systems. This debate, especially at the sweeping level of ‘we can only tolerate one, ’ is a false debate. We need to get to a level of nuance.”
Why “open weights” changes the calculus
Publishing model weights is fundamentally different from publishing source code. Open‑source code lets people inspect and improve algorithms. Publishing weights, or checkpoints, hands over the numerical parameters that let others run or fine‑tune a powerful model without redoing the costly training phase. That drop in compute and time‑to‑use is why open weights speed both innovation and the potential for misuse.
Evidence of this diffusion is visible in the flow of major open‑weights releases since 2023. A compiled timeline of open‑weights model releases documents several high‑impact checkpoints:
- LLaMA, released 2023‑02‑24 (research model, multiple sizes).
- Llama 2, released 2023‑07‑18 (research and commercial use sizes).
- Mistral 7B, released 2023‑09‑27.
- Notable later releases include models and variants through 2024-2025, and OpenAI’s gpt‑oss family in August 2025; a safety‑conditioned variant (gpt‑oss‑safeguard) followed in October 2025, designed to enforce developer safety policies at inference time.
Those timelines help explain Hinton’s stark line: the compute barrier that once constrained who could deploy foundation‑scale capabilities has been materially lowered.
What this means for business leaders, priorities and concrete actions
Two strategic priorities should lead your response: (1) know the provenance and risk profile of every model in your stack, and (2) treat openness as a design choice, not an article of faith.
- Procurement and provenance (highest urgency). Immediately ask vendors: Can you provide a model SBOM (training data sources, preprocessing steps, licenses)? Do you publish red‑team reports, safety test results, and provenance metadata for checkpoints? Require these in new RFPs and contract renewals.
- Security vs. agility trade‑off. Closed vendor stacks simplify control and compliance, but they increase vendor lock‑in and slow innovation. Open weights accelerate prototyping and lower cost, but they widen your attack surface and complicate compliance. Balance by sandboxing experiments and applying graduated controls for higher‑risk capabilities.
- Competitive posture and geopolitics. Contributing to or adopting open ecosystems can accelerate product development and increase influence in regions that prefer open models. Conversely, relying exclusively on closed stacks can cede influence to foreign providers.
- Design for layered openness. Follow Fei‑Fei Li’s practical prescription: keep low‑risk research and educational artifacts open, allow commercial innovation, and impose stricter controls where misuse could cause serious harm.
Three immediate, timebound steps for executives
- 30 days, Inventory and flag. Owner: CTO. Compile a list of all models and endpoints in production, note whether vendors publish checkpoints/weights, and assign a risk tier (low/medium/high) to each model.
- 60 days, Strengthen procurement and evidence. Owners: Procurement + Security. Update RFP templates to require model SBOMs, red‑team reports, safety‑testing summaries, and explicit licensing terms for any released weights.
- 90 days, Controlled experimentation. Owner: Head of Product/AI. Permit open‑weights experiments only in sandboxed environments with monitoring, rollback plans, and clear acceptance criteria; deny production deployment until safety audits are passed.
Key questions, quick answers
-
Are open weights already something I must consider?
Yes. Since 2023, major checkpoints from multiple organizations have been publicly released, and open‑weights distributions have lowered the compute barrier for third parties to deploy and fine‑tune capable models. (Refer to public timelines of open‑weight releases.)
-
Does openness equal safety?
No. Openness increases scrutiny and speeds innovation, but publishing weights also reduces friction for misuse; safety requires mitigation, not just transparency.
-
Should my company default to closed vendor stacks to be safe?
Not automatically. Closed stacks reduce some operational risks but can create lock‑in and slow innovation. A layered approach, open for research and low‑risk tooling, controlled for high‑risk capabilities, is usually smarter. Assign Security and Legal to vet each use case.
-
Will regulation resolve this tension?
Regulation is widely seen as necessary by leading researchers, but it must be practical and multilayered, disclosure, safety testing, provenance, hardware export controls, and incident reporting are among the levers under discussion. Regulators and industry will need to iterate together.
-
How should leaders act now?
Inventory models, demand provenance and safety evidence from vendors, sandbox open‑weights experiments, and participate in policy conversations so rules preserve research benefits without creating monopolistic gatekeepers.
Two uncomfortable truths
First: the technical tide has shifted. Open weights are now part of the ecosystem, which constrains the policy and product choices available to firms and governments. Second: the binary “open good / closed safe” is false. Practical governance mixes openness where it fuels progress with controls where capabilities pose systemic risk.
That mix is the terrain where business, engineering, and policy must converge. Start by knowing what you run, insisting on provenance and safety evidence, and treating openness as an architectural decision rather than a slogan.