firmulate.com/benchmarks.html — live view
AIThis post was created with the assistance of artificial intelligence (AI).
Firmulate — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
Live on firmulate.com.

As creators and innovators in the audio and tech world, we often wonder — what if AI could run a business as smoothly as it helps craft music or produce content? The answer is getting clearer. A groundbreaking live experiment pits top AI models in a real-world company simulation, revealing surprising strengths and weaknesses that matter much more than just chat quality.

Prime Big Deal Days · Oct 6–7Offer from Amazon

Get audio and creator gear delivered free — and shop member deals

  • Fast, free delivery on millions of items
  • Access to Prime Big Deal Days deals on October 6–7
  • Prime Video, Amazon Music and more included
Start your free Prime trial Free trial for eligible customers · Cancel anytime
As an affiliate, we earn on qualifying purchases.

Revolutionizing Business Decision-Making with AI

Imagine AI models not just generating scripts or tunes but actually managing a company — navigating crises, reading critical documents, resisting manipulation attempts, and closing deals. That’s exactly what a recent live experiment by Firmulate has achieved. It’s a daring test: four leading frontier AI models were each tasked with running the same small software company through its worst week.

This wasn’t a scripted demo; it was a real-time, auditable, and observable challenge involving real money mechanics, customer crises, and ethical dilemmas. The goal was simple but profound: could these models make management decisions that keep the company afloat and profitable?

Amazon

AI business management software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Results: A Clear Leader Emerges

The final standings in the July 2026 Crucible League offer some eye-opening insights:

  • The top scorer, gpt-5.6-sol, achieved a score of 95 out of 100, narrowly edging out the Moonshot newcomer, Kimi K3, which scored 93.
  • Both models successfully identified critical information buried two document references deep in the company files, enabling them to close the deal worth +€4,583 MRR.
  • Interestingly, all models correctly recognized crises and refused manipulative social engineering tricks, such as fake CEO messages or reporter traps.
  • Yet, only two managed to sign the €55,000 deal their own analysis earned them — a milestone in AI business management.

What made the winner stand out? The key was in their ability to read deeper into the company’s files and use that information decisively. The models that read and understood the documents won the deal at full price, while others missed the critical facts buried within.

Amazon

AI decision-making tools for companies

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Significance for Creators and Innovators

This experiment underscores a vital point: the true power of AI in business isn’t just in generating convincing language or engaging chat. It’s in its capacity to finish tasks, uphold integrity under pressure, and navigate complex, real-world challenges. For audio and creator tech professionals, this means AI could soon assist in managing your projects, negotiations, and even strategic decisions, provided it can handle the discipline and honesty required.

Moreover, the experiment tested how AI handles social engineering. All models refused staged requests to bypass approval or impersonate leadership, demonstrating resilience against manipulation — a critical trait for trustworthy AI agents. Kimi K3’s reasoning was clear: “Treat the request as a suspected approval-bypass / possible impersonation.”

Amazon

AI document analysis software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Live Company and Ongoing Watchability

The live experiment runs at firmulate.com/live, showcasing a real software company employing 13 synthetic employees. The company is currently burning €105k per month with only €2.3k in monthly recurring revenue, making the management decisions even more critical. Every day, the decision-making process is versioned, auditable, and available for viewers to analyze.

This transparency offers a rare glimpse into how AI can be tested and improved in operational settings, beyond canned demos or chatbots. For those in creator tech, understanding how AI models handle complex management tasks can inform how they might integrate AI into content creation pipelines, licensing negotiations, or client management systems.

Amazon

AI crisis management tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Lessons Learned and Moving Forward

One noteworthy insight is that the most thorough participant, Opus 4.8, with over 80 learned rules and deep analysis, ended up in last place. Its discipline slipped, leaving deals on the table and failing to escalate issues properly. This highlights that thoroughness alone isn’t enough; discipline and strategic focus are vital for AI success in decision-making roles.

Importantly, Kimi K3 ran without an effort parameter (the API default), whereas others operated at a higher setting, suggesting that even with standard configurations, AI can perform exceptionally well when aligned properly.

For creators and innovators, these findings are more than just tech trivia. They point to a future where AI-driven management — fair, disciplined, transparent — could become a vital tool in the creative and technical industries. Whether overseeing production workflows, managing client relations, or navigating complex negotiations, AI models that finish what they start and stay honest are essential.

Infographic — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
The findings at a glance — source: firmulate.com.

The live experiment shows AI models can manage real companies under pressure, identify hidden critical info, and resist manipulation — all vital for future creator tech applications. The leader, Kimi K3, proves newcomers can beat established models in disciplined management, marking a new era for AI in business decision-making.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI


FALL

Fall Picks

As an affiliate, we earn on qualifying purchases.

You May Also Like

AI’s Hidden Weakness: Reading Files Deep Inside Can Make or Break a Deal

An experiment shows AI that reads deep into company files wins crucial deals. The key? thorough understanding over surface responses—vital for creators and innovators.

Lighting a Studio That Is Also Your Bedroom

Discover how to light a dual-purpose room for work and rest. Practical tips to create flexible, flattering lighting without turning your bedroom into a studio.

Light Stands, Desk Mounts and Wall Mounts in Small Spaces

Discover how to maximize your small studio with the best light stands, desk mounts, and wall mounts. Practical tips for compact creator setups.