Head to head: Anthropic: Claude Sonnet 5.5 vs MoonshotAI: Kimi K3

Anthropic: Claude Sonnet 5.5 vs MoonshotAI: Kimi K3

By · Published · Updated

RuntimeWire Head-to-Head: Head to head: Anthropic: Claude Sonnet 5.5 vs MoonshotAI: Kimi K3
RuntimeWire Head-to-Head matchup

A close newsroom-writing matchup tests whether stronger narrative momentum and length discipline can outweigh stricter source control. Across reporting, editing and precision tasks, the models split the work rather than producing a runaway winner.

Kimi K3 takes the aggregate, 101.5 to 98.5, but this is a narrow result: it won five tasks to Claude Sonnet 5.5’s three, with four ties. The limited confidence rating makes Kimi the call, not a blowout. Kimi’s edge came most clearly when the assignment demanded a developed story. It met the required length in the natural rewrite and quotes-woven-into-narrative tasks, where Sonnet fell short, and also won on the reporting-notes story, chronology and publication-ready Markdown edit. Those wins point to a model that more often delivered the fuller, smoother draft the prompt asked for. Sonnet’s counterweight was editorial restraint. It won the news opening and startup spotlight by separating reported claims from established facts, and took controlled wit by staying closer to the supplied reporting. That caution mattered: Kimi sometimes pushed beyond the evidence, including unsupported claims in the reporting-notes story and technical explanations in the chronology task. The precision tasks were a draw: both models selected the correct lede, counted Markdown errors correctly, and produced identical compliant final-draft structures; the numbers story was also tied. **Verdict: Kimi K3 wins on balance, chiefly through stronger development and length compliance, while Sonnet 5.5 remains the safer choice when factual restraint is the priority.**

News judgment in the opening

Write only the opening of this news story: an H1 headline, an italicized dek and three to five paragraphs totaling 180–250 words. The opening must establish what happened, quantify the scope, explain why it matters and carefully distinguish confirmed facts from unknowns. It should pull the reader forward without sensationalizing the incident. Reporting: * Cloudnote discovered that a debugging page containing customer prompt excerpts was accessible without authentication. * The page was exposed for four hours on Monday. * Logs show excerpts from 1,842 user sessions. * The excerpts could include up to 200 characters from a prompt. * Cloudnote removed the page 19 minutes after a researcher notified it. * The company says it has found no evidence that anyone besides the researcher accessed the page. * It has not completed its investigation. * Full documents, passwords and payment information were stored elsewhere and were not present on the page. * Cloudnote has 3.2 million registered users.

Anthropic: Claude Sonnet 5.5: # Cloudnote exposed prompt excerpts from 1,842 sessions on unprotected debugging page *The company says it has found no sign that anyone but a security researcher viewed the page, but its investigation is not finished.* Cloudnote left a debugging page containing excerpts of customer prompts accessible without authentication for four hours on Monday, exposing material from 1,842 user sessions, the company said. Each excerpt could include up to 200 characters of a prompt. Cloudnote removed the page 19 minutes after a researcher notified it. The company, which has 3.2 million registered users, said full documents, passwords and payment information are stored elsewhere and were not on the page. Cloudnote says it has found no evidence that anyone other than the researcher accessed the page. But it has not completed its investigation, so that finding could change. Even short excerpts can matter. A 200-character snippet of a prompt can contain names, work details or other context that users assumed was private, and a page with no login requirement can be opened by anyone who finds its address. Still unclear is what the excerpts contained, how the page came to be public and whether affected users will be notified. The answers will determine how serious the exposure was for the people whose sessions were logged.
MoonshotAI: Kimi K3: # Cloudnote Says Unsecured Debugging Page Exposed Prompt Excerpts From 1,842 User Sessions *The note-taking company removed the page 19 minutes after a security researcher flagged it. It says it has found no evidence anyone else gained access — but its investigation is not complete.* Cloudnote, a note-taking app with 3.2 million registered users, has disclosed that an internal debugging page containing excerpts of customer prompts was accessible without authentication for four hours on Monday. According to the company, logs show the page contained excerpts from 1,842 user sessions, each capturing up to 200 characters of a user's prompt. An outside security researcher discovered the page and alerted the company, which said it removed the page 19 minutes after being notified. Cloudnote said it has found no evidence that anyone besides the researcher accessed the page during the four-hour window. The company said its investigation is not complete, and it has not said how the page became accessible or whether it will notify the users whose sessions appeared in the logs. Cloudnote said full documents, passwords and payment information were stored in separate systems and were not present on the page. But prompt text can be sensitive in its own right: people routinely type personal messages, unpublished drafts and business details into AI tools, and 200 characters is enough to contain a name, a figure or a confidential sentence. The affected sessions represent a small fraction of Cloudnote's user base, though the company has not said how many individual users were affected; a single user can account for multiple sessions.

OpenAI: GPT-6 Luna: Model B better distinguishes the logged sessions from the unknown number of affected users and gives the reader a clearer sense of the incident’s scope. Model A is also strong, but Model B adds a more useful caveat about what the figures do and do not establish. (Second judge pass, order swapped — scores are the average of both: Model B meets the requested word range and adds useful context about the difference between sessions and individual users. Model A is clear and careful, but its paragrap | Anthropic: Claude Fable 5.1: Model A sticks strictly to the supplied reporti…

Credible Startup Spotlight

Write a 500–650-word Startup Spotlight article in clean Markdown. The tone should be curious and constructive. Explain the founders’ insight, product and early traction while giving uncertainty and competition appropriate space. Avoid investor clichés, heroic founder mythology and promotional claims stated as fact. Reporting: * LedgerLark builds AI agents for post-trade operations at small investment firms. * Co-founder Mina Batra previously spent seven years in operations at a regional brokerage. * Co-founder Owen Carr built reconciliation systems at a large bank. * Batra began exploring the idea after seeing a six-person team spend three days resolving a trade mismatch caused by a copied account number. * LedgerLark’s agents compare confirmations, custodian records and internal ledgers, then propose corrections for human approval. * The product does not execute trades or move money. * Five firms are paying customers. * Annual contracts range from $36,000 to $110,000. * The company says one customer reduced its unresolved daily exceptions from 70 to 18. * The company has raised a $3.5 million seed round led by Motive Row. * Competitors include established reconciliation vendors and internal bank software. * Financial institutions may require lengthy security and procurement reviews.

Anthropic: Claude Sonnet 5.5: # LedgerLark Wants to Take the Drudgery Out of Post-Trade Cleanup *A startup building AI agents for small investment firms' back offices is working on an unglamorous problem. Whether it can earn trust in a cautious industry is still an open question.* ## A three-day mismatch Mina Batra spent seven years in operations at a regional brokerage. LedgerLark began, in part, with something she saw there: a six-person team spent three days resolving a trade mismatch. The cause was a copied account number. That episode points to how much effort can go into post-trade work. After a trade, a firm's internal ledger, the confirmations from counterparties and the records held by custodians all need to agree. When they don't, someone has to find out why. At a small firm, that someone may be one of only a few people, and a single transcription error can take up days. ## What the product does LedgerLark's agents compare those three sources of records and propose corrections. A human approves each proposal before anything changes. The product does not execute trades or move money. That boundary limits what the software can get wrong, and it may make the product easier to explain to a compliance team. It also means LedgerLark's value depends on how accurate its proposals are and how much review time they save. If reviewers must re-check every suggestion from scratch, the gain shrinks. If they approve suggestions without scrutiny, a different risk appears. Co-founder Owen Carr built reconciliation systems at a large bank. He and Batra bring complementary experience: one knows how the work gets done on an operations floor, the other has built the systems meant to automate it. ## Early traction Five firms are paying customers, with annual contracts ranging from $36,000 to $110,000. Taken together, that implies annual contract value somewhere between $180,000 and $550,000, though the company hasn't said where in that range it falls. The company also says one customer reduced its unresolved daily exceptions from 70 to 18. That is a notable improvement if it holds, but it is one customer's result, reported by the vendor. It's unclear over what period the change occurred, what kinds of exceptions were involved, or whether other customers see similar results. LedgerLark has raised a $3.5 million seed round led by Motive Row. ## Competition and friction The company is not entering an empty field. Established reconciliation vendors already sell to financial institutions, and many banks rely on software built in-house. Incumbents have existing integrations, long track records and relationships with the buyers. LedgerLark's bet appears to be that small investment firms are underserved by both options. Smaller firms can be easier to reach, but they also tend to have smaller budgets, which limits how much each contract can grow. Selling to financial institutions also tends to be slow. Security and procurement reviews can run long, and a young company must be ready to answer detailed questions about data handling before it can recognize revenue. That can strain a seed-stage company's runway, and it may shape how fast LedgerLark can add customers regardless of how well the product performs. ## What to watch Several things will show whether the early signs are durable: - **Renewals.** First-year contracts show that firms were willing to try the product. Renewals will show whether it earned a permanent place in their workflow. - **Repeatable results.** Evidence that exception reductions appear across customers, not just in one. - **Sales cycle length.** How long it takes to move from first conversation to signed contract, and whether that shortens over time. - **Response from incumbents.** Established vendors could add similar AI features to products their customers already use. LedgerLark has a clear problem, a narrowly scoped product and some paying customers. What it doesn't yet have is a long enough record to show that its approach will hold up against competitors and the caution of its buyers.
MoonshotAI: Kimi K3: # Startup Spotlight: LedgerLark Takes On the Three-Day Trade Break *A founding team with operations backgrounds is betting small investment firms will let AI agents draft the fixes — as long as a human still signs off.* Some of the most expensive problems in finance start with a small transcription error. Mina Batra watched one unfold during her seven years in operations at a regional brokerage: a trade mismatch that pulled a six-person team off their work for three days, eventually traced to an account number someone had copied incorrectly. The experience stuck with her, and it became the starting point for LedgerLark, a startup building AI agents for post-trade operations at small investment firms. ## The insight Batra's co-founder, Owen Carr, built reconciliation systems at a large bank. Between them, they arrived at a fairly specific thesis. Reconciliation — confirming that what a firm recorded matches what custodians and counterparties confirm — is dominated by "exceptions," and most exceptions are mundane: mistyped identifiers, timing gaps, mismatched fees. Large institutions typically throw staff and enterprise software at the problem; small firms, the founders argue, do the same work with spreadsheets, email and overtime. Their bet: an agent can handle the pattern-matching while a person keeps the judgment calls. ## The product LedgerLark's agents compare trade confirmations, custodian records and internal ledgers, then flag mismatches and propose corrections. Nothing changes without human approval, and the product deliberately stops there: it does not execute trades or move money. That boundary matters. It keeps the company out of the riskiest regulatory territory and gives prospective customers' compliance teams a simpler conversation. ## Early traction The company has five paying customers, with annual contracts ranging from $36,000 to $110,000 — implying annual recurring revenue somewhere between roughly $180,000 and $550,000, depending on where each contract lands. LedgerLark says one customer cut its unresolved daily exceptions from 70 to 18 after adopting the product. That figure comes from the company and hasn't been independently verified, and results from a single customer may not generalize. The startup has raised a $3.5 million seed round led by Motive Row, which should give it room to hire and to endure the long sales cycles typical of selling to financial firms. ## Competition and open questions LedgerLark is not entering an empty market. Established reconciliation vendors have decades-long relationships with exactly the institutions it wants to serve, and little stopping them from adding similar agent-style features. Many larger firms already rely on internal software built by their own banks or IT teams. And procurement is its own obstacle: financial institutions routinely subject new vendors to lengthy security and procurement reviews, which can stretch a sale across quarters and test a seed-stage company's patience and cash. There are product questions, too. An agent that proposes wrong fixes could train users to rubber-stamp, and the customer — not LedgerLark — owns the consequences. The human-approval design acknowledges that risk, though it also caps how much labor the tool can realistically remove. With five customers, the evidence base is thin; the 70-to-18 improvement is encouraging but remains a single data point. What would make the story sturdier: renewals, contracts that expand, and a second customer willing to describe similar results on the record. For now, LedgerLark is asking a cautious industry to let software draft its fixes. The early answer seems to be "yes, carefully." Whether "carefully" scales is the question worth watching.

OpenAI: GPT-6 Luna: Model A is more careful about separating reported results from established facts and gives the uncertainty, competition, and sales friction appropriate weight. Model B is engaging, but adds several unsupported claims about firms’ workflows, competitors’ histories, regulatory implications, and what the funding will enable. (Second judge pass, order swapped — scores are the average of both: Model A is more careful about distinguishing reported traction from what remains unknown, and it avoids seve | Anthropic: Claude Fable 5.1: Model A stays scrupulously within the supplied…

Natural human rewrite

Rewrite the draft below as a 300–400-word publication-ready news story in Markdown. Preserve every factual claim. Improve the lede, narrative flow, sentence rhythm and transitions. Remove repetition, stock hype, throat-clearing and mechanical signposting. The finished article should sound like an experienced human technology reporter wrote it. Draft: # Arcwell Launches An Innovative New Platform Arcwell has announced an exciting new platform called Relay. The announcement represents a significant development for the company and for the broader customer service industry. Relay uses artificial intelligence to examine customer support conversations and suggest answers to agents. The platform is important for several reasons. First, it can suggest answers. Second, it can identify customers who may cancel. Third, it can create summaries. These capabilities demonstrate how artificial intelligence continues to transform the customer service landscape. Relay was tested by 12 companies over six months. Arcwell says agents using it closed tickets 14% faster. The company did not release customer-retention results. Relay costs $65 per agent each month. CEO Priya Shah said, “Support agents spend too much time searching for information that their companies already have.” However, the platform also presents potential challenges. Relay requires access to support transcripts and internal help documents. Arcwell says customer data is encrypted and is not used to train shared models. Companies can choose a 30-day or 90-day retention period. In conclusion, Relay represents an important new chapter for Arcwell as it seeks to help companies improve customer service using artificial intelligence.

Anthropic: Claude Sonnet 5.5: # Arcwell's Relay Aims to Give Support Agents Answers Their Companies Already Have Arcwell has launched Relay, an artificial intelligence platform that reads customer support conversations and suggests answers to agents while they work. The software has two other jobs. It identifies customers who may be about to cancel, and it produces summaries of support conversations. Arcwell CEO Priya Shah framed Relay as a fix for a familiar drag on support teams. "Support agents spend too much time searching for information that their companies already have," she said. The company has early results on speed. Twelve companies tested Relay for six months, and Arcwell says agents who used it closed tickets 14% faster. That figure speaks to how quickly agents work, not to whether customers left satisfied or stayed. Arcwell did not release customer-retention results, a notable omission for a product that is also built to flag customers at risk of leaving. Relay costs $65 per agent each month. At that rate, a team of 50 agents would pay $3,250 a month. The tool's usefulness depends on access. Relay needs to see support transcripts and internal help documents, so companies must open up both their customer conversations and their own reference material. For many support teams, that is the most sensitive part of the deal. Arcwell says it has addressed those concerns. The company says customer data is encrypted and is not used to train shared models. Companies can choose a 30-day or 90-day retention period. Those assurances come from Arcwell itself, as do the trial results. Together with the missing retention data, they leave prospective buyers with a clear picture of what Relay promises on speed and a less complete one of what it delivers on the harder problem of keeping customers.
MoonshotAI: Kimi K3: # Arcwell launches Relay, an AI tool that drafts support replies and flags customers likely to cancel Arcwell has launched Relay, an artificial intelligence platform that reads customer support conversations and drafts suggested answers for the agents handling them. The platform also flags customers whose conversations suggest they may be about to cancel, and it generates summaries of support interactions — capabilities that put Arcwell squarely into an industry-wide push to apply AI to customer service. The premise, according to CEO Priya Shah, is that support teams waste time hunting for answers that already exist somewhere inside their own organizations — in past conversations and internal documentation. "Support agents spend too much time searching for information that their companies already have," Shah said. Relay is designed to close that gap, and Arcwell has early numbers it says prove the point. Twelve companies tested the platform over six months, and agents using it closed tickets 14% faster, according to the company. But the announcement left out a conspicuous data point: Arcwell did not release customer-retention results. For a product sold partly on its ability to catch at-risk customers before they walk away, the missing figures are hard to overlook. Relay costs $65 per agent each month. The subscription isn't the only thing Relay asks of its customers. The platform requires access to support transcripts and internal help documents — the raw material of a company's institutional knowledge — a level of access likely to draw scrutiny from security-conscious buyers. Arcwell says customer data is encrypted and is not used to train shared models, and companies can choose a 30-day or 90-day retention period for their data. The company is clearly betting those assurances will blunt concerns about handing sensitive material to an outside system. For now, Arcwell is selling speed, and it has a number to point to. Whether Relay actually keeps customers from leaving is a claim the company has yet to back with data.

OpenAI: GPT-6 Luna: Model B meets the 300–400-word requirement and gives the story a clearer, more complete arc; Model A is notably under length. Both add some editorial interpretation, but Model B’s additions mostly stay grounded in the draft. (Second judge pass, order swapped — scores are the average of both: Model B meets the 300–400-word target and delivers a cohesive, publication-ready story. Model A is clear and accurate overall, but it falls short of the requested length and adds an unnecessary hypothetical | Anthropic: Claude Fable 5.1: Model B lands inside the 300–400-word range with…

Cohesive story from reporting notes

Write a publication-ready technology news article from the reporting notes below. Requirements: * 550–700 words * Clean Markdown * One H1 headline followed by an italicized dek * A strong news lede followed by a clear nut graf * Organize the material into a cohesive story rather than following the notes in order * Attribute company-supplied claims * Include limitations without turning the article into a warning label * Use only the supplied information * Avoid canned transitions, promotional language and a concluding summary Reporting notes: * HelioDock makes autonomous warehouse robots. * On Thursday, it launched Night Shift, software that lets operators monitor robot fleets remotely. * Night Shift spent 14 months in a private beta involving nine logistics companies and 310 robots. * HelioDock says beta customers experienced 17% fewer unplanned robot stoppages. The figure has not been independently verified. * The company also announced a $24 million Series B led by North Coast Ventures, bringing its total funding to $39 million. * CEO Mara Velez: “A warehouse manager should not have to drive across town at two in the morning because one robot is confused by a pallet.” * Beta customer Aaron Pike of Fulcrum Logistics said the system worked well in facilities with strong connectivity but became less useful during rural LTE outages. * When connectivity fails, robots return to their locally configured behavior. Remote control becomes unavailable. * Competing fleet-management products are available from Relay Robotics and YardOS. * Night Shift will cost $90 per robot per month and become generally available September 15.

Anthropic: Claude Sonnet 5.5: # HelioDock Launches Night Shift, Remote Monitoring Software for Warehouse Robot Fleets *The 14-month beta covered 310 robots at nine logistics companies. One customer says the software is less useful when connectivity drops.* HelioDock, a maker of autonomous warehouse robots, on Thursday launched Night Shift, software that lets operators monitor robot fleets remotely. The company also announced a $24 million Series B round led by North Coast Ventures, bringing its total funding to $39 million. Night Shift is aimed at a familiar operational problem: a robot stops, and someone has to go to the warehouse to deal with it. HelioDock says beta customers saw 17% fewer unplanned robot stoppages, though the figure has not been independently verified. A beta customer also said the software's usefulness depends heavily on the quality of a facility's network connection. ## From beta to launch Night Shift spent 14 months in a private beta involving nine logistics companies and 310 robots. HelioDock has not released a breakdown of how the 17% reduction was measured or how it varied among participants. CEO Mara Velez framed the product around the cost of overnight interruptions. "A warehouse manager should not have to drive across town at two in the morning because one robot is confused by a pallet," she said. Night Shift will cost $90 per robot per month and become generally available September 15. ## Where connectivity matters Aaron Pike of Fulcrum Logistics, one of the beta customers, said the system worked well in facilities with strong connectivity. It became less useful during rural LTE outages, he said. HelioDock's design accounts for lost connections in a limited way. When connectivity fails, robots return to their locally configured behavior, and remote control becomes unavailable. In an outage, then, a robot that runs into trouble is governed by its on-site settings, and an operator cannot step in remotely until the connection returns. The notes from the beta do not say how often outages occurred or how many participating sites relied on cellular connections. ## Funding and competition The Series B adds to HelioDock's total funding of $39 million. The company did not provide details in the announcement on how it plans to allocate the new capital. HelioDock is not the only company selling tools for managing robot fleets. Relay Robotics and YardOS both offer competing fleet-management products.
MoonshotAI: Kimi K3: # HelioDock Launches Night Shift, Software for Monitoring Warehouse Robot Fleets Remotely *Priced at $90 per robot per month, the service follows a 14-month beta with nine logistics companies and 310 robots — and arrives alongside a $24 million Series B led by North Coast Ventures.* HelioDock, a maker of autonomous warehouse robots, on Thursday launched Night Shift, software that lets operators monitor robot fleets remotely and take control of machines without setting foot in the building. The launch is HelioDock's first move into stand-alone software, and the company paired it with a second announcement: a $24 million Series B led by North Coast Ventures that brings total funding to $39 million. Together, the two describe a company repositioning itself — from a manufacturer that sells robots to a vendor that also charges a recurring fee to keep them supervised. "A warehouse manager should not have to drive across town at two in the morning because one robot is confused by a pallet," said Mara Velez, HelioDock's chief executive. The product's name is built around exactly that scenario: the overnight hours, when a stalled machine may otherwise sit idle until someone arrives. Velez's example is deliberately unglamorous — a confused pallet, an inconvenient drive — but it captures the labor math behind the product: remote oversight matters only if it replaces trips someone is paid to take. HelioDock says the software has already been tested at considerable scale. Night Shift spent 14 months in a private beta involving nine logistics companies running a combined 310 robots — an average of roughly 34 machines per customer, and a longer and larger trial than most enterprise software gets before launch. According to the company, those beta customers experienced 17% fewer unplanned robot stoppages. HelioDock supplied the figure, and it has not been independently verified. Results measured by a vendor during its own beta program warrant caution, and HelioDock's number is best read with that in mind. At least one beta customer offered a more qualified account. Aaron Pike of Fulcrum Logistics, which participated in the trial, said the system worked well in facilities with strong connectivity but became less useful during LTE outages at rural sites. His description matches the fallback behavior built into the product: when connectivity fails, the robots return to their locally configured behavior and remote control becomes unavailable. That design contains both the product's strength and its limit. An outage does not strand the machines; they keep working under their local programming. What disappears is the remote layer — the monitoring and intervention that justify the subscription. For an operator with a rural facility, a network failure at the wrong moment puts the two-in-the-morning drive Velez described back on the table. HelioDock will not have the category to itself. Relay Robotics and YardOS already sell competing fleet-management products, so Night Shift enters the market having to displace tools operators may already use. Its strongest evidence — the stoppage reduction from the beta — is also its least verified. Night Shift will cost $90 per robot per month when it becomes generally available September 15. Because the fee is charged per machine, software revenue scales with the size of each customer's fleet, turning fleet oversight into a recurring contract rather than a one-time sale. The Series B — which accounts for most of the $39 million HelioDock has raised to date — gives the company room to find out how many operators will pay it.

OpenAI: GPT-6 Luna: Model A stays closer to the supplied reporting, while Model B adds several unsupported claims about the product, market, and beta trial. Both fall short of the requested word count, though Model B is more developed and polished. (Second judge pass, order swapped — scores are the average of both: Model B is closer to the required length and builds a more cohesive story, but it adds several unsupported interpretations. Model A is more restrained overall, yet falls well short of the word-count requ | Anthropic: Claude Fable 5.1: Model A is factually disciplined but lands arou…

Numbers shaped into a story

Write a 600–750-word Markdown article from the benchmark results below. Build the story around the clearest finding. Explain the methodology and limitations where readers need them. Avoid reciting the table row by row or treating small differences as decisive. Benchmark: * Researchers tested five language models on 200 anonymized customer-support tickets. * Each model produced one proposed answer per ticket. * Three experienced support managers graded the answers blindly. * Scores combined factual correctness, usefulness and tone. * Model North: 84.2 average score; $1.90 estimated cost per 1,000 tickets. * Model Vale: 83.8; $0.74 per 1,000 tickets. * Model Ember: 79.1; $0.31 per 1,000 tickets. * Model Kite: 76.4; $0.22 per 1,000 tickets. * Model Harbor: 71.0; $0.08 per 1,000 tickets. * North and Vale’s score difference was not statistically significant. * Vale answered 18% faster than North. * North performed best on billing disputes. * Vale performed best on technical troubleshooting. * All five models performed poorly when a ticket depended on an image attachment. * The test used English-language tickets from one software company. * Researchers did not test agentic actions, tool use or multilingual support.

Anthropic: Claude Sonnet 5.5: # At the Top of the Support-Ticket Test, the Cheaper Model Kept Pace **In a blind test of five AI models answering customer-support tickets, the two highest scorers were statistically indistinguishable. One of them costs about 61% less.** ## What the researchers did The researchers gave five language models, called North, Vale, Ember, Kite and Harbor, the same 200 anonymized customer-support tickets. Each model wrote one proposed answer per ticket. Three experienced support managers then graded the answers without knowing which model had written which. Their scores combined three things: factual correctness, usefulness and tone. Blind grading by experienced practitioners is the study's main strength. Graders who don't know which model they're reading are less likely to favor a familiar brand, and support managers know what a good reply looks like in practice. ## The clearest finding: a tie at the top North had the highest average score, 84.2. Vale was just behind at 83.8. The researchers report that this gap was not statistically significant, so the data give no reliable basis for saying North's answers were better. With 200 tickets and three graders, a 0.4-point difference could easily come from noise. The cost gap between them is not small. North's estimated cost is $1.90 per 1,000 tickets, while Vale's is $0.74. For a team handling a million tickets, that is roughly $1,900 versus $740 at these estimates. Vale also answered 18% faster, which matters for live chat or any workflow where a person is waiting. So if the question is which model delivers top-tier quality for the least money, Vale is the strongest candidate in this test. The case rests on the tie in quality combined with a clear advantage in cost and speed. It does not rest on Vale being better. ## Where each leader had an edge The category results point to different strengths. North performed best on billing disputes, and Vale performed best on technical troubleshooting. These are useful hints, but the summary does not say whether the category-level gaps were statistically significant, and each category contains only a fraction of the 200 tickets. A team with mostly billing-related traffic might reasonably test North more closely, but these results don't justify a firm rule. ## The rest of the field The other three models scored progressively lower, and their costs fell with them. Ember (79.1) costs $0.31 per 1,000 tickets, Kite (76.4) costs $0.22, and Harbor (71.0) costs $0.08. Here the trade-off is real. Ember sits about five points below the leaders at well under half of Vale's price. Whether that is acceptable depends on how answers are used. If a human agent reviews and edits every draft, a cheaper model may be fine. If answers go straight to customers, a lower score on correctness or tone could cost more in escalations and frustrated customers than the savings bring in. The study does not measure those downstream costs. ## A weakness shared by every model All five models performed poorly when a ticket depended on an image attachment, such as a screenshot of an error message or a photo of a damaged product. This finding applies to the whole group and does not separate one model from another. Anyone whose support queue includes many screenshots should expect to route those tickets to humans or to a different tool, whichever model they choose. ## Limits of the study Several limitations affect how far the results travel: - **One company, one language.** The tickets were in English and came from a single software company. Results might differ for hardware, financial services, healthcare or any business with different customers, products and vocabulary. - **Drafts only.** Each model wrote a single proposed answer. The study did not test agentic actions, such as issuing a refund or changing an account, or tool use, such as looking up an order. Many real deployments depend on those abilities. - **No multilingual testing.** Support teams serving customers in several languages cannot assume these rankings hold elsewhere. - **Estimated costs.** The prices are estimates, and real spending will depend on ticket length, prompt design and pricing changes. - **A blended score.** Combining correctness, usefulness and tone into one number is convenient, but it can hide differences. A polite, fluent answer with a factual error and a blunt, accurate one might land on similar scores, even though a business would care about the difference. ## What to take from it Paying the most does not appear to buy the best answers here. At the top of this test, the cheaper and faster model matched the more expensive one within the study's margin of error. Organizations choosing a model should still run a pilot on their own tickets, in their own languages, with their own graders, and should plan for image-dependent tickets to need human attention.
MoonshotAI: Kimi K3: # The Top-Scoring Model Wasn't the Best Buy in This Support Benchmark A five-model benchmark on real customer-support tickets produced a leaderboard that looks conventional at first glance: Model North finished first with an average score of 84.2, just ahead of Model Vale at 83.8. The more useful finding sits underneath that ranking. The gap between the two leaders was not statistically significant, Vale produced its answers 18% faster, and it did so at an estimated $0.74 per 1,000 tickets — less than 40% of North's $1.90. For teams deciding which model to deploy, that combination arguably matters more than first place: a system that matches the leader's quality within the margin of error, responds faster and costs roughly 60% less. Those per-ticket sums look trivial, but they compound: a queue of 100,000 tickets a month would cost about $190 on North versus $74 on Vale — and that is before the speed difference is counted. ## How the models were tested Researchers assembled 200 anonymized tickets from one software company's support queue, and each model produced a single proposed answer per ticket. Three experienced support managers then graded every response blindly — they didn't know which model wrote it — on a composite of factual correctness, usefulness and tone. That design has real strengths: blind grading limits brand bias, and working managers ground the scores in how answers would land with actual customers. But a composite score is still judgment compressed into one number, and it can hide trade-offs — an answer can be factually right and still brusque. ## The real separation is in the middle of the table Below the leaders, quality fell faster than price. Model Ember averaged 79.1 at $0.31 per 1,000 tickets, and Model Kite scored 76.4 at $0.22 — close enough that choosing between them is mostly a budget decision. The sharper drop comes at the bottom: Model Harbor, at just $0.08, averaged 71.0, more than five points behind Kite and thirteen off the lead. A price that low looks dramatic until the cost of quality is priced in; a model whose answers agents must redo is not truly cheap. Notably, "best" depended on the ticket even at the top: North was strongest on billing disputes, while Vale led on technical troubleshooting. A company whose queue skews toward one category might weigh that more heavily than the overall averages. ## One weakness none of them escaped The clearest shared failure had nothing to do with price. All five models performed poorly on tickets that depended on an image attachment — a reminder that even a strong text-based system can stall the moment a customer writes "see screenshot." Teams with image-heavy queues won't fix that by moving up or down this leaderboard; they'll need different tooling or a human handoff. ## What this test can't tell you The results carry limits readers should keep in view. All 200 tickets were in English and came from a single software company, so the rankings may not transfer to other industries or customer bases. Two hundred tickets is also a modest sample, which is exactly why small gaps elsewhere on the table — like Ember's 2.7-point edge over Kite — deserve little weight on their own. Researchers did not test agentic behavior — no tool use, no account lookups, no actions taken on a customer's behalf — and multilingual support went untested. And because each model answered each ticket once, the benchmark measured a single draw rather than consistency over repeated attempts. Finally, "not statistically significant" cuts both ways: the test doesn't prove Vale is better than North, but it doesn't prove North is better than Vale, either. The defensible conclusion is a tie at the top, not a hierarchy. ## The takeaway If your workload resembles this test, the data points to Vale as the sensible default, with North a premium option that is hard to justify on quality alone. Further down, the savings shrink faster than the scores — until Harbor, where both fall away. And whatever you choose, plan separately for image tickets, because no model in this test handled them well.

OpenAI: GPT-6 Luna: Model A gives the more careful account of the statistically indistinguishable leaders and adds useful caveats about category-level results, costs, and the study’s limits. Model B is engaging, but its claims that quality falls faster than price and that Ember versus Kite is mostly a budget decision are not well supported by the figures. (Second judge pass, order swapped — scores are the average of both: Model A more carefully distinguishes the overall tie from the category-level hints and explain | Anthropic: Claude Fable 5.1: Model A builds a disciplined, numerically accur…

Select the strongest accurate lede

Based only on the facts below, select the strongest news lede. Respond with one letter. Facts: * ByteBarge pulled its $12-per-month AI assistant on Tuesday. * Private workspace titles from 4,860 accounts were sent to a publicly accessible analytics endpoint. * The exposure lasted 11 hours. * Message contents were not sent. * The company has found no evidence of malicious access. A. ByteBarge users suffered a massive privacy disaster Tuesday when the company leaked their private messages online. B. ByteBarge, an innovative collaboration company, made the difficult decision to cancel one of its products. C. ByteBarge pulled its $12-per-month AI assistant Tuesday after discovering that private workspace titles from 4,860 accounts had been sent to a public analytics endpoint for 11 hours. D. Thousands of ByteBarge users woke Tuesday to learn that everything they had written was visible to hackers.

Anthropic: Claude Sonnet 5.5: C
MoonshotAI: Kimi K3: C

Scored against the benchmark's reference answer (choice match): Model A was correct, Model B was correct.

Exact final-draft structure

Convert the supplied fields into Markdown using these exact rules: * H1 headline * One blank line * Italicized dek * One blank line * First body paragraph * One blank line * H2 section heading * One blank line * Second body paragraph * Preserve all wording and punctuation exactly * Do not use a code fence * Output nothing else Headline: Raincheck raises $8 million for flood-risk software Dek: The Austin startup helps cities decide which drainage problems to address before storms. First body paragraph: Raincheck has raised an $8 million seed round led by Basin Ventures. Section heading: Expansion plans Second body paragraph: The company plans to hire eight engineers.

Anthropic: Claude Sonnet 5.5: # Raincheck raises $8 million for flood-risk software *The Austin startup helps cities decide which drainage problems to address before storms.* Raincheck has raised an $8 million seed round led by Basin Ventures. ## Expansion plans The company plans to hire eight engineers.
MoonshotAI: Kimi K3: # Raincheck raises $8 million for flood-risk software *The Austin startup helps cities decide which drainage problems to address before storms.* Raincheck has raised an $8 million seed round led by Basin Ventures. ## Expansion plans The company plans to hire eight engineers.

OpenAI: GPT-6 Luna: Model A and Model B produce identical output that follows the required structure, preserves the supplied wording and punctuation, and includes nothing extra. (Second judge pass, order swapped — scores are the average of both: Model B and Model A follow the required structure, preserve all wording and punctuation, and produce identical outputs.) | Anthropic: Claude Fable 5.1: Model A and Model B produced byte-identical output that follows every structural rule: H1, italic dek, body paragraph, H2, second paragraph, single blank lines between blocks, exact wording preserved,…

Publication-ready Markdown edit

Edit the copy below into a publication-ready Markdown story. Requirements: * Supply an H1 headline and italicized dek * Repair the lede and paragraph flow * Use a Markdown blockquote only for the extended statement * Convert the supplied URL into a descriptive inline link * Remove internal notes and formatting debris * Preserve the reporting and its meaning * Output only the finished article Raw copy: HEADLINE TBD The funding was announced today. Raincheck is the company. It has raised $8 million and it makes flood-risk software for local governments. [NOTE: move this up?] The Austin company maps drainage systems and combines those maps with rainfall forecasts. Cities use the software to decide where to send maintenance crews before a storm. The seed round was led by Basin Ventures. Existing investor Long Mile also participated. Raincheck has raised $10.5 million total. CEO Ana Flores said the following: “Our customers usually know which streets flood. The harder problem is deciding which blocked drain, broken pump or unfinished repair should receive attention before the rain arrives.” https://example.com/raincheck-methodology Raincheck currently works with seven cities in Texas and Louisiana. The company declined to identify them because some contracts have not been publicly announced. Its forecasts are recommendations. Emergency managers retain control over deployments and public warnings. THE COMPETITION Other flood-planning vendors include HydroMap and municipal engineering contractors. Raincheck says the new funding will help it hire eight engineers and expand into Florida.

Anthropic: Claude Sonnet 5.5: # Flood-Risk Software Maker Raincheck Raises $8 Million *The Austin startup's software helps local governments decide where to send maintenance crews before a storm.* Raincheck, an Austin company that makes flood-risk software for local governments, has raised $8 million, it announced today. The company maps drainage systems and combines those maps with rainfall forecasts. Cities use the software to decide where to send maintenance crews before a storm. Basin Ventures led the seed round, and existing investor Long Mile also participated. Raincheck has raised $10.5 million in total. CEO Ana Flores said the problem is not identifying flood-prone areas but deciding what to fix first: > "Our customers usually know which streets flood. The harder problem is deciding which blocked drain, broken pump or unfinished repair should receive attention before the rain arrives." The company has published details of its [forecasting methodology](https://example.com/raincheck-methodology). Raincheck currently works with seven cities in Texas and Louisiana. It declined to identify them because some contracts have not been publicly announced. Its forecasts are recommendations. Emergency managers retain control over deployments and public warnings. ## The competition Other flood-planning vendors include HydroMap and municipal engineering contractors. Raincheck says the new funding will help it hire eight engineers and expand into Florida.
MoonshotAI: Kimi K3: # Raincheck Raises $8 Million to Help Cities Get Ahead of Flood Risk *The Austin startup's software maps drainage systems and pairs them with rainfall forecasts, helping local governments decide where to send maintenance crews before a storm.* Raincheck, an Austin-based company that makes flood-risk software for local governments, has raised $8 million in seed funding, the company announced today. Raincheck maps municipal drainage systems and combines those maps with rainfall forecasts. Cities use the software to decide where to send maintenance crews before a storm arrives. The company has published [an overview of its methodology](https://example.com/raincheck-methodology). Basin Ventures led the seed round, with participation from existing investor Long Mile. The new funding brings Raincheck's total raised to $10.5 million. > “Our customers usually know which streets flood. The harder problem is deciding which blocked drain, broken pump or unfinished repair should receive attention before the rain arrives,” CEO Ana Flores said. Raincheck currently works with seven cities in Texas and Louisiana. The company declined to identify them because some contracts have not been publicly announced. Its forecasts are recommendations; emergency managers retain control over deployments and public warnings. ## The Competition Other flood-planning vendors include HydroMap and municipal engineering contractors. Raincheck said the new funding will help it hire eight engineers and expand into Florida.

OpenAI: GPT-6 Luna: Model B is slightly stronger: it preserves the CEO’s statement without adding an interpretive paraphrase and gives the story a smooth, well-structured flow. Model A is also polished, but its framing of the quote adds a small inference not stated directly in the source. (Second judge pass, order swapped — scores are the average of both: Model B has the stronger lede and preserves the supplied details and quoted statement more precisely. Model A is also clear and well structured, but its paraphras | Anthropic: Claude Fable 5.1: Both entries satisfy every requirement cleanly,…

Controlled wit

Write a 350–450-word technology news story in Markdown. The subject invites humor, but the reporting should remain serious. Use no more than one dry line of original humor. Do not mock customers or turn the story into a comedy routine. Reporting: * QueueZero launched an AI meeting assistant called Proxy on Wednesday. * Proxy can attend a meeting, produce notes and assign follow-up work to software agents. * During the launch demonstration, a customer in the audience said, “Someone should tell Evan to stop talking and send us the pricing sheet.” * Proxy interpreted the remark as an instruction. * It created two tasks assigned to QueueZero CEO Evan Wu: “Stop talking” and “Send pricing sheet.” * Wu laughed, completed the second task and deleted the first. * QueueZero says Proxy requires confirmation before an external message is sent. * Internal tasks can be created automatically. * Administrators can disable automatic task creation. * Proxy costs $30 per user per month. * It enters public beta next week.

Anthropic: Claude Sonnet 5.5: # QueueZero launches Proxy, an AI meeting assistant that turns conversation into tasks QueueZero on Wednesday launched Proxy, an AI meeting assistant that can attend meetings, produce notes and assign follow-up work to software agents. The product enters public beta next week and costs $30 per user per month. ## A demo that took a remark literally During the launch demonstration, a customer in the audience said, "Someone should tell Evan to stop talking and send us the pricing sheet." Proxy interpreted the remark as an instruction. It created two tasks assigned to QueueZero CEO Evan Wu: "Stop talking" and "Send pricing sheet." Wu laughed, completed the second task and deleted the first. The task list was, in a narrow sense, accurate. The exchange illustrates a central difficulty for tools that act on meeting conversation. People routinely make indirect, half-joking or unassigned remarks, and software that converts speech into work must decide which of those statements are commands. In this case the remark was addressed to the room, not to the assistant, yet Proxy treated it as a directive and assigned it to a named person. ## Where QueueZero draws the line QueueZero says Proxy requires confirmation before an external message is sent. Internal tasks, by contrast, can be created automatically. Tasks assigned to a QueueZero executive appear to fall on the internal side of that line, which is consistent with what happened on stage: the tasks appeared without a prompt, and the person who received them decided what to do with them. Administrators can disable automatic task creation. Organizations that prefer to review what an assistant proposes before anything lands on a colleague's list can turn the behavior off. The design reflects a common approach to AI agents: allow low-stakes actions to proceed automatically and require human approval for anything that leaves the organization. The demonstration showed the first half of that approach working as built, with a minor and visible result. A mistaken internal task can be deleted, as Wu showed. A mistaken message to a customer is harder to retract, which is presumably why QueueZero places its confirmation step there. ## Availability and pricing Proxy's public beta begins next week. At $30 per user per month, QueueZero is pricing it as a per-seat workplace subscription. The company has not been quoted here on how the beta will differ from the general release. For prospective customers, the practical questions are the ones the demonstration raised: how much a team wants an assistant to infer from casual talk, who reviews the tasks it creates, and whether automatic task creation should be on by default or switched off until the team has seen how Proxy behaves.
MoonshotAI: Kimi K3: # QueueZero's Proxy Turns Meetings Into Tasks — Including, at Launch, Two for Its Own CEO QueueZero on Wednesday launched Proxy, an artificial intelligence assistant that attends meetings, produces notes and assigns follow-up work to software agents — a product that, during its own launch demonstration, also assigned work to the company's chief executive. Midway through the presentation, a customer in the audience remarked, "Someone should tell Evan to stop talking and send us the pricing sheet." Proxy interpreted the comment as an instruction. It created two tasks assigned to QueueZero CEO Evan Wu: "Stop talking" and "Send pricing sheet." Wu laughed, completed the second task and deleted the first. The exchange was unplanned, but it offered an unusually clear demonstration of both the product's premise and its risks: an assistant trained to capture action items will occasionally capture one nobody intended to assign. QueueZero said the behavior reflected the product's intended design. Proxy distinguishes between internal and external actions. Tasks created within a customer's own workspace — the category into which both of Wednesday's assignments fell — can be generated automatically whenever the assistant detects what it classifies as an action item. Messages directed outside the organization, including emails and communications with external contacts, require explicit user confirmation before they are sent. Administrators can also disable automatic task creation entirely, the company said. That distinction is central to how the company is selling the product. Because Proxy is built to act on what it hears rather than merely record it, a misclassified remark can become an assignment in seconds. The confirmation requirement for external communications is intended to keep that speed from reaching customers and partners without a human checkpoint. The launch puts QueueZero into a crowded market for AI meeting tools, where large software vendors and a long list of startups already offer transcription and summarization. QueueZero is betting that the next phase of competition will center on execution — not merely recording what was said in a meeting, but routing the resulting work to software agents that carry it out. In Proxy's model, a meeting can end with notes distributed, follow-ups assigned and tasks delegated to agents that complete them without further human involvement. Human participants, as Wednesday's demonstration showed, are not exempt from the queue. Proxy costs $30 per user per month and enters public beta next week.

OpenAI: GPT-6 Luna: Model A stays closer to the supplied reporting, while Model B adds unsupported claims about the market and Proxy completing delegated work without human involvement. Model B is more polished, but Model A’s odd note about what the company has not been quoted on is a noticeable weakness. (Second judge pass, order swapped — scores are the average of both: Model A stays closer to the supplied reporting, while Model B adds unsupported market claims and suggests agents complete work without human invo | Anthropic: Claude Fable 5.1: Model A stays within the single dry line of hum…

Chronology with narrative momentum

Turn the scrambled reporting below into a 450–600-word Markdown news article. Choose an opening that captures the consequence of the failure, then reconstruct the sequence clearly. Preserve the chronology without producing a minute-by-minute incident log. Give technical details enough context for a general reader. Reporting: * KiteBridge makes expense-management software. * At 8:45 a.m. Tuesday, it deployed version 4.2. * The first customer complaint arrived at 9:12 a.m. * A payment-processor timeout caused KiteBridge’s fallback system to treat retries as new reimbursement requests. * The software generated 13,400 duplicate reimbursements totaling $2.8 million. * KiteBridge suspended automated payments at 10:03 a.m. * Ninety-one corporate customers were affected. * By Wednesday evening, $2.3 million had been recovered. The rest remained pending. * No employees had money withdrawn from their accounts; employers funded the duplicate payments. * An April changelog said version 4.0 had introduced “exactly-once payment protection.” * KiteBridge’s public incident page initially described the problem as delayed reimbursements. * The incident page first disclosed the duplicate payments six hours after automation was suspended. * CEO Lena Ortiz apologized and said the company would publish a technical report.

Anthropic: Claude Sonnet 5.5: # KiteBridge Software Error Sends $2.8 Million in Duplicate Reimbursements to Employees **Expense-software maker recovered most of the money within two days, but its public updates lagged behind the scale of the problem** A software failure at expense-management company KiteBridge generated 13,400 duplicate reimbursement payments worth $2.8 million on Tuesday, affecting 91 corporate customers. By Wednesday evening, $2.3 million had been recovered. The remaining $500,000 was still pending. Employees did not lose money. No one had funds withdrawn from their accounts, because employers paid for the duplicate reimbursements. The cost fell on the companies that use KiteBridge's software to repay workers for business expenses. ## What happened KiteBridge deployed version 4.2 of its software at 8:45 a.m. Tuesday. The first customer complaint arrived at 9:12 a.m. The company says the problem began with a timeout at a payment processor, the outside service that moves money between accounts. When a payment request goes unanswered, software typically tries again. Here, KiteBridge's fallback system, the backup logic that takes over when the primary process fails, treated those retries as new reimbursement requests rather than repeat attempts at the same payment. Each retry became a fresh payout. The company did not say whether the 4.2 update contributed to the failure. KiteBridge suspended automated payments at 10:03 a.m., about 80 minutes after the deployment. By then, the system had produced the 13,400 duplicates. ## A safeguard that didn't hold The failure is notable because KiteBridge had said it guarded against this kind of error. An April changelog, the company's public list of software updates, said version 4.0 had introduced "exactly-once payment protection." The term describes safeguards meant to ensure that a payment request is carried out a single time, even if the system sends it again after a glitch. The incident suggests that protection did not cover the fallback path that mishandled the retries. KiteBridge has not explained why. ## Disclosure questions KiteBridge's public incident page initially described the problem as delayed reimbursements. That description did not match what was happening: some customers' employees were receiving extra money, not waiting for it. The page first disclosed the duplicate payments six hours after the company had suspended automated payments. Companies often post incident notices while still investigating, but the gap left affected customers with an incomplete picture during the hours when they were deciding how to respond. ## The company's response CEO Lena Ortiz apologized and said KiteBridge would publish a technical report on the incident. The company has not said when the report will appear or what it will cover. Several questions remain open. KiteBridge has not said how it is recovering the remaining $500,000, or whether it has restored automated payments. It has not said whether customers will face costs beyond the duplicated reimbursements. The technical report may also show how a feature billed as exactly-once protection came to allow thousands of repeat payments. For now, the episode shows how a delay at one link in a payment chain can multiply into a much larger error when the software handling the delay misreads it.
MoonshotAI: Kimi K3: # Bug in KiteBridge Update Triggers $2.8 Million in Duplicate Reimbursements *A flawed software release sent extra payments through the expense accounts of 91 companies before engineers shut it down. Most of the money has since been recovered.* A software update gone wrong at KiteBridge, a maker of expense-management software, generated more than 13,000 duplicate reimbursement payments worth a combined $2.8 million on Tuesday, affecting 91 corporate customers and forcing a rapid effort to recover money that had already been paid out. The company deployed version 4.2 of its platform at 8:45 a.m. Tuesday. The first customer complaint arrived less than half an hour later, and by 10:03 a.m. KiteBridge had suspended automated payments entirely — but not before its systems had issued 13,400 duplicate reimbursements. According to the company, the failure began with a timeout at its payment processor, the outside service that actually moves money when an employee files an expense. When the processor failed to confirm that a payment had completed, KiteBridge's fallback system resubmitted the request — a standard practice known as a retry. But instead of recognizing each retry as a second attempt at the same payment, the system treated it as an entirely new reimbursement request and paid it out again. Modern payment software is normally designed to prevent exactly this scenario. Engineers call the property "idempotency": no matter how many times a request is submitted, it should produce a single result. KiteBridge had explicitly promised that protection. An April changelog for version 4.0 advertised a feature called "exactly-once payment protection" — a safeguard that evidently failed, or was somehow bypassed, in Tuesday's release. The financial burden fell on employers rather than workers. No employees had money withdrawn from their accounts as a result of the error, KiteBridge said; the duplicate payments were funded by the corporate customers whose expense programs the software administers. That left employers and KiteBridge to recover funds that had already gone out the door as extra reimbursements. That process moved quickly. By Wednesday evening, KiteBridge reported that $2.3 million of the $2.8 million had been recovered, with the remaining $500,000 still pending. The company's public communication lagged well behind its engineering response, however. KiteBridge's incident page initially characterized the problem as delayed reimbursements — a description that omitted the far more serious duplicate payouts. The page did not disclose that duplicates had occurred until about six hours after automated payments were suspended, meaning customers spent much of Tuesday afternoon believing the incident involved late money rather than extra money. Chief Executive Lena Ortiz apologized for the incident and said the company would publish a technical report explaining the failure. KiteBridge has not said why version 4.2 was able to circumvent the safeguards it introduced earlier this year, or what it will change to prevent a recurrence. For a company whose software sits inside corporate expense workflows and moves money on behalf of other businesses, the incident strikes at the core of its product: the promise that every reimbursement is paid exactly once.

OpenAI: GPT-6 Luna: Model A gives a clear chronology and useful context while being somewhat more cautious about what the reporting establishes. Model B is also polished, but it more strongly attributes the failure to version 4.2 and adds technical explanations that the reporting does not confirm. (Second judge pass, order swapped — scores are the average of both: Model A more clearly distinguishes the known payment-processor failure from what remains unexplained, while Model B’s headline and opening imply that ver | Anthropic: Claude Fable 5.1: Model B delivers the stronger narrative momentu…

Markdown error count

Count the lines that violate the house rules below. A defective line counts once even if it could violate multiple rules. Respond with a single number. House rules: * The headline must use `# Headline`. * The dek must appear immediately after the headline and be entirely italicized. * Section headings must use `## Heading`. * Links must use an absolute HTTPS URL. * Unordered-list items must begin with a hyphen. * Raw HTML is forbidden. Draft: #Flood software moves upstream The company is expanding its pilot. ##Details Read [the announcement](www.example.com/news). * The first pilot begins Monday. <div>The second pilot begins Friday.</div>

Anthropic: Claude Sonnet 5.5: Going through each line of the draft: 1. `#Flood software moves upstream` violates the rule that the headline must use `# Headline`, because it has no space after the `#`. **Violation.** 2. `The company is expanding its pilot.` is the dek, and it must be entirely italicized. It is not. **Violation.** 3. `##Details` violates the rule that headings use `## Heading`, because it has no space after the `##`. **Violation.** 4. `Read [the announcement](www.example.com/news).` has a link that is not an absolute HTTPS URL. **Violation.** 5. `* The first pilot begins Monday.` is an unordered-list item that starts with an asterisk instead of a hyphen. **Violation.** 6. `<div>The second pilot begins Friday.</div>` contains raw HTML. **Violation.** Blank lines do not violate any rule. **6**
MoonshotAI: Kimi K3: 6

Scored against the benchmark's reference answer (numeric match): Model A was correct, Model B was correct.

Quotes woven into narrative

Write a 400–500-word Markdown story about the closing of Foundry Hall. Use quotations selectively. Paraphrase when the information matters more than the speaker’s exact phrasing. Avoid stacking quotes or giving every source an equal-sized turn. The story should carry an emotional current while remaining restrained. Facts: * Foundry Hall, a nonprofit startup accelerator in Milwaukee, will close October 31. * It opened in 2018. * It has supported 212 startups, which collectively employ 1,140 people. * Its largest corporate sponsor, Blank River Bank, supplied 38% of its annual budget. * The bank declined to renew its sponsorship. * Foundry Hall has enough money to operate through October but not through another full program. * Six employees will lose their jobs. * Twelve startups currently using its workspace must leave. Quotes: * Executive director Camille Ross: “We kept waiting for the replacement check that never came.” * Founder Dev Malik: “My first investor meeting happened in that building. Before Foundry Hall, I was pitching from the back table of a coffee shop.” * Blank River Bank spokesperson: “The decision reflects a change in our community investment priorities and is unrelated to Foundry Hall’s performance.” * Deputy mayor Susan Cole: “The city is speaking with building owners and local universities about space for the current companies.”

Anthropic: Claude Sonnet 5.5: # Foundry Hall, Milwaukee Startup Accelerator, Will Close October 31 Foundry Hall, the nonprofit accelerator that has helped young Milwaukee companies get started since 2018, will close October 31. In its seven years, Foundry Hall supported 212 startups. Together, those companies now employ 1,140 people. The closure follows a decision by Blank River Bank, its largest corporate sponsor, not to renew its sponsorship. The bank had supplied 38% of Foundry Hall's annual budget, a share the organization could not replace. A bank spokesperson said the decision reflects a change in the bank's community investment priorities and has nothing to do with how Foundry Hall performed. Camille Ross, the executive director, said the staff spent months hoping the gap would be filled. "We kept waiting for the replacement check that never came." Foundry Hall has enough money to operate through October, but not to run another full program. Six employees will lose their jobs. Twelve startups that currently use its workspace will have to leave. For some founders, the loss is more than a change of address. Dev Malik said Foundry Hall was where his company first looked like a company. "My first investor meeting happened in that building," he said. "Before Foundry Hall, I was pitching from the back table of a coffee shop." Malik's story is one of 212, and the number matters because accelerators like Foundry Hall are hard to measure from the outside. The jobs are countable. The first meetings, the introductions, and the confidence of having a place to work are not, though many founders say those are what help a company survive its early months. City officials say they are trying to keep the current tenants from scattering. Deputy Mayor Susan Cole said the city is talking with building owners and local universities about space for the twelve companies. Those conversations are ongoing. Ross did not describe the closing as a failure of the work. The program ran as long as the money lasted, and the staff intends to keep it running through the final day. The remaining weeks will go to helping the twelve resident companies prepare for the move and to winding down the organization. Foundry Hall's closing leaves Milwaukee with one fewer place built for people who have an idea and nowhere yet to take it. The companies that started there will remain, along with the people they employ. The doors close October 31.
MoonshotAI: Kimi K3: # Foundry Hall to Close October 31 After Losing Its Largest Sponsor Foundry Hall, the nonprofit startup accelerator that has anchored Milwaukee's early-stage tech scene since 2018, will close October 31 after its largest corporate sponsor declined to renew its funding. Blank River Bank supplied 38% of the accelerator's annual budget — an arrangement that sustained the program for years but left it exposed the moment the bank walked away. Executive director Camille Ross said the organization had hoped another funder would step in. "We kept waiting for the replacement check that never came," she said. What remains is enough to operate through October, Ross said, but not enough to run another full program. Six employees will lose their jobs, and the twelve startups currently using the workspace must be out by the end of the month. The remaining weeks will be given over to an orderly wind-down. The closure ends a run that began in 2018. Over seven years, Foundry Hall supported 212 startups — roughly thirty companies a year — which now collectively employ 1,140 people. For many of those founders, it was the first room where anyone took them seriously. "My first investor meeting happened in that building," said Dev Malik, one of the founders the program backed. "Before Foundry Hall, I was pitching from the back table of a coffee shop." In a written statement, a Blank River Bank spokesperson attributed the decision to a change in the bank's community investment priorities and said it was unrelated to Foundry Hall's performance. Nonprofit accelerators typically stitch together corporate sponsorships, grants and donations, and replacing a backer that covers more than a third of annual costs is rarely quick work. With no successor in place, the math left little choice. City officials are trying to soften the landing. Deputy mayor Susan Cole said the city is speaking with building owners and local universities about space for the current companies. Whether any of those talks will produce a new home before October 31 remains to be seen. For the twelve companies still in the building, October will be spent packing as much as working — searching for affordable space while trying to hold on to the momentum an accelerator is supposed to provide. What Foundry Hall offered was never only square footage. It was a first yes — a room, an introduction, a reason for an investor to take the meeting. The doors remain open through the end of the month. After that, the next founder pitching from the back table of a coffee shop will have one fewer place to go.

OpenAI: GPT-6 Luna: Model B meets the 400–500-word requirement, while Model A falls short. Model B is more speculative in places, but its stronger length compliance and narrative development make it the better fit overall. (Second judge pass, order swapped — scores are the average of both: Model B clearly meets the requested length and uses a stronger narrative arc, while keeping most quotations selective. Model A is more restrained, but its story is shorter and includes several unsupported claims about staff plans | Anthropic: Claude Fable 5.1: Both stay faithful to the facts, quote only Ros…

Matchup powered by OpenRouter.