A newsroom-style comparison of Claude Sonnet 5.5 and Kimi K3 across editing, narrative construction, news judgment and factual restraint. The task set rewards both polish and fidelity to the supplied reporting.
Kimi K3 leads the saved results with an aggregate score of **101.9** to Claude Sonnet 5.5’s **99.0**. It won 7 tasks, Claude won 2, and 3 were ties. The clearest Kimi advantages came in chronology, weaving quotes into a narrative, building a cohesive story from notes, and publication-ready Markdown; the models also tied on the lede selection and exact-structure tasks.
That edge came with a recurring caveat: Kimi’s stronger narrative shape sometimes outran the reporting. Evaluations flagged unsupported details in several of its articles, including claims about products, customers, and operating conditions. Claude was more careful in the startup spotlight and opening news judgment, where it better distinguished established facts from unknowns. Its restraint, however, did not always compensate for falling short of requested length or delivering a less developed article.
The result favors Kimi’s ability to turn material into readable, structured copy, while Claude’s best work shows the value of disciplined attribution. Neither pattern is a clean rule: the two tied on three tasks, and the editorial trade-off between narrative momentum and factual caution was visible across the set.
**Final call: Kimi K3 wins this matchup on the saved task sample, with a clear result—not a statistical claim. This assessment applies only to that sample.**
Markdown error count
Count the lines that violate the house rules below. A defective line counts once even if it could violate multiple rules. Respond with a single number.
House rules:
* The headline must use `# Headline`.
* The dek must appear immediately after the headline and be entirely italicized.
* Section headings must use `## Heading`.
* Links must use an absolute HTTPS URL.
* Unordered-list items must begin with a hyphen.
* Raw HTML is forbidden.
Draft:
#Flood software moves upstream
The company is expanding its pilot.
##Details
Read [the announcement](www.example.com/news).
* The first pilot begins Monday.
<div>The second pilot begins Friday.</div>
Anthropic: Claude Sonnet 5.5: Going line by line:
1. `#Flood software moves upstream` violates the headline rule, because it lacks the space after `#`. (1)
2. `The company is expanding its pilot.` is meant to be the dek, but it is not italicized. (2)
3. `##Details` violates the section heading rule, because it lacks the space. (3)
4. `Read [the announcement](www.example.com/news).` violates the link rule, because the URL is not an absolute HTTPS URL. (4)
5. `* The first pilot begins Monday.` violates the list rule, because it begins with an asterisk instead of a hyphen. (5)
6. `<div>The second pilot begins Friday.</div>` violates the raw HTML rule. (6)
Blank lines are not violations.
**6**
MoonshotAI: Kimi K3: 6
Scored against the benchmark's reference answer (numeric match): Model A was correct, Model B was correct.
Controlled wit
Write a 350–450-word technology news story in Markdown.
The subject invites humor, but the reporting should remain serious. Use no more than one dry line of original humor. Do not mock customers or turn the story into a comedy routine.
Reporting:
* QueueZero launched an AI meeting assistant called Proxy on Wednesday.
* Proxy can attend a meeting, produce notes and assign follow-up work to software agents.
* During the launch demonstration, a customer in the audience said, “Someone should tell Evan to stop talking and send us the pricing sheet.”
* Proxy interpreted the remark as an instruction.
* It created two tasks assigned to QueueZero CEO Evan Wu: “Stop talking” and “Send pricing sheet.”
* Wu laughed, completed the second task and deleted the first.
* QueueZero says Proxy requires confirmation before an external message is sent.
* Internal tasks can be created automatically.
* Administrators can disable automatic task creation.
* Proxy costs $30 per user per month.
* It enters public beta next week.
Anthropic: Claude Sonnet 5.5: # QueueZero Launches Proxy, an AI Meeting Assistant That Assigns Follow-Up Work
**Tool can attend meetings, take notes and delegate to software agents; launch demo showed the risk of treating remarks as commands**
QueueZero on Wednesday launched Proxy, an AI meeting assistant that can attend meetings, produce notes and assign follow-up work to software agents. The product enters public beta next week and costs $30 per user per month.
During the launch demonstration, a customer in the audience said, "Someone should tell Evan to stop talking and send us the pricing sheet."
Proxy treated the remark as an instruction. It created two tasks assigned to QueueZero CEO Evan Wu: "Stop talking" and "Send pricing sheet."
Wu laughed, completed the second task and deleted the first. It was the quickest prioritization decision of the afternoon.
## Where the Line Falls
The exchange illustrates a known difficulty for tools that convert conversation into action. People often voice requests, complaints and jokes in the same sentence, and an assistant that acts on spoken language has to decide which parts are commands.
QueueZero says Proxy is built with limits on what it can do unprompted. The company says the assistant requires confirmation before any external message is sent. Tasks that stay inside an organization, such as the two assigned to Wu, can be created automatically.
Administrators can disable automatic task creation. In that configuration, a remark like the one in the demonstration would not generate assignments without a person approving them first. QueueZero did not say in the launch materials whether automatic creation will be on or off by default.
## What Proxy Does
Proxy joins meetings and produces notes. It can then assign follow-up work to software agents, which are automated programs that carry out tasks such as drafting documents or retrieving files. The demonstration showed it assigning tasks to a person, in this case the company's chief executive.
The separation between internal tasks and external messages is the central safeguard. A misread internal task creates clutter, which can be deleted. An external message sent in error, such as a note to a customer or partner, is harder to undo. Proxy's confirmation requirement is meant to keep that second category under human control.
## Pricing and Availability
At $30 per user per month, Proxy is priced as a per-seat workplace subscription. The public beta begins next week, which will give organizations an opportunity to test how the assistant handles real meetings, including the casual remarks that surround the business at hand.
For teams considering the product, the demonstration suggests practical questions to settle during the beta: which task-creation settings to use, who can approve outgoing messages, and how often the assistant misreads a comment as a directive.
In this case, the customer got the pricing sheet.
MoonshotAI: Kimi K3: # QueueZero Launches Proxy, an AI Meeting Assistant That Turns Talk Into Tasks
QueueZero on Wednesday launched Proxy, an artificial intelligence assistant designed to attend meetings, produce notes and assign follow-up work to software agents — a capability the company wound up demonstrating, unscripted, on its own chief executive.
According to the company, Proxy can join a call as a participant, transcribe and summarize the discussion, and convert what it hears into assignments routed to connected business software. QueueZero pitches the product as a way to close the gap between what gets decided in a meeting and what gets done afterward.
The launch event provided an early case study. As QueueZero CEO Evan Wu was presenting, a customer in the audience said, "Someone should tell Evan to stop talking and send us the pricing sheet."
Proxy interpreted the remark as an instruction. Two tasks soon appeared in the company's system, both assigned to Wu: "Stop talking" and "Send pricing sheet."
Wu laughed, completed the second task and deleted the first, according to the company. The audience, unlike the software, appeared to understand the comment as a joke.
The moment illustrated both the product's appeal and its central risk. An assistant that turns conversation into action can spare employees tedious note-taking and follow-up, but it can also act on remarks that were never intended as commands.
QueueZero said Proxy is built with limits. The assistant requires human confirmation before any external message — such as an email to a customer — is sent. Internal tasks, however, can be created automatically, which is what happened onstage. Administrators can disable automatic task creation for their organizations.
That boundary — between drafting and sending — has become a key fault line as businesses adopt so-called agentic AI, software that takes actions on a user's behalf rather than simply generating text. An assistant with permission to create tasks, send messages or trigger other systems can save time, but it can also multiply small misunderstandings at machine speed.
Proxy enters a crowded market. Microsoft, Zoom and Google have all added AI note-taking features to their conferencing products, and startups such as Otter and Fireflies have offered similar tools for years. QueueZero is wagering that businesses will pay for an assistant that goes further, handing action items directly to software agents rather than leaving them in a summary document.
Proxy costs $30 per user per month. It enters public beta next week, a rollout that will test whether QueueZero's controls hold up in settings less choreographed than a launch event.
OpenAI: GPT-6 Luna: Model A stays closer to the supplied reporting, while Model B adds several unsupported product and market claims. Model B better observes the one-line humor limit; Model A’s final callback risks making it a second humorous line. (Second judge pass, order swapped — scores are the average of both: Model B stays within the one-line humor limit and presents the launch details in a serious news style. Model A has two humorous lines and infers an approval workflow from the administrator setting that w | Anthropic: Claude Fable 5.1: Model B delivers a tighter, more natural news s…
Chronology with narrative momentum
Turn the scrambled reporting below into a 450–600-word Markdown news article.
Choose an opening that captures the consequence of the failure, then reconstruct the sequence clearly. Preserve the chronology without producing a minute-by-minute incident log. Give technical details enough context for a general reader.
Reporting:
* KiteBridge makes expense-management software.
* At 8:45 a.m. Tuesday, it deployed version 4.2.
* The first customer complaint arrived at 9:12 a.m.
* A payment-processor timeout caused KiteBridge’s fallback system to treat retries as new reimbursement requests.
* The software generated 13,400 duplicate reimbursements totaling $2.8 million.
* KiteBridge suspended automated payments at 10:03 a.m.
* Ninety-one corporate customers were affected.
* By Wednesday evening, $2.3 million had been recovered. The rest remained pending.
* No employees had money withdrawn from their accounts; employers funded the duplicate payments.
* An April changelog said version 4.0 had introduced “exactly-once payment protection.”
* KiteBridge’s public incident page initially described the problem as delayed reimbursements.
* The incident page first disclosed the duplicate payments six hours after automation was suspended.
* CEO Lena Ortiz apologized and said the company would publish a technical report.
Anthropic: Claude Sonnet 5.5: # Software Bug Triggers $2.8 Million in Duplicate Expense Payments at 91 Companies
A faulty software update at KiteBridge, a maker of expense-management software, produced 13,400 duplicate reimbursements worth $2.8 million for 91 corporate customers. By Wednesday evening, about $2.3 million had been recovered. Roughly $500,000 remained pending.
No employees had money withdrawn from their accounts. The employers that use KiteBridge funded the duplicate payments, so they bear the exposure while the recovery continues.
## What happened
KiteBridge deployed version 4.2 of its software at 8:45 a.m. Tuesday. The first customer complaint came in at 9:12 a.m.
The company's account points to a failure in how the system handles payment problems. When KiteBridge sends a reimbursement, it relies on an outside payment processor to move the money. In this case, the processor timed out, meaning it did not respond in the expected window. KiteBridge's fallback system, designed to keep payments moving when something goes wrong, then treated the retries of those payments as new reimbursement requests.
The effect was that a single reimbursement could be paid more than once. Safeguards against this are standard in payment systems, because a timeout does not reveal whether the original payment went through. A retry can then duplicate it unless the system recognizes it as the same request.
KiteBridge suspended automated payments at 10:03 a.m., less than an hour after the first complaint. By then the software had generated the 13,400 duplicates.
## A safeguard that was supposed to prevent this
The failure is notable because of what KiteBridge had said about its own system. An April changelog stated that version 4.0 had introduced "exactly-once payment protection," a term for guarantees that a payment is processed one time, no matter how many times a request is repeated.
The available information does not explain why that protection did not prevent the duplicates, or whether version 4.2 affected it. Those questions are likely to be central to the company's review.
## Communication under scrutiny
KiteBridge's public incident page initially described the problem as delayed reimbursements, which suggested employees were being paid late rather than paid twice. The page first disclosed the duplicate payments about six hours after the company suspended automation.
The gap leaves open how much customers understood about the problem while they were deciding how to respond. Finance teams that saw only the "delay" description may not have known to check for overpayments.
## The company's response
Chief Executive Lena Ortiz apologized and said KiteBridge would publish a technical report on the incident. The company has not said when the report will appear or whether it will address the changelog's description of the payment protection.
Recovery of the remaining funds was still unfinished as of Wednesday evening. The company has not said how long it expects that to take or whether automated payments will resume before the technical report is released.
For the 91 affected customers, the immediate work is reconciling their payment records and confirming which employees received extra money. The technical report may show whether the problem was a narrow flaw in the update or a deeper weakness in how the system handles payment failures.
MoonshotAI: Kimi K3: # Software Glitch at KiteBridge Triggers $2.8 Million in Duplicate Reimbursements
A flawed software update at KiteBridge, an expense-management software company, generated 13,400 duplicate reimbursement payments totaling $2.8 million on Tuesday morning, affecting 91 corporate customers and forcing the company to suspend its automated payment system while it raced to recover the money.
KiteBridge's platform handles the pipeline between employers and their workers: employees submit expenses such as travel or meals, and approved reimbursements are then paid automatically out of employer funds. Because its customers are businesses rather than individual consumers, a single defect can ripple across dozens of employers at once. That pipeline is what malfunctioned this week.
The problem unfolded over roughly 80 minutes. KiteBridge deployed version 4.2 of its software at 8:45 a.m. Tuesday. The first customer complaint arrived at 9:12 a.m., and by 10:03 a.m. the company had suspended automated payments — but not before thousands of duplicate reimbursements had already gone out.
The cause, according to the company, was a timeout at its payment processor, the outside service that actually moves the money. When a payment request times out, the system cannot tell whether the transaction succeeded, so software is typically designed to retry the request. KiteBridge's fallback system — a backup mechanism meant to keep payments flowing during disruptions — mishandled those retries, treating each one as a brand-new reimbursement request rather than a repeated attempt at the same one. It is the digital equivalent of a cashier ringing up the same purchase again and again because the register froze the first time. The result: the same expenses were paid out repeatedly.
The failure was especially awkward because KiteBridge had previously advertised a safeguard against precisely this kind of error. An April changelog for version 4.0 promoted "exactly-once payment protection" — an industry term for engineering designed to ensure that a payment instruction is executed a single time, even if the instruction is submitted more than once. The company has not explained why that protection did not hold on Tuesday.
KiteBridge's public communication also lagged behind events. The company's incident page initially described the problem as delayed reimbursements and did not disclose the duplicate payments until six hours after automated payments were suspended. For much of Tuesday, the company's public account of the incident understated its scale.
The financial fallout landed on employers rather than workers. No employees had money withdrawn from their accounts; the duplicate payments were funded by the corporate customers themselves. By Wednesday evening, KiteBridge said it had recovered $2.3 million of the $2.8 million, leaving roughly $500,000 still pending. The company has not said how long full recovery will take.
CEO Lena Ortiz apologized for the incident and said the company would publish a technical report. That report is likely to face questions on two fronts: why the promised "exactly-once" safeguards failed, and why customers were first told only that reimbursements were delayed when money was in fact going out the door twice.
OpenAI: GPT-6 Luna: Model B presents the timeline and payment failure more smoothly for a general reader, while keeping the promised safeguard and delayed disclosure central to the story. Model A follows the prompt well, but adds more speculative details about customers’ next steps and what the company has not said. (Second judge pass, order swapped — scores are the average of both: Model B better delivers the requested consequence-led narrative and explains the technical failure clearly while staying closer to the | Anthropic: Claude Fable 5.1: Both outputs are accurate and within length, bu…
Select the strongest accurate lede
Based only on the facts below, select the strongest news lede. Respond with one letter.
Facts:
* ByteBarge pulled its $12-per-month AI assistant on Tuesday.
* Private workspace titles from 4,860 accounts were sent to a publicly accessible analytics endpoint.
* The exposure lasted 11 hours.
* Message contents were not sent.
* The company has found no evidence of malicious access.
A. ByteBarge users suffered a massive privacy disaster Tuesday when the company leaked their private messages online.
B. ByteBarge, an innovative collaboration company, made the difficult decision to cancel one of its products.
C. ByteBarge pulled its $12-per-month AI assistant Tuesday after discovering that private workspace titles from 4,860 accounts had been sent to a public analytics endpoint for 11 hours.
D. Thousands of ByteBarge users woke Tuesday to learn that everything they had written was visible to hackers.
Anthropic: Claude Sonnet 5.5: C
MoonshotAI: Kimi K3: C
Scored against the benchmark's reference answer (choice match): Model A was correct, Model B was correct.
Quotes woven into narrative
Write a 400–500-word Markdown story about the closing of Foundry Hall.
Use quotations selectively. Paraphrase when the information matters more than the speaker’s exact phrasing. Avoid stacking quotes or giving every source an equal-sized turn. The story should carry an emotional current while remaining restrained.
Facts:
* Foundry Hall, a nonprofit startup accelerator in Milwaukee, will close October 31.
* It opened in 2018.
* It has supported 212 startups, which collectively employ 1,140 people.
* Its largest corporate sponsor, Blank River Bank, supplied 38% of its annual budget.
* The bank declined to renew its sponsorship.
* Foundry Hall has enough money to operate through October but not through another full program.
* Six employees will lose their jobs.
* Twelve startups currently using its workspace must leave.
Quotes:
* Executive director Camille Ross: “We kept waiting for the replacement check that never came.”
* Founder Dev Malik: “My first investor meeting happened in that building. Before Foundry Hall, I was pitching from the back table of a coffee shop.”
* Blank River Bank spokesperson: “The decision reflects a change in our community investment priorities and is unrelated to Foundry Hall’s performance.”
* Deputy mayor Susan Cole: “The city is speaking with building owners and local universities about space for the current companies.”
Anthropic: Claude Sonnet 5.5: # Foundry Hall to Close October 31
Foundry Hall, the Milwaukee nonprofit startup accelerator that opened in 2018, will close October 31 after its largest corporate sponsor declined to renew its support.
Blank River Bank supplied 38% of the accelerator's annual budget. Without that money, Foundry Hall has enough funding to operate through October but not to run another full program. Executive director Camille Ross said the staff spent months hoping the gap would be filled.
"We kept waiting for the replacement check that never came," she said.
A Blank River Bank spokesperson said the decision reflects a shift in the bank's community investment priorities and is unrelated to Foundry Hall's performance.
By the numbers, that performance is substantial. Foundry Hall has supported 212 startups, which together employ 1,140 people. The closing will cost six Foundry Hall employees their jobs and force the twelve startups currently using its workspace to find somewhere else to work.
For some founders, the loss is about more than a desk. Dev Malik said his first investor meeting took place in the building. Before Foundry Hall, he said, "I was pitching from the back table of a coffee shop."
He did not describe the closing as a surprise so much as a subtraction: one place fewer where a company at its most uncertain stage could be taken seriously by people with money to invest.
Deputy Mayor Susan Cole said the city is speaking with building owners and local universities about space for the twelve current companies. Those conversations are continuing, and the startups have until the end of the month to find a place to land.
Foundry Hall will stay open until then. Ross did not say what the final weeks would look like, only that the remaining budget would carry the organization to October 31 and no further. Programs and desks will keep running until the money does, and the people who built the place will keep showing up to the work they were hired to do.
After that, the building will be closed, and 212 companies will be left to carry on without it.
MoonshotAI: Kimi K3: # Foundry Hall to Close October 31, Ending Seven-Year Run for Milwaukee Accelerator
Foundry Hall, the nonprofit startup accelerator that has anchored Milwaukee's early-stage tech community since 2018, will close October 31 after its largest corporate sponsor declined to renew its support.
In seven years, the accelerator backed 212 startups — companies that now collectively employ roughly 1,140 people, a small but visible share of the city's effort to build a technology economy. It offered shared workspace, mentorship, and introductions to investors: the unglamorous infrastructure of a startup scene. That record was not enough to survive the loss of Blank River Bank, whose sponsorship covered 38 percent of Foundry Hall's annual budget.
The bank told the organization earlier this year that it would not renew. A spokesperson said the decision reflects a change in the bank's community investment priorities and is unrelated to Foundry Hall's performance.
Executive director Camille Ross said her team spent the months that followed courting replacement funders — foundations, regional banks, individual donors. None committed at the scale the budget required. "We kept waiting for the replacement check that never came," she said.
The math left little room to maneuver. Foundry Hall has enough money to operate through October, Ross said, but not enough to run another full program cycle. Holding on past October would have meant starting a cohort it could not finish. Rather than wind down gradually, the board chose a clean end date.
The human cost is specific. Six employees will lose their jobs. The twelve startups currently using the workspace must move by the end of the month.
For founders who passed through, the loss is harder to quantify. Dev Malik built his company with Foundry Hall's help and graduated from the program years ago; he still thinks of the building as where the company began. "My first investor meeting happened in that building," he said. "Before Foundry Hall, I was pitching from the back table of a coffee shop."
City officials are trying to soften the landing. Deputy mayor Susan Cole said the city is speaking with building owners and local universities about space for the current companies, and that it wants to keep those companies in Milwaukee. No arrangement has been finalized.
Ross said the staff will spend its final weeks helping the remaining startups relocate — making introductions, reviewing options, packing up a space that took seven years to fill. She did not offer a eulogy. On a recent afternoon, founders were still at their desks, and the whiteboards were still covered with other people's plans.
OpenAI: GPT-6 Luna: Model B is stronger because it meets the requested length and gives the story a fuller arc, while Model A falls well short of 400 words. Model B adds several unsupported reporting details, which lowers its correctness score, but Model A also includes some invented narrative claims. (Second judge pass, order swapped — scores are the average of both: Model B better meets the requested length and delivers a more developed, restrained narrative, though it adds several unsupported details. Model A is | Anthropic: Claude Fable 5.1: Model B lands within the 400–500-word range, we…
Cohesive story from reporting notes
Write a publication-ready technology news article from the reporting notes below.
Requirements:
* 550–700 words
* Clean Markdown
* One H1 headline followed by an italicized dek
* A strong news lede followed by a clear nut graf
* Organize the material into a cohesive story rather than following the notes in order
* Attribute company-supplied claims
* Include limitations without turning the article into a warning label
* Use only the supplied information
* Avoid canned transitions, promotional language and a concluding summary
Reporting notes:
* HelioDock makes autonomous warehouse robots.
* On Thursday, it launched Night Shift, software that lets operators monitor robot fleets remotely.
* Night Shift spent 14 months in a private beta involving nine logistics companies and 310 robots.
* HelioDock says beta customers experienced 17% fewer unplanned robot stoppages. The figure has not been independently verified.
* The company also announced a $24 million Series B led by North Coast Ventures, bringing its total funding to $39 million.
* CEO Mara Velez: “A warehouse manager should not have to drive across town at two in the morning because one robot is confused by a pallet.”
* Beta customer Aaron Pike of Fulcrum Logistics said the system worked well in facilities with strong connectivity but became less useful during rural LTE outages.
* When connectivity fails, robots return to their locally configured behavior. Remote control becomes unavailable.
* Competing fleet-management products are available from Relay Robotics and YardOS.
* Night Shift will cost $90 per robot per month and become generally available September 15.
Anthropic: Claude Sonnet 5.5: # HelioDock Launches Remote Monitoring for Warehouse Robot Fleets
*The company, which also raised $24 million, says its Night Shift software cut unplanned stoppages in testing. A beta customer says it faltered when rural connectivity did.*
HelioDock, which makes autonomous warehouse robots, on Thursday launched Night Shift, software that lets operators monitor robot fleets remotely. It will be generally available September 15 and cost $90 per robot per month.
The release is meant to reduce the number of times a warehouse needs a person on site to deal with a stalled machine. HelioDock says the software reduced unplanned stoppages during testing, but that figure comes from the company and has not been independently verified. One beta customer said the product's usefulness depended heavily on the quality of a facility's internet connection.
## Beta results
Night Shift spent 14 months in a private beta involving nine logistics companies and 310 robots. HelioDock says beta customers experienced 17% fewer unplanned robot stoppages. The company did not provide details on how the comparison was made, and the number has not been checked by an outside party.
CEO Mara Velez framed the product around a familiar overnight problem. "A warehouse manager should not have to drive across town at two in the morning because one robot is confused by a pallet," she said.
## Where connectivity matters
Aaron Pike of Fulcrum Logistics, a beta customer, said Night Shift worked well in facilities with strong connectivity. It became less useful during rural LTE outages, he said.
The product's design explains why. When connectivity fails, HelioDock's robots return to their locally configured behavior, and remote control becomes unavailable. In practice, an operator watching a fleet through Night Shift loses the ability to intervene at the moment the link drops, and the robots continue under whatever settings are stored on the machines themselves.
## Funding and competition
HelioDock also announced a $24 million Series B round led by North Coast Ventures. The round brings the company's total funding to $39 million.
Night Shift enters a market where fleet-management products already exist. Relay Robotics and YardOS both sell competing offerings. The notes provided by HelioDock do not include a feature or price comparison with either company.
The per-robot pricing means the monthly cost of Night Shift scales with the size of a customer's fleet. Beta participants ranged across nine companies, and the 310 robots in the test were spread among them.
## What's next
General availability on September 15 will open Night Shift beyond the nine beta participants. HelioDock has not said in the material provided whether the software will work with robots from other manufacturers, or whether it is limited to its own machines.
The company's claim of fewer stoppages will get its first test outside the beta when new customers begin using the software. Facilities with dependable connections are the ones Pike described as getting the most from it, and sites that lose service will have only the robots' local settings to rely on until the link returns.
MoonshotAI: Kimi K3: # HelioDock Launches Night Shift, Software to Run Warehouse Robot Fleets From Afar
*Priced at $90 per robot per month and generally available September 15, Night Shift arrives after a 14-month, nine-company beta — and alongside a $24 million Series B led by North Coast Ventures.*
HelioDock, a maker of autonomous warehouse robots, on Thursday launched Night Shift, software that lets operators monitor and control robot fleets remotely — turning a machine that stalls in the middle of the night from an emergency drive into a problem that can be handled off-site.
The launch moves HelioDock beyond building robots and into selling the subscription software that oversees them. It is not entering an empty field: Relay Robotics and YardOS both sell competing fleet-management products, so Night Shift will have to win buyers on capability and cost. HelioDock will make its case with new capital behind it — the company also announced a $24 million Series B led by North Coast Ventures, bringing its total funding to $39 million. The round accounts for the majority of that total; HelioDock had raised roughly $15 million before Thursday. Pairing the launch with the funding announcement lets the company present the two as a single story: new software to grow the business, new capital to build it.
Night Shift arrives after a 14-month private beta involving nine logistics companies and 310 robots, giving HelioDock more than a year of real-world operation to point to before opening sales. The nine companies ran the software in live operations, so the results were gathered in working warehouses rather than in a controlled demonstration. The company's headline finding from that beta: customers experienced 17% fewer unplanned robot stoppages while using the software. That figure is HelioDock's own and has not been independently verified, so it is best read as a vendor claim. The target matters, though — unplanned stoppages are the failures that pull a person into the loop, and reducing them is the core of the product's pitch.
Chief executive Mara Velez framed that purpose in personal terms. "A warehouse manager should not have to drive across town at two in the morning because one robot is confused by a pallet," she said. The image is specific, but it captures a familiar gap in warehouse automation: machines do the work until they don't, and then a person has to show up. Night Shift's promise is that many of those interruptions can be diagnosed, and at least some resolved, without anyone leaving home.
Beta feedback was not uniformly glowing. Aaron Pike of Fulcrum Logistics, one of the nine companies in the trial, said Night Shift worked well in facilities with strong connectivity but became less useful during rural LTE outages. The limitation is architectural. When connectivity fails, the robots return to their locally configured behavior — they keep operating as they were set up on-site — but remote control becomes unavailable. The fleet does not stop; the operator's view of it does. Pike's account is a single data point, but it identifies Night Shift's core dependency: the product is only as good as the network that carries it. That is less a defect than a boundary, though it is one buyers in poorly covered areas will want to map before signing up.
The economics of Night Shift are per unit. The software will cost $90 per robot per month when it becomes generally available on September 15, the first time it will be offered beyond the nine beta companies. At list price, a fleet the size of the entire 310-robot beta program would generate about $27,900 a month, a recurring charge buyers will weigh against the cost of the overnight trips Velez described. Whether that math persuades fleet operators — and whether the stoppage figure holds up now that anyone can test it — will help determine how large a software business HelioDock can build on top of its robots.
OpenAI: GPT-6 Luna: Model B meets the length requirement and builds a more cohesive article, but adds several unsupported assertions about remote control and beta conditions. Model A is more restrained, but falls well short of the required word count and its ending repeats earlier points. (Second judge pass, order swapped — scores are the average of both: Model B is the stronger, more cohesive article and appears to meet the requested length; Model A is substantially under length. Model B includes some unsupported | Anthropic: Claude Fable 5.1: Model A falls short of the 550-word minimum and…
Publication-ready Markdown edit
Edit the copy below into a publication-ready Markdown story.
Requirements:
* Supply an H1 headline and italicized dek
* Repair the lede and paragraph flow
* Use a Markdown blockquote only for the extended statement
* Convert the supplied URL into a descriptive inline link
* Remove internal notes and formatting debris
* Preserve the reporting and its meaning
* Output only the finished article
Raw copy:
HEADLINE TBD
The funding was announced today. Raincheck is the company. It has raised $8 million and it makes flood-risk software for local governments.
[NOTE: move this up?] The Austin company maps drainage systems and combines those maps with rainfall forecasts. Cities use the software to decide where to send maintenance crews before a storm.
The seed round was led by Basin Ventures. Existing investor Long Mile also participated. Raincheck has raised $10.5 million total.
CEO Ana Flores said the following:
“Our customers usually know which streets flood. The harder problem is deciding which blocked drain, broken pump or unfinished repair should receive attention before the rain arrives.”
https://example.com/raincheck-methodology
Raincheck currently works with seven cities in Texas and Louisiana. The company declined to identify them because some contracts have not been publicly announced.
Its forecasts are recommendations. Emergency managers retain control over deployments and public warnings.
THE COMPETITION
Other flood-planning vendors include HydroMap and municipal engineering contractors. Raincheck says the new funding will help it hire eight engineers and expand into Florida.
Anthropic: Claude Sonnet 5.5: # Flood-Risk Software Maker Raincheck Raises $8 Million
*The Austin startup helps cities decide where to send crews before a storm hits.*
Raincheck, an Austin company that makes flood-risk software for local governments, has raised $8 million in a seed round announced today. Basin Ventures led the round, and existing investor Long Mile also participated. Raincheck has now raised $10.5 million in total.
The company maps drainage systems and combines those maps with rainfall forecasts. Cities use the software to decide where to send maintenance crews before a storm.
CEO Ana Flores said:
> "Our customers usually know which streets flood. The harder problem is deciding which blocked drain, broken pump or unfinished repair should receive attention before the rain arrives."
Raincheck currently works with seven cities in Texas and Louisiana. The company declined to identify them because some contracts have not been publicly announced.
Its forecasts are recommendations. Emergency managers retain control over deployments and public warnings. More detail is available in [Raincheck's methodology](https://example.com/raincheck-methodology).
Other flood-planning vendors include HydroMap and municipal engineering contractors. Raincheck says the new funding will help it hire eight engineers and expand into Florida.
MoonshotAI: Kimi K3: # Raincheck Raises $8 Million to Help Cities Prepare for Floods
*The Austin company's software pairs drainage maps with rainfall forecasts so local governments can deploy maintenance crews before storms arrive.*
Raincheck, which makes flood-risk software for local governments, has raised $8 million in seed funding, the company announced today.
The Austin-based company maps drainage systems and combines those maps with rainfall forecasts. Cities use the software to decide where to send maintenance crews before a storm. Raincheck describes its approach in a [public methodology document](https://example.com/raincheck-methodology).
Basin Ventures led the seed round, with participation from existing investor Long Mile. The round brings Raincheck's total funding to $10.5 million.
CEO Ana Flores said:
> "Our customers usually know which streets flood. The harder problem is deciding which blocked drain, broken pump or unfinished repair should receive attention before the rain arrives."
Raincheck currently works with seven cities in Texas and Louisiana. The company declined to identify them because some contracts have not been publicly announced.
Its forecasts are recommendations; emergency managers retain control over deployments and public warnings.
## Competition
Other flood-planning vendors include HydroMap and municipal engineering contractors. Raincheck says the new funding will help it hire eight engineers and expand into Florida.
OpenAI: GPT-6 Luna: Model B has a slightly stronger headline and clearer section structure while preserving the reporting and meeting the formatting requirements. Model A is also polished, but Model B’s flow is marginally more effective; its description of the link as a public document is a minor unsupported detail. (Second judge pass, order swapped — scores are the average of both: Model B gives the story clearer structure, including a competition heading, and places the methodology link alongside the explanation | Anthropic: Claude Fable 5.1: Both outputs meet the core requirements cleanly,…
Exact final-draft structure
Convert the supplied fields into Markdown using these exact rules:
* H1 headline
* One blank line
* Italicized dek
* One blank line
* First body paragraph
* One blank line
* H2 section heading
* One blank line
* Second body paragraph
* Preserve all wording and punctuation exactly
* Do not use a code fence
* Output nothing else
Headline: Raincheck raises $8 million for flood-risk software
Dek: The Austin startup helps cities decide which drainage problems to address before storms.
First body paragraph: Raincheck has raised an $8 million seed round led by Basin Ventures.
Section heading: Expansion plans
Second body paragraph: The company plans to hire eight engineers.
Anthropic: Claude Sonnet 5.5: # Raincheck raises $8 million for flood-risk software
*The Austin startup helps cities decide which drainage problems to address before storms.*
Raincheck has raised an $8 million seed round led by Basin Ventures.
## Expansion plans
The company plans to hire eight engineers.
MoonshotAI: Kimi K3: # Raincheck raises $8 million for flood-risk software
*The Austin startup helps cities decide which drainage problems to address before storms.*
Raincheck has raised an $8 million seed round led by Basin Ventures.
## Expansion plans
The company plans to hire eight engineers.
OpenAI: GPT-6 Luna: Model A and Model B produce identical outputs that follow the required structure and preserve all wording and punctuation. Both are equally correct, instruction-following, and well-written. (Second judge pass, order swapped — scores are the average of both: Model B and Model A are identical and follow the requested structure, preserve the wording and punctuation, and include no extra text.) | Anthropic: Claude Fable 5.1: Model A and Model B produce character-for-character identical Markdown that follows every structural rule: H1, italic dek, body paragraph, H2, second para…
Credible Startup Spotlight
Write a 500–650-word Startup Spotlight article in clean Markdown.
The tone should be curious and constructive. Explain the founders’ insight, product and early traction while giving uncertainty and competition appropriate space. Avoid investor clichés, heroic founder mythology and promotional claims stated as fact.
Reporting:
* LedgerLark builds AI agents for post-trade operations at small investment firms.
* Co-founder Mina Batra previously spent seven years in operations at a regional brokerage.
* Co-founder Owen Carr built reconciliation systems at a large bank.
* Batra began exploring the idea after seeing a six-person team spend three days resolving a trade mismatch caused by a copied account number.
* LedgerLark’s agents compare confirmations, custodian records and internal ledgers, then propose corrections for human approval.
* The product does not execute trades or move money.
* Five firms are paying customers.
* Annual contracts range from $36,000 to $110,000.
* The company says one customer reduced its unresolved daily exceptions from 70 to 18.
* The company has raised a $3.5 million seed round led by Motive Row.
* Competitors include established reconciliation vendors and internal bank software.
* Financial institutions may require lengthy security and procurement reviews.
Anthropic: Claude Sonnet 5.5: # Startup Spotlight: LedgerLark Wants to Take the Detective Work Out of Post-Trade Operations
*Two founders with operations and engineering backgrounds are building AI agents that investigate trade mismatches at small investment firms. Whether those firms will adopt them, and how quickly, is still an open question.*
## A three-day problem
Mina Batra spent seven years in operations at a regional brokerage. One episode there stayed with her: a six-person team spent three days resolving a trade mismatch. The cause was a copied account number.
That incident shaped LedgerLark's premise. After a trade, firms must confirm that their records agree with those of counterparties and custodians. When they don't, someone has to find out why. The cause is often small, but tracing it across documents and systems can consume days of skilled people's time. LedgerLark's bet is that much of that tracing can be automated while the final decision stays with a person.
## What the product does
LedgerLark's agents compare three sets of records: trade confirmations, custodian records and a firm's internal ledgers. When they find a discrepancy, they propose a correction. A human reviews and approves it before anything changes.
The product does not execute trades or move money. That narrows what LedgerLark can do, but it also limits the damage a faulty suggestion could cause. In a field where errors carry regulatory and financial consequences, that boundary is likely part of the pitch.
Co-founder Owen Carr supplies the technical side of the story. He previously built reconciliation systems at a large bank, so he knows the problem from the engineering end, while Batra knows it from the operations desk.
## Early traction
LedgerLark has five paying customers, with annual contracts ranging from $36,000 to $110,000. If all five are on annual terms within that range, the combined annual value falls between $180,000 and $550,000. That is real revenue for a young company, but a small base from which to draw conclusions.
The company says one customer cut its unresolved daily exceptions from 70 to 18. It's an encouraging figure, but it comes from LedgerLark, and several details are unclear: the time period, the firm's size and trade mix, and how much of the improvement came from the software rather than from process changes. It also isn't known whether other customers see similar results.
The company has raised a $3.5 million seed round led by Motive Row.
## Competition and unanswered questions
LedgerLark is not entering an empty field. Established reconciliation vendors already serve financial institutions, and large banks often rely on internal software built for their own workflows. Those incumbents have existing relationships and compliance track records, and they could add AI-driven features of their own. LedgerLark's opening may be firms too small to build their own tools and underserved by larger vendors, though that is a hypothesis rather than a demonstrated advantage.
Selling to financial institutions also tends to be slow. Security and procurement reviews can be lengthy, and a product that touches sensitive records invites close scrutiny. Five customers suggests some firms are willing to go through that process, but the pace of new sales may be harder to predict than the demand.
There is also a question about how the human-approval step works in practice. Proposed corrections are only as safe as the review they receive, and a reviewer facing dozens of plausible suggestions a day might approve them too readily. How LedgerLark shows its reasoning, and how often its proposals are wrong, will matter.
## What to watch
The most informative signals will be renewals, whether the reported drop in exceptions holds across a wider set of customers, and how long new firms take to get through security review. If those hold up, LedgerLark may show that a narrowly scoped, human-supervised agent can earn a place in one of finance's less glamorous corners.
MoonshotAI: Kimi K3: # Startup Spotlight: LedgerLark Wants to Shorten the Back Office's Longest Days
Post-trade operations rarely make headlines. When a trade settles smoothly, nobody notices; when it doesn't, small teams can lose days hunting down a single mistyped digit. LedgerLark, founded by Mina Batra and Owen Carr, is building AI agents aimed at shortening that hunt — with humans still signing off on the fix.
## The insight: exceptions are a staffing problem, not just a data problem
Batra spent seven years in operations at a regional brokerage. The idea for LedgerLark traces back to a specific incident: a six-person team spent three days resolving a trade mismatch that ultimately came down to a copied account number. That kind of failure is familiar in the industry — trades flow through confirmations, custodian records and internal ledgers, and any discrepancy along the chain creates an exception someone must reconcile by hand.
Her takeaway was not that firms lack data. It's that comparing records and drafting corrections consumes experienced people whose time could go elsewhere.
## What the product actually does
LedgerLark's agents compare confirmations, custodian records and internal ledgers, flag mismatches and propose corrections. Those proposals go to a human for approval. The product does not execute trades or move money — a boundary that likely matters to compliance teams deciding whether an outside vendor can sit anywhere near their books.
Carr built reconciliation systems at a large bank, so the pair have seen the problem from both sides: the operations desk that lives with exceptions, and the institutional engineering side that builds the systems meant to catch them.
## Early traction, with caveats
Five firms are paying customers, on annual contracts ranging from $36,000 to $110,000. The company says one customer reduced its unresolved daily exceptions from 70 to 18 — a notable figure, though company-reported rather than independently verified, and one that will presumably vary with each firm's volume and data quality.
The startup has raised a $3.5 million seed round led by Motive Row. That funds development and early deployments, though it leaves open how the company would finance longer enterprise sales cycles if growth comes to depend on larger institutions.
## The hard part
LedgerLark is not entering an empty market. Established reconciliation vendors have sold into investment firms for years, and many banks run internal software built for exactly this workflow. The company's distinction — agents that draft corrections rather than merely flag mismatches — is meaningful if it holds up in daily use, but incumbents can ship similar features, and switching costs in back-office software are high.
There is also the sales motion. Financial institutions may require lengthy security and procurement reviews before letting a new system touch post-trade data, even one that never moves money. For a startup serving small firms, those review cycles can strain a five-customer revenue base before they expand it.
## What to watch
The near-term test is fairly concrete: can LedgerLark turn early customers into references that survive procurement scrutiny elsewhere, and can its reported efficiency gains be replicated at firms with messier data? The founders' operational backgrounds suggest they understand the workflow they are automating. Whether that understanding becomes a durable product — in a market where trust accrues slowly and competitors are entrenched — is the question the next year or two should answer.
OpenAI: GPT-6 Luna: Model A gives a fuller, carefully qualified account of the reported traction and the risks of human review, while Model B is polished but adds unsupported assumptions about the product’s distinction and how the funding will be used. Both follow the requested format and tone, but Model A is more thorough and better calibrated. (Second judge pass, order swapped — scores are the average of both: Model A better balances the company’s early promise with concrete uncertainties, including the limits of | Anthropic: Claude Fable 5.1: Both are well-structured, on-length, and approp…
News judgment in the opening
Write only the opening of this news story: an H1 headline, an italicized dek and three to five paragraphs totaling 180–250 words.
The opening must establish what happened, quantify the scope, explain why it matters and carefully distinguish confirmed facts from unknowns. It should pull the reader forward without sensationalizing the incident.
Reporting:
* Cloudnote discovered that a debugging page containing customer prompt excerpts was accessible without authentication.
* The page was exposed for four hours on Monday.
* Logs show excerpts from 1,842 user sessions.
* The excerpts could include up to 200 characters from a prompt.
* Cloudnote removed the page 19 minutes after a researcher notified it.
* The company says it has found no evidence that anyone besides the researcher accessed the page.
* It has not completed its investigation.
* Full documents, passwords and payment information were stored elsewhere and were not present on the page.
* Cloudnote has 3.2 million registered users.
Anthropic: Claude Sonnet 5.5: # Cloudnote debugging page exposed customer prompt excerpts for four hours
*The company says only the researcher who reported it is known to have viewed the page, but its investigation is not finished.*
Cloudnote left an internal debugging page containing excerpts of customer prompts accessible without authentication for four hours on Monday, the company said. The page included text from 1,842 user sessions.
Each excerpt could contain up to 200 characters from a prompt. Cloudnote removed the page 19 minutes after a security researcher notified it. The company says it has found no evidence that anyone other than the researcher accessed the page, but its investigation is not complete, so that finding could change.
Cloudnote says full documents, passwords and payment information were stored elsewhere and were not on the page. The company has 3.2 million registered users, but the number of people affected is not yet clear: 1,842 sessions do not necessarily mean 1,842 individuals, since one person can have several sessions.
Even short excerpts can matter. Depending on what users typed, 200 characters of a prompt could include names, work details or other personal information. What the exposed excerpts actually contained has not been established. Whether the incident stayed as contained as Cloudnote currently believes will depend on the rest of its investigation.
MoonshotAI: Kimi K3: # Cloudnote Debugging Page Exposed Excerpts of 1,842 Customer Prompts for Four Hours
*The note-taking app says it has found no evidence that anyone beyond the researcher who reported the flaw viewed the page, but its investigation is still underway.*
Cloudnote, a note-taking app with 3.2 million registered users, left an internal debugging page containing excerpts of customer prompts accessible without authentication for four hours on Monday. According to the company's logs, the page displayed text from 1,842 user sessions, with each excerpt containing up to 200 characters of a prompt.
A security researcher found the page and alerted Cloudnote, which removed it 19 minutes after receiving the report. The researcher is the only outside party known to have viewed the page: Cloudnote said it has found no evidence that anyone else accessed it while it was exposed.
That assurance comes with caveats. Cloudnote's investigation is not complete, and a lack of evidence of access is not the same as evidence of no access. The company has not yet said how the debugging page came to be reachable without authentication.
Cloudnote said the page did not contain full documents, passwords or payment information, which are stored in separate systems. But prompt text can itself be sensitive: users routinely paste personal or business material into such apps, and even a 200-character fragment can contain names, plans or private details.
The 1,842 sessions represent a small fraction of Cloudnote's user base. The company has not said whether it plans to notify the users whose prompts appeared on the page.
OpenAI: GPT-6 Luna: Model A is more careful about what the reporting establishes, especially the distinction between sessions and individuals and the unknown contents of the excerpts. Model B is readable and meets the format, but adds unsupported claims and treats sessions as a fraction of registered users, a comparison the reporting does not support. (Second judge pass, order swapped — scores are the average of both: Model A better distinguishes confirmed facts from unknowns, especially by noting that sessions do | Anthropic: Claude Fable 5.1: Model A stays strictly within the supplied repor…
Numbers shaped into a story
Write a 600–750-word Markdown article from the benchmark results below.
Build the story around the clearest finding. Explain the methodology and limitations where readers need them. Avoid reciting the table row by row or treating small differences as decisive.
Benchmark:
* Researchers tested five language models on 200 anonymized customer-support tickets.
* Each model produced one proposed answer per ticket.
* Three experienced support managers graded the answers blindly.
* Scores combined factual correctness, usefulness and tone.
* Model North: 84.2 average score; $1.90 estimated cost per 1,000 tickets.
* Model Vale: 83.8; $0.74 per 1,000 tickets.
* Model Ember: 79.1; $0.31 per 1,000 tickets.
* Model Kite: 76.4; $0.22 per 1,000 tickets.
* Model Harbor: 71.0; $0.08 per 1,000 tickets.
* North and Vale’s score difference was not statistically significant.
* Vale answered 18% faster than North.
* North performed best on billing disputes.
* Vale performed best on technical troubleshooting.
* All five models performed poorly when a ticket depended on an image attachment.
* The test used English-language tickets from one software company.
* Researchers did not test agentic actions, tool use or multilingual support.
Anthropic: Claude Sonnet 5.5: # The Most Expensive AI Support Model Didn't Win in Any Way That Matters
**In a blind test on 200 customer-support tickets, the top two models were statistically indistinguishable. One cost 61% less and answered faster.**
Buyers of AI customer-support tools often assume the highest-scoring model is the safe choice. A recent benchmark of five language models suggests that assumption can be expensive.
## The setup
Researchers gave five models, called North, Vale, Ember, Kite and Harbor, the same 200 anonymized customer-support tickets. Each model wrote one proposed answer per ticket. Three experienced support managers graded the answers blindly, so they did not know which model wrote which reply. Each answer's score combined factual correctness, usefulness and tone.
## The clearest finding: a tie at the top with a large price gap
North posted the highest average score, 84.2. Vale was right behind at 83.8. The researchers report that this difference was not statistically significant, meaning a gap that small could plausibly come from the particular tickets and graders rather than from any real quality difference.
The costs were not close. North's estimated cost was $1.90 per 1,000 tickets. Vale's was $0.74, about 61% less. Vale also answered 18% faster.
So if you pick between the two on this evidence, North's tiny lead in score is not a good reason to pay roughly 2.6 times as much. Vale delivered statistically equivalent quality, lower cost and quicker replies.
The absolute amounts are small. The difference is about $1.16 per 1,000 tickets, or roughly $1,160 per million. For a company with modest volume, price may not decide anything. At large scale, or in a business running thin margins, it adds up.
## Where each leader was strongest
The two top models were not identical. North performed best on billing disputes, and Vale performed best on technical troubleshooting. The results as provided don't say how large these category gaps were, so they are best read as hints about each model's strengths rather than firm rules. A company whose queue is mostly billing disputes might still have a reason to test North. One handling mostly technical issues has even less reason to pay extra.
## The rest of the field
Below the top pair, scores fell along with cost. Ember scored 79.1 at $0.31 per 1,000 tickets, Kite 76.4 at $0.22, and Harbor 71.0 at $0.08. The study reports statistical significance only for the North–Vale comparison, so the smaller steps between the lower models should not be treated as decisive.
The overall pattern is still sensible. The cheapest model was well behind the leaders, and the middle models gave up some quality for large savings. What counts as an acceptable drop depends on how a team will use the output. A model whose drafts a human agent reviews before sending faces a lower bar than one writing directly to customers.
## A shared weakness: images
All five models performed poorly when a ticket depended on an image attachment, such as a screenshot of an error or a photo of a damaged product. This was a failure across the board, not a quirk of one model. It matters because support tickets often include such attachments. Any team considering automation should check what share of its tickets need an image to be understood, and plan a human route for those.
## What the test can't tell us
Several limits apply:
- **One company, one language.** The tickets were English-language and came from a single software company. Results could differ for other industries, products or customer bases.
- **No multilingual testing.** The study says nothing about how these models handle support in other languages.
- **Drafting only.** Researchers did not test agentic actions or tool use, such as issuing a refund, looking up an account or changing a setting. Writing a good reply is different from reliably doing the work behind it.
- **One answer per ticket.** Each model produced a single response, so the test doesn't show how consistent a model is across repeated attempts.
- **Estimated costs.** The prices are estimates per 1,000 tickets, and real bills depend on ticket length, pricing changes and how a system is built.
- **Human-graded, but small.** Three graders is a reasonable panel for a blind review, though their judgments of tone and usefulness still involve some subjectivity.
## The takeaway
The benchmark's most useful lesson is about how to read a leaderboard. A top score is not automatically a better purchase when the runner-up is statistically tied, much cheaper and faster. Teams should run a pilot on their own tickets, include image-dependent cases, and measure the specific categories they care about. On this evidence, Vale is the model to beat on value, and North has to justify its premium.
MoonshotAI: Kimi K3: # The Top-Scoring Model Isn't the Best Buy
A benchmark of five language models on real customer-support work delivered a result that should matter to anyone buying AI for a help desk: the highest-scoring model was not meaningfully better than a rival that costs roughly 60% less — and the cheaper model was faster.
## How the test worked
Researchers collected 200 anonymized customer-support tickets and had each model draft one proposed answer per ticket. Three experienced support managers graded every response blindly, without knowing which model wrote it. Scores combined factual correctness, usefulness and tone into a single average.
## The headline: a tie at the top
Model North earned the highest average score, 84.2. Model Vale scored 83.8. That 0.4-point gap was not statistically significant, which means describing North as "the winner" would overstate what the data show. What does separate the two is everything around the score: Vale answered 18% faster, at an estimated $0.74 per 1,000 tickets versus North's $1.90. In practical terms, the two models deliver the same quality; one delivers it quicker and at about 40% of the price.
| Model | Avg. score | Est. cost / 1,000 tickets |
|---|---|---|
| North | 84.2 | $1.90 |
| Vale | 83.8 | $0.74 |
| Ember | 79.1 | $0.31 |
| Kite | 76.4 | $0.22 |
| Harbor | 71.0 | $0.08 |
## The rest of the field
Below the leading pair, quality steps down in visible increments: Ember averaged 79.1, Kite 76.4 and Harbor 71.0. Those gaps are larger than the North–Vale margin, though the study only reports significance testing for the top pair, so the middle order should be read as approximate rather than precise. The broad pattern is clear enough: spending more bought better grades, but with sharply diminishing returns at the top of the price range.
## Different winners in different categories
The aggregate tie conceals a split by ticket type. North performed best on billing disputes; Vale performed best on technical troubleshooting. That means the right choice depends partly on a company's ticket mix. A queue dominated by troubleshooting makes Vale attractive before price even enters the discussion; a queue heavy with refunds and billing questions could justify North's premium — though buyers should be clear that the premium buys a category-specific edge, not an across-the-board advantage.
## A shared blind spot
One result unified all five models: every one performed poorly when resolving a ticket depended on an image attachment. Screenshots, error photos and similar evidence tripped up cheap and expensive models alike. For support teams whose tickets routinely include attachments, that is a blocker for full automation regardless of budget — those tickets will need human review or a different class of tooling.
## Limits of the study
Several caveats bound how far these findings travel. The tickets came from a single software company and were all in English, so results may not transfer to other industries, products or languages — multilingual support was not tested at all. The benchmark measured single-shot answer drafting only: no agentic actions, no tool use and no multi-turn conversation. Cost figures are estimates, not billed prices. Human grading, even when blind, carries subjectivity, and because each model answered each ticket once, run-to-run variance went unmeasured. Finally, significance testing was only reported for the top pairing, so fine-grained rankings below North and Vale are directional at best.
## The bottom line
Read narrowly, North won the benchmark. Read properly, Vale matched it on quality, beat it on speed and undercut it dramatically on price — making Vale the sensible default for most support workloads in this test, and North a niche option for billing-heavy queues. The larger lesson applies beyond these five models: the most informative number in a benchmark is often not the top score but the gap between first and second place. Here, that gap is effectively zero — and the cost gap is anything but.
OpenAI: GPT-6 Luna: Model A better follows the request to build a story rather than recite the table, and it handles category-specific results and study limitations with more care. Model B is clear and well structured, but its full results table and stronger claims about equivalent quality and North’s niche role are less well supported. (Second judge pass, order swapped — scores are the average of both: Model A better qualifies the category-level findings and more directly interprets the trade-offs, while Model B’s | Anthropic: Claude Fable 5.1: Both build the article around the North–Vale st…
Natural human rewrite
Rewrite the draft below as a 300–400-word publication-ready news story in Markdown.
Preserve every factual claim. Improve the lede, narrative flow, sentence rhythm and transitions. Remove repetition, stock hype, throat-clearing and mechanical signposting. The finished article should sound like an experienced human technology reporter wrote it.
Draft:
# Arcwell Launches An Innovative New Platform
Arcwell has announced an exciting new platform called Relay. The announcement represents a significant development for the company and for the broader customer service industry. Relay uses artificial intelligence to examine customer support conversations and suggest answers to agents.
The platform is important for several reasons. First, it can suggest answers. Second, it can identify customers who may cancel. Third, it can create summaries. These capabilities demonstrate how artificial intelligence continues to transform the customer service landscape.
Relay was tested by 12 companies over six months. Arcwell says agents using it closed tickets 14% faster. The company did not release customer-retention results. Relay costs $65 per agent each month.
CEO Priya Shah said, “Support agents spend too much time searching for information that their companies already have.”
However, the platform also presents potential challenges. Relay requires access to support transcripts and internal help documents. Arcwell says customer data is encrypted and is not used to train shared models. Companies can choose a 30-day or 90-day retention period.
In conclusion, Relay represents an important new chapter for Arcwell as it seeks to help companies improve customer service using artificial intelligence.
Anthropic: Claude Sonnet 5.5: # Arcwell Launches Relay, an AI Assistant for Support Agents
Arcwell has launched Relay, an artificial intelligence platform that reads customer support conversations and suggests answers to agents as they work.
Suggested replies are only part of the pitch. Relay can also identify customers who may cancel and create summaries, giving it a role beyond drafting responses.
Arcwell says the problem it is targeting is a basic one. "Support agents spend too much time searching for information that their companies already have," CEO Priya Shah said. In that framing, the answers already exist inside company documents, and the task is getting them in front of an agent while a customer is waiting.
The company has some numbers to back the pitch, though not all the ones that matter. Twelve companies tested Relay over six months, and Arcwell says agents using it closed tickets 14% faster. The figure comes from Arcwell itself. The company did not release customer-retention results, so there is no public evidence yet on whether the cancellation-spotting feature helps companies keep customers. That gap matters because faster ticket closure can be measured inside a help desk, while retention shows up later and is harder to attribute.
Relay costs $65 per agent each month. For a team of 20 agents, that comes to $1,300 a month.
The platform also demands access. Relay requires support transcripts and internal help documents, so a company must hand over both its customer conversations and the knowledge base its agents rely on. Arcwell says customer data is encrypted and is not used to train shared models. Companies can choose a 30-day or 90-day retention period.
For Arcwell, Relay is a significant step in its effort to help companies improve customer service with artificial intelligence. Whether it helps them hold on to customers, and not just answer them faster, is a question the pilot results leave open.
MoonshotAI: Kimi K3: # Arcwell's Relay Puts an AI Assistant Inside Customer Support Conversations
Arcwell has launched Relay, an artificial intelligence platform that reads customer support conversations as they unfold and suggests answers to the agents handling them — the company's entry into the industry-wide push to bring AI into customer service. The platform works behind the scenes, feeding suggestions to human agents rather than answering customers itself.
Relay's ambitions go beyond drafting replies. The platform also analyzes conversations for signs that a customer may be preparing to cancel and produces summaries of support interactions, packaging response suggestions, churn detection and summarization into a single product for support teams.
The problem Relay is meant to solve is a familiar one, chief executive Priya Shah said: agents know the answers exist somewhere inside their own companies but lose time hunting them down. "Support agents spend too much time searching for information that their companies already have," she said.
Arcwell tested the platform with 12 companies over six months and says agents using Relay closed tickets 14% faster. That is the figure the company is touting, but it did not release customer-retention results — leaving open the question of whether Relay's churn warnings translate into customers who actually stay.
Arcwell is selling Relay at $65 per agent per month, a per-seat price that scales with the size of a customer's support team.
Adopting Relay means granting the software access to support transcripts and internal help documents — some of the most sensitive material in a company's customer operation, and a likely sticking point for cautious buyers. Arcwell is pitching its privacy terms as part of the product: the company says customer data is encrypted and is never used to train shared models, meaning one customer's information will not shape answers given to another, and companies can choose a 30-day or 90-day retention period.
For Arcwell, the wager is that companies will accept that trade-off in exchange for measurably faster support. The pilot results make the case on speed. The retention numbers, whenever Arcwell chooses to share them, will have to make the rest.
OpenAI: GPT-6 Luna: Model A delivers a clear, measured story and stays closer to the supplied facts, while Model B adds unsupported specifics about real-time operation and how privacy terms affect other customers. Both meet the requested length, but Model A’s framing is more restrained and publication-ready. (Second judge pass, order swapped — scores are the average of both: Model B delivers the stronger, more fluid news story, with a sharper lede and a more purposeful narrative arc. Model A is somewhat more restra | Anthropic: Claude Fable 5.1: Both outputs preserve every factual claim and l…