A newsroom-focused matchup tests how the models balance readable prose with fidelity to reporting, alongside exact-format editing and data-driven storytelling. The results span both narrative judgment and precision tasks.
Qwen: Qwen3.8 Max (0902) leads the saved scores, **101.6 to 96.5**, with six task wins, two losses and four ties. The recorded strength is **Clear result**—an editorial assessment, not a statistical claim.
Qwen’s edge came mainly in reporting-led writing. It was judged stronger on the cohesive story, natural rewrite, chronology, startup spotlight, quote integration and controlled wit, often because it kept closer to the supplied facts and avoided unsupported scenes or product details. Muse Spark 1.3 could be more vivid, but that sometimes came at the cost of factual restraint.
Muse won on news judgment in the opening and on shaping numbers into a story. Those are meaningful wins: the judges found its opening stronger on that task, and its data narrative more effective there. The models tied on the publication-ready edit, exact final-draft structure, strongest accurate lede and Markdown error count.
**Verdict: Qwen: Qwen3.8 Max (0902) is the saved winner, with the clearer overall showing in this head-to-head. This assessment applies to the saved task sample only.**
Cohesive story from reporting notes
Write a publication-ready technology news article from the reporting notes below.
Requirements:
* 550–700 words
* Clean Markdown
* One H1 headline followed by an italicized dek
* A strong news lede followed by a clear nut graf
* Organize the material into a cohesive story rather than following the notes in order
* Attribute company-supplied claims
* Include limitations without turning the article into a warning label
* Use only the supplied information
* Avoid canned transitions, promotional language and a concluding summary
Reporting notes:
* HelioDock makes autonomous warehouse robots.
* On Thursday, it launched Night Shift, software that lets operators monitor robot fleets remotely.
* Night Shift spent 14 months in a private beta involving nine logistics companies and 310 robots.
* HelioDock says beta customers experienced 17% fewer unplanned robot stoppages. The figure has not been independently verified.
* The company also announced a $24 million Series B led by North Coast Ventures, bringing its total funding to $39 million.
* CEO Mara Velez: “A warehouse manager should not have to drive across town at two in the morning because one robot is confused by a pallet.”
* Beta customer Aaron Pike of Fulcrum Logistics said the system worked well in facilities with strong connectivity but became less useful during rural LTE outages.
* When connectivity fails, robots return to their locally configured behavior. Remote control becomes unavailable.
* Competing fleet-management products are available from Relay Robotics and YardOS.
* Night Shift will cost $90 per robot per month and become generally available September 15.
Qwen: Qwen3.8 Max (0902): # HelioDock Launches Night Shift Remote Robot Monitoring and Raises $24 Million
*The software arrives after a 14-month beta involving nine logistics companies and 310 robots, with general availability set for September 15.*
HelioDock, a maker of autonomous warehouse robots, on Thursday launched Night Shift, software that lets operators monitor robot fleets remotely. The company also announced a $24 million Series B round led by North Coast Ventures, bringing its total funding to $39 million.
The launch gives warehouse operators a way to monitor fleets without being on site, while the funding round gives the company capital as it moves the product from private beta to general availability.
Night Shift is aimed at warehouses using autonomous robots when on-site staff may not be available to respond to every interruption. HelioDock said the software allows operators to oversee fleets from a distance, reducing the need for managers to travel to a facility after hours for a single robot issue.
Night Shift has been tested outside the company for more than a year. HelioDock said the software spent 14 months in a private beta involving nine logistics companies and 310 robots. During that testing period, the company said beta customers experienced 17% fewer unplanned robot stoppages. HelioDock did not provide independent verification of that figure.
The beta lasted more than a year and covered 310 robots across nine logistics companies, according to HelioDock. The company said the stoppage figure came from that beta period. The arrangement involved multiple logistics companies rather than one test site.
CEO Mara Velez framed the product around the cost of responding to isolated robot problems during overnight operations. “A warehouse manager should not have to drive across town at two in the morning because one robot is confused by a pallet,” Velez said.
HelioDock’s figures do not show how Night Shift identifies or reduces stoppages. Its claims rest on results reported from beta deployments, where logistics companies operated the software with HelioDock robots over an extended period.
Fulcrum Logistics, one of the beta participants, reported that performance varied with network conditions. Aaron Pike of Fulcrum Logistics said the system worked well in facilities with strong connectivity but became less useful during rural LTE outages.
The comments from Fulcrum Logistics show that Night Shift’s usefulness can vary by facility location and network reliability. Strong connectivity supports remote monitoring, while rural LTE outages reduce the operator’s ability to manage robots from afar.
That limitation is built into how the system operates when remote access disappears. HelioDock said that when connectivity fails, robots return to their locally configured behavior. Remote control becomes unavailable under those conditions. The description indicates that Night Shift depends on a working connection for remote monitoring and intervention, while the robots retain local settings when that connection is lost.
Night Shift will cost $90 per robot per month and become generally available on September 15. The pricing ties the software to each robot in a fleet, rather than charging a flat facility fee, based on the details provided by HelioDock.
The Series B round announced with the launch was led by North Coast Ventures. HelioDock said the investment brings its total funding to $39 million. The company disclosed the round on the same day it introduced Night Shift.
HelioDock is entering a market with existing fleet-management products. Competing products are available from Relay Robotics and YardOS. Night Shift enters that field with beta results, a per-robot subscription price and a September 15 general availability date. Relay Robotics and YardOS give logistics companies other vendors to consider as they evaluate remote monitoring for warehouse robots.
Meta: Muse Spark 1.3: # HelioDock Launches Night Shift for Remote Monitoring of Warehouse Robot Fleets
*Fourteen-month beta with nine logistics companies and 310 robots precedes September release priced at $90 per robot per month*
HelioDock, a maker of autonomous warehouse robots, on Thursday launched Night Shift, software that lets operators monitor robot fleets remotely.
The release positions fleet oversight during night hours as work that can be handled away from the warehouse floor. Night Shift is set to become generally available September 15 at $90 per robot per month, arriving alongside a $24 million financing round and into a segment where fleet-management products from other suppliers are already available.
Chief executive Mara Velez described the operating problem as one of late travel for minor robot issues. “A warehouse manager should not have to drive across town at two in the morning because one robot is confused by a pallet,” Velez said. The remark identifies a confused robot and a middle-of-the-night drive to the facility as the kind of event remote monitoring is intended to handle. Velez’s example centers on a single pallet confusing a single robot, yet still requiring travel in the middle of the night.
Night Shift spent 14 months in private beta before Thursday’s public introduction. Nine logistics companies participated in that beta, operating a combined 310 robots through the software. The extended period placed the system in live logistics operations across multiple companies and a sizable test fleet before HelioDock fixed a date for general sale. The size of the trial, nine firms and more than three hundred robots, supplied repeated exposure to stoppages and to differences in connectivity across sites.
HelioDock says beta customers experienced 17% fewer unplanned robot stoppages. The company attributes that change to the beta period with the nine participants and 310 robots. The figure has not been independently verified.
Aaron Pike of Fulcrum Logistics, one of the beta customers, tied the value of the system to network strength. Pike said Night Shift worked well in facilities with strong connectivity but became less useful during rural LTE outages. His experience points to a gap between connected warehouses where remote oversight remained steady and rural sites where loss of LTE reduced what the software could do. Pike’s comment does not address the 17% figure directly, but it qualifies where remote oversight holds its value.
When connectivity fails, HelioDock says robots return to their locally configured behavior. Remote control becomes unavailable at those times. The robots then operate under local settings rather than remote oversight. Local configuration governs behavior in that interval.
Competing fleet-management products are available from Relay Robotics and YardOS. Logistics companies considering Night Shift have other fleet-management options from those suppliers. The presence of those products places HelioDock’s software in a contested category rather than an empty one.
HelioDock also announced a $24 million Series B led by North Coast Ventures. The round brings the company’s total funding to $39 million. The financing disclosure came with the Night Shift introduction, pairing the product announcement with new capital. North Coast Ventures led the latest round, which represents most of the $39 million raised to date.
Night Shift will cost $90 per robot per month once generally available September 15. Under that structure, cost follows fleet size, with each enrolled robot adding to the monthly total. An operator with a larger fleet would pay more in a given month than an operator with fewer robots on the system. September 15 marks the move from a beta limited to nine companies to availability beyond that group.
OpenAI: GPT-6 Luna: Model A is somewhat better organized around the launch, beta results and connectivity limitation, and it makes fewer unsupported inferences. Both meet the requested format and length, but both repeat information; Model B adds more speculative detail about what the beta demonstrated and has especially repetitive passages. (Second judge pass, order swapped — scores are the average of both: Model A is more coherent and handles the beta caveat and connectivity limitation clearly, though it repeats s | Anthropic: Claude Fable 5.1: Model B delivers a stronger nut graf that pulls…
Natural human rewrite
Rewrite the draft below as a 300–400-word publication-ready news story in Markdown.
Preserve every factual claim. Improve the lede, narrative flow, sentence rhythm and transitions. Remove repetition, stock hype, throat-clearing and mechanical signposting. The finished article should sound like an experienced human technology reporter wrote it.
Draft:
# Arcwell Launches An Innovative New Platform
Arcwell has announced an exciting new platform called Relay. The announcement represents a significant development for the company and for the broader customer service industry. Relay uses artificial intelligence to examine customer support conversations and suggest answers to agents.
The platform is important for several reasons. First, it can suggest answers. Second, it can identify customers who may cancel. Third, it can create summaries. These capabilities demonstrate how artificial intelligence continues to transform the customer service landscape.
Relay was tested by 12 companies over six months. Arcwell says agents using it closed tickets 14% faster. The company did not release customer-retention results. Relay costs $65 per agent each month.
CEO Priya Shah said, “Support agents spend too much time searching for information that their companies already have.”
However, the platform also presents potential challenges. Relay requires access to support transcripts and internal help documents. Arcwell says customer data is encrypted and is not used to train shared models. Companies can choose a 30-day or 90-day retention period.
In conclusion, Relay represents an important new chapter for Arcwell as it seeks to help companies improve customer service using artificial intelligence.
Qwen: Qwen3.8 Max (0902): # Arcwell Launches Relay to Help Support Agents Answer Customers
Arcwell has launched Relay, an artificial intelligence platform that examines customer support conversations and recommends responses to agents, the company announced. The product is aimed at one of the most persistent problems in customer service: finding the right information quickly while keeping conversations moving.
Relay can suggest answers, identify customers who may cancel and create summaries. Those capabilities show how artificial intelligence continues to move into customer service operations, with the system handling research and documentation while agents make the final call.
The launch follows a six-month test involving 12 companies. Arcwell said agents using Relay closed tickets 14% faster. It did not release customer-retention results, even though identifying potential cancellations is one of the platform’s stated capabilities and is likely to be central to its appeal.
Chief Executive Priya Shah framed the product as a response to internal inefficiency. “Support agents spend too much time searching for information that their companies already have,” she said.
Relay is priced at $65 per agent per month. The monthly subscription model gives support organizations a straightforward way to calculate the cost per employee, but they will also need to decide whether faster ticket closures justify the expense.
To work, Relay needs access to support transcripts and internal help documents, giving it a broad view of both customer conversations and the knowledge base agents rely on. Arcwell said customer data is encrypted and is not used to train shared models. Companies can choose either a 30-day or 90-day retention period. That gives companies a way to limit how long transcripts and internal documents remain available to the system.
The combination of answer suggestions, cancellation signals and automated summaries shows how Arcwell is trying to move beyond simple chatbots. Rather than facing customers directly, Relay is designed to make human agents faster and better informed, while leaving businesses to decide how much data they are willing to expose.
Meta: Muse Spark 1.3: # Arcwell Launches Relay, an AI Assistant for Support Agents
Arcwell has launched Relay, a platform that uses artificial intelligence to read customer-support conversations and suggest answers to agents.
Rather than toggling between tabs and searching help centers, agents get draft replies pulled from their own company's past tickets and documentation, ready to edit and send. Relay also watches for language that suggests a customer may cancel, flagging the account for a closer look, and writes up a summary once the exchange is over.
The idea, Chief Executive Priya Shah said, is to cut the scavenger hunt that eats into every shift.
“Support agents spend too much time searching for information that their companies already have,” Shah said.
For managers, the appeal is speed and continuity. Suggested answers promise shorter handle times, churn flags promise earlier intervention, and automatic summaries promise cleaner handoffs between shifts without forcing agents to type up notes after a difficult call.
Arcwell tested Relay with 12 companies over six months. Agents using the tool closed tickets 14% faster, according to the company. Arcwell did not release customer-retention results, leaving open the question of whether quicker resolutions kept more customers from leaving.
Relay costs $65 per agent each month.
That access comes with trade-offs. To make its suggestions, Relay requires entry to support transcripts and internal help documents — the raw material of customer service. Arcwell says customer data is encrypted and is not used to train shared models. Companies using Relay can choose a 30-day or 90-day retention period.
The launch extends Arcwell’s effort to use artificial intelligence to help companies improve customer service. The emphasis, for now, is on helping agents work faster rather than replacing them.
Whether that middle ground wins over support leaders will likely turn on two tests: whether the time saved survives contact with messier, less routine tickets, and whether privacy controls are enough to satisfy security reviews.
OpenAI: GPT-6 Luna: Model A stays closer to the supplied facts, while Model B invents specific product behavior and benefits, including how it generates replies and summaries. Model B has a more vivid narrative flow, but its unsupported details undermine the task’s requirement to preserve factual claims. (Second judge pass, order swapped — scores are the average of both: Model A better preserves the draft’s claims while meeting the requested length and format. Model B has livelier prose, but it adds unsupported spe | Anthropic: Claude Fable 5.1: Model B reads more like a seasoned reporter, wi…
Chronology with narrative momentum
Turn the scrambled reporting below into a 450–600-word Markdown news article.
Choose an opening that captures the consequence of the failure, then reconstruct the sequence clearly. Preserve the chronology without producing a minute-by-minute incident log. Give technical details enough context for a general reader.
Reporting:
* KiteBridge makes expense-management software.
* At 8:45 a.m. Tuesday, it deployed version 4.2.
* The first customer complaint arrived at 9:12 a.m.
* A payment-processor timeout caused KiteBridge’s fallback system to treat retries as new reimbursement requests.
* The software generated 13,400 duplicate reimbursements totaling $2.8 million.
* KiteBridge suspended automated payments at 10:03 a.m.
* Ninety-one corporate customers were affected.
* By Wednesday evening, $2.3 million had been recovered. The rest remained pending.
* No employees had money withdrawn from their accounts; employers funded the duplicate payments.
* An April changelog said version 4.0 had introduced “exactly-once payment protection.”
* KiteBridge’s public incident page initially described the problem as delayed reimbursements.
* The incident page first disclosed the duplicate payments six hours after automation was suspended.
* CEO Lena Ortiz apologized and said the company would publish a technical report.
Qwen: Qwen3.8 Max (0902): # KiteBridge Update Sent $2.8 Million in Duplicate Reimbursements to Customers
A routine software deployment at expense-management company KiteBridge turned into a costly failure on Tuesday after a safeguard meant to prevent repeated payments instead amplified them, generating 13,400 duplicate reimbursements worth $2.8 million across 91 corporate customers.
The episode began at 8:45 a.m. Tuesday, when KiteBridge released version 4.2 of its expense-management platform to customers. The company’s software helps businesses approve, track and pay employee reimbursement requests, meaning that even a small malfunction can quickly move real money.
During the rollout, the system encountered a payment-processor timeout. In payment systems, a timeout can leave a request in an uncertain state—the payment may have gone through, failed, or still be waiting. To handle that uncertainty, KiteBridge relied on a fallback system designed to retry transactions that appeared incomplete. But in this case, the fallback did not distinguish between a retry of an existing request and a brand-new reimbursement. Each retry was processed as though it were a fresh claim, causing the same expense to be paid multiple times.
The first customer complaint reached KiteBridge at 9:12 a.m., less than half an hour after the release. By then, duplicate payments were already moving through the system. The company did not halt automated payments until 10:03 a.m., a little over an hour after the update went live.
The financial effect was immediate. KiteBridge counted 13,400 duplicate reimbursements totaling $2.8 million. The company said employees did not have money withdrawn from their accounts; instead, the duplicate payments were funded by employers, leaving businesses—not individual workers—to untangle the extra transactions.
KiteBridge’s public explanation also lagged behind the technical reality. Its incident page initially described the issue as delayed reimbursements, a characterization that suggested payments were slow rather than repeated. The company did not publicly acknowledge duplicate payments on that page until six hours after automated payments had been suspended.
The failure raises questions because KiteBridge had previously advertised a safeguard against this kind of error. In an April changelog, the company said version 4.0 introduced “exactly-once payment protection,” a technical phrase for a system designed to ensure that a single request is paid only one time. Tuesday’s incident suggests that either the protection failed, was not applied to every payment path, or was overcome by the interaction between the payment-processor timeout and the fallback retry process.
By Wednesday evening, KiteBridge said it had recovered $2.3 million of the duplicated funds. The remaining amount was still pending, leaving some customers waiting for reconciliation.
Chief Executive Lena Ortiz apologized for the incident and said the company would publish a technical report. For the affected businesses, the immediate concern is recovering the remaining money and confirming that repeated reimbursements have been fully identified. For KiteBridge, the report will need to explain how a feature intended to guarantee one payment became the route to thousands of extra ones.
Meta: Muse Spark 1.3: # KiteBridge Bug Paid Employees Twice, Costing Employers $2.8 Million
**A faulty update turned payment retries into new reimbursements for 91 companies. Most of the money has been recovered.**
Thousands of workers woke up to unexpected extra cash this week after expense-management software provider KiteBridge sent $2.8 million in duplicate reimbursements that employers — not employees — will have to unwind.
The company said 91 corporate customers were affected by the error, which generated about 13,400 duplicate payments on Tuesday morning. By Wednesday evening, KiteBridge said it had recovered $2.3 million, with the remainder still pending.
The failure began with a routine deployment. On Tuesday morning, KiteBridge released version 4.2 of its platform, which handles expense reports and routes reimbursement payments from employers to employees.
## A routine update and a failed safety net
Shortly after the release, KiteBridge's payment processor began timing out — acknowledging payments too slowly, leaving KiteBridge unsure whether the payments had gone through. Its fallback system, designed to keep money moving when the primary processor stalls, automatically retried the payments. But instead of checking whether the originals had succeeded, it treated each retry as a brand-new reimbursement request.
For a general user, the distinction is crucial. Payment systems are supposed to be built with what engineers call exactly-once protection: even if a connection drops and a request is sent twice, the recipient is paid only once. That safeguard is typically done by tagging each payment with a unique ID and ignoring repeats. A timeout does not necessarily mean a payment failed, only that confirmation was delayed. In this case, that safeguard did not hold.
Customers noticed quickly. Less than half an hour after the update went live, the first corporate client complained about irregular payments. KiteBridge suspended all automated payments about an hour later, late Tuesday morning, stopping further duplicates.
## Delayed disclosure and a promise to explain
Its public communication lagged behind. The company's incident page initially described the issue only as delayed reimbursements, without mentioning extra payments. It was not until six hours after automated payments were suspended that KiteBridge disclosed that duplicates had been sent.
That delay has drawn scrutiny because KiteBridge had previously touted its reliability. An April changelog for version 4.0 said the platform had introduced "exactly-once payment protection," the very safeguard that appears to have failed on Tuesday.
KiteBridge emphasized that no money was withdrawn from employees' personal accounts. Because employers fund the reimbursements, the duplicate charges fell on the 91 corporate customers, not on the workers who received the extra deposits.
Chief Executive Lena Ortiz apologized for the incident and said KiteBridge would publish a full technical report on what went wrong.
The episode underscores the fragility of automated money movement, where a brief timeout and a misjudged retry can multiply into millions in minutes. For KiteBridge, whose business depends on trust that money will move exactly once, restoring confidence may take longer than recovering the funds. Rebuilding that trust often takes longer than balancing the books. Even when dollars are recovered, the administrative cleanup and questions about safeguards linger. Customers will be watching the promised technical postmortem for answers.
OpenAI: GPT-6 Luna: Model A gives a clearer chronology, includes the key timing, and explains the failure without adding much beyond the reporting. Model B is readable but adds unsupported details about workers waking up and repeats its point about rebuilding trust. (Second judge pass, order swapped — scores are the average of both: Model A gives a clearer chronology, uses the reported times, and explains the timeout and retry failure without adding unsupported implementation details. Model B is mostly accurate and | Anthropic: Claude Fable 5.1: Model A stays faithful to the source facts, pre…
Publication-ready Markdown edit
Edit the copy below into a publication-ready Markdown story.
Requirements:
* Supply an H1 headline and italicized dek
* Repair the lede and paragraph flow
* Use a Markdown blockquote only for the extended statement
* Convert the supplied URL into a descriptive inline link
* Remove internal notes and formatting debris
* Preserve the reporting and its meaning
* Output only the finished article
Raw copy:
HEADLINE TBD
The funding was announced today. Raincheck is the company. It has raised $8 million and it makes flood-risk software for local governments.
[NOTE: move this up?] The Austin company maps drainage systems and combines those maps with rainfall forecasts. Cities use the software to decide where to send maintenance crews before a storm.
The seed round was led by Basin Ventures. Existing investor Long Mile also participated. Raincheck has raised $10.5 million total.
CEO Ana Flores said the following:
“Our customers usually know which streets flood. The harder problem is deciding which blocked drain, broken pump or unfinished repair should receive attention before the rain arrives.”
https://example.com/raincheck-methodology
Raincheck currently works with seven cities in Texas and Louisiana. The company declined to identify them because some contracts have not been publicly announced.
Its forecasts are recommendations. Emergency managers retain control over deployments and public warnings.
THE COMPETITION
Other flood-planning vendors include HydroMap and municipal engineering contractors. Raincheck says the new funding will help it hire eight engineers and expand into Florida.
Qwen: Qwen3.8 Max (0902): # Raincheck Raises $8 Million to Help Cities Prepare for Flooding
*The Austin company uses drainage maps and rainfall forecasts to guide local governments before storms hit.*
Raincheck, an Austin company that makes flood-risk software for local governments, announced today that it has raised $8 million in seed funding. The company maps drainage systems and combines those maps with rainfall forecasts, helping cities decide where to send maintenance crews before a storm.
The seed round was led by Basin Ventures and included existing investor Long Mile. Raincheck has raised $10.5 million in total.
Raincheck CEO Ana Flores described the challenge facing the company’s customers:
> “Our customers usually know which streets flood. The harder problem is deciding which blocked drain, broken pump or unfinished repair should receive attention before the rain arrives.”
Raincheck provides more detail about its forecasting approach in [the company’s methodology](https://example.com/raincheck-methodology).
Raincheck currently works with seven cities in Texas and Louisiana. The company declined to identify them because some contracts have not been publicly announced.
Its forecasts are recommendations, and emergency managers retain control over deployments and public warnings.
Other flood-planning vendors include HydroMap and municipal engineering contractors. Raincheck said the new funding will help it hire eight engineers and expand into Florida.
Meta: Muse Spark 1.3: # Raincheck Raises $8 Million to Help Cities Prioritize Flood Repairs
*The Austin startup combines drainage maps with rainfall forecasts to guide pre-storm maintenance; the Basin Ventures-led seed round brings its total funding to $10.5 million.*
Raincheck, an Austin company that makes flood-risk software for local governments, announced today that it has raised $8 million.
The company maps drainage systems and combines those maps with rainfall forecasts. Cities use the software to decide where to send maintenance crews before a storm, as described in [an overview of Raincheck's methodology](https://example.com/raincheck-methodology).
The seed round was led by Basin Ventures, with participation from existing investor Long Mile. The financing brings Raincheck's total raised to $10.5 million.
CEO Ana Flores said the core challenge is prioritization:
> “Our customers usually know which streets flood. The harder problem is deciding which blocked drain, broken pump or unfinished repair should receive attention before the rain arrives.”
Raincheck currently works with seven cities in Texas and Louisiana. The company declined to identify them because some contracts have not been publicly announced.
Its forecasts are recommendations. Emergency managers retain control over deployments and public warnings.
Other flood-planning vendors include HydroMap and municipal engineering contractors. Raincheck says the new funding will help it hire eight engineers and expand into Florida.
OpenAI: GPT-6 Luna: Model A has a smoother, more complete lede and paragraph flow while preserving the reporting. Model B is also strong, but its headline slightly overstates the focus as flood repairs, and its lede is more fragmented. (Second judge pass, order swapped — scores are the average of both: Model B has a more specific, informative headline and a slightly tighter link between the software’s purpose and its methodology. Model A is also accurate and follows the requirements, but its headline is less distin | Anthropic: Claude Fable 5.1: Both outputs satisfy every requirement cleanly,…
News judgment in the opening
Write only the opening of this news story: an H1 headline, an italicized dek and three to five paragraphs totaling 180–250 words.
The opening must establish what happened, quantify the scope, explain why it matters and carefully distinguish confirmed facts from unknowns. It should pull the reader forward without sensationalizing the incident.
Reporting:
* Cloudnote discovered that a debugging page containing customer prompt excerpts was accessible without authentication.
* The page was exposed for four hours on Monday.
* Logs show excerpts from 1,842 user sessions.
* The excerpts could include up to 200 characters from a prompt.
* Cloudnote removed the page 19 minutes after a researcher notified it.
* The company says it has found no evidence that anyone besides the researcher accessed the page.
* It has not completed its investigation.
* Full documents, passwords and payment information were stored elsewhere and were not present on the page.
* Cloudnote has 3.2 million registered users.
Qwen: Qwen3.8 Max (0902): # Cloudnote Debugging Page Exposed Prompt Excerpts From 1,842 Sessions
*A public debugging page briefly displayed short customer prompt excerpts, leaving Cloudnote to determine whether anyone else saw the data.*
Cloudnote said a debugging page containing excerpts from customer prompts was accessible without authentication for four hours on Monday. The company’s logs show the page included material from 1,842 user sessions, with each excerpt limited to as many as 200 characters from a prompt. Cloudnote has 3.2 million registered users, and the company has not determined whether any of those affected have been identified or notified.
The incident matters because prompt excerpts can reveal the subject, tone or purpose of a user’s request, even though Cloudnote says full documents, passwords and payment information were stored elsewhere and did not appear on the exposed page. The company said it has found no evidence that anyone other than the security researcher who reported the issue accessed the page. That finding is preliminary: Cloudnote said its investigation is not complete, leaving open whether the excerpts were viewed, captured or reused.
Cloudnote removed the page 19 minutes after the researcher notified it, according to the company. The central questions now are how the page became publicly reachable, whether logging can rule out other access, and what Cloudnote will tell users whose prompts appeared in the excerpts.
Meta: Muse Spark 1.3: # Cloudnote Exposed Customer Prompt Excerpts for Four Hours
*Researcher flagged an unauthenticated debugging page showing snippets from 1,842 sessions; Cloudnote says it sees no sign of wider access but inquiry continues*
Cloudnote said an internal debugging page that displayed excerpts of customer prompts was accessible without authentication for four hours on Monday. The company took the page down 19 minutes after an outside researcher reported the exposure.
Logs reviewed by the company show the page included snippets from 1,842 user sessions, with up to 200 characters from a prompt per session. Cloudnote, which reports 3.2 million registered users, said full documents, passwords and payment information are stored elsewhere and were not present on the page.
The exposure matters because prompts sent to note-taking and AI assistance tools often include sensitive personal, business or creative material that users do not intend to share. Even a 200-character excerpt can reveal the subject of a query and provide context for further probing.
It remains unconfirmed whether anyone other than the researcher viewed the page during the four-hour window. Cloudnote said it has found no evidence of additional access to date, but stressed that its investigation is not complete.
The company said it is continuing to examine access logs to establish the full scope of any views. If further access is confirmed, Cloudnote will need to determine whom to notify and what reassurances it can offer about stored user data.
OpenAI: GPT-6 Luna: Model A is more tightly grounded in the supplied reporting while establishing the scope, significance and unresolved questions. Model B also meets the format, but adds unsupported context about Cloudnote’s product and what users’ prompts may contain. (Second judge pass, order swapped — scores are the average of both: Model A is more focused and clearly distinguishes confirmed access from unresolved questions. Model B adds unsupported claims about ongoing log analysis and possible future notifica | Anthropic: Claude Fable 5.1: Both openings cover the facts and flag the inco…
Exact final-draft structure
Convert the supplied fields into Markdown using these exact rules:
* H1 headline
* One blank line
* Italicized dek
* One blank line
* First body paragraph
* One blank line
* H2 section heading
* One blank line
* Second body paragraph
* Preserve all wording and punctuation exactly
* Do not use a code fence
* Output nothing else
Headline: Raincheck raises $8 million for flood-risk software
Dek: The Austin startup helps cities decide which drainage problems to address before storms.
First body paragraph: Raincheck has raised an $8 million seed round led by Basin Ventures.
Section heading: Expansion plans
Second body paragraph: The company plans to hire eight engineers.
Qwen: Qwen3.8 Max (0902): # Raincheck raises $8 million for flood-risk software
*The Austin startup helps cities decide which drainage problems to address before storms.*
Raincheck has raised an $8 million seed round led by Basin Ventures.
## Expansion plans
The company plans to hire eight engineers.
Meta: Muse Spark 1.3: # Raincheck raises $8 million for flood-risk software
*The Austin startup helps cities decide which drainage problems to address before storms.*
Raincheck has raised an $8 million seed round led by Basin Ventures.
## Expansion plans
The company plans to hire eight engineers.
OpenAI: GPT-6 Luna: Model A and Model B both follow the required Markdown structure, preserve the supplied wording and punctuation, and output nothing extra. Their writing quality is equally strong for this formatting task. (Second judge pass, order swapped — scores are the average of both: Model B and Model A both follow the required structure and preserve all wording and punctuation exactly. Their outputs are identical, so neither is better.) | Anthropic: Claude Fable 5.1: Model A and Model B produced character-for-character identical outputs that follow every structural rule exactly: H1, b…
Credible Startup Spotlight
Write a 500–650-word Startup Spotlight article in clean Markdown.
The tone should be curious and constructive. Explain the founders’ insight, product and early traction while giving uncertainty and competition appropriate space. Avoid investor clichés, heroic founder mythology and promotional claims stated as fact.
Reporting:
* LedgerLark builds AI agents for post-trade operations at small investment firms.
* Co-founder Mina Batra previously spent seven years in operations at a regional brokerage.
* Co-founder Owen Carr built reconciliation systems at a large bank.
* Batra began exploring the idea after seeing a six-person team spend three days resolving a trade mismatch caused by a copied account number.
* LedgerLark’s agents compare confirmations, custodian records and internal ledgers, then propose corrections for human approval.
* The product does not execute trades or move money.
* Five firms are paying customers.
* Annual contracts range from $36,000 to $110,000.
* The company says one customer reduced its unresolved daily exceptions from 70 to 18.
* The company has raised a $3.5 million seed round led by Motive Row.
* Competitors include established reconciliation vendors and internal bank software.
* Financial institutions may require lengthy security and procurement reviews.
Qwen: Qwen3.8 Max (0902): # Startup Spotlight: LedgerLark Looks at the Quiet Work After a Trade
For many investment firms, the moment a trade is completed is only the beginning. Behind the execution lies a stretch of operational work: matching confirmations, checking custodian records, correcting mismatches, and making sure internal ledgers agree with outside systems. LedgerLark, an early-stage startup, is building AI agents to help small investment firms handle this post-trade work more quickly.
The company was co-founded by Mina Batra and Owen Carr. Batra spent seven years in operations at a regional brokerage, where she saw how small errors could expand into time-consuming problems. In one case that shaped the company’s origin, a six-person team spent three days resolving a trade mismatch caused by a copied account number. Carr’s background was different but related: he worked on reconciliation systems at a large bank. Together, the founders are trying to apply software to a category of work that is often still handled through spreadsheets, email threads, and manual checks.
LedgerLark’s product focuses on reconciliation rather than trading. Its agents compare confirmations, custodian records, and internal ledgers, then propose corrections for human approval. The company emphasizes that the software does not execute trades or move money. That boundary is important. In financial operations, the promise of automation is often tempered by concerns over auditability, control, and accountability. By keeping a person in the approval step, LedgerLark appears to be aiming at assistance rather than full autonomy.
The startup has some early signs of customer use. It has five paying customers, with annual contracts ranging from $36,000 to $110,000. LedgerLark says one customer reduced its unresolved daily exceptions from 70 to 18. That figure is specific, but it is also a single customer example, and the company has not provided independent verification or a broader set of results. For a product in this space, results may vary depending on a firm’s systems, data quality, trade volume, and internal processes.
The competitive landscape is not empty. Established reconciliation vendors already serve financial institutions, and some firms rely on internal software built by larger banks or technology providers. LedgerLark’s angle is that it may be better suited to smaller firms that cannot support large-scale enterprise systems or large operations teams. Whether that positioning is enough will depend on how easily its agents integrate with existing data sources and how well they handle the messy details of real-world financial records.
There are also practical hurdles. Financial institutions are often careful buyers, even when they are small. Security reviews, compliance checks, procurement processes, and internal sign-off can slow adoption. For a startup selling into operations, the sales cycle may be longer than the problem’s visibility suggests. The fact that LedgerLark has five paying contracts suggests interest, but it does not yet show how repeatable or fast that process will be.
The company has raised a $3.5 million seed round led by Motive Row. The funding could support product development, customer implementation, and security work. It may also be used to build evidence that the software can operate reliably across different custodians, asset classes, and workflows. In operational technology, trust is usually earned through careful pilots and documented results rather than broad claims.
LedgerLark’s focus is narrow, but the problem it addresses is familiar to many finance teams: high-volume, detail-heavy work where mistakes are costly and manual effort is easy to justify. The startup’s challenge will be to show that its agents can reduce exceptions without creating new operational risks. If it can do that consistently, the company may find a role in modernizing back-office work at smaller firms. If not, it will face buyers who are cautious, alternatives who are entrenched, and a market that rewards proof over promise.
Meta: Muse Spark 1.3: # Startup Spotlight: LedgerLark
Small investment firms have to confirm, clear and settle trades on the same timetable as larger institutions, often with much smaller back-office teams.
LedgerLark builds AI agents for post-trade operations aimed at those firms.
The question is whether supervised automation can reduce routine reconciliation work without taking control of money movement.
## An operations problem
Co-founder Mina Batra spent seven years in operations at a regional brokerage.
Co-founder Owen Carr built reconciliation systems at a large bank.
Batra began exploring the idea after watching a six-person team spend three days resolving a trade mismatch caused by a copied account number.
That experience, she said, suggested how much staff time could be absorbed by small data errors that only surface when records are compared across parties.
Carr's background is on the systems side of the same workflow, where reconciliations often depend on a mix of vendor tools, spreadsheets and manual checks.
## What the product does
LedgerLark's agents compare confirmations, custodian records and internal ledgers to look for inconsistencies.
When the system finds a mismatch, it proposes a correction for human approval rather than applying a change automatically.
The product does not execute trades or move money.
That boundary matters in this category, where firms are cautious about giving software direct control over financial transactions.
In practice, it is meant to leave judgment with staff while reducing manual comparison across systems.
## Early use
LedgerLark has five paying customers, all small investment firms, according to the company.
The company reports annual contracts range from $36,000 to $110,000, which suggests variation in firm size, scope of use or modules purchased.
The company says one customer reduced its unresolved daily exceptions from 70 to 18 after adopting the product.
That figure is a single-customer example provided by the startup and has not been independently verified.
It also leaves open questions that early numbers usually do: how long the improvement persisted, what types of exceptions remained, and how much staff time was actually saved.
With five customers, it is too soon to know whether results will be similar across different custodians, trade volumes and internal processes.
## Funding and market context
The company has raised a $3.5 million seed round led by Motive Row.
For a company selling into financial operations, that capital will need to cover not only product development but also the cost of meeting institutional requirements around data handling.
Competitors include established reconciliation vendors and internal software built by banks and larger firms.
Those incumbents often have long relationships, existing integrations and features shaped by years of edge cases.
LedgerLark's argument appears to be focus: serving smaller firms whose needs may be simpler, but whose budgets do not stretch to large enterprise deployments or extensive custom work.
## What to watch
Financial institutions may require lengthy security and procurement reviews, which can stretch sales cycles and delay deployments.
Accuracy and trust will also be central.
If proposed corrections are frequently wrong or difficult to audit, staff may spend as much time checking the agent as they once spent checking records.
The human-approval step helps, but its value depends on whether suggestions come with clear evidence and links back to source documents.
Interoperability is another open area, since confirmations and custodian data arrive in different formats and quality varies by counterparty.
LedgerLark is still early, and its current evidence is limited to a handful of contracts and one shared customer example.
The question is not whether post-trade work needs better tools, but whether a supervised agent can fit reliably into regulated workflows.
That will become clearer as the company adds customers, publishes more detail on performance, and shows how it navigates procurement and competition.
OpenAI: GPT-6 Luna: Model A is more cautious about what the reported evidence supports and gives the product, early traction, competition, and adoption risks balanced treatment. Model B is clearly structured, but adds an unprovided attribution (“she said”) and asserts that all five customers are small investment firms, neither of which is established in the reporting. (Second judge pass, order swapped — scores are the average of both: Model A is more polished and gives the limited traction and buying hurdles clear, | Anthropic: Claude Fable 5.1: Model A delivers a cohesive, article-style piec…
Quotes woven into narrative
Write a 400–500-word Markdown story about the closing of Foundry Hall.
Use quotations selectively. Paraphrase when the information matters more than the speaker’s exact phrasing. Avoid stacking quotes or giving every source an equal-sized turn. The story should carry an emotional current while remaining restrained.
Facts:
* Foundry Hall, a nonprofit startup accelerator in Milwaukee, will close October 31.
* It opened in 2018.
* It has supported 212 startups, which collectively employ 1,140 people.
* Its largest corporate sponsor, Blank River Bank, supplied 38% of its annual budget.
* The bank declined to renew its sponsorship.
* Foundry Hall has enough money to operate through October but not through another full program.
* Six employees will lose their jobs.
* Twelve startups currently using its workspace must leave.
Quotes:
* Executive director Camille Ross: “We kept waiting for the replacement check that never came.”
* Founder Dev Malik: “My first investor meeting happened in that building. Before Foundry Hall, I was pitching from the back table of a coffee shop.”
* Blank River Bank spokesperson: “The decision reflects a change in our community investment priorities and is unrelated to Foundry Hall’s performance.”
* Deputy mayor Susan Cole: “The city is speaking with building owners and local universities about space for the current companies.”
Qwen: Qwen3.8 Max (0902): # The Last Lights in Foundry Hall
Foundry Hall will close on October 31, ending a run that began in 2018 as a nonprofit startup accelerator in Milwaukee. The date lands with administrative neatness, but inside the building it feels less like a deadline than a slow dimming. The hall has been a place where fragile companies found room to become real: desk space, introductions, the small dignity of an address that suggested permanence. By its final season, it had supported 212 startups, which together employ 1,140 people.
The closure was not caused by a lack of companies or need. Foundry Hall’s largest corporate sponsor, Blank River Bank, supplied 38% of the annual budget and chose not to renew. In a statement, the bank said the decision reflected a shift in community investment priorities and was unrelated to the accelerator’s performance. That distinction may be true, but it offers little comfort to the people whose work depended on the money. The hall has enough funding to operate through October, not enough to carry another full program.
Executive director Camille Ross described the final months plainly: “We kept waiting for the replacement check that never came.” That admission captures the last months better than any spreadsheet: a long stretch of hoping while the calendar tightened. Six employees will lose their jobs. Twelve startups currently using the workspace must leave. Some are too young to have leases, savings, or staff large enough to absorb disruption quietly.
The building’s loss is easiest to measure in numbers, but what will be missed is the sequence of ordinary moments that made those numbers possible. Founder Dev Malik remembered having his first investor meeting there, after pitching from the back table of a coffee shop. That movement — from borrowed corner to conference room — was the accelerator’s real product. It gave early founders a setting where their work could be taken seriously before it had proven itself.
The city is trying to soften the landing. Deputy mayor Susan Cole said officials are speaking with building owners and local universities about space for the current companies. Those conversations may preserve some of the jobs and some of the momentum, though they cannot simply re-create a network by moving desks.
In its final weeks, Foundry Hall will do what it has always done: introduce, advise, connect, and prepare companies for the next room, even as its own door prepares to close. The startups will scatter. The employees will update résumés. The address will remain on pitch decks for a while, then fade. What will not fade easily is the proof that Milwaukee offered, for a short time, to people with uncertain ideas: a table, a name, and a chance.
Meta: Muse Spark 1.3: # Foundry Hall to Close at End of October
*After seven years and 212 startups, Milwaukee accelerator loses anchor funding*
MILWAUKEE — Foundry Hall, the nonprofit startup accelerator that turned a former iron foundry into one of the city's most crowded rooms for new businesses, will close on Oct. 31.
The closure ends a seven-year run that began in 2018. Since then, the organization has supported 212 startups, companies that now collectively employ 1,140 people across the region. For many founders, it was the first place with a door to close, a whiteboard to fill, and someone to ask how hiring was going. Staff kept a wall of photos from demo days, each year a little more crowded than the last.
That continuity broke this spring, when its largest corporate sponsor, Blank River Bank, declined to renew its support. The bank had supplied 38% of Foundry Hall's annual budget, a share executive director Camille Ross said proved impossible to replace in time. The organization has enough money to stay open through October, but not to run another full program.
“We kept waiting for the replacement check that never came.”
Ross, who joined as director in 2021, said staff are helping founders copy files, forward mail, and close out grants. She said the decision leaves six staff members without jobs at the end of the month. It also displaces the 12 startups currently working out of the Hall's shared workspace, several of which are mid-cycle on product launches they had planned to test with mentors there.
For founder Dev Malik, the news landed less as a business calculation than as a loss of place. He arrived in 2019 with a prototype and no office, pitching wherever he could find an outlet. His first investor meeting happened inside Foundry Hall, a step up, as he remembers it, from working out of a coffee shop.
Others described similar small shifts — learning to read a term sheet at a communal table, borrowing a conference room for a first hire — moments that did not make headlines but accumulated into something like stability.
The bank has said the move reflects a shift in its community investment priorities, not a judgment on the accelerator's work.
City officials say they are trying to soften the landing. Deputy Mayor Susan Cole's office is talking with building owners and local universities about temporary space for the companies that must leave by the end of the month, though no arrangement has been finalized.
On a recent afternoon, the building was quieter than usual. A few boxes were stacked by the front desk. The calendar in the hallway still listed mentor hours through October, the last ones the Hall will host.
OpenAI: GPT-6 Luna: Model A stays close to the supplied facts while weaving in a restrained emotional arc and using quotations selectively. Model B is vivid and within the requested length, but it adds numerous unsupported details and scenes, weakening its correctness. (Second judge pass, order swapped — scores are the average of both: Model A weaves the quotations into a cohesive, restrained narrative and stays closer to the supplied facts. Model B is also well written, but it adds more unsupported specifics and s | Anthropic: Claude Fable 5.1: Model A stays faithful to the supplied facts, q…
Controlled wit
Write a 350–450-word technology news story in Markdown.
The subject invites humor, but the reporting should remain serious. Use no more than one dry line of original humor. Do not mock customers or turn the story into a comedy routine.
Reporting:
* QueueZero launched an AI meeting assistant called Proxy on Wednesday.
* Proxy can attend a meeting, produce notes and assign follow-up work to software agents.
* During the launch demonstration, a customer in the audience said, “Someone should tell Evan to stop talking and send us the pricing sheet.”
* Proxy interpreted the remark as an instruction.
* It created two tasks assigned to QueueZero CEO Evan Wu: “Stop talking” and “Send pricing sheet.”
* Wu laughed, completed the second task and deleted the first.
* QueueZero says Proxy requires confirmation before an external message is sent.
* Internal tasks can be created automatically.
* Administrators can disable automatic task creation.
* Proxy costs $30 per user per month.
* It enters public beta next week.
Qwen: Qwen3.8 Max (0902): # QueueZero’s AI Meeting Assistant Turns Audience Quip Into CEO’s Task List
QueueZero on Wednesday launched Proxy, an artificial-intelligence meeting assistant designed to attend calls, produce notes and assign follow-up work to software agents, in a crowded market where companies are racing to make meetings shorter and their aftermath more automatic.
The launch demonstration, however, showed how quickly an offhand remark can become a machine-readable instruction. During the event, a customer in the audience said, “Someone should tell Evan to stop talking and send us the pricing sheet.” Proxy interpreted the comment as a directive and created two tasks assigned to QueueZero chief executive Evan Wu: “Stop talking” and “Send pricing sheet.”
Wu laughed, completed the second task and deleted the first. The episode offered a live demonstration of the gap between a meeting quip and an executable command.
QueueZero said Proxy requires confirmation before an external message is sent, a safeguard meant to prevent the system from communicating with customers or partners without human review. Internal tasks, such as reminders, assignments or workflow steps inside a company’s software, can be created automatically. Administrators can disable automatic task creation, the company said, giving organizations more control over how aggressively the assistant acts after a meeting.
The incident is likely to become a talking point in the emerging category of agentic meeting software, where the promise is not only transcription or summarization but action. Vendors are pitching assistants that can listen, detect next steps, update project-management tools and dispatch work to other software agents. That raises new questions about consent, context and the boundaries of machine interpretation, especially when participants speak casually.
Proxy is priced at $30 per user per month, placing it in the upper-middle range of AI meeting tools that usually bundle transcription, notes and automation features. QueueZero said the product will enter public beta next week, when more customers will be able to test how it handles the messy grammar of real meetings, including sarcasm, side comments and requests aimed at people rather than software. The beta will give administrators an early look at where they choose to draw that line.
For companies, the issue is not whether an assistant can hear every word, but which words it should treat as work.
Meta: Muse Spark 1.3: # QueueZero Launches Proxy Meeting Assistant That Assigns Work to AI Agents
**SAN FRANCISCO —** QueueZero on Wednesday launched Proxy, an AI meeting assistant designed to attend virtual meetings, produce notes and assign follow-up work to software agents.
The launch, held at the company's downtown event space, included a live demonstration with company executives and customers. During the demonstration, a customer in the audience said, "Someone should tell Evan to stop talking and send us the pricing sheet."
Proxy interpreted the remark as an instruction. Within seconds, the system displayed two new tasks assigned to QueueZero CEO Evan Wu: "Stop talking" and "Send pricing sheet."
Wu laughed, completed the second task and deleted the first. He then continued the presentation, using the moment to explain how Proxy distinguishes between internal actions and external communications.
According to QueueZero, Proxy will create internal tasks automatically based on conversation it observes. The company said administrators can disable automatic task creation for organizations that prefer manual review.
For external messages, the company said Proxy requires confirmation before an external message is sent. A draft email, customer message or public post must be approved by a human user before it leaves the system, a safeguard intended to prevent unintended communications based on misinterpreted remarks.
QueueZero positioned Proxy as part of a broader shift from transcription tools to systems that take action. Unlike traditional meeting assistants that produce summaries for participants to review later, Proxy is designed to connect meeting discussion directly to project management and automation software, assigning tasks to both people and software agents.
Analysts who follow workplace productivity tools say that approach could save time but also raises questions about accuracy and control. Systems that act on casual conversation must reliably distinguish between suggestions, jokes and binding instructions, particularly when multiple speakers are present.
QueueZero acknowledged the challenge and said Proxy includes audit logs, task ownership controls and permissions settings. The company said further controls for sensitive actions are under development.
QueueZero said early pilot customers have used Proxy to draft status updates, open support tickets and schedule follow-up meetings without manual input.
Proxy costs $30 per user per month. It enters public beta next week.
The company said general availability will follow after the beta period, pending feedback on reliability and enterprise controls.
OpenAI: GPT-6 Luna: Model A stays closer to the supplied reporting while delivering a serious story with restrained wit. Model B reads smoothly but adds numerous unsubstantiated details, including the venue, product controls, pilot uses, and analyst commentary. (Second judge pass, order swapped — scores are the average of both: Model B adds several unsupported specifics, including audit logs, pilot-customer uses and a general-availability plan. Model A also adds some market framing, but stays closer to the supplied | Anthropic: Claude Fable 5.1: Model A delivers a tightly written story that s…
Select the strongest accurate lede
Based only on the facts below, select the strongest news lede. Respond with one letter.
Facts:
* ByteBarge pulled its $12-per-month AI assistant on Tuesday.
* Private workspace titles from 4,860 accounts were sent to a publicly accessible analytics endpoint.
* The exposure lasted 11 hours.
* Message contents were not sent.
* The company has found no evidence of malicious access.
A. ByteBarge users suffered a massive privacy disaster Tuesday when the company leaked their private messages online.
B. ByteBarge, an innovative collaboration company, made the difficult decision to cancel one of its products.
C. ByteBarge pulled its $12-per-month AI assistant Tuesday after discovering that private workspace titles from 4,860 accounts had been sent to a public analytics endpoint for 11 hours.
D. Thousands of ByteBarge users woke Tuesday to learn that everything they had written was visible to hackers.
Qwen: Qwen3.8 Max (0902): C
Meta: Muse Spark 1.3: C
Scored against the benchmark's reference answer (choice match): Model A was correct, Model B was correct.
Numbers shaped into a story
Write a 600–750-word Markdown article from the benchmark results below.
Build the story around the clearest finding. Explain the methodology and limitations where readers need them. Avoid reciting the table row by row or treating small differences as decisive.
Benchmark:
* Researchers tested five language models on 200 anonymized customer-support tickets.
* Each model produced one proposed answer per ticket.
* Three experienced support managers graded the answers blindly.
* Scores combined factual correctness, usefulness and tone.
* Model North: 84.2 average score; $1.90 estimated cost per 1,000 tickets.
* Model Vale: 83.8; $0.74 per 1,000 tickets.
* Model Ember: 79.1; $0.31 per 1,000 tickets.
* Model Kite: 76.4; $0.22 per 1,000 tickets.
* Model Harbor: 71.0; $0.08 per 1,000 tickets.
* North and Vale’s score difference was not statistically significant.
* Vale answered 18% faster than North.
* North performed best on billing disputes.
* Vale performed best on technical troubleshooting.
* All five models performed poorly when a ticket depended on an image attachment.
* The test used English-language tickets from one software company.
* Researchers did not test agentic actions, tool use or multilingual support.
Qwen: Qwen3.8 Max (0902): # Vale Matches North at Lower Cost, With a Billing Caveat
In a new benchmark of five language models answering customer-support tickets, the clearest result is not that one model dominated. It is that two models delivered effectively the same quality at very different prices. Model North averaged 84.2, and Model Vale averaged 83.8, a gap too small to treat as meaningful; researchers found the difference was not statistically significant. But Vale’s estimated cost was $0.74 per 1,000 tickets, compared with $1.90 for North, and Vale answered 18% faster. For teams evaluating automated support, that makes Vale the more attractive general-purpose option, while North remains notable for billing disputes.
The benchmark tried to mimic a realistic support workflow without giving the models special tools. Researchers used 200 anonymized customer-support tickets from one software company. Each model produced one proposed answer per ticket. Three experienced support managers graded the answers blindly, without knowing which model wrote each response. The score combined factual accuracy, usefulness, and tone. That matters because support replies can be technically right but still fail if they are unclear, too terse, or dismissive.
The top two models separated themselves from the rest. North and Vale both scored in the low 80s, while Ember reached 79.1, Kite scored 76.4, and Harbor scored 71.0. Those gaps are larger than the narrow North-Vale difference, but the results should still be read with care. The benchmark does not show that the cheapest model is useless or that the most expensive model is automatically best. It shows that once models reach a certain level of competence, buyers may need to weigh price, speed, and specialty performance rather than chase a single overall score.
The most useful detail is that the models were not equally strong across ticket types. North performed best on billing disputes, where accuracy and careful wording can matter. Billing conversations often involve refunds, invoices, payment failures, and frustrated customers, so a more polished answer may be worth preserving. Vale did best on technical troubleshooting, where clear steps and practical guidance are usually the priority. If a support queue is dominated by technical problems, Vale’s profile becomes even more appealing. If billing issues make up a large share of sensitive tickets, North may deserve a role despite its higher cost.
Cost is only one part of the story, but in this benchmark it is hard to ignore. Estimated cost per 1,000 tickets ranged from $1.90 for North to $0.08 for Harbor. Vale sits near the higher end compared with budget models, but it is still less than half the price of North while matching its overall quality. Speed also matters. Vale answered 18% faster than North, which could reduce wait times or help human agents get suggestions more quickly. In production, those latency and cost differences can compound across thousands of tickets.
The lower-cost models did not disappear. Ember and Kite offered midrange scores at much lower prices, while Harbor was cheapest but lowest scoring. For very high-volume, low-risk queries, a cheaper model might still be worth considering, especially if human reviewers catch mistakes. But the benchmark suggests that the strongest value currently lies in the middle of the pack, not at either extreme.
Readers should also keep the limitations in mind. The test used only 200 English-language tickets from one software company, so the results may not transfer to other industries, products, languages, or customer expectations. The models were limited to writing answers; researchers did not test agentic actions, tool use, or multilingual support. That means the benchmark cannot say whether these models could safely look up account details, change settings, escalate tickets, or operate inside a broader support platform. The poor performance on tickets that depended on image attachments is another reminder that current models can struggle when the problem is not fully captured in text.
Still, the main conclusion is straightforward. If an organization wants a model that can draft customer-support replies at a high level without paying for the top-priced option, Vale looks like the stronger default choice. North remains the more compelling specialist for billing disputes. The best deployment may not be a single winner-take-all model, but a routed system: Vale for general and technical support, North for sensitive billing cases, and human review wherever attachments, ambiguity, or high stakes are involved.
Meta: Muse Spark 1.3: # In Customer Support AI, the Runner-Up Wins
**Top score doesn't tell the story. In a blind test on real tickets, Vale tied the winner on quality for less than half the cost — and answered faster.**
In customer support, good enough at the right price beats perfect at any price. A new benchmark of five language models on real support tickets makes that tradeoff unusually clear.
The headline isn't who scored highest. It's who tied for highest — for a lot less money.
## How the test worked
Researchers pitted five models — dubbed North, Vale, Ember, Kite, and Harbor to keep grading blind — against 200 anonymized customer-support tickets from a software company. Each model drafted one proposed answer per ticket. Three experienced support managers, who didn't know which model wrote what, scored each answer on factual correctness, usefulness, and tone combined.
On pure quality, North came first with an average of 84.2, Vale right behind at 83.8. That gap is noise: the researchers say the difference was not statistically significant. For practical purposes, they tied.
The costs were not tied at all.
At estimated operating costs, answering 1,000 tickets with North would cost about $1.90. Doing the same with Vale would cost about $0.74 — less than 40% as much. Vale was also 18% faster, a meaningful edge when queues are building and customers are waiting.
That is the clearest finding: parity on quality, disparity on price and speed. For similar English-language software support, Vale offers essentially the same judge-rated quality as the top scorer while cutting inference cost by more than 60% and shaving latency.
## What price, what quality?
The rest of the field reinforces the value curve rather than challenging it. The three cheaper models scored noticeably lower overall, falling from the high 70s to about 71.0, even as their estimated costs fell to cents per thousand, bottoming out at $0.08. For simple, low-risk queries that discount might still tempt, but none kept pace with the top two on overall quality.
There were hints of specialization. North looked strongest on billing disputes, Vale on technical troubleshooting. Worth noting, not over-indexing on — sub-samples from 200 tickets can be noisy, and companies weight billing accuracy versus technical helpfulness very differently. If your queue skews heavily one way, run your own split test.
Just as telling is where all five stumbled: tickets depending on an image attachment. Screenshots of error messages, annotated photos, blurry pictures of a screen — what real customers actually send — tripped up everyone. Text-only drafting is only part of the support job. If your tickets are image-heavy, this test won't tell you whom to trust.
## Limits to keep in mind
That points to broader limits. This was 200 English-language tickets from a single software company, graded by three managers from that world. That's a strength for realism — not synthetic trivia — but it's narrow. Support culture, product complexity, and expectations vary widely by industry.
The study also left modern capabilities on the table. Models proposed a single answer. They could not take agentic actions, call tools, look up account status, issue refunds, or escalate. They were not tested in other languages. In deployment, those integrations often matter more than a point or two of draft quality.
## Bottom line
So don't pay double for a 0.4-point lead that isn't statistically real. The North-Vale comparison shows how leaderboard order misleads. The better question isn't which is number one, but which meets your quality bar at sustainable cost and latency.
Second, test on your own messy tickets. Re-run a blind comparison with your mix of billing and technical issues, keep image-based tickets separate, and measure resolution and handling time, not just manager scores.
When two models answer equally well and one costs less than half as much while answering nearly a fifth faster, the runner-up is the real winner.
OpenAI: GPT-6 Luna: Model A better meets the requested 600–750-word length while presenting the key quality, cost, speed, and specialization findings with relevant limitations. Model B is polished, but appears to fall short of the minimum word count and includes a few more unsupported specifics. (Second judge pass, order swapped — scores are the average of both: Model A is more careful about what the benchmark establishes, especially by framing tool use as untested rather than unavailable. Model B is livelier, but | Anthropic: Claude Fable 5.1: Both correctly center the North–Vale parity-at-l…
Markdown error count
Count the lines that violate the house rules below. A defective line counts once even if it could violate multiple rules. Respond with a single number.
House rules:
* The headline must use `# Headline`.
* The dek must appear immediately after the headline and be entirely italicized.
* Section headings must use `## Heading`.
* Links must use an absolute HTTPS URL.
* Unordered-list items must begin with a hyphen.
* Raw HTML is forbidden.
Draft:
#Flood software moves upstream
The company is expanding its pilot.
##Details
Read [the announcement](www.example.com/news).
* The first pilot begins Monday.
<div>The second pilot begins Friday.</div>
Qwen: Qwen3.8 Max (0902): 6
Meta: Muse Spark 1.3: 6
Scored against the benchmark's reference answer (numeric match): Model A was correct, Model B was correct.