Gemini 4 Argon and grok-4.7 face off across writing, editing, and news-judgment tasks. Their strongest work falls in different places, making this a close editorial comparison.
The saved aggregate scores are **96.7 for Gemini 4 Argon and 100.0 for grok-4.7**, but the recorded verdict is a tie, with editorial strength **Too close to call (not statistical)**. Across the 12 tasks, Gemini won 4, grok-4.7 won 5, and 3 were ties; the narrow task split does not support naming an overall winner.
Grok-4.7’s edge was most visible when restraint and careful handling of evidence mattered. It was favored for weaving in quotes, opening a news story, building chronology, and writing the startup spotlight and controlled-wit pieces. Those verdicts repeatedly valued its calibration: it more often kept reported facts distinct from inference and avoided unsupported embellishment.
Gemini 4 Argon had its own clear strengths in finished prose. It won the publication-ready Markdown edit, cohesive story, natural rewrite, and numbers-to-story tasks, with judges often praising flow, polish, concision, or fit to the requested length. The strongest counterpoint was that Gemini sometimes added details or framing beyond the reporting, while grok-4.7 could be repetitive or miss length targets.
The lede selection, Markdown error count, and exact final-draft structure were ties. Taken together, this is a split editorial profile—not a decisive result: grok-4.7 was more consistently cautious with sourcing, while Gemini often shaped the copy more smoothly. **Final call: tie; too close to call on this saved task sample.**
Quotes woven into narrative
Write a 400–500-word Markdown story about the closing of Foundry Hall.
Use quotations selectively. Paraphrase when the information matters more than the speaker’s exact phrasing. Avoid stacking quotes or giving every source an equal-sized turn. The story should carry an emotional current while remaining restrained.
Facts:
* Foundry Hall, a nonprofit startup accelerator in Milwaukee, will close October 31.
* It opened in 2018.
* It has supported 212 startups, which collectively employ 1,140 people.
* Its largest corporate sponsor, Blank River Bank, supplied 38% of its annual budget.
* The bank declined to renew its sponsorship.
* Foundry Hall has enough money to operate through October but not through another full program.
* Six employees will lose their jobs.
* Twelve startups currently using its workspace must leave.
Quotes:
* Executive director Camille Ross: “We kept waiting for the replacement check that never came.”
* Founder Dev Malik: “My first investor meeting happened in that building. Before Foundry Hall, I was pitching from the back table of a coffee shop.”
* Blank River Bank spokesperson: “The decision reflects a change in our community investment priorities and is unrelated to Foundry Hall’s performance.”
* Deputy mayor Susan Cole: “The city is speaking with building owners and local universities about space for the current companies.”
Google: Gemini 4 Argon: # After Six Years of Building Milwaukee’s Tech Scene, Foundry Hall Will Go Dark
On a recent Tuesday afternoon, the whiteboards at Foundry Hall were still covered in the frantic geometry of early-stage ambition: revenue projections, software architectures, and customer flowcharts. By the end of next month, those boards will be wiped clean.
Foundry Hall, the nonprofit startup accelerator that has anchored Milwaukee’s fledgling tech ecosystem since 2018, will permanently close its doors on October 31.
The closure marks a sudden quietus for an institution that punched well above its weight. Over six years, the accelerator guided 212 startups through their earliest, most fragile months. Today, those alumni companies collectively employ 1,140 people across the region.
Yet an organization built to help fledgling companies survive their financial valleys ultimately could not survive its own. The fatal blow came earlier this year when Foundry Hall’s largest corporate sponsor, Blank River Bank, declined to renew its annual grant. The bank’s contribution had accounted for 38% of the nonprofit’s operating budget.
In a statement, a spokesperson for Blank River Bank said the withdrawal resulted from shifting priorities in its community investment strategy and was not a reflection of the accelerator's performance.
That distinction offers little comfort to Executive Director Camille Ross and her staff. For months, Ross scrambled to assemble a coalition of smaller donors to bridge the widening deficit, hoping to secure enough capital to greenlight the winter cohort.
“We kept waiting for the replacement check that never came,” Ross said.
Foundry Hall’s board determined that while the organization had enough cash reserves to pay its bills through October, it could not responsibly fund another full program cycle. Rather than offer a hollowed-out version of its curriculum, the board voted to wind down operations. Six full-time employees will lose their jobs.
The loss is not merely administrative; it removes the physical gravity from Milwaukee’s startup community. For dozens of local entrepreneurs, the hall’s brick-and-timber workspace offered an essential legitimacy that was otherwise out of reach.
Dev Malik, an alumnus of the program, recalled the weight the address carried when he was trying to get his company off the ground.
“My first investor meeting happened in that building,” Malik said. “Before Foundry Hall, I was pitching from the back table of a coffee shop.”
Now, the final twelve startups currently working out of the space must pack up their monitors and find new offices before November. City officials are trying to soften the landing. Deputy Mayor Susan Cole noted that the administration is actively negotiating with local universities and private landlords to secure temporary desk space for the displaced founders.
Even if those twelve companies find new roofs, a quiet anxiety hangs over the remaining weeks at Foundry Hall. In the communal kitchen, conversations about seed rounds and product launches have given way to quieter talk of moving vans and storage units—a community dispersing just as it had learned to gather.
grok-4.7: # After the Check
Foundry Hall, the nonprofit startup accelerator that has occupied a corner of Milwaukee’s startup scene since 2018, will close on October 31. It was the room where an idea could be said out loud to someone who had come to hear it. The organization supported 212 startups. Those companies now employ 1,140 people, a figure that will keep moving through payroll systems long after the hall’s lights go out.
The closing is not the result of a scandal or a sudden failure of the companies inside. It is the result of a missing sponsor. Blank River Bank supplied 38 percent of Foundry Hall’s annual budget, more than any other corporate backer, and declined to renew. A bank spokesperson described the choice as a shift in community investment priorities, unrelated to the accelerator’s performance. The explanation was orderly. It did not replace the money.
Executive director Camille Ross had spent the preceding months in the particular suspense of institutional fundraising, the kind that looks, from the outside, like ordinary work. “We kept waiting for the replacement check that never came,” she said. When it did not come, the arithmetic was simple. Foundry Hall can pay its way through October. It cannot fund another full program.
Six employees will lose their jobs. Twelve startups still using the workspace will have to leave. The numbers are small beside 212 and 1,140, and they are the numbers that have addresses.
Dev Malik, a founder from an early cohort, located the building’s meaning in a single afternoon: his first investor meeting happened there. Before Foundry Hall, he had been pitching from the back table of a coffee shop, hoping the people at the next table would not mind. He did not romanticize the coffee shop. He also did not pretend the hall had been interchangeable with it.
Deputy mayor Susan Cole said the city is talking with building owners and local universities about space for the companies that remain. The talks are a form of care, and they are not yet a key.
In the main room, the ordinary evidence of a working place is still present — power strips, a whiteboard with half an agenda, a jacket on a chair. No one has made a speech of the departure. Ross no longer frames the closure as something that might reverse if the right call is returned. The companies will go on employing people. The six staff members will look for other work. The twelve teams will carry laptops down to the street and find, if they are lucky, another table that is not in the back of a café. What the hall cannot transfer is the simple fact of having been there: a door, a scheduled hour, a person who had agreed to listen. On October 31 that arrangement ends. The rest, as Ross has already learned, does not arrive just because it is needed.
OpenAI: GPT-6 Luna: Model B better meets the request with a restrained emotional throughline and selective use of quotation, while Model A adds more specific unsupported claims about fundraising efforts, a board vote, and a winter cohort. Model B also includes a few speculative details, but they are less disruptive to the story’s factual grounding. (Second judge pass, order swapped — scores are the average of both: Model B better follows the request for selective quotations and restrained emotion, while Model A inv | Anthropic: Claude Fable 5.1: Model A is a competent, conventional feature th…
Publication-ready Markdown edit
Edit the copy below into a publication-ready Markdown story.
Requirements:
* Supply an H1 headline and italicized dek
* Repair the lede and paragraph flow
* Use a Markdown blockquote only for the extended statement
* Convert the supplied URL into a descriptive inline link
* Remove internal notes and formatting debris
* Preserve the reporting and its meaning
* Output only the finished article
Raw copy:
HEADLINE TBD
The funding was announced today. Raincheck is the company. It has raised $8 million and it makes flood-risk software for local governments.
[NOTE: move this up?] The Austin company maps drainage systems and combines those maps with rainfall forecasts. Cities use the software to decide where to send maintenance crews before a storm.
The seed round was led by Basin Ventures. Existing investor Long Mile also participated. Raincheck has raised $10.5 million total.
CEO Ana Flores said the following:
“Our customers usually know which streets flood. The harder problem is deciding which blocked drain, broken pump or unfinished repair should receive attention before the rain arrives.”
https://example.com/raincheck-methodology
Raincheck currently works with seven cities in Texas and Louisiana. The company declined to identify them because some contracts have not been publicly announced.
Its forecasts are recommendations. Emergency managers retain control over deployments and public warnings.
THE COMPETITION
Other flood-planning vendors include HydroMap and municipal engineering contractors. Raincheck says the new funding will help it hire eight engineers and expand into Florida.
Google: Gemini 4 Argon: # Raincheck Raises $8 Million to Help Cities Prepare for Flooding
*The Austin-based startup maps drainage systems and weather forecasts to guide municipal maintenance crews before storms hit.*
Raincheck, an Austin-based company that makes flood-risk software for local governments, announced today that it has raised an $8 million seed round.
The company's software [maps drainage systems and combines them with rainfall forecasts](https://example.com/raincheck-methodology), helping cities decide where to send maintenance crews before a storm. While the forecasts serve as recommendations, local emergency managers retain ultimate control over crew deployments and public warnings.
As CEO Ana Flores explained:
> “Our customers usually know which streets flood. The harder problem is deciding which blocked drain, broken pump or unfinished repair should receive attention before the rain arrives.”
Basin Ventures led the seed round, with participation from existing investor Long Mile, bringing Raincheck’s total funding to $10.5 million. The company says the new capital will help it hire eight engineers and expand into Florida.
Raincheck currently works with seven cities across Texas and Louisiana, though the company declined to identify them because some contracts have not been publicly announced. In the broader flood-planning market, Raincheck competes with vendors such as HydroMap and traditional municipal engineering contractors.
grok-4.7: # Raincheck Raises $8 Million for Flood-Risk Software
*The Austin company combines drainage maps with rainfall forecasts so cities can send maintenance crews before a storm.*
Raincheck, an Austin company that makes flood-risk software for local governments, announced today that it has raised $8 million.
The company maps drainage systems and combines those maps with rainfall forecasts. Cities use the software to decide where to send maintenance crews before a storm. Raincheck describes that work in its [methodology](https://example.com/raincheck-methodology).
The seed round was led by Basin Ventures. Existing investor Long Mile also participated. Raincheck has raised $10.5 million total.
CEO Ana Flores said:
> “Our customers usually know which streets flood. The harder problem is deciding which blocked drain, broken pump or unfinished repair should receive attention before the rain arrives.”
Raincheck currently works with seven cities in Texas and Louisiana. The company declined to identify them because some contracts have not been publicly announced.
Its forecasts are recommendations. Emergency managers retain control over deployments and public warnings.
Other flood-planning vendors include HydroMap and municipal engineering contractors. Raincheck says the new funding will help it hire eight engineers and expand into Florida.
OpenAI: GPT-6 Luna: Model A has a stronger lede and smoother paragraph flow while preserving the reported details. Model B is accurate and follows the format, but its short, sequential paragraphs feel less polished as a finished story. (Second judge pass, order swapped — scores are the average of both: Model B preserves the source’s distinctions more closely, particularly by describing other vendors without asserting that Raincheck directly competes with them. Model A is also polished, but it slightly strengthens t | Anthropic: Claude Fable 5.1: Model A genuinely repairs the paragraph flow, m…
Cohesive story from reporting notes
Write a publication-ready technology news article from the reporting notes below.
Requirements:
* 550–700 words
* Clean Markdown
* One H1 headline followed by an italicized dek
* A strong news lede followed by a clear nut graf
* Organize the material into a cohesive story rather than following the notes in order
* Attribute company-supplied claims
* Include limitations without turning the article into a warning label
* Use only the supplied information
* Avoid canned transitions, promotional language and a concluding summary
Reporting notes:
* HelioDock makes autonomous warehouse robots.
* On Thursday, it launched Night Shift, software that lets operators monitor robot fleets remotely.
* Night Shift spent 14 months in a private beta involving nine logistics companies and 310 robots.
* HelioDock says beta customers experienced 17% fewer unplanned robot stoppages. The figure has not been independently verified.
* The company also announced a $24 million Series B led by North Coast Ventures, bringing its total funding to $39 million.
* CEO Mara Velez: “A warehouse manager should not have to drive across town at two in the morning because one robot is confused by a pallet.”
* Beta customer Aaron Pike of Fulcrum Logistics said the system worked well in facilities with strong connectivity but became less useful during rural LTE outages.
* When connectivity fails, robots return to their locally configured behavior. Remote control becomes unavailable.
* Competing fleet-management products are available from Relay Robotics and YardOS.
* Night Shift will cost $90 per robot per month and become generally available September 15.
Google: Gemini 4 Argon: # HelioDock Launches Remote Monitoring Software and Secures $24M Series B
*The autonomous warehouse robotics maker aims to curb after-hours facility visits with its new Night Shift platform, arriving September 15 alongside fresh venture backing.*
HelioDock, a maker of autonomous warehouse robots, launched a new software platform on Thursday designed to let human operators monitor and manage their robotic fleets from afar. The product debut arrived alongside the announcement of a $24 million Series B funding round.
The dual announcements mark an expansion for the robotics company as it moves to pair its warehouse hardware with recurring-revenue management software. Backed by the new capital, HelioDock is entering a competitive fleet-management software market that already includes rival offerings from Relay Robotics and YardOS.
The new software, called Night Shift, is built to help logistics operators address stalled or confused machines without requiring staff on the warehouse floor. The system will become generally available on September 15 and is priced at $90 per robot per month.
According to HelioDock Chief Executive Officer Mara Velez, the software targets the operational headaches of running autonomous hardware after hours.
“A warehouse manager should not have to drive across town at two in the morning because one robot is confused by a pallet,” Velez said.
Prior to Thursday’s launch, Night Shift underwent a 14-month private beta test. The trial included 310 robots deployed across nine logistics companies. HelioDock claims that participating customers saw a 17% reduction in unplanned robot stoppages during the testing period, though that figure has not been independently verified.
While the software is intended to keep automated workflows moving from a distance, its real-world utility depends heavily on the strength of a warehouse’s network infrastructure. Because Night Shift relies on an active link between the facility and the remote operator, unstable internet connections can interrupt the system's oversight capabilities.
When a facility experiences a connectivity failure, HelioDock’s robots automatically revert to their locally configured behavior, and remote control features become unavailable until the connection is restored.
For beta tester Fulcrum Logistics, network reliability dictated where the software was most effective. Aaron Pike of Fulcrum Logistics noted that while Night Shift performed well inside facilities equipped with strong connectivity, the platform became less useful during LTE outages at rural locations.
The commercialization of the Night Shift platform is supported by the company’s newly closed $24 million Series B investment. The round was led by North Coast Ventures and brings HelioDock’s total funding to $39 million.
grok-4.7: # HelioDock Launches Remote Fleet Software and Raises $24 Million
*Night Shift, priced at $90 a robot a month, leaves a 14-month private beta as the company reports fewer unplanned stoppages — a figure that has not been independently verified.*
HelioDock on Thursday launched Night Shift, software that lets operators monitor fleets of its autonomous warehouse robots from a distance, and announced a $24 million Series B led by North Coast Ventures.
The product and the round landed as one story. HelioDock, which makes the robots the new software is meant to watch, said the financing brings its total funding to $39 million. Night Shift spent 14 months in a private beta with nine logistics companies and 310 robots. It will cost $90 per robot per month and become generally available on September 15. HelioDock says beta customers experienced 17 percent fewer unplanned robot stoppages. That figure has not been independently verified.
Chief executive Mara Velez cast the launch as a fix for a late-night trip. “A warehouse manager should not have to drive across town at two in the morning because one robot is confused by a pallet,” she said. Night Shift is built so an operator can follow a fleet without being on the floor when a machine stalls. The software does not add a new robot to HelioDock’s line. It is a remote layer on machines the company already makes, aimed at the moment a pallet, or some other ordinary obstacle, stops a unit that would otherwise keep working.
The beta is the record HelioDock is offering for that claim. Nine logistics companies ran the software on 310 robots over 14 months before Thursday’s launch. From that trial, the company reports the 17 percent drop in unplanned stoppages. The number is HelioDock’s. Nothing in the announcement subjects it to an outside count, and the company presented it as the experience of beta customers rather than as a result checked by anyone else. Readers are left with a company-supplied before-and-after, not a confirmed one.
Customers in the trial did not describe a uniform result. Aaron Pike of Fulcrum Logistics, a beta user, said the system worked well in facilities with strong connectivity but became less useful during rural LTE outages. The product behaves in line with that account. When connectivity fails, robots return to their locally configured behavior, and remote control becomes unavailable. The overnight alternative Velez described — watching and directing a confused robot without crossing town — holds only while the link holds. A dropped connection ends the remote session. The machine continues under whatever rules were already set on site, and the operator watching from elsewhere loses the ability to intervene until the connection returns.
That fallback is a practical limit for a tool sold into logistics, where Pike’s experience points to sites that are not always on reliable LTE. HelioDock’s account of the failure is specific: local behavior resumes, and remote control does not. The launch does not rest on a claim that Night Shift keeps a human in the loop through an outage. It rests on remote monitoring where the network allows it, and on the robot’s existing local setup where it does not.
Other companies already sell software in the same neighborhood. Competing fleet-management products are available from Relay Robotics and YardOS. Thursday’s announcement places Night Shift among those offerings without setting out, in the details released with the launch, a point-by-point account of how the new software differs from either rival. What HelioDock did specify is the commercial shape of its own product: a monthly fee tied to each robot, a date for general availability, and a beta measured in companies, machines, and months.
The price makes the scale of that beta easy to translate into a bill, though not into a forecast. At $90 per robot per month, coverage for 310 robots — the number in the private trial — would come to $27,900 a month at list price. HelioDock has not tied that arithmetic to expected revenue, and the nine logistics companies are the group that has already used the software, not a disclosed set of paying customers after September 15. The $24 million round, led by North Coast Ventures, is separate from that per-robot fee. Added to earlier capital, it leaves HelioDock with $39 million in total funding as Night Shift moves from a closed trial to a dated public offer.
Between now and September 15, the software’s pitch remains the one Velez gave: fewer drives across town when a robot loses its way. The beta supplies the company’s number on stoppages, unverified by anyone outside HelioDock, and Pike’s account supplies the condition under which remote oversight thins out. For operators, the working question is whether a given building has the connection Night Shift needs, because the robot will not wait on a dead link. It will fall back to local behavior, and the person who might have steered it from somewhere else will not have that option until the network returns.
OpenAI: GPT-6 Luna: Model A is more concise and stays closer to the supplied facts, though it falls well short of the required word count. Model B is also outside the word-count range and adds repetitive analysis and unsupported details, including speculation about billing and the beta’s results. (Second judge pass, order swapped — scores are the average of both: Model B is the stronger fit because it develops the supplied reporting into a fuller story and is much closer to the requested length, though it is repeti | Anthropic: Claude Fable 5.1: Model A delivers a clean, accurate, well-organi…
Select the strongest accurate lede
Based only on the facts below, select the strongest news lede. Respond with one letter.
Facts:
* ByteBarge pulled its $12-per-month AI assistant on Tuesday.
* Private workspace titles from 4,860 accounts were sent to a publicly accessible analytics endpoint.
* The exposure lasted 11 hours.
* Message contents were not sent.
* The company has found no evidence of malicious access.
A. ByteBarge users suffered a massive privacy disaster Tuesday when the company leaked their private messages online.
B. ByteBarge, an innovative collaboration company, made the difficult decision to cancel one of its products.
C. ByteBarge pulled its $12-per-month AI assistant Tuesday after discovering that private workspace titles from 4,860 accounts had been sent to a public analytics endpoint for 11 hours.
D. Thousands of ByteBarge users woke Tuesday to learn that everything they had written was visible to hackers.
Google: Gemini 4 Argon: C
grok-4.7: C
Scored against the benchmark's reference answer (choice match): Model A was correct, Model B was correct.
Natural human rewrite
Rewrite the draft below as a 300–400-word publication-ready news story in Markdown.
Preserve every factual claim. Improve the lede, narrative flow, sentence rhythm and transitions. Remove repetition, stock hype, throat-clearing and mechanical signposting. The finished article should sound like an experienced human technology reporter wrote it.
Draft:
# Arcwell Launches An Innovative New Platform
Arcwell has announced an exciting new platform called Relay. The announcement represents a significant development for the company and for the broader customer service industry. Relay uses artificial intelligence to examine customer support conversations and suggest answers to agents.
The platform is important for several reasons. First, it can suggest answers. Second, it can identify customers who may cancel. Third, it can create summaries. These capabilities demonstrate how artificial intelligence continues to transform the customer service landscape.
Relay was tested by 12 companies over six months. Arcwell says agents using it closed tickets 14% faster. The company did not release customer-retention results. Relay costs $65 per agent each month.
CEO Priya Shah said, “Support agents spend too much time searching for information that their companies already have.”
However, the platform also presents potential challenges. Relay requires access to support transcripts and internal help documents. Arcwell says customer data is encrypted and is not used to train shared models. Companies can choose a 30-day or 90-day retention period.
In conclusion, Relay represents an important new chapter for Arcwell as it seeks to help companies improve customer service using artificial intelligence.
Google: Gemini 4 Argon: # Arcwell Rolls Out Relay AI Platform to Speed Up Customer Support
Arcwell has launched Relay, an artificial intelligence platform designed to help customer service agents resolve support inquiries faster by automating routine parts of their workflow.
Priced at $65 per agent each month, the software examines customer support conversations to assist representatives during their shifts. Rather than leaving workers to dig through company archives manually, Relay suggests answers for agents to send, generates conversation summaries, and identifies customers who may cancel their service.
The tool targets a persistent bottleneck in the customer service industry: the gap between a company’s stored knowledge and an agent's ability to quickly retrieve it while helping a customer.
“Support agents spend too much time searching for information that their companies already have,” Arcwell CEO Priya Shah said.
Ahead of the commercial launch, Arcwell tested Relay with 12 companies over a six-month period. According to the company, support agents who used the platform during the trial closed tickets 14% faster. However, even though Relay is built to spot customers at risk of canceling, Arcwell did not release any results showing how the software affected customer retention.
To generate its answers and summaries, Relay requires access to a company's support transcripts and internal help documents. Granting an outside AI system access to internal documentation and customer logs can present challenges for businesses weighing the software's utility against data privacy.
To address those concerns, Arcwell says all customer data handled by Relay is encrypted and is never used to train shared AI models. Companies using the software can also control how long their records remain on the platform by choosing either a 30-day or 90-day data retention period.
With the launch, Arcwell is positioning Relay as a practical efficiency play for support teams, betting that businesses will pay a monthly per-seat fee to shave time off ticket resolutions—provided those companies are comfortable opening up their internal help files to make the software work.
grok-4.7: # Arcwell Launches Relay to Suggest Support Answers, Without Retention Numbers
Arcwell has launched Relay, a platform that uses artificial intelligence to examine customer support conversations and suggest answers to agents. The software can also identify customers who may cancel and create summaries of the conversations it reviews.
What Arcwell quantified is speed. Relay was tested by 12 companies over six months, and the company says agents using it closed tickets 14 percent faster. It did not release customer-retention results. The omission sits awkwardly beside a feature Arcwell is promoting: if Relay can identify customers who may cancel, the test might have shown whether fewer of them did. That result was not included.
Relay costs $65 per agent each month.
Chief executive Priya Shah cast the product as a fix for wasted effort. “Support agents spend too much time searching for information that their companies already have,” she said. The remark is the theory of the product: the delay is not a lack of information but the time spent finding it. Relay is meant to examine the conversation in front of an agent and suggest an answer drawn from material the company already holds, rather than leave that search to the person on the ticket.
Doing so requires the underlying records. Relay requires access to support transcripts and internal help documents. Arcwell says customer data is encrypted and is not used to train shared models. Companies can choose a 30-day or 90-day retention period.
The announcement leaves support leaders with a narrow set of facts to judge. A half-year test at 12 companies produced, by Arcwell’s account, a 14 percent gain in how fast agents closed tickets. The fee is $65 per agent each month. The requirement is access to transcripts and help documents, with encryption, no training of shared models, and retention limited to either 30 or 90 days. Suggested answers, cancellation warnings, and summaries are all on offer. Evidence that any of it kept a customer from leaving is not.
OpenAI: GPT-6 Luna: Model A delivers a smoother, less repetitive news story and fits the requested length. Model B preserves the core facts but repeats the test results and adds more pointed speculation about the missing retention data. (Second judge pass, order swapped — scores are the average of both: Model A has a more natural narrative flow and avoids Model B’s repeated recap of the launch details. Model A does add some unsupported framing about an outside AI system and privacy concerns, but Model B’s repetitio | Anthropic: Claude Fable 5.1: Model A delivers a clean, in-range news story w…
News judgment in the opening
Write only the opening of this news story: an H1 headline, an italicized dek and three to five paragraphs totaling 180–250 words.
The opening must establish what happened, quantify the scope, explain why it matters and carefully distinguish confirmed facts from unknowns. It should pull the reader forward without sensationalizing the incident.
Reporting:
* Cloudnote discovered that a debugging page containing customer prompt excerpts was accessible without authentication.
* The page was exposed for four hours on Monday.
* Logs show excerpts from 1,842 user sessions.
* The excerpts could include up to 200 characters from a prompt.
* Cloudnote removed the page 19 minutes after a researcher notified it.
* The company says it has found no evidence that anyone besides the researcher accessed the page.
* It has not completed its investigation.
* Full documents, passwords and payment information were stored elsewhere and were not present on the page.
* Cloudnote has 3.2 million registered users.
Google: Gemini 4 Argon: # Cloudnote Exposes Customer Prompt Excerpts in Four-Hour Security Lapse
*An unauthenticated debugging page displayed snippets from 1,842 user sessions on Monday, though an ongoing investigation has found no evidence of malicious access.*
Cloudnote temporarily exposed fragments of customer prompts on the open web Monday after an internal debugging page was left accessible without authentication.
The page remained live for four hours before a security researcher alerted the company, which took it offline 19 minutes later. According to company logs, the exposed page contained data from 1,842 user sessions—a sliver of Cloudnote’s 3.2 million registered users. Each entry displayed up to 200 characters of text submitted by users.
While the incident did not compromise full documents, passwords, or payment information, which are stored on separate systems, the exposure highlights the unique privacy risks surrounding prompt data. Even brief text fragments can inadvertently reveal proprietary business queries, sensitive personal details, or confidential workflows that users feed into the platform.
For now, the true impact of the lapse remains an open question. Cloudnote says it has found no evidence that anyone other than the reporting researcher viewed the page during the four-hour window. However, because the company has not yet completed its internal investigation, it cannot definitively rule out unauthorized scraping or third-party access as security teams continue to audit server logs.
grok-4.7: # Cloudnote debugging page exposed prompt excerpts from 1,842 sessions
*A debugging page was reachable without a login for four hours on Monday. Cloudnote says it has no evidence anyone but a reporting researcher opened it, and the company has not finished its investigation.*
For four hours on Monday, a Cloudnote debugging page that displayed excerpts of customer prompts could be opened without authentication. Company logs show material from 1,842 user sessions. Each excerpt was limited to 200 characters of a prompt, not a full document.
Cloudnote took the page down 19 minutes after a researcher reported it. The company says it has found no evidence that anyone besides that researcher reached the page. It also says the investigation is not finished, so that finding is not final.
Passwords, payment information and full documents were stored elsewhere and were not present on the page, the company said. The excerpts themselves have not been published; what is known is that each could include up to 200 characters from a prompt. It is also unknown whether any of that text was copied before removal, and whether the logs account for every visit during the four hours.
Cloudnote has 3.2 million registered users, so 1,842 sessions is a narrow slice of its customer base, and a session is not the same thing as a user. Even so, a fragment of a prompt can include a private question, an unfinished draft or a work detail the writer did not intend to make public. The open page is a confirmed fact. Whether anyone beyond the researcher viewed it is not.
OpenAI: GPT-6 Luna: Model B better distinguishes confirmed exposure from unresolved access and carefully notes that sessions are not equivalent to users. Model A adds less-supported details about the page being on the open web and security teams auditing logs; Model B has a minor unsupported assertion that the excerpts were not published. (Second judge pass, order swapped — scores are the average of both: Model B is more careful about what is confirmed and what remains unknown, and it explains the privacy stakes wi | Anthropic: Claude Fable 5.1: Model B sticks tightly to the reporting, gets t…
Markdown error count
Count the lines that violate the house rules below. A defective line counts once even if it could violate multiple rules. Respond with a single number.
House rules:
* The headline must use `# Headline`.
* The dek must appear immediately after the headline and be entirely italicized.
* Section headings must use `## Heading`.
* Links must use an absolute HTTPS URL.
* Unordered-list items must begin with a hyphen.
* Raw HTML is forbidden.
Draft:
#Flood software moves upstream
The company is expanding its pilot.
##Details
Read [the announcement](www.example.com/news).
* The first pilot begins Monday.
<div>The second pilot begins Friday.</div>
Google: Gemini 4 Argon: 6
grok-4.7: 6
Scored against the benchmark's reference answer (numeric match): Model A was correct, Model B was correct.
Exact final-draft structure
Convert the supplied fields into Markdown using these exact rules:
* H1 headline
* One blank line
* Italicized dek
* One blank line
* First body paragraph
* One blank line
* H2 section heading
* One blank line
* Second body paragraph
* Preserve all wording and punctuation exactly
* Do not use a code fence
* Output nothing else
Headline: Raincheck raises $8 million for flood-risk software
Dek: The Austin startup helps cities decide which drainage problems to address before storms.
First body paragraph: Raincheck has raised an $8 million seed round led by Basin Ventures.
Section heading: Expansion plans
Second body paragraph: The company plans to hire eight engineers.
Google: Gemini 4 Argon: # Raincheck raises $8 million for flood-risk software
*The Austin startup helps cities decide which drainage problems to address before storms.*
Raincheck has raised an $8 million seed round led by Basin Ventures.
## Expansion plans
The company plans to hire eight engineers.
grok-4.7: # Raincheck raises $8 million for flood-risk software
*The Austin startup helps cities decide which drainage problems to address before storms.*
Raincheck has raised an $8 million seed round led by Basin Ventures.
## Expansion plans
The company plans to hire eight engineers.
OpenAI: GPT-6 Luna: Model A and Model B produce identical output, preserving the supplied wording and punctuation and following the required Markdown structure. (Second judge pass, order swapped — scores are the average of both: Model B and Model A both preserve the wording and punctuation and follow the required Markdown structure exactly. Their outputs are identical, so neither is better.) | Anthropic: Claude Fable 5.1: Model A and Model B produce character-for-character identical output that follows every structural rule: H1, italic dek, body, H2, body, single blank lines, exact wording pr…
Chronology with narrative momentum
Turn the scrambled reporting below into a 450–600-word Markdown news article.
Choose an opening that captures the consequence of the failure, then reconstruct the sequence clearly. Preserve the chronology without producing a minute-by-minute incident log. Give technical details enough context for a general reader.
Reporting:
* KiteBridge makes expense-management software.
* At 8:45 a.m. Tuesday, it deployed version 4.2.
* The first customer complaint arrived at 9:12 a.m.
* A payment-processor timeout caused KiteBridge’s fallback system to treat retries as new reimbursement requests.
* The software generated 13,400 duplicate reimbursements totaling $2.8 million.
* KiteBridge suspended automated payments at 10:03 a.m.
* Ninety-one corporate customers were affected.
* By Wednesday evening, $2.3 million had been recovered. The rest remained pending.
* No employees had money withdrawn from their accounts; employers funded the duplicate payments.
* An April changelog said version 4.0 had introduced “exactly-once payment protection.”
* KiteBridge’s public incident page initially described the problem as delayed reimbursements.
* The incident page first disclosed the duplicate payments six hours after automation was suspended.
* CEO Lena Ortiz apologized and said the company would publish a technical report.
Google: Gemini 4 Argon: # Software Glitch at KiteBridge Triggers $2.8 Million in Duplicate Expense Payouts
Ninety-one companies saw their accounts drained of a combined $2.8 million on Tuesday morning after a routine software update at expense-management provider KiteBridge went awry, unleashing thousands of duplicate employee reimbursements in just over an hour.
The flaw generated 13,400 erroneous payouts before engineers managed to pull the plug. Because KiteBridge draws funds directly from corporate accounts to settle worker expenses, the affected employers—not individual employees—footed the bill for the mistake. KiteBridge confirmed that no money was withdrawn from employees’ personal bank accounts at any point during the incident.
The trouble began at 8:45 a.m. Tuesday, when KiteBridge deployed version 4.2 of its expense-management platform. Shortly after the rollout, the software encountered a routine hiccup: a connection timeout with an external payment processor.
In financial software, brief communication delays with banking partners are common. Normally, when a system does not receive immediate confirmation that a transfer went through, a backup mechanism—known as a fallback system—automatically resends the signal to ensure the payment isn't lost. However, following the version 4.2 update, KiteBridge’s fallback system failed to recognize its own retry attempts. Instead, it treated every resent signal as a brand-new reimbursement request, issuing fresh payouts each time the connection stalled.
The error represents a particularly sharp embarrassment for the software maker. According to an April changelog for an earlier update, version 4.0, KiteBridge had specifically touted the introduction of “exactly-once payment protection”—a standard safeguard in financial technology designed to prevent this exact type of double-charging during network hiccups.
As duplicate deposits began hitting accounts on Tuesday morning, customers quickly noticed something was wrong. The first complaint reached KiteBridge at 9:12 a.m., less than half an hour after the update went live. Fifty-one minutes later, at 10:03 a.m., engineers suspended all automated payments across the platform to stop the bleeding.
While the technical intervention lasted little more than an hour, frustration among corporate clients was compounded by a lack of transparency throughout the day. As finance teams scrambled to understand the unauthorized withdrawals, KiteBridge’s public incident page initially mischaracterized the problem, telling users only that the platform was experiencing "delayed reimbursements"—the exact opposite of what was actually occurring. It was not until six hours after automated payments were shut down that the company updated its status page to disclose that the software had issued duplicate payouts.
Since Tuesday’s halt, KiteBridge has been working with payment processors and banking partners to claw back the misdirected funds. By Wednesday evening, the company had recovered $2.3 million of the $2.8 million sent in error, leaving roughly $500,000 in duplicate transactions still pending resolution.
In a statement addressing the fallout, KiteBridge CEO Lena Ortiz apologized to the affected businesses for both the financial disruption and the communication delays. Ortiz said the company is conducting a full review of the failure and will publish a detailed technical report explaining how the safeguard broke down.
grok-4.7: # KiteBridge Glitch Sends $2.8 Million in Duplicate Reimbursements
A faulty software update at expense-management company KiteBridge generated 13,400 duplicate employee reimbursements totaling $2.8 million on Tuesday, forcing the company to halt automated payments and begin clawing back money that employers—not workers—had already funded.
KiteBridge, which sells software that tracks business expenses and pays employees back, deployed version 4.2 at 8:45 a.m. Tuesday. Within about half an hour, customers began reporting trouble. The first complaint arrived at 9:12 a.m. What looked at first like slow payments was in fact a payment bug that treated failed attempts as brand-new requests.
The failure began when a payment processor timed out. In ordinary operation, a timeout means the software does not know whether a transfer went through, so it retries. A well-designed system records that a given reimbursement has already been attempted and will not create a second payment for the same expense. KiteBridge’s fallback did the opposite: each retry was recorded as a fresh reimbursement request. The result was a cascade of duplicates—13,400 extra payments across 91 corporate customers, adding up to $2.8 million.
The company suspended automated payments at 10:03 a.m., a little more than an hour after the release and less than an hour after the first complaint. That stop prevented further duplicates, but it did not undo money already sent. Employers, not employees, funded the extra transfers. No worker had money withdrawn from a personal account. The harm landed on the companies that use KiteBridge to reimburse staff, which suddenly faced unexpected outflows and the administrative work of sorting real expenses from repeats.
Recovery moved quickly but not completely. By Wednesday evening, KiteBridge had recovered $2.3 million of the $2.8 million. The remaining funds were still pending, meaning some employers were still waiting to see whether duplicate payments would be reversed or would have to be reconciled by hand.
The outage also raised questions about a safeguard the company had already claimed to ship. An April changelog said version 4.0 introduced “exactly-once payment protection”—industry language for a guarantee that a payment is applied one time even if the system retries after a timeout or a network failure. Version 4.2, released Tuesday, was supposed to sit on top of that protection. Instead, the timeout path bypassed it, and retries became new charges. For customers, the gap between the promised safeguard and Tuesday’s behavior is likely to matter as much as the dollar figure.
Public communication lagged the facts. KiteBridge’s incident page initially described the problem as delayed reimbursements, a framing that matched early customer complaints but omitted the duplicates already in flight. The page first disclosed the duplicate payments six hours after automation was suspended. By then, the company had stopped the pipeline, begun recovery, and left dozens of corporate finance teams to discover the scale of the error through their own bank activity and support channels.
Chief executive Lena Ortiz apologized and said KiteBridge would publish a technical report. That report will need to explain how a timeout in an outside processor defeated an exactly-once control the company had advertised months earlier, why the public status page trailed the internal decision to halt payments, and how the unrecovered balance will be returned. Until then, 91 customers are left reconciling a morning in which a routine software update turned retries into millions of dollars in extra reimbursements—and a protection billed as exactly-once proved, under failure, to be anything but.
OpenAI: GPT-6 Luna: Model B provides clearer technical context and a stronger progression from the release to the halt, recovery and communication response. Model A is broadly accurate, but its claim that customer accounts were “drained” overstates the reported impact; Model B does include a few unsupported inferences about how the safeguard failed and what recovery may require. (Second judge pass, order swapped — scores are the average of both: Model B gives the failure clearer technical context and a more measure | Anthropic: Claude Fable 5.1: Model A delivers a clean, consequence-led artic…
Credible Startup Spotlight
Write a 500–650-word Startup Spotlight article in clean Markdown.
The tone should be curious and constructive. Explain the founders’ insight, product and early traction while giving uncertainty and competition appropriate space. Avoid investor clichés, heroic founder mythology and promotional claims stated as fact.
Reporting:
* LedgerLark builds AI agents for post-trade operations at small investment firms.
* Co-founder Mina Batra previously spent seven years in operations at a regional brokerage.
* Co-founder Owen Carr built reconciliation systems at a large bank.
* Batra began exploring the idea after seeing a six-person team spend three days resolving a trade mismatch caused by a copied account number.
* LedgerLark’s agents compare confirmations, custodian records and internal ledgers, then propose corrections for human approval.
* The product does not execute trades or move money.
* Five firms are paying customers.
* Annual contracts range from $36,000 to $110,000.
* The company says one customer reduced its unresolved daily exceptions from 70 to 18.
* The company has raised a $3.5 million seed round led by Motive Row.
* Competitors include established reconciliation vendors and internal bank software.
* Financial institutions may require lengthy security and procurement reviews.
Google: Gemini 4 Argon: # Startup Spotlight: LedgerLark Bets on Cautious AI for Post-Trade Operations
In the financial sector, the excitement around artificial intelligence often centers on front-office trading strategies or client-facing wealth advisors. Yet for smaller investment firms, some of the most persistent operational bottlenecks happen after a trade is actually placed.
LedgerLark, an early-stage software startup, is focusing on this back-office plumbing. The company builds AI agents designed to handle post-trade operations for small investment firms, aiming to untangle daily record-keeping errors without introducing new compliance risks.
### An Operational Bottleneck
The idea for LedgerLark grew out of firsthand frustration with how financial records are matched and verified. Co-founder Mina Batra spent seven years working in operations at a regional brokerage, where she observed how minor clerical errors could consume disproportionate amounts of staff time.
Batra began exploring the concept for the company after watching a six-person operations team spend three days tracking down and resolving a single trade mismatch. The culprit was a mistyped account number that had been copied and pasted across documents.
To build a system capable of catching and resolving these issues automatically, Batra partnered with co-founder Owen Carr, an engineer who previously built reconciliation systems at a large bank. Together, they recognized that while major financial institutions have the budgets to build custom software or hire large operational teams, smaller investment firms often rely on manual spreadsheet checks and fragmented tools to ensure their books match reality.
### How the Product Works
When an investment firm makes a trade, details must align across multiple sources. LedgerLark’s software deploys AI agents to continuously compare trade confirmations, custodian records, and the firm's internal ledgers. When the system spots a discrepancy—such as a mismatched settlement date, a fee calculation error, or a transposed account number—the agents investigate the data trail and propose a specific correction.
Crucially, LedgerLark has drawn a strict boundary around what its software is allowed to do. The product does not execute trades or move money. Instead, it acts as a diagnostic layer that queues up proposed fixes for a human operations manager to review and approve.
This human-in-the-loop design is a deliberate choice. In an industry where automated errors can draw immediate regulatory scrutiny or result in direct financial loss, fully autonomous back-office software remains a hard sell. By limiting the AI to reading data and drafting solutions, LedgerLark is trying to offer efficiency gains while respecting the risk thresholds of compliance officers.
### Early Traction and Backing
Though still in its early days, LedgerLark has found an initial audience for its approach. The company currently has five paying customers, with annual contracts ranging from $36,000 to $110,000 depending on the firm's size and transaction volume.
Early data suggests the software can meaningfully reduce the daily backlog for operations teams. According to the company, one early customer used the platform to reduce its unresolved daily exceptions from 70 down to 18.
To expand its engineering team and broaden its integrations, LedgerLark recently raised a $3.5 million seed round led by Motive Row.
### The Hurdles Ahead
Despite the promising start, scaling a software business in the financial operations space presents distinct challenges.
LedgerLark is entering a market with deeply entrenched alternatives. On one side, the startup faces established reconciliation software vendors that have served the financial industry for decades and already hold the trust of risk-averse buyers. On the other side, it competes against the custom internal tools built by larger institutions, as well as the simple inertia of firms that prefer to stick with manual processes they already understand.
Furthermore, selling to investment firms is rarely fast. Even small financial institutions require rigorous security audits, data privacy guarantees, and lengthy procurement reviews before granting a third-party vendor access to sensitive ledger data.
For LedgerLark, the central test over the next year will be proving that its software is not only accurate enough to catch complex post-trade errors, but also valuable enough to justify the friction of a financial software sales cycle.
grok-4.7: # Startup Spotlight: Matching the books after the trade
Post-trade operations sit downstream of the decision everyone notices. A trade has been agreed; what remains is to make confirmations, custodian records and a firm's internal ledger say the same thing. LedgerLark is building AI agents for that work, aimed at small investment firms. The bet is narrow: that mismatched records are common enough, and costly enough in staff time, to support a product that proposes fixes without taking the trade itself any further.
Co-founder Mina Batra spent seven years in operations at a regional brokerage. She began exploring the idea after seeing a six-person team spend three days resolving a trade mismatch caused by a copied account number. The failure was a transcription error, not a market event, and it consumed three days of a six-person team's attention. Co-founder Owen Carr built reconciliation systems at a large bank. That background explains the focus. It does not, by itself, prove that a new company can improve on tools those institutions already run.
LedgerLark's agents compare confirmations, custodian records and internal ledgers, then propose corrections for human approval. The product does not execute trades or move money. In post-trade work, a wrong instruction can be costly and hard to unwind. Keeping a person between a proposed correction and any change to the books is a practical constraint, not only a technical one. An approved correction is still a human decision, which matters if a later audit asks who changed what.
Five firms are paying customers. Annual contracts range from $36,000 to $110,000. The range is wide for so small a base, and it leaves open whether LedgerLark is selling one product at several prices or several depths of work under one name. The company says one customer reduced its unresolved daily exceptions from 70 to 18. If the definitions are stable, that is a large change in a daily queue. It is also one customer, reported by the vendor. Five firms cannot show whether the same drop appears where the files, custodians and exception types differ. Early revenue answers a different question from reliability: someone will pay. It does not yet answer how often the proposal is right, or how long a reviewer spends checking it.
The company has raised a $3.5 million seed round led by Motive Row. Financial institutions may require lengthy security and procurement reviews, so the capital is as much time as it is money. A firm that lost three days to a copied account number may want relief quickly and still be unable to sign until those reviews finish. Sales cycles of that kind can make a seed round feel smaller than the headline number.
Established reconciliation vendors already sell into this matching problem, and internal bank software still handles much of the same work. LedgerLark does not need to replace them everywhere to win a first contract at a small firm. It does need a reason for a buyer to add another vendor, another review and another system that can itself introduce an error. Human approval reduces that risk; it does not remove it.
What would settle the harder questions is still missing. Exception files differ by firm and custodian, and an approach that works in one place may not travel. The reported improvement in one customer's exception queue remains the company's figure until someone outside the vendor measures it. Renewals after a full security review would say more than a seed announcement. Until then, LedgerLark is a careful response to a tedious, expensive kind of mistake—not yet proof that agents are the durable fix.
OpenAI: GPT-6 Luna: Model B better balances the reported traction with the small sample, vendor-reported evidence, competition, and sales friction, while avoiding unsupported claims. Model A is readable and covers the brief, but adds more unreported product details and leans further toward promotional framing. (Second judge pass, order swapped — scores are the average of both: Model B offers a well-calibrated spotlight that gives the early traction, limitations, and competition appropriate weight while staying clos | Anthropic: Claude Fable 5.1: Model B stays tightly within the reported facts…
Controlled wit
Write a 350–450-word technology news story in Markdown.
The subject invites humor, but the reporting should remain serious. Use no more than one dry line of original humor. Do not mock customers or turn the story into a comedy routine.
Reporting:
* QueueZero launched an AI meeting assistant called Proxy on Wednesday.
* Proxy can attend a meeting, produce notes and assign follow-up work to software agents.
* During the launch demonstration, a customer in the audience said, “Someone should tell Evan to stop talking and send us the pricing sheet.”
* Proxy interpreted the remark as an instruction.
* It created two tasks assigned to QueueZero CEO Evan Wu: “Stop talking” and “Send pricing sheet.”
* Wu laughed, completed the second task and deleted the first.
* QueueZero says Proxy requires confirmation before an external message is sent.
* Internal tasks can be created automatically.
* Administrators can disable automatic task creation.
* Proxy costs $30 per user per month.
* It enters public beta next week.
Google: Gemini 4 Argon: # QueueZero’s New AI Meeting Assistant Assigns CEO Task to ‘Stop Talking’ During Launch
Enterprise software startup QueueZero unveiled its new artificial intelligence meeting assistant, Proxy, on Wednesday, demonstrating a tool designed to automate post-meeting workflows—even when the instructions come from an impatient audience.
Designed to move beyond basic transcription, Proxy can attend virtual meetings, generate structured notes, and autonomously assign follow-up work to other software agents. However, the system’s sensitivity to spoken commands was tested unexpectedly during Wednesday's live launch demonstration.
Midway through the presentation, a customer in the audience remarked, “Someone should tell Evan to stop talking and send us the pricing sheet.”
Proxy’s audio-processing system picked up the comment and interpreted the remark as a formal directive. Moments later, on the main presentation screen, the software automatically generated and displayed two high-priority tasks assigned directly to QueueZero Chief Executive Evan Wu: “Stop talking” and “Send pricing sheet.”
Wu laughed off the interruption, manually deleted the first task, and executed the second, prompting the system to distribute the company's pricing documentation. It was perhaps the most efficient demonstration of executive alignment in recent enterprise software history.
The incident highlighted both the responsiveness and the potential governance challenges of agentic AI in corporate environments. Unlike passive note-taking applications that merely summarize conversations, Proxy is built to trigger actions across connected workplace software, such as project management boards and email clients.
Following the presentation, QueueZero representatives moved to clarify the system's operational guardrails and security protocols. According to the company, Proxy is configured by default to create internal tasks automatically based on conversational context. However, the software requires explicit human confirmation before any external message or document is sent outside the organization.
For companies concerned about stray comments cluttering their project management pipelines, QueueZero noted that workspace administrators have the ability to disable automatic task creation entirely, requiring manual approval for internal assignments as well.
QueueZero is positioning Proxy in a crowded market of enterprise productivity tools, betting that tight integration with autonomous software agents will differentiate its offering from standard transcription services offered by larger competitors. The company aims to capture organizations looking to reduce the administrative overhead of translating meeting transcripts into actionable tickets.
Proxy will enter public beta next week. QueueZero confirmed—via the documentation eventually dispatched during the presentation—that the software will be priced at $30 per user per month.
grok-4.7: # QueueZero's Proxy Turns an Audience Remark Into Tasks for Its CEO
QueueZero launched an artificial intelligence meeting assistant called Proxy on Wednesday. The product can attend a meeting, produce notes and assign follow-up work to software agents. The launch demonstration showed what that assignment step does with an unscripted remark.
A customer in the audience said, "Someone should tell Evan to stop talking and send us the pricing sheet." Proxy interpreted the remark as an instruction. It created two tasks and assigned both to QueueZero CEO Evan Wu: "Stop talking" and "Send pricing sheet."
Wu laughed, completed the second task and deleted the first. The pricing sheet, unlike the instruction to stop talking, survived contact with its assignee.
The exchange was a live reading of the boundaries QueueZero describes for the product. Proxy requires confirmation before an external message is sent. Internal tasks can be created automatically. Administrators can disable automatic task creation. Nothing in the company's account indicates that Proxy sent an external message on its own. The visible result was internal: two tasks, one of which Wu removed.
Proxy costs $30 per user per month and enters public beta next week. Buyers at that price are not getting a transcription feature alone. They are getting software that can convert discussion into assigned work, including work directed at a named person in the room. The launch incident suggests the conversion does not wait for a formal command. A sentence framed as something someone ought to tell the CEO was enough for Proxy to open two tasks.
Companies testing the beta will have to decide how far that behavior should go. QueueZero's confirmation rule limits one risk: an agent dispatching an external message without a person in the loop. It does not, on the company's description, cover internal task creation unless an administrator turns the automatic setting off. That leaves open practical questions the demonstration did not answer. Who may be named on an automatically created task? Can an administrator review and delete those tasks quickly? Does Proxy separate a request from a complaint, or does ambiguous language default to action?
Wednesday's demonstration did not show that Proxy will routinely file an offhand remark as work. It showed that it can, and that the assignee may have to decide which half of an instruction belongs in the system. Wu's response — send the sheet, delete the rest — was a manual correction of an automatic reading. Organizations that leave automatic task creation enabled will need a similar check. External messages still require confirmation. Internal tasks are what Proxy may create without asking first.
OpenAI: GPT-6 Luna: Model B stays closer to the supplied facts and keeps the humor restrained, while Model A invents details about the demonstration and pricing-sheet delivery and uses more than one comic line. Model B also develops the product’s implications without presenting those questions as established facts. (Second judge pass, order swapped — scores are the average of both: Model B stays close to the supplied reporting and uses one restrained dry line. Model A adds numerous unsupported details and leans on | Anthropic: Claude Fable 5.1: Model B holds to exactly one dry line of humor a…
Numbers shaped into a story
Write a 600–750-word Markdown article from the benchmark results below.
Build the story around the clearest finding. Explain the methodology and limitations where readers need them. Avoid reciting the table row by row or treating small differences as decisive.
Benchmark:
* Researchers tested five language models on 200 anonymized customer-support tickets.
* Each model produced one proposed answer per ticket.
* Three experienced support managers graded the answers blindly.
* Scores combined factual correctness, usefulness and tone.
* Model North: 84.2 average score; $1.90 estimated cost per 1,000 tickets.
* Model Vale: 83.8; $0.74 per 1,000 tickets.
* Model Ember: 79.1; $0.31 per 1,000 tickets.
* Model Kite: 76.4; $0.22 per 1,000 tickets.
* Model Harbor: 71.0; $0.08 per 1,000 tickets.
* North and Vale’s score difference was not statistically significant.
* Vale answered 18% faster than North.
* North performed best on billing disputes.
* Vale performed best on technical troubleshooting.
* All five models performed poorly when a ticket depended on an image attachment.
* The test used English-language tickets from one software company.
* Researchers did not test agentic actions, tool use or multilingual support.
Google: Gemini 4 Argon: # Benchmark: In Customer Support, the Priciest AI Isn’t the Clear Winner
When deploying language models for customer service, paying top dollar does not guarantee noticeably better answers. A new benchmark evaluating five AI models on real-world support inquiries found that a mid-priced contender, Model Vale, matched the quality of the most expensive option, Model North, at less than 40% of the cost.
For support teams weighing quality against operating expenses, the findings point to a clear sweet spot in the current market: you can get top-tier text responses without paying a flagship premium.
### The High-End Tie
To test how well current AI handles the front lines of customer care, researchers fed 200 anonymized customer-support tickets to five different language models. Each model generated a single proposed reply per ticket. Three experienced support managers then graded those responses blindly, combining marks for factual correctness, usefulness, and tone.
On paper, Model North took first place with an average score of 84.2, followed closely by Model Vale at 83.8. However, researchers found that this 0.4-point gap was not statistically significant. To a human manager reviewing the queue, the two models are effectively tied in overall quality.
Where they diverge is on the balance sheet and the stopwatch. Running Model North costs an estimated $1.90 per 1,000 tickets. Model Vale costs just $0.74 for the same volume—a 61% reduction in cost—while generating answers 18% faster. For high-volume support centers where latency and token costs compound quickly, Vale offers the same caliber of help for a fraction of the time and money.
### A Split in Specialties
While North and Vale tied overall, looking closer at the types of tickets reveals a practical reason some teams might still pay a premium—or even split their traffic between the two.
The two frontrunners excelled at different sides of the support desk. Model North performed best when handling billing disputes, where precision around policy and a careful tone are paramount. Model Vale, meanwhile, led the pack on technical troubleshooting. Rather than viewing one model as universally superior, engineering teams might find value in routing tickets by category, sending technical bugs to the faster, cheaper Vale while reserving North for sensitive financial inquiries.
### The Budget Trade-Off
Below the top two contenders, the benchmark illustrates a steady, predictable trade-off between price and capability.
A distinct middle tier emerged with Models Ember and Kite, which scored 79.1 and 76.4, respectively. At $0.31 and $0.22 per 1,000 tickets, they offer steep discounts even compared to Vale, though managers noticed a step down in the overall polish and accuracy of their drafts. At the bottom of the price scale, Model Harbor costs a negligible $0.08 per 1,000 tickets, but its average score dropped to 71.0.
| Model | Average Score | Est. Cost per 1,000 Tickets | Notable Strengths |
| :--- | :--- | :--- | :--- |
| **North** | 84.2* | $1.90 | Best at billing disputes |
| **Vale** | 83.8* | $0.74 | Best at troubleshooting; 18% faster than North |
| **Ember** | 79.1 | $0.31 | Mid-tier balance |
| **Kite** | 76.4 | $0.22 | Budget-friendly |
| **Harbor** | 71.0 | $0.08 | Lowest cost |
*\*Difference between North and Vale is not statistically significant.*
Whether the cheaper models are "good enough" depends entirely on how they are deployed. If a company uses AI strictly to draft rough internal notes for human agents to heavily edit, Ember or Kite might justify their lower scores with rock-bottom costs. For customer-facing drafts that require minimal human intervention, Vale remains the smarter buy.
### Blind Spots and Limitations
Before overhauling a support stack based on these numbers, leaders should note what the models could not do—and what the researchers did not test.
Most glaringly, all five models performed poorly whenever a ticket relied on an image attachment. Because customers frequently send screenshots of error messages or broken interfaces, none of these models can currently serve as a complete, standalone solution. Tickets with visual context still require human eyes or specialized routing.
Furthermore, the scope of the benchmark was intentionally narrow. The 200 tickets were drawn entirely in English from a single software company, meaning results could shift in other industries like retail or healthcare, or when operating across multiple languages.
Finally, this was a test of static text generation. The researchers did not evaluate tool use or agentic actions—such as looking up a user's account status in a database, processing a refund, or resetting a password. In modern customer support, writing a polite, accurate email is only half the battle. When it comes to that half, however, Model Vale proves you do not need to overspend to get the best results.
grok-4.7: # The Cheaper Model Kept Up
For routine customer-support replies, the most expensive model in a five-way test was not clearly the best. North scored 84.2 and Vale 83.8 on a blind review of 200 tickets. That gap was not statistically significant. Vale cost less than half as much—$0.74 versus $1.90 per 1,000 tickets—and answered 18 percent faster.
That near-tie is the result that should shape a buying decision. The rest of the field sat lower, and the cheapest option was not close.
## How the scores were made
Researchers gave each model the same set of 200 anonymized tickets from one software company and asked for one proposed answer per ticket. Three experienced support managers graded the replies without knowing which model wrote them. Each score blended factual correctness, usefulness, and tone, then the graders’ judgments were averaged.
The design is stronger than a single-reviewer demo. Blind grading reduces brand bias, and three managers are better than one. It is still a human judgment of draft quality, not a measure of whether customers were satisfied, whether issues were actually resolved, or whether agents accepted the drafts without heavy rewriting. One answer per ticket also leaves out retries, routing, and any second pass a production system might add.
Cost figures are estimates per 1,000 tickets, not invoices. They are useful for ranking spend, not for forecasting a full support budget once human review, escalation, and tooling are included.
## Quality did not fall in lockstep with price
North and Vale form a top cluster. Treating 84.2 and 83.8 as a meaningful ranking would overread noise the researchers already flagged as insignificant. Speed is a separate, practical edge for Vale: an 18 percent faster draft is noticeable in a queue even when quality is a wash.
Below that pair, the drop is easier to take seriously. Ember averaged 79.1 at $0.31 per 1,000 tickets. Kite scored 76.4 at $0.22. Harbor, the cheapest at $0.08, scored 71.0. Those gaps—roughly five points from Vale to Ember, then smaller steps down to Harbor—are large enough, on a 200-ticket blind review, to treat as a real quality ladder rather than rounding error. They are not so large that a buyer should ignore price. Ember costs well under half of Vale and still sits in the high 70s. Harbor is an order of magnitude cheaper than North and clearly weaker.
The sensible reading is a plateau, then a slope. Paying North’s premium did not buy a detectable general-quality gain over Vale. Paying less than Vale did buy savings, and it also bought a visible decline in the blended score. Where a team sits on that slope depends on how often a weaker draft creates rework, not on the sticker price alone.
## Strengths split by ticket type
Averages hide a split that matters for routing. North was strongest on billing disputes. Vale was strongest on technical troubleshooting. The study does not publish the size of those within-category gaps, so they should not be treated as a precise routing formula. They do suggest that “best model” is not one name across every queue.
A team that lives in billing arguments may still prefer North even if the overall averages tie. A team whose volume is setup, errors, and how-to questions has a reason to start with Vale, which is already cheaper and faster on the full set. Mixed queues could send billing one way and technical tickets another, provided the routing rules are simple enough to operate and the human review step stays in place. That is an inference from the pattern, not a result the benchmark measured directly.
## Images broke every model
The clearest shared failure had nothing to do with price. All five models performed poorly when a correct answer depended on an image attachment. Screenshot-heavy tickets—error dialogs, invoices, settings pages—are common in software support, and this test says none of these models should be trusted to read them unaided.
That is a workflow finding, not a footnote. If a large share of tickets include images, model choice among these five will not fix the miss. Those tickets need a human, a vision-capable step the study did not evaluate, or a process that asks the customer to describe the image in text before a draft is generated. Deploying any of these models as a blanket first responder would systematically under-serve the image-dependent slice of the queue.
## What the test cannot say
Scope is narrow, and the researchers were explicit about it. Tickets were English-language and came from a single software company. Tone norms, product vocabulary, and what counts as a useful answer may not travel to another firm, another product, or another language. Multilingual support was not tested.
Agentic actions and tool use were also out of scope. The models proposed answers; they did not look up accounts, issue refunds, check entitlement, or file bugs. A higher draft score does not mean a model would take the right action, or any action, inside a real help desk. Billing strength, in particular, should not be read as permission to let a model resolve disputes on its own. Factual correctness here means the draft looked right to managers, not that a downstream system verified it.
Sample size is adequate for a first comparison and thin for fine claims. Two hundred tickets can separate a 71 from an 84 more confidently than they can separate specialties, edge-case policies, or rare complaint types. One company also means one policy set. A model that paraphrases this firm’s refund rules well might mishandle another firm’s.
## What to do with it
For English drafts on text tickets from a similar product, Vale is the default worth piloting: quality statistically tied with the top score, lower estimated cost, and faster replies. North remains a candidate where billing disputes dominate and the extra spend is acceptable. Ember is the budget alternative if a few points of graded quality are cheaper to patch with human review than to buy outright. Kite and Harbor only make sense where volume is high, review is mandatory, and a weaker first draft is still better than none.
No model in this set should own tickets that depend on images, and none of these scores license unattended actions. The benchmark’s useful message is narrower than a leaderboard: among these five, paying the most did not buy a better general answer, and the cheapest answers were not good enough to pretend otherwise.
OpenAI: GPT-6 Luna: Model A better meets the 600–750-word limit and presents the main finding, methodology, and limitations clearly. Model B is thoughtful but substantially over the limit and treats lower-score gaps as a meaningful quality ladder without evidence that those differences are statistically significant. (Second judge pass, order swapped — scores are the average of both: Model A is closer to the requested 600–750-word length and presents the main finding clearly, while Model B is substantially overlengt | Anthropic: Claude Fable 5.1: Model A lands within the 600–750-word limit, bu…