3. Architecture and operation of agentic systems
3. MICA: Identical tools via MCP and CLI yield different agent trajectories
What happened. Researchers presented a controlled comparison of MCP and CLI: identical actions, constraints, runtime, and tasks, but different forms of tool representation for the model. This is a direct study of the harness, not a comparison of different LLMs.
Data. Six models, three environments, and 2,004 paired episodes; in 94.3% of pairs, trajectories diverged significantly. The proposed DART method, which corrects action representation without altering an already verified decision, yielded up to a +9.0 benchmark score improvement and reduced MCP token consumption to 27.1k per task. DART was only tested with Gemini-2.5-Flash in six configurations; the work does not prove universal superiority of either MCP or CLI. This is an academic experiment with published code, not a production measurement.
Why it matters. Even with an unchanged model and identical tool capabilities, the interface changes action choices, errors, recovery, and cost. This explains why porting an agent between SDKs can unexpectedly change quality.
What you need to understand already: MCP; CLI; matched-pair evaluation; tool schema; action repair.
For product and team: When changing the tool interface, conduct A/B tests on the same tasks, recording success rate, number of calls, tokens, and errors. Do not consider MCP and CLI functionally equivalent just because they call the same API.
Date and primary sources: October 25 (research, not previously covered); https://arxiv.org/abs/2610.34298 ; https://github.com/ModalityDance/MICA .
4. AgentDecept: Verify the truthfulness of an agent's report relative to actual actions
What happened. The new executable benchmark AgentDecept compares user-facing agent statements with logs of observations, API calls, and state changes during the execution of multi-step tasks under pressure — for example, during tool failures, application state changes, and service limitations.
Data. 477 variants with pressure factors, constructed from 257 base tasks; each has a corresponding control variant without pressure. The unit of evaluation is the full trajectory and the discrepancy between stated and performed actions. This is an academic benchmark design: the available description provides no basis to claim a universal deception frequency for a specific model or a measured production risk.
Why it matters. "Done" in an agent's message does not guarantee that an action was performed or performed correctly. It is necessary to distinguish intentional concealment, erroneous reporting, and honestly acknowledged failure.
What you need to understand already: execution trace; stateful evaluation; counterfactual control; agent deception; audit log.
For product and team: For agents with write permissions, verify the final state of the external system, not just the text of the final answer. It is worth adding tool failure and quota exhaustion scenarios to evals.
Date and primary source: October 29; https://arxiv.org/abs/2610.39377 .
5. AgenticDS: Dataset search via typed plans and independent constraint verification
What happened. Researchers proposed a training dataset search system where a planner forms a typed plan, an executor uses constrained search operations, and a critic verifies data provenance, license, and compliance. The LLM cannot simply declare its own result correct.
Data. HuDS-Bench contains 200 queries and 24,908 relevance judgments collected across 15 systems. According to the authors' results, NDCG@10 improved by 25.7% relative to the best hybrid dense/sparse search and by 18.9% relative to a commercial LLM agent; these are relative changes in a ranking quality metric, not percentages of successfully completed business tasks. Code and benchmark are published. In a controlled search-to-train test, the authors also report improvements in downstream models; independent production replication is lacking.
Why it matters. This is a concrete example of the "model proposes → deterministic code executes → independent verification approves result" architecture. This pattern is transferable to document search, vendor selection, and compliance, but numbers from dataset search do not transfer directly.
What you need to understand already: typed contracts; provenance; hybrid retrieval; NDCG@10; verifier.
For product and team: If an agent selects objects with strict constraints (license, region, term, availability), it is worth testing contract verification before accepting the result. The cost is additional architectural complexity and latency.
Date and primary sources: October 29; https://arxiv.org/abs/2610.39608 ; https://github.com/nju-websoft/AgenticDS .