Discover your interests, together

Real deals, honest reviews and shopping stories from people who share your interests — every day on Milik.

Discover your interests, togetherReal deals, honest reviews and shopping stories from people who share your interests — every day on Milik.

How AI Agents Cut Analytics Toil in Half

How AI Agents Cut Analytics Toil in Half
Interest|AI-Assisted Productivity

AI agents in analytics are about less toil, not fewer analysts

AI agents for analytics automation are specialized systems that run data analysis workflows end-to-end—discovering data, writing queries, validating outputs, and iterating analyses—so human analysts spend less time on mechanical tasks and more time on framing questions, interpreting causality, and making business decisions. This is not a theoretical promise; it is already reshaping how data teams at large organizations work. The headline change is simple: analysts stop being report factories and become product thinkers for data. Instead of debating whether agents will replace humans, the real question is whether you can afford to keep your best people trapped in SQL tickets and dashboard commentary while competitors let agents carry that load.

Grab: slashing mechanical tickets from 44% to 30%

Grab shows what AI agents analytics automation looks like when it is wired into daily operations: the share of mechanical tickets handled by analysts fell from 44% in February to 30% in June, covering routine data preparation, alerting, and reporting. That is a direct, quantifiable analytics toil reduction. Their five-level autonomy model makes the key bet: let agents own more of the workflow while humans keep responsibility for metric definitions, causal interpretation, business assumptions, and final decisions. At Level 3, agents discover data, write and execute queries, validate results, and draft analysis between a human question and a human review, with no intervention in the middle. This is the point: toil vanishes from the middle of workflows, not from their strategic edges.

Grab’s Spartan system takes natural language requests, including questions submitted through Slack, and routes them into specialized data analysis workflows using more than 50 skills and 120 analysis frameworks. A root cause request can trigger analysis across certified metrics and relevant dimensions, while an experiment question can retrieve an existing scorecard instead of querying the data lake. Between March and May, self-service analytics answered without human involvement rose from 53% to 67% for metric requests, 63% to 90% for data pulls, and 50% to 81% for SQL requests. About three-quarters of threads originated outside the analytics team, and 85% received a first response within a minute, which shows the practical impact for ordinary users who now get data answers almost instantly.

Certified data and operational agents: autonomy with guardrails

The quiet lesson in Grab’s story is that you cannot get reliable AI agents without investing in the boring parts of data. The company maintains more than 5,000 certified tables and metrics, 4,000 context documents, and 2,000 golden records to give agents trusted inputs and clear definitions. Its ContextIQ system treats this information as a lifecycle, updating context when instrumentation changes and feeding in fixes learned from production agent failures. In other words, autonomy rides on top of certified data pipelines, not on loose data lakes.

Grab also uses AI agents for analytics operations. Scarlet handles pipeline failures by performing root cause analysis and can fix failures or escalate when predefined gates or documented runbooks do not cover the problem. For recurring analytics, agents automate metric and OKR commentary, assessing significant movements, breaking them down across countries and segments, and correlating them with operational changes and experiments. The effect is structural: organizations combine agent autonomy with certified data and clear escalation rules so that repetitive checks and commentary happen automatically, while humans only step in at decision points. Data teams who ignore this pattern will remain stuck in reactive fire-fighting instead of building reusable analytics workflows.

Netflix: causal inference agents that force better methods, not faster guesses

If Grab proves that agents can clear the low-level analytics queue, Netflix proves they can handle advanced data analysis workflows like causal inference without encouraging lazy thinking. Netflix has open-sourced an agentic workflow for Observational Causal Inference (OCI) that reduces toil in causal analysis by automating error-prone tasks such as sensitivity analysis and tracking multiple iterations. OCI analysis is framed as target trial emulation—finding the optimal A/B test for answering the causal question. The workflow uses an actor-critic loop: the human analyst creates a templated Jupyter notebook and an analysis plan, the actor agent produces a spec, fills in parameters, and executes the notebook, and the critic reviews outputs, rates them from not_satisfactory to fully_satisfactory, and recommends spec changes.

In a case study estimating the impact of new entertainment types such as games on 2‑month retention, a baseline Claude run defaulted to a simple linear regression. When the research team used the causal inference agents in the oci-agent workflow, the estimated effect was "just 25% of the baseline," and the critic agent flagged issues like potential early adopter bias and a failed placebo test. Fabio Piazza praised the design: agents publish plans, specs, plots, and notebooks that humans can inspect and re-execute, pairing these process audits with human oversight and splitting work across actor and critic agents. Taikai Takeda noted that such workflows help non-experts avoid "half-baked regression analysis" and lower the entry barrier for specialized tasks. This is the future of analytics toil reduction: agents not only do more work; they insist on better methodology.

How AI Agents Cut Analytics Toil in Half

What data teams should ship now: workflows, not one-off dashboards

The combined lesson from Grab and Netflix is blunt: if your data team is not building AI agents into its analytics workflows, it is shipping the wrong product. Grab shows that mechanical analyst work can drop from 44% to 30%, with self-service answers for metrics, data pulls, and SQL requests increasingly handled without humans, while analysts focus on deeper analysis and better workflows. Netflix shows that causal inference agents can automate sensitivity checks and iterative analyses while keeping every step transparent and auditable.

Organizations that succeed with AI agents do two things. First, they combine agent autonomy with certified data pipelines and explicit human accountability for definitions and decisions. Second, they treat agents as participants in a workflow, not oracles: they publish artifacts, apply process audits, and design critic roles to surface gaps. Ordinary users gain faster, more reliable analytics answers—often within minutes—while experts spend their time on strategy instead of toil. The opinionated takeaway is clear: the competitive edge is no longer who has the biggest data lake, but who turns that lake into agent-driven, audited workflows that keep humans working on questions only humans can answer.

Milik earns a commission when you shop through our links, at no extra cost to you.

You May Also Like

Comments
Say something...
No comments yet. Be the first to share your thoughts!