loader animation

Frame-by-frame video labeling & content moderation

From generic to granular: frame-by-frame processing for smarter video analysis powered by AI.

Scroll down to read more

Project highlights

Industry: Advertising Solutions
Client services: AI Business Transformation
Started in 2024
Location: United Kingdom
Team size: 4 members 
Duration: 5 months 

About the client

A UK-based media technology company working with broadcasters, VOD/FAST, and CTV providers.

Their platform combines natural language processing and computer vision to deliver contextual insights for safer, more relevant content and ad placement – improving brand safety and audience targeting at scale.

Business challenges 

The client sought to move away from a one-size-fits-all, sampling-based approach toward frame-by-frame analysis to:

  • Balance quality and cost when filtering and labeling frames.
  • Reduce exposure to upstream changes in third-party features or pricing.
  • Replace a monolithic pipeline with modular, scalable components.

Goals set to Achievion

The engagement goal was to lower the total cost of video labeling and content moderation while increasing accuracy and control.

That required a design that prioritized:

  1. Selective frame processing to avoid unnecessary compute
  2. Transparent quality safeguards so results remain auditable, and
  3. An architecture that the client could scale and tune without being locked into external feature shifts or pricing changes.

In short, the client asked for a practical path from prototype to production – measurable quality, predictable spend, and a roadmap to iterate quickly as catalog volume and formats grow.

Solution 

Achievion delivered a production-ready PoC blueprint and a modular data-processing pipeline centered on frame-level selectivity. The design emphasizes cost control and reliability, starting with deterministic pre-filters that cut obvious non-informative frames and route only signal-rich segments downstream.

We implemented threshold-based filters (e.g., brightness, contrast, sharpness) to remove unusable or redundant frames before analysis. A lightweight scene boundary component detects cuts and transitions, ensuring labeling and moderation respect narrative context rather than treating frames in isolation. This improves precision without over-processing.

The pipeline is composed of loosely coupled services (ingestion, filtering, scene segmentation, analysis, storage, and reporting), orchestrated for stable performance under load and straightforward evolution as requirements change. The design decouples business logic from underlying cloud features so the client isn’t constrained by third-party roadmap or pricing shifts.

Cloud-native services handle storage, orchestration, and event routing; video I/O is powered by proven tooling (e.g., FFmpeg), while AI analysis services are integrated behind clear interfaces so specific components can be swapped or upgraded without re-architecting the system. Monitoring and metrics provide visibility into cost per processed minute and quality KPIs, enabling ongoing optimization.

Business outcome

The frame-by-frame pipeline gives the client granular control at materially lower cost – delivering high-accuracy contextual insights while processing only the frames that matter.

Editorial and ad-ops teams gain a clearer content signal for brand safety and hyper-relevant placement, while engineering gains a future-proof foundation that is resilient to external feature and pricing changes.

Operationally, the modular architecture improves throughput under peak loads, shortens iteration cycles for new labeling and moderation rules, and strengthens reporting needed for partner transparency.

In short, the client now has a scalable solution that aligns technical performance with business impact.

Timeline 

November 2024
Discovery phase

Project kickoff:

  • Stakeholder workshops to define objectives, guardrails, and decision criteria (quality, cost/throughput, auditability)
  • Current-state mapping of ingest, labeling, moderation, and reporting flows; identify failure points and cost drivers
  • Data governance review (access, retention, PII handling, encryption) and non-functional requirements (SLA, observability)
  • Success metrics agreed (e.g., cost per processed minute/frame, precision/recall baseline, latency SLOs)

Outcome: Validated problem statement, target KPIs, and a prioritized scope for the PoC and MVP

December 2024
Proof of Concept Development
  • Stand up core, modular pipeline: ingest → deterministic pre-filters (blur/duplication/luminance) → scene boundary detection → analysis interface → storage → reporting slice
  • Implement frame selectivity and routing logic to process only signal-rich segments; attach metadata for explainability (frame IDs, thresholds, rationale)
  • Build initial dashboards for cost and SLO telemetry; run first end-to-end tests on a representative sample set
  • Calibrate thresholds using labeled ground truth; incorporate a lightweight reviewer feedback loop to reduce false positives/negatives

Outcome: Production-grade PoC demonstrating measurable accuracy gains and reduced processing cost on sample content

May 2025
MVP Delivery
  • Harden orchestration (queues/steps, back-pressure, retries) for stable throughput under peak loads
  • Extend reporting for business users (brand safety, placement suitability) and add audit trails for partner transparency
  • Security & compliance checks (IAM least-privilege, logging, retention); finalize runbooks and on-call SOPs
  • Knowledge transfer with engineering and ops; define post-launch KPI cadence and backlog (new policy packs/classifiers, cost optimizations)

Outcome: Deployed MVP with monitored performance, operational handover completed, and a roadmap for iterative improvements

Team

Project Manager 
AI Architect 
MLOps Engineer
Sr Data Scientist

Tech Stack

Cloud & Orchestration:

AWS S3
API Gateway
AWS Lambda
AWS Step Functions
Amazon SQS

Storage & Analytics:

Amazon DynamoDB
Amazon QuickSight

AWS Glue / Athena

Video & Processing:

FFmpeg

AI & Analysis:

Amazon Rekognition

Monitoring & Security:

Amazon CloudWatch
Cost guardrails

You may also like

Get in touch to learn how our AI powered solutions
can solve your business problem.

    *

    *

    0 from 500