Back
On-device AI

Speech AI that runs
inside the set-top box

An AI service that runs right on the device, with a lightweight LLM on the SoC. In broadcast and telecom set-top boxes, it filters noise and echo and recognizes speech without sending audio to a server. Built for operators and set-top box makers.

Comparison

How is it different from sending speech to a server?

Instead of sending audio to a server, a lightweight LLM on the set-top box's SoC filters noise and recognizes speech right there.

Today: speech sent to a server

The set-top box sends the audio it hears to a server across the network, then acts on the result that comes back.

  • Audio goes to a server for recognition, then the result comes back
  • Waits while data travels over the network
  • TV audio and room noise travel along with the voice

On the device: voice AI inside the device

A lightweight LLM on the SoC strengthens speech recognition and noise removal in broadcast and telecom set-top boxes.

  • Speech is recognized on the set-top box's AI chip
  • Noise and echo are removed first to strengthen recognition
  • The device acts on the recognized command right away
How it works

Inside the set-top box

Noise and echo are filtered from the microphone input, then a lightweight LLM understands the command and drives the device.

Inside the set-top box · no audio sent to a server
  1. Sound input

    The set-top box microphone picks up the user's voice together with TV audio and room noise.

  2. Noise and echo removal

    Echo coming back from the TV speaker and background noise are removed so only the voice remains.

  3. Lightweight LLM recognition

    A lightweight LLM on the SoC recognizes the speech and understands the command on the device.

  4. Device action

    The set-top box carries out the command, such as changing the channel.

Features

What it does today

Speech recognition

AI speech recognition optimized for noise removal understands commands that mix Korean and English.

Remote control signal analysis

AI checks remote control signals to identify errors and malfunctions, and detects and excludes abnormal input.

VOD metadata analysis

It collects and parses VOD schedule information and analyzes it with AI optimized for the NPU to make recommendations for each viewer.

Business structure

A lightweight LLM, running right on the SoC

AIO2O's lightweight LLM sits on the AI chip (SoC), the set-top box carries both, and broadcasters and telcos deliver the service.

  1. Chipmakers

    The semiconductor (SoC) that runs AI inside the device

  2. AIO2O: lightweight LLM

    Noise and echo removal plus speech recognition, on the device

  3. Set-top box and appliance makers

    The device that carries the AI chip and software

  4. Broadcasters and telcos

    Deliver voice services through the set-top box

In development

What comes next

We are developing features that make more of the set-top box chip.

In development

Ad exposure analysis for sports broadcasts

Vision recognition on the set-top box chip's NPU spots billboards in the broadcast in real time and produces data on when and how long ads were shown.

In development

Real-time speech recognition and multilingual subtitles

Broadcast speech is turned into text in real time, and subtitles in several languages are generated automatically.

In development

Hybrid AI (device + cloud)

Inference runs on the device and learning in the cloud, extending to services such as ad performance reports.

Technical basis

The experience and track record behind it

AIO2O
  • Domestic broadcasters and telcos
  • Overseas broadcasters
  • Chipmakers
  • Set-top box and hardware makers
20+years developing and delivering broadcast and telecom solutions
  • Our CEO's experience developing and launching KT's AI set-top box, GiGA Genie (The Korea Economic Daily, Feb 2026)
  • AI voice and metadata services commercialized since the company was founded in 2017 (press release, Nov 2025)
  • Registered Korean patents in speech recognition, noise removal and echo cancellation: Speech recognition method and speech recognition device (10-1811716); Method and device for removing noise from a sound signal input through a microphone (10-1449433); AI speaker device for external connection, and method of echo cancellation and synchronization with external devices (10-2291117)
  • Took part in the 2025 APAC TV Summit in Bangkok (Nov 20, 2025)
  • Development contract and MOU with Marusys Vina for an automated multimodal content generation platform (Jul 3, 2025)

The full patent list is on the intellectual property page.

Who it is for

Operators and set-top box makers

For companies that build or run voice-controlled set-top boxes and appliances.

Broadcasters and telecom operators

Operators that deliver voice services through set-top boxes.

Set-top box and appliance makers

Makers that put AI chips and voice software into devices.

Review checklist

Information and questions for a device voice AI review

Start with device specifications and the conditions in which people use voice commands. Compare local and server processing, then confirm feasibility and performance test conditions for the target device.

TopicInformation to prepareQuestions to confirm
Device specifications and software environmentList the chip, memory, operating system, microphone setup and current voice processing flow of the target device.Confirm what can run on the device, how software would connect and what resources it would require.
Usage conditions and commandsDescribe languages, commands, distance from the device, background noise and conditions such as TV playback.Confirm test conditions for recognition accuracy and response time, including failures and retries.
Processing location and data managementMap the current path of voice data and which functions require a server connection.Confirm the division between device and server processing, network dependencies, and whether voice data is stored or transmitted.
Test devices and operational conditionsList target device models, test conditions and schedule, and the teams responsible for updates and operation.Confirm whether a trial is available, its scope and acceptance criteria, and support for updates and operation.

Tell us your device and the voice functions you need

Our team will review it and reply.

Frequently asked questions

What is AIO2O's on-device AI?

An AI service that runs right on the device, with a lightweight LLM on the SoC. In broadcast and telecom set-top boxes, it removes noise and echo and recognizes speech on the device, without sending audio to a server.

How does on-device AI differ from cloud AI?

Cloud AI sends data to remote servers for processing. On-device AI runs on a chip inside the device, so it does not wait on the network and does not need to send voice outside the device.

What can it do today?

Speech recognition with noise removal and mixed Korean-English commands, remote control signal analysis that filters out malfunctions and abnormal input, and per-viewer recommendations from VOD metadata analysis.

Who is it for?

Broadcasters and telecom operators that deliver voice services through set-top boxes, and set-top box and appliance makers that put AI chips and voice software into devices.

What is in development?

Ad exposure analysis for sports broadcasts using NPU vision recognition, real-time speech recognition with multilingual subtitles, and hybrid AI that splits inference on the device and learning in the cloud.

Sources

Last updated