No Hang Ups With Hangul: KT Trains Smart Speakers, Customer Call Centers With NVIDIA AI

South Korea’s most common AI voice assistant, GiGA Genie, converses with eight million persons every working day.

The AI-run speaker from telecom enterprise KT can control TVs, provide real-time traffic updates and entire a slew of other dwelling-guidance jobs primarily based on voice instructions. It has mastered its conversational abilities in the remarkably elaborate Korean language many thanks to significant language types (LLMs) — equipment discovering algorithms that can figure out, fully grasp, predict and generate human languages centered on huge textual content datasets.

The company’s designs are designed employing the NVIDIA DGX SuperPOD info heart infrastructure platform and the NeMo Megatron framework for training and deploying LLMs with billions of parameters.

The Korean language, acknowledged as Hangul, reliably demonstrates up in lists of the world’s most demanding languages. It incorporates four forms of compound verbs, and words and phrases are typically composed of two or more roots.

KT — South Korea’s leading cellular operator with more than 22 million subscribers — improved the clever speaker’s comprehending of these words by establishing LLMs with all over 40 billion parameters. And by means of integration with Amazon Alexa, GiGA Genie can converse with consumers in English, as well.

“With transformer-based mostly types, we’ve achieved important high quality improvements for the GiGA Genie clever speaker, as very well as our buyer providers system AI Speak to Heart, or AICC,” claimed Hwijung Ryu, LLM progress staff guide at KT.

AICC is an all-in-1, cloud-dependent platform that delivers AI voice agents and other purchaser services-associated programs.

It can receive phone calls and give requested facts — or rapidly hook up prospects to human agents for responses to far more thorough inquiries. AICC with out human intervention manages far more than 100,000 phone calls day-to-day across Korea, in accordance to Ryu.

“LLMs enable GiGA Genie to obtain far better language knowing and create a lot more human-like sentences, and AICC to minimize session moments by 15 seconds as it summarizes and classifies inquiry styles additional rapidly,” he extra.

Education Huge Language Models

Establishing LLMs can be an costly, time-consuming approach that requires deep technical knowledge and comprehensive-stack technological innovation investments.

The NVIDIA AI platform simplified and sped up this method for KT.

“We educated our LLM versions extra properly with NVIDIA DGX SuperPOD’s highly effective efficiency — as nicely as NeMo Megatron’s optimized algorithms and 3D parallelism techniques,” Ryu claimed. “NeMo Megatron is continuously adopting new features, which is the major benefit we believe it offers in improving our design accuracy.”

3D parallelism — a distributed training technique in which an incredibly large-scale deep mastering model is partitioned throughout many devices — was important for teaching KT’s LLMs. NeMo Megatron enabled the crew to conveniently complete this process with the best throughput, according to Ryu.

“We considered making use of other platforms, but it was complicated to come across an choice that offers whole-stack environments — from the components amount to the inference stage,” he extra. “NVIDIA also offers extraordinary experience from product or service, engineering teams and more, so we simply solved numerous technological issues.”

Applying hyperparameter optimization instruments in NeMo Megatron, KT experienced its LLMs 2x a lot quicker than with other frameworks, Ryu said. These instruments allow for buyers to automatically come across the ideal configurations for LLM training and inference, easing and speeding the development and deployment course of action.

KT is also setting up to use the NVIDIA Triton Inference Server to offer an optimized genuine-time inference support, as perfectly as NVIDIA Foundation Command Manager to easily check and handle hundreds of nodes in its AI cluster.

“Thanks to LLMs, KT can launch aggressive items faster than at any time,” Ryu mentioned. “We also consider that our technological innovation can drive innovation from other corporations, as it can be utilised to enhance their worth and make ground breaking merchandise.”

KT programs to launch extra than 20 pure language comprehending and normal language technology APIs for developers in November. The application programming interfaces can be utilized for duties including document summarization and classification, emotion recognition, and filtering of likely inappropriate articles.

Learn extra about breakthrough systems for the period of AI and the metaverse at NVIDIA GTC, working on the net as a result of Thursday, Sept. 22. 

View NVIDIA founder and CEO Jensen Huang’s keynote handle in replay beneath:

Leave a comment

Your email address will not be published.