Hands-free Medical Record Solution' Becomes a Hot Topic

Puzzle AI Unveils First AI-Integrated 'AR (Augmented Reality) Glasses'... Targeting Global Market

by Gu Gyo-yun (yun@dailymedi.com)

09.24.2025 10:36

The "Hands-Free Medical Record Solution" unveiled by Puzzle  AI at the "K-Hospital Fair 2025," held at COEX in Seoul from September 17 to 19, is an example of attempting voice-based medical record automation by combining AR (Augmented Reality) glasses and AI (Artificial Intelligence) technology. Targeting environments where hands cannot be kept free, such as operating rooms, the system records medical details in real-time and transmits them to the EMR system based on voice recognition and context understanding. The expo featured 257 participating companies and operated 478 booths, attracting a total of 21,024 visitors. Puzzle AI's booth drew a steady stream of visitors eager to experience this technology, which was being introduced to the hospital industry for the first time, and served as a testing ground for the potential for future application and expansion in medical settings.

On the afternoon of September 17, at the 'K-Hospital Fair 2025' held at COEX in Seoul, the area in front of the Puzzle AI booth was crowded with visitors eager to experience the 'hands-free medical record solution.'

When a visitor wearing special AR glasses said "Save," the conversation just shared was displayed in real-time on the screen, summarized, and transmitted to the EMR (Electronic Medical Record) system.  The reaction at the scene was enthusiastic, witnessing the recording being done solely by voice without the use of hands.

Puzzle AI showcased an AR-AI agent-based medical record solution at this exhibition.  This solution is a medical record device that allows medical staff to record conversations with patients hands-free and transmit them immediately to the EMR.

It is particularly useful in environments where keyboard input is restricted due to the wearing of gloves and masks, such as operating rooms, and can improve record accuracy and reduce the workload of medical staff through features such as real-time conversation captioning, voice command-based saving, conversation summarization, and automatic formatting.

It is attracting attention for simultaneously securing the reliability and practicality of medical data through a structure that combines speaker separation and context understanding, going beyond simple speech recognition technology.

CEO Kim Yong-sik, whom we met at the site that day, emphasized, "Hands-free medical record solutions can contribute to real-time recording in any medical environment, as well as shorten recording time, reduce errors, and improve clinical efficiency. This  ultimately creates an environment where medical staff can focus more on patient care."

A microphone for implementing hands-free medical records. It separates and recognizes only the speaker's voice.

AR (Augmented Reality) glasses that display voice recordings. The speaker's words are displayed on the screen, and when "save" is said, they are summarized and transferred to the EMR system.

Puzzle AI primarily targeted surgical and procedural environments. It applied AR glasses to enable recording and saving using only voice in situations where keyboard input is difficult due to the wearing of gloves and masks.

Dialogue is displayed on the screen like subtitles, allowing medical staff to check the content and issue commands without taking their hands off the screen. The current demonstration device features a monochrome display, but plans to switch to color are underway.

The key feature of this solution is that it goes beyond simple dictation. It summarizes and organizes conversations through speaker separation and context understanding, and even automatically generates necessary medical forms.

CEO Kim explained, “Simple voice recognition alone has significant limitations in noisy medical environments,” adding, “The strength lies in the structure that connects accurate recording to generation.”

On-premise LLM was also implemented for security purposes. The explanation is that operating the model within the hospital's internal network minimizes data leakage. 

Puzzle AI plans to expand its application beyond the demand confirmed in some areas, such as radiology and outpatient clinics, to inaccessible spaces like operating rooms.  

In particular, we aim to distribute it to Bundang Seoul National University Hospital and Seoul St. Mary's Hospital starting this coming October.

A foreign visitor is experiencing a hands-free medical record solution. ⓒ Reporter Gu Gyo-yun

Q&A with Kim Yong-sik, CEO of Puzzle AI

― What is the fundamental change in this solution? Why did you pursue AR (Augmented Reality)?

We have implemented a workflow where conversations with patients are immediately recorded. Conversations appear in real-time on the glasses' display, and saying "Save" transmits the summarized results to the EMR. An agent also assists with diagnostic reports, test results, and prescription suggestions. In surgical and procedural environments, hands cannot be used due to gloves and masks, but AR (augmented reality) glasses allow for immediate verification and commands without obstructing the field of vision.

― What is the difference from simple speech-to-text (STT)?

The medical field is difficult to utilize with simple dictation due to the abundance of noise and specialized terminology. Puzzle AI combines speaker separation and context understanding to summarize and organize conversations, and even automatically generate necessary forms. Its most significant differentiator is its structure, which seamlessly connects record creation, organization, and transmission.

― How are the actual applicability and implementation plans progressing?

We are currently in discussions with Seoul National University Bundang Hospital and Seoul St. Mary's Hospital with the goal of implementation. Our objective is to begin clinical validation as soon as possible. We believe it is crucial to demonstrate the technology's effectiveness in the field through clinical verification.

― The global entry and market expansion strategy is

We plan to establish a foothold in the domestic market while simultaneously pursuing expansion into overseas markets such as the U.S. and Europe. We believe that expansion into diverse fields, including dentistry and traditional Korean medicine, is also feasible. Our goal is to secure trust through collaboration with overseas hospitals and grow into a global leader in medical AI.

― What changes will this technology bring to the medical field?

Above all, it enables medical staff to focus more on patients. Reduced recording time and decreased errors and omissions enhance patient safety. Technology is meaningful only when it is actually used in the field. Puzzle AI aims to fundamentally transform medical record keeping through AR and AI agents, and furthermore, contribute to the improvement of the global healthcare environment.

― The future vision is

The hands-free medical record solution can contribute to real-time recording in any medical environment, as well as reducing recording time, decreasing errors, and improving clinical efficiency. Taking this exhibition as an opportunity, we plan to make a full-scale entry into overseas markets, including the U.S. and Europe, in addition to the domestic market, expand our solutions across the entire medical sector—including dental and traditional Korean medicine clinics—and leap forward as a global medical artificial intelligence (AI) company.

Source: Dailymedi (https://www.dailymedi.com/)