WO2026025416A1 - Systèmes de gestion d'hôpital - Google Patents

Systèmes de gestion d'hôpital

Info

Publication number
WO2026025416A1
WO2026025416A1 PCT/CN2024/109060 CN2024109060W WO2026025416A1 WO 2026025416 A1 WO2026025416 A1 WO 2026025416A1 CN 2024109060 W CN2024109060 W CN 2024109060W WO 2026025416 A1 WO2026025416 A1 WO 2026025416A1
Authority
WO
WIPO (PCT)
Prior art keywords
patient
data
hospital
user
intelligent
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
PCT/CN2024/109060
Other languages
English (en)
Inventor
Emeli ZHANG
Yuankang WEI
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai United Imaging Metahealthcare Co Ltd
Original Assignee
Shanghai United Imaging Metahealthcare Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai United Imaging Metahealthcare Co Ltd filed Critical Shanghai United Imaging Metahealthcare Co Ltd
Priority to PCT/CN2024/109060 priority Critical patent/WO2026025416A1/fr
Priority to CN202510054032.8A priority patent/CN119964757A/zh
Priority to CN202411743195.9A priority patent/CN119580978A/zh
Publication of WO2026025416A1 publication Critical patent/WO2026025416A1/fr
Pending legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/20—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/67—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for remote operation
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems

Definitions

  • the present disclosure generally relates to hospital systems, and in particular, to systems for hospital management.
  • Hospital management involves overseeing the administrative and operational aspects (e.g., administrative management, clinical management, financial management, operation management, personnel management, etc. ) of a hospital or healthcare facility to ensure efficient and effective delivery of healthcare services.
  • An effective system for hospital management (also referred to as a hospital management system) is crucial for the operation of a hospital. Therefore, it is desirable to develop an effective and reliable hospital management system.
  • a system for hospital management may be provided.
  • the system may include an interface provided for a user to manage resources of a hospital.
  • the resources may include digital twins that map the status of corresponding physical entities and are generated according to a predefined data structure.
  • the digital twins may include one or more first digital twins.
  • the mapping the status of a corresponding physical entity may include that the first digital twin is updated based on an update of the status of the corresponding physical entity.
  • the update of the status of the corresponding physical entity may be detected based on real-time information of the corresponding physical entity.
  • the real-time information of the corresponding physical entity may comprise at least one of information collected by sensing devices in the hospital or information collected by user terminals associated with the hospital.
  • the one or more first digital twins may include a digital twin corresponding to a public area in the hospital, and the digital twin may correspond to the public area reflects a digital twin view of the public area.
  • the one or more first digital twins may include a digital twin corresponding to a medical service, and the digital twin corresponding to the medical service may reflect operating indicators of the medical service.
  • the first digital twin may be updated in a first manner in response to detecting that the update of the status of the corresponding physical entity is normal; the first digital twin may be updated in a second manner in response to detecting that the update of the status of the corresponding physical entity is abnormal.
  • the first manner may be different from the second manner.
  • the digital twins may include one or more second digital twins that are updatable via the interface.
  • the mapping the status of a corresponding physical entity may include that the corresponding physical entity is updated based on an update of the second digital twin.
  • the one or more second digital twins may include a digital twin corresponding to a hardware device, and the digital twin corresponding to the hardware device reflect parameters of the hardware device.
  • the system may further comprise a processing device.
  • the processing device may receive updating information relating to the digital twin corresponding to the hardware device from a manager terminal that presents the interface. Further, the processing device may control the hardware device to update its configuration based on the updating information.
  • the processing device may store the updating information into a storage device. Further, the processing device may send an update notification to the hardware device so that the hardware device acquires the updating information from the storage device to update its configuration.
  • the one or more second digital twins may include a digital twin corresponding to a user service, and the digital twin corresponding to the user service may reflect parameters of the user service.
  • the user service may be accessible from a patient space application installed in a patient terminal or a doctor space application in a doctor terminal.
  • the one or more second digital twins may include a digital twin corresponding to a medical service procedure, and the digital twin corresponding to the medical service procedure may reflect parameters of the medical service procedure.
  • the parameters of the medical service procedure may include a standard operating procedure (SOP) specifying standard stages in the medical service procedure.
  • SOP standard operating procedure
  • the interface may be configured to present a virtual character configured to communicate with the user and an interface element for the user to initiate a communication session with the virtual character.
  • the content displayed via the interface may be updated according to the communication content of the communication session.
  • a system for hospital management may be provided.
  • the system may include an interface provided for a user to manage digital intelligent resources of a hospital.
  • the digital intelligent resources may include intelligent agents.
  • the intelligent agents may include software entities built based on artificial intelligence algorithms.
  • the interface may present essential data used by at least a portion of the intelligent agents.
  • the essential data may be updatable by the user via the interface.
  • the interface may present operating indicators of the at least a portion of the intelligent agents.
  • At least a portion of the intelligent agents may be further built based on natural language processing algorithms.
  • the intelligent agents may include intelligent agents corresponding to different types of medical service providers.
  • the intelligent agents may include intelligent agents corresponding to different hospital departments.
  • the intelligent agents may include intelligent agents corresponding to different medical service procedures.
  • the intelligent agents may include intelligent agents corresponding to different user services.
  • the at least a portion of intelligent agents may include a first intelligent agent corresponding to a medical service procedure, and the first intelligent agent may be configured to perform the following operations.
  • the first intelligent agent may monitor updates in data relating to the medical service procedure of a patient.
  • the first intelligent agent may perform event of interest (EOI) detection based on the updated data.
  • the first intelligent agent may further perform one or more predetermined operations corresponding to the EOI to provide user services to relevant users of the medical service procedure. At least one of the EOI detection or the implementation of the one or more predetermined operation may be performed based on updated essential data corresponding to the first intelligent agent, the updated essential data being obtained via the interface.
  • EOI event of interest
  • the at least a portion of intelligent agents may include a second intelligent agent corresponding to a user service relating to a stage in a medical service procedure, and the second intelligent agent may be configured to perform the following operations.
  • the second intelligent agent may obtain data relating to the stage in the medical service procedure of a patient.
  • the second intelligent agent may also process the data based on updated essential data corresponding to the second intelligent agent, the updated essential data being obtained via the interface. Further, the second intelligent agent may provide the user service to relevant users of the stage based on a processing result of the data.
  • FIG. 1 is a block diagram illustrating an exemplary medical service system according to some embodiments of the present disclosure
  • FIG. 2 is a schematic diagram illustrating an exemplary medical service system according to some embodiments of the present disclosure
  • FIG. 3 is a schematic diagram illustrating an exemplary hospital support platform according to some embodiments of the present disclosure
  • FIG. 4 is a schematic diagram illustrating an exemplary system for hospital management according to some embodiments of the present disclosure
  • FIG. 5 is a schematic diagram illustrating an exemplary interface according to some embodiments of the present disclosure.
  • FIG. 6 is a schematic diagram illustrating exemplary digital twins according to some embodiments of the present disclosure.
  • FIG. 7A is a schematic diagram illustrating an exemplary digital twin view of a check-in area according to some embodiments of the present disclosure
  • FIG. 7B is a schematic diagram illustrating an exemplary digital twin view of a waiting room according to some embodiments of the present disclosure
  • FIG. 7C is a schematic diagram illustrating an exemplary digital twin view of a consultation area according to some embodiments of the present disclosure.
  • FIG. 7D is a schematic diagram illustrating an exemplary digital twin view of a consultation room of the consultation area in FIG. 7C according to some embodiments of the present disclosure
  • FIG. 7E is a schematic diagram illustrating an exemplary digital twin view of an operating area according to some embodiments of the present disclosure.
  • FIG. 7F is a schematic diagram illustrating an exemplary digital twin view of an operating room of the operating area in FIG. 7E according to some embodiments of the present disclosure
  • FIG. 8A is a schematic diagram illustrating an exemplary digital twin corresponding to an out-patient registration service according to some embodiments of the present disclosure
  • FIG. 8B is a schematic diagram illustrating an exemplary digital twin corresponding to a treatment and nursing service according to some embodiments of the present disclosure
  • FIG. 8C is a schematic diagram illustrating an exemplary digital twin corresponding to a daily surgery operation service according to some embodiments of the present disclosure
  • FIG. 8D is a schematic diagram illustrating an exemplary digital twin corresponding to a medical consultation service according to some embodiments of the present disclosure
  • FIG. 8E is a schematic diagram illustrating an exemplary digital twin corresponding to a hospitalization service according to some embodiments of the present disclosure
  • FIG. 8F is a schematic diagram illustrating an exemplary digital twin corresponding to a department surgery service according to some embodiments of the present disclosure
  • FIG. 9A is a schematic diagram illustrating an exemplary display device in a waiting room according to some embodiments of the present disclosure.
  • FIG. 9B is a schematic diagram illustrating an exemplary display device in a consultation room according to some embodiments of the present disclosure.
  • FIG. 9C is a schematic diagram illustrating an exemplary display device in an inpatient ward according to some embodiments of the present disclosure.
  • FIG. 9D is a schematic diagram illustrating an exemplary display device in a surgery waiting area according to some embodiments of the present disclosure.
  • FIG. 10 is a flowchart illustrating an exemplary process for updating configuration of a hardware device according to some embodiments of the present disclosure
  • FIG. 11 is a schematic diagram illustrating an exemplary interface for presenting information relating to an intelligent agent according to some embodiments of the present disclosure
  • FIG. 12 is a flowchart illustrating an exemplary process for providing user services to relevant users of a medical service procedure using a first intelligent agent according to some embodiments of the present disclosure.
  • FIG. 13 is a flowchart illustrating an exemplary process for providing user services to relevant users using a second intelligent agent according to some embodiments of the present disclosure
  • FIG. 14A is a flowchart illustrating an exemplary process for providing a pre-consultation service according to some embodiments of the present disclosure
  • FIG. 14B is a flowchart illustrating an exemplary process for conducting a pre-consultation inquiry according to some embodiments of the present disclosure
  • FIG. 15 is a flowchart illustrating an exemplary process for providing a medical consultation service based on sensed information according to some embodiments of the present disclosure
  • FIG. 16 is a flowchart illustrating an exemplary process for providing user services relating to a hospitalization admission stage according to some embodiments of the preset disclosure
  • FIG. 17 is a schematic diagram illustrating an exemplary process for providing a nursing service according to some embodiments of the present disclosure
  • FIG. 18 is a schematic diagram illustrating an exemplary preoperative guidance process according to some embodiments of the present disclosure.
  • FIG. 19 is a schematic diagram illustrating an exemplary process of a surgery execution according to some embodiments of the present disclosure.
  • system, ” “engine, ” “unit, ” “module, ” and/or “block” used herein are one method to distinguish different components, elements, parts, sections or assembly of different levels in ascending order. However, the terms may be displaced by another expression if they achieve the same purpose.
  • first, ” “second, ” “third, ” “fourth, ” etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element, without departing from the scope of example embodiments of the present invention.
  • Spatial and functional relationships between elements are described using various terms, including “connected, “ “engaged, “ “interfaced, “ and “coupled. " Unless explicitly described as being “direct, " when a relationship between first and second elements is described in the present disclosure, that relationship includes a direct relationship where no other intervening elements are present between the first and second elements, and also an indirect relationship where one or more intervening elements are present (either spatially or functionally) between the first and second elements. In contrast, when an element is referred to as being “directly” connected, engaged, interfaced, or coupled to another element, there are no intervening elements present.
  • An anatomical structure shown in an image of a subject may correspond to an actual anatomical structure existing in or on the subject’s body.
  • the term “object” and “subject” in the present disclosure are used interchangeably to refer to a biological object (e.g., a patient, an animal) or a non-biological object (e.g., a phantom) .
  • the object may include a specific part, organ, and/or tissue of the object.
  • the object may include the head, the bladder, the brain, the neck, the torso, a shoulder, an arm, the thorax, the heart, the stomach, a blood vessel, soft tissue, a knee, a foot, or the like, or any combination thereof, of a patient.
  • Conventional hospital management systems typically employ distinct systems (e.g., surgery system, emergency system) dedicated to various departments.
  • the present disclosure introduces an advanced hospital management system by integrating and overseeing the systems of multiple departments through a unified manager space application.
  • the disclosed hospital management system is designed to uniformly manage hospital resources.
  • One aspect of the disclosed system is its capability to support various types of hospital managers by providing deep integration and visualization for monitoring and optimizing healthcare services and specific resource allocations, thereby facilitating refined hospital operations.
  • the system offers data analysis and visual interaction tools for decision-making, enhancing the ability to comprehensively monitor and manage clinical operations, including outpatient services, surgeries, and inpatient care.
  • unified resource management significantly enhances medical resource utilization efficiency, reduces dependency on fragmented "chimney-style" information systems, and simplifies hospital operations and management.
  • the hospital management system may include an interface provided for a user to manage resources of a hospital.
  • the resources may include digital twins that map the status of corresponding physical entities and are generated according to a predefined data structure.
  • the digital twins may be created using data from sensors and other sources to model the real-world counterpart in real-time.
  • the digital twins may be used for monitoring, analysis, simulation, control, and providing valuable insights, thereby optimizing the performance and improving overall efficiency of the hospital management system.
  • the resources may include digital intelligent resources of a hospital.
  • the digital intelligent resources may include intelligent agents, which includes software entities built based on artificial intelligence algorithms. According to some embodiments of the present disclosure, the configuration of intelligent agents in the hospital can be customized, which may significantly improve the accuracy and efficiency of diagnosis and treatment, while also enhancing the patient treatment experience.
  • FIG. 1 is a block diagram illustrating an exemplary medical service system 100 according to some embodiments of the present disclosure.
  • the medical service system 100 can also be referred to as a meta hospital system, and is built based on various innovative technologies including metaverse technology, XR technology (e.g., augmented reality (AR) technology, virtual reality (VR) technology, mixed reality (MR) technology, etc. ) , AI technology, digital twin technology, IOT technology, data circulation technology (e.g., blockchain technology, data privacy computing technology) , spatial computing technology, image rendering technology, etc.
  • XR technology e.g., augmented reality (AR) technology, virtual reality (VR) technology, mixed reality (MR) technology, etc.
  • AI technology e.g., digital twin technology
  • IOT technology e.g., digital twin technology
  • data circulation technology e.g., blockchain technology, data privacy computing technology
  • spatial computing technology e.g., image rendering technology, etc.
  • the medical service system 100 may include a physical hospital 110, a virtual hospital 130, at least one user space application 120, and a hospital support platform 140.
  • the hospital support platform 140 may map data relating to the physical hospital 110 into the virtual hospital 130 corresponding to the physical hospital 110, and provide user services to relevant users of the physical hospital 110 via the at least one user space application 120.
  • the physical hospital 110 refers to a hospital that exists in the physical world and has tangible properties.
  • healthcare institutions that offer medical, surgical, and psychiatric care and treatment for people are collectively referred to as hospitals.
  • the physical hospital 110 may include a plurality of physical entities.
  • the plurality of physical entities may include departments, users, hardware devices, user services, public areas, medical service procedures, or the like, or any combination thereof.
  • a department refers to a specialized unit or division dedicated to providing specific types of medical care, treatments, and services.
  • Each of the departments may focus on a particular area of medicine and may be staffed by healthcare professionals with expertise in that area.
  • the departments may include a consultation department, a hospitalization department, a surgery department, a support department (e.g., a registration department, a pharmacy department) , an internal medicine department, a surgical department, a specialized medical department, a children’s health department, or the like, or any combination thereof.
  • the users may include any users associated with the physical hospital 110 (or referred to as relevant users of the physical hospital 110) .
  • the users may include patients (or a portion of the patients (e.g., organs) ) , companions of the patients, visitors of the patients, hospital staff of the physical hospital 110, suppliers of the physical hospital 110, application developers of the physical hospital 110, or the like, or any combination thereof.
  • the hospital staff of the physical hospital 110 may include medical service providers (e.g., doctors, nurses, technicians, etc. ) , hospital managers, support staff, or the like, or any combination thereof.
  • Exemplary hospital managers may include a departmental nursing manager, a clinical leader, a departmental dean, a hospital dean, a hospital executive, a functional manager, or the like, or any combination thereof.
  • the hardware devices may include hardware devices located in the physical hospital 110 and/or hardware devices in a communication with the hardware devices in the physical hospital 110.
  • Exemplary hardware devices may include terminal devices, medical service devices, sensing devices, basic devices, or the like, or any combination thereof.
  • the terminal devices may include terminal devices that interact with the users relating to the medical service system 100.
  • the terminal devices may include a terminal device that interacts with a patient (also referred to as a patient terminal device) , a terminal device that interacts with a doctor of the patient (also referred to as a doctor terminal device) , a terminal device that interacts with a nurse (also referred to as a nurse terminal device) , a terminal device that interacts with a remote visitor (also referred to as a remote terminal device) , a public terminal of the hospital (e.g., a consultation room terminal, a bedside terminal device, a terminal device in a waiting region, an intelligent surgery terminal) , or the like, or any combination thereof.
  • a patient terminal device also referred to as a patient terminal device
  • a terminal device that interacts with a doctor of the patient also referred to as a doctor terminal device
  • a terminal device that interacts with a nurse also referred to as a nurse terminal device
  • a terminal device that is owned by a user and a terminal device that is provided to the user by the physical hospital 110 are collectively referred to as a terminal device of the user or a terminal device that interacts with the user.
  • the terminal devices may include a mobile terminal, an XR device, a smart wearable device, etc.
  • the mobile terminal may include a smart phone, a personal digital assistant (PDA) , a display, a gaming device, a navigation device, a handheld terminal (POS) , a tablet computer, or the like, or any combination thereof.
  • PDA personal digital assistant
  • POS handheld terminal
  • the XR device may include a device that allows a user to be engaged in an extended reality experience.
  • the XR device may include a VR assembly, an AR assembly, an MR assembly, or the like, or any combination thereof.
  • the XR device may include an XR helmet, XR glasses, an XR patch, a stereoscopic headset, or the like, or any combination thereof.
  • the XR device may include a Google Glass TM , an Oculus Rift TM , a Gear VR TM , an Apple Vision pro TM , etc.
  • the XR device may include a display component on which virtual content may be rendered and/or displayed.
  • the XR device may further include an input component.
  • the input component may enable user interactions between a user and the virtual content (e.g., the virtual surgery environment) displayed by the display component.
  • the input component may include a touch sensor, a microphone, an image sensor, etc., configured to receive user input, which may be provided to the XR device and used to control the virtual world by varying the visual content rendered on the display component.
  • the input component may include a handle, a glove, a stylus, a console, etc.
  • the smart wearable device may include smart bracelets, smart shoes and socks, smart glasses, smart helmets, smart watches, smart clothes, smart backpacks, smart accessories, or the like, or any combination thereof.
  • the smart wearable device may obtain physiological data (e.g., heart rate, blood pressure, body temperature, etc. ) of the user.
  • the medical service devices may be configured to provide medical services to the patients.
  • the medical service devices may include examination devices, nursing care devices, therapeutic devices, or the like, or any combination thereof.
  • the examination devices may be configured to provide examination services to the patients, such as collecting examination data of the patients.
  • Exemplary examination data may include a heart rate, a respiratory rate, a body temperature, blood pressure, medical imaging data, a body fluid test report (e.g., a blood test report) , or the like, or any combination thereof.
  • the examination devices may include a vital sign monitor (e.g., a blood pressure monitor, a glucometer, a cardiotachometer, a thermometer, a digital stethoscope, etc. ) , a medical imaging device (e.g., a computed tomography (CT) device, a digital subtraction angiography (DSA) device, a magnetic resonance (MR) device, etc. ) , a laboratory device (e.g., a blood routine examination device, etc. ) , or the like, or any combination thereof.
  • CT computed tomography
  • DSA digital subtraction angiography
  • MR magnetic resonance
  • the nursing care devices may be configured to provide nursing care services to the patients and/or assist the medical service providers to provide the nursing care services.
  • Exemplary nursing care devices may include a hospital bed, a patient-care robot, an intelligent nursing trolley, an intelligent medicine box, an intelligent wheelchair, etc.
  • the therapeutic devices may be configured to provide therapeutic services to the patients and/or assist the medical service providers to provide the therapeutic services.
  • Exemplary therapeutic devices may include surgical devices, radiotherapeutic devices, physical therapy devices, or the like, or any combination thereof.
  • the sensing devices may be configured to collect sensed information relating to the environment where it is located.
  • the sensing devices may include an image sensor, an acoustic sensor, etc.
  • the image sensor may be configured to collect image data in the physical hospital 110
  • the acoustic sensor may be configured to collect acoustic data in the physical hospital 110.
  • a sensing device may be an independent device or be integrated into another device.
  • the acoustic sensor may be part of a medical service device or a terminal device.
  • the basic devices may be configured to support data transmission, storage, and processing.
  • the basic devices may be networks, machine room facilities, computing devices, computing chips, storage devices, etc.
  • At least part of the hardware devices of the physical hospital 110 are IoT devices.
  • the IoT devices refer to devices with sensors, processing ability, software, and other technologies that connect and exchange data with other devices and systems over the Internet or other communications networks.
  • one or more medical service devices and/or sensing devices of the physical hospital 110 are IoT devices and configured to transmit the collected data to the hospital support platform 140 for storage and/or processing.
  • the user services may include any services provided by the hospital support platform 140 to the users.
  • the user services include medical services provided to the patients and/or the companions of the patients, support services provided to the staff of the physical hospital 110 and/or suppliers of the physical hospital 110, etc.
  • the user services may be provided to patients, doctors, and hospital managers via the user space application (s) 120, which will be described in detail in the following descriptions.
  • the public areas refer to shared spaces accessible to the users (or a portion of the users) in the physical hospital 110.
  • the public areas may include a reception area (e.g., a front desk) , waiting areas, corridors and hallways, or the like, or any combination thereof.
  • a medical service procedure refers to a procedure that provides a corresponding medical service to the patients.
  • the medical service procedure normally includes serval stages and/or steps that a user needs to go through for receiving the corresponding medical service.
  • Exemplary medical service procedures may include a consultation procedure, a hospitalization procedure, a surgery procedure, or the like, or any combination thereof.
  • the medical service procedure may include medical service procedures corresponding to different departments, different diseases, etc.
  • a preset data acquisition protocol may be set and specify standard stages involved in the medical service procedure and how to collect relating to the medical service procedure.
  • the at least one user space application 120 provides the users with access to the user services provided by the hospital support platform 140.
  • a user space application 120 may be an application program, a plug-in, a website, an applet, or in any other suitable form.
  • the user space application 120 is an application program installed on a user’s terminal device, and the application program includes user interfaces for the user to initiate requests and receive corresponding services.
  • the at least one user space application 120 may include different applications corresponding to different types of users.
  • the at least one user space application 120 includes a patient space application corresponding to patients, a doctor space application corresponding to doctors, a manager space application corresponding to managers, or the like, or any combination thereof.
  • User services provided via the patient space application, the doctor space application, and the manager space application are also referred to as patient space services, doctor space services, and manager space services, respectively.
  • Exemplary patient space services include registration services, navigation services, pre-consultation services, remote consultation services, hospitalization admission services, hospitalization discharge services, etc.
  • Exemplary doctor space services include scheduling services, surgical planning services, surgical simulation services, patient management services, remote ward round services, remote consultation services, etc.
  • Example manager space services include monitoring services, medical service evaluation services, equipment parameter setting services, service parameter setting services, resource scheduling services, etc.
  • the patient space application, the doctor space application, and the manager space application may be integrated into one user space application 120, and the user space application 120 may be configured to provide access for each type of the users (e.g., the patients, the medical service providers, the managers, etc. ) .
  • a specific user may have a corresponding identity that can be used to log into the user space application, view corresponding diagnosis and treatment data, and obtain corresponding user services.
  • each type of users can easily obtain various user services that he/she may need on his/her corresponding user space application.
  • the users are usually required to install various applications to obtain different user services, which results in poor user experience and high development costs. Therefore, the user space applications in the present disclosure can improve the user experience, improve the service quality and efficiency, enhance the service safety, and reduce the development or operational costs.
  • the at least one user space application 120 may be configured to provide access for the relevant users of the physical hospital 110 to interact with the virtual hospital 130.
  • a user may input an instruction for retrieving digital content of the virtual hospital 130 (e.g., a digital twin model of a hardware device, a patient organ, a public area) , view the digital content, and interact with the digital content.
  • a user via a user space application 120, a user may communicate with a virtual character representing an intelligent agent.
  • a public terminal of the hospital may be installed with a manager space application, and a manager account of the department corresponding to the public terminal may be logged in the manager space application. Users may receive user services via the manager space application installed in the public terminal.
  • the virtual hospital 130 is a digital twin (i.e., a virtual representation or virtual copy) of the physical hospital 110 that is used to simulate, analyze, predict, and optimize the operation status of the physical hospital 110.
  • the virtual hospital 130 may be a digital copy of the physical hospital 110 in real time.
  • the virtual hospital 130 may be presented to the users using digital technologies. For example, at least a portion of the virtual hospital 130 may be presented to the relevant users using the XR technology when the relevant users interact with the virtual hospital 130. Merely by way of example, the at least a portion of the virtual hospital 130 may be superimposed on a real-world view of the relevant users using the MR technology.
  • the virtual hospital 130 may include digital twins of the physical entities relating to the physical hospital 110.
  • a digital twin refers to a virtual representation (e.g., a virtual copy, a mapping body, a digital simulator) of a physical entity.
  • the digital twins may reflect and predict status, behaviors, and performances of the physical entities in real time.
  • the virtual hospital 130 may include digital twins of at least a portion of the medical services, the departments, the users, the hardware devices, the user services, the public areas, the medical service procedures, etc., of the physical hospital 110.
  • the digital twin of a physical entity may be in various forms including a model, an image, a graph, text, numerical values, etc.
  • the digital twins may be a virtual hospital corresponding to the physical hospital, virtual personnel (e.g., virtual doctors, virtual nurses, and virtual patients) corresponding to personnel entities (e.g., the doctors, the nurses, and the patients) , virtual devices (e.g., the virtual imaging device and a virtual scalpel) corresponding to medical service devices (e.g., an imaging device and a scalpel) , etc.
  • virtual personnel e.g., virtual doctors, virtual nurses, and virtual patients
  • personnel entities e.g., the doctors, the nurses, and the patients
  • virtual devices e.g., the virtual imaging device and a virtual scalpel
  • medical service devices e.g., an imaging device and a scalpel
  • the digital twins may include one or more first digital twins and/or one or more second digital twins.
  • the status of each first digital twin may be updated based on an update of the status of the corresponding physical entity.
  • the one or more first digital twins may be updated during a process of mapping the data relating to the physical hospital 110 into the virtual hospital 130.
  • the one or more second digital twins may be updatable via at least one of the at least one user space application 120, and the update of each second digital twin may result in a status update of the corresponding physical entity.
  • a first digital twin may be updated accordingly; when a second digital twin is updated, the status of the corresponding physical entity changes accordingly.
  • the one or more first digital twins may include the digital twins of the public areas, the medical services, the users, the hardware devices, etc.
  • the one or more second digital twins may include the digital twins of the hardware devices, the user services, the medical service procedures, etc. It should be understood that a digital twin can be both a first digital twin and a second digital twin.
  • the physical hospital 110 by generating the virtual hospital 130 including the digital twins of the physical entities relating to the physical hospital 110, the physical hospital 110 (encompassing the hardware device, the users, the user services, the medical service procedures, etc. ) can be simulated and tested in a safe and controllable environment.
  • a virtual-real linkage e.g., real-time interactions between the physical hospital 110 and the virtual hospital 130
  • various medical scenarios can be predicted and responded to more accurately, thereby improving the quality and efficiency of the medical services.
  • the use of the XR technology and virtual-real integration technology enables more natural and intuitive interactions for the relevant users, providing a more comfortable and efficient medical environment, thereby enhancing the user experience.
  • the virtual hospital 130 may further include intelligent agents that achieve self-evolution based on the data relating to the physical hospital 110 and AI technology.
  • An intelligent agent refers to an agent acting in an intelligent manner.
  • the intelligent agent may include a computing/software entity that can learn and evolve autonomously, and perceive and analyze data to perform specific tasks and/or achieve specific goals (e.g., the medical service procedures) .
  • AI technology e.g., reinforcement learning, deep learning, etc.
  • the intelligent agent may continuously learn and self-optimize in the interaction with the environment.
  • the intelligent agent may collect and analyze massive amounts of data (e.g., the data relating to the physical hospital 110) through big data technology, and mine patterns and learn rules from the data to optimize a decision-making process, so as to identify environmental changes, respond quickly, and make reasonable judgments in uncertain or dynamic environments.
  • the intelligent agents may autonomously learn and evolve based on the AI technology to adapt to changes in the physical hospital 110.
  • the intelligent agents may be built based on an NLP technology (e.g., a large language model, etc. ) , and may automatically learn and autonomously update via a large amount of language texts (e.g., hospital business data and patient feedback information) to improve the quality of the user services provided by the physical hospital 110.
  • NLP technology e.g., a large language model, etc.
  • language texts e.g., hospital business data and patient feedback information
  • the intelligent agents may include different types corresponding to different medical service procedures, different user services, different departments, different diseases, different hospital positions (e.g., the nurses, doctors, technicians, etc. ) , different stages in a medical service procedure, etc.
  • An intelligent agent of a specific type is used to handle tasks corresponding to the specific type.
  • one intelligent agent may correspond to different medical service procedures (or different medical services, or different departments, or different diseases, or different hospital positions) .
  • the intelligent agent may operate with reference to essential data (e.g., dictionaries, knowledge graphs, templates, etc. ) of the department and/or disease corresponding to the intelligent agent.
  • a plurality of intelligent bodies may collaborate with each other and share information via network communication to accomplish complex tasks together.
  • configurations of an intelligent agent may be set.
  • essential data used by the intelligent agent in operation may be set.
  • the essential data may include a dictionary, a knowledge database, a template, etc.
  • usage permissions of the intelligent agent may be set for different users.
  • a manager of the physical hospital 110 may set configurations of the intelligent agent via a manage space application.
  • an intelligent agent may be integrated into or deployed on a hardware device.
  • an intelligent agent corresponding to the hospitalization services may be integrated into the hospital bed or a presentation device of the hospital bed.
  • an intelligent agent may be integrated into or deployed on an embodied intelligence robot.
  • the embodied intelligence robot refers to a robotic system that integrates physical presence (embodiment) with intelligent behavior (cognition) .
  • the embodied intelligence robot may be configured to interact with the real world in a manner that mimics or complements human capabilities, utilizing physical form and cognitive functions to perform tasks, make decisions, and adapt to the environment.
  • the embodied intelligence robot may operate autonomously, interact with the environment, and continuously improve the performance.
  • the embodied intelligence robot may be configured with the intelligent agent corresponding to the surgery services and assist the doctors to perform surgeries.
  • At least a portion of the user services may be provided based on the intelligent agents.
  • the at least a portion of the user services may be provided to the relevant users based on a processing result, wherein the processing result is generated by at least one of the intelligent agents based on the data relating to the physical hospital 110.
  • the data relating to the physical hospital 110 may include data relating to a medical service procedure of the physical hospital 110
  • the intelligent agents may include an intelligent agent corresponding to the medical service procedure
  • the user services may be provided to relevant users of the medical service procedure by processing the data using the intelligent agent corresponding to the medical service procedure.
  • the hospital support platform 140 may be configured to provide technical support for the medical service system 100.
  • the hospital support platform 140 may include computational hardware and software to support the innovative technologies including XR technology, the AI technology, digital twin technology, data circulation technology, etc.
  • the hospital support platform 140 may at least include a storage device for data storage and a processing device for data computation.
  • the hospital support platform 140 may support the interaction between the physical hospital 110 and the virtual hospital 130.
  • the processing device of the hospital support platform 140 may obtain data relating to the physical hospital 110 from the hardware devices and map the data relating to the physical hospital 110 into the virtual hospital 130.
  • the processing device of the hospital support platform 140 may update a portion of the digital twins in the virtual hospital 130 (e.g., the one or more first digital twins) based on the obtained data, so that each of the portion of the digital twins in the virtual hospital 130 may reflect an updated status of the corresponding physical entity in the physical hospital 110.
  • intelligent agent (s) corresponding to the data relating to the physical hospital 110 may be self-evolving and self-learning by training and/or updating based on the data relating to the physical hospital 110.
  • the hospital support platform 140 may support and/or provide the user services to the relevant users of the physical hospital 110. For example, in response to receiving a user service request from a user, the processing device of the hospital support platform 140 may provide the user service corresponding to the service request. As another example, in response to detecting that a user service needs to be provided to a user, the processing device of the hospital support platform 140 may control a physical entity or a virtual entity corresponding to the user service to provide the user service. For instance, in response to detecting that the patient is admitted to a hospital ward, the processing device of the hospital support platform 140 may control the intelligent nursing trolley to guide a nurse to the hospital ward to perform an initial examination on the patient.
  • At least a portion of the user services may be provided to the relevant users based on the interactions between the relevant users and the virtual hospital 130.
  • An interaction refers to a reciprocal action or influence (e.g., conversation, behavior, etc. ) between the relevant users and the virtual hospital 130.
  • the interactions between the relevant users and the virtual hospital 130 may include interactions between the relevant users and the digital twins in the virtual hospital 130, interactions between the relevant users and the intelligent agents, interactions between the relevant users and the virtual characters, or the like, or any combination thereof.
  • At least a portion of the user services may be provided to the relevant users based on the interactions between the relevant users and at least one of the digital twins.
  • an updating instruction of a second digital twin inputted by a relevant user may be received via the at least one user space application 120, and the corresponding physical entity of the second digital twin may be updated based on the updating instruction.
  • a user may view a first digital twin of a physical entity (e.g., a 3D digital twin model of a patient’s organ or a hardware device) via the user space application 120 to understand the status of the physical entity.
  • the user may change the display angle, the display size, etc., the digital twin.
  • the processing device of the hospital support platform 140 may present a virtual character corresponding to an intelligent agent via the at least one user space application to interact with the relevant users, and provide at least a portion of the user services to the relevant users based on the interactions between the relevant users and the virtual character.
  • the hospital support platform 140 may have a five-layer structure, including a hardware device layer, an interface layer, a data processing layer, an application development layer, and a service layer, which will be described in FIG. 3.
  • the hardware devices of the physical hospital 110 may be part of the hospital support platform 140.
  • the virtual hospital corresponding to the physical hospital can be established.
  • This virtual hospital can reflect the real-time statuses (e.g., changes, updates, etc. ) of the physical entities relating to the physical hospital, thereby enabling monitoring and evaluation of the physical entities.
  • This integration can provide accurate data support for the operation of the medical services and intelligent decision-making.
  • the relevant users relating to the medical services can collaboratively establish an open and shared ecosystem, thereby fostering innovation and enhancement of medical services.
  • full-life cycle patient medical and health services with in-hospital and out-of-hospital linkage may be provided.
  • the perspective of the medical services is expanded from simple disease treatment to encompass the entire life cycle of the patients, including prevention, diagnosis, treatment, rehabilitation, health management, etc.
  • the physical hospital can better integrate online and offline resources to provide the patients comprehensive and continuous medical and health services.
  • the patients’ health status can be tracked in real time, which can adjust treatment plans promptly, and improve treatment outcomes.
  • FIG. 2 is a schematic diagram illustrating an exemplary medical service system 200 according to some embodiments of the present disclosure.
  • the medical service system 200 may include a processing device 210, a network 220, a storage device 230, one or more medical service devices 240, one or more sensing devices 250, one or more patient terminal devices 260 of a patient 261, and one or more doctor terminal devices 270 of a doctor 271 associated with the patient 261.
  • components in the medical service system 200 may be connected to and/or communicate with each other via a wireless connection, a wired connection, or a combination thereof.
  • the connection between the components of the medical service system 200 may be variable.
  • the processing device 210 may process data and/or information obtained from the storage device 230, the medical service device (s) 240, the sensing device (s) 250, the patient terminal device (s) 260, and/or the doctor terminal device (s) 270.
  • the processing device 210 may provide user services to the patient 261 and the doctor 271 via the patient terminal device (s) 260 and/or the doctor terminal device (s) 270, respectively.
  • the processing device 210 may be a single server or a server group.
  • the server group may be centralized or distributed.
  • the processing device 210 may be local to or remote from the medical service system 200.
  • the processing device 210 may be implemented on a cloud platform.
  • the cloud platform may include a private cloud, a public cloud, a hybrid cloud, a community cloud, a distributed cloud, an inter-cloud, a multi-cloud, or the like, or a combination thereof.
  • the processing device 210 may include one or more processors (e.g., single-core processor (s) or multi-core processor (s) ) .
  • processors e.g., single-core processor (s) or multi-core processor (s)
  • s single-core processor
  • s multi-core processor
  • the medical service system 200 in the present disclosure may also include multiple processing devices.
  • operations and/or method steps that are performed by one processing device 210 as described in the present disclosure may also be jointly or separately performed by the multiple processing devices.
  • the network 220 may include any suitable network that can facilitate the exchange of information and/or data for the medical service system 200.
  • the network 220 may be or include a wired network, a wireless network (e.g., an 802.11 network, a Wi-Fi network) , a Bluetooth TM network, a near field communication (NFC) network, or the like, or any combination thereof.
  • a wireless network e.g., an 802.11 network, a Wi-Fi network
  • Bluetooth TM network e.g., Bluetooth TM network
  • NFC near field communication
  • the storage device 230 may store data, instructions, and/or any other information. In some embodiments, the storage device 230 may store data obtained from other components of the medical service system 200. In some embodiments, the storage device 230 may store data and/or instructions that the processing device 210 may execute or use to perform exemplary methods described in the present disclosure.
  • the data stored in the storage device 230 may include multimodal data.
  • the multimodal data may include data in multiple forms (e.g., images, graphics, video, text, etc. ) , data of various types, data obtained from different sources, data relating to different medical businesses (e.g., diagnosis, surgery, rehabilitation, etc. ) , data relating to different users (e.g., the patients, the medical staff, managers, etc. ) .
  • the data stored in the storage device 230 may include medical data of the patient 261 reflecting a health condition of the patient 261.
  • the medical data may include an electronic health record of the patient 261.
  • the electronic health record refers to an electronic file that records various types of patient data (e.g., basic information, examination data, imaging data) .
  • the electronic health record may include three-dimensional models of a plurality of organs and/or tissues of the patient 261.
  • the storage device 230 may include a mass storage device, a removable storage device, a volatile read-and-write memory, a read-only memory (ROM) , or the like, or any combination thereof.
  • the storage device 230 may include a data lake and a data warehouse, which will be described in detail in connection with FIG. 3.
  • the medical service device (s) 240 may be used to provide or assist medical services. As shown in FIG. 2, the medical service device (s) 240 include a consultation room terminal 240-1, a hospital bed 240-2, an intelligent surgery terminal 240-3, an intelligent nursing trolley 240-4, an intelligent wheelchair 240-5, or the like, or any combination thereof.
  • the consultation room terminal 240-1 refers to a terminal device configured in a consultation room for use by doctors and patients in a medical consultation process.
  • the consultation room terminal 240-1 may include one or more of a screen, a sound output component, an image sensor, or an acoustic sensor.
  • the screen of the consultation room terminal 240-1 may present a consultation interface, and data may be presented on the consultation interface for facilitating the communication between patients and doctors.
  • Exemplary data may include an electronic health record (or a portion thereof) , a pre-consultation record, a medical image, a 3D organ model, an examination result, a decision recommendation, etc.
  • the hospital bed 240-2 refers to a bed in a hospital ward that can support a patient admitted to the hospital ward and provide user services to the patient.
  • the hospital bed 240-2 may include a bed, a bedside terminal device, a bedside examination device, sensors, or the like, or any combination thereof.
  • the bedside terminal device may include an XR device, a display device, a mobile device, or the like, or any combination thereof.
  • the hospital bed 240-2 may be controlled by an intelligent agent corresponding to hospitalization services, wherein such a hospital bed may be also referred to as an intelligent hospital bed or a meta-hospital bed.
  • the intelligent surgery terminal 240-3 refers to a device configured for assisting surgeries and controlled by an intelligent agent corresponding to the surgery service.
  • the intelligent surgery terminal 240-3 may perceive interactions (e.g., conversation, behavior, etc. ) between the medical service providers, the patients, and the intelligent agent, and obtain data captured by the sensing device (s) 250, so as to provide surgery assistance.
  • the intelligent surgery terminal 240-3 may be configured to perform risk warnings of surgical operations, generate surgical records for the surgery procedure, etc., based on the intelligent agent configured therein.
  • the intelligent nursing trolley 240-4 refers to a nursing trolley that has an automatic driving function and can assist in patient treatment and care.
  • the intelligent nursing trolley 240-4 may be configured to guide a nurse to the hospital ward to perform an initial examination on the patient.
  • the intelligent nursing trolley can be controlled by an intelligent agent (e.g., an intelligent agent corresponding to the hospitalization services, a nursing intelligent agent) .
  • the intelligent nursing trolley 240-4 may include a trolley, a presentation device, one or more examination devices and/or nursing tools, sensors (e.g., an image sensor, a GPS sensor, an acoustic sensor, etc. ) , etc.
  • the intelligent nursing trolley 240-4 may be configured to obtain relevant treatment and care information of the patient and generate measurement data, nursing data, etc.
  • the measurement data may include vital signs data of the patient.
  • the nursing data may include a detailed record of a nursing operation, such as a nursing time, a nursing operator, nursing measures, patient responses, etc.
  • the intelligent wheelchair 240-5 refers to a transport device for intelligently picking up and dropping off the patients.
  • the intelligent wheelchair 240-5 may be configured to perform autonomous navigation through integrated sensors and maps, locate a location of a patient using a radio frequency identification device (RFID) , Bluetooth, or Wi-Fi signals, identify the patient through biometric technology.
  • RFID radio frequency identification
  • the intelligent wheelchair 240-5 may be controlled by an intelligent agent (e.g., an intelligent agent corresponding to the hospitalization services, an intelligent agent corresponding to the surgery services) .
  • the intelligent wheelchair 240-5 may be configured to generate data (e.g., records of interaction content between the intelligent agent and the patients) by sensing interaction data through built-in cameras/sensors.
  • the sensing device (s) 250 may be configured to collect sensed information relating to the environment where it is located.
  • the sensing device (s) 250 may include sensing device (s) in the physical hospital 110.
  • the sensing device (s) 250 may include an image sensor 250-1, an acoustic sensor, 250-2, a temperature sensor, a humidity sensor, etc.
  • the patient terminal device (s) 260 may be a terminal device that interacts with the patient 261.
  • the patient terminal device (s) 260 may include a mobile terminal 260-1, an XR device 260-2, a smart wearable device 260-3, etc.
  • the doctor terminal device (s) 270 may be a terminal device that interacts with the doctor 271.
  • the doctor terminal device (s) 270 may include a mobile terminal 270-1, an XR device 270-2, etc.
  • the patient 261 may access the user space application (e.g., the patient space application) through a patient terminal device 260
  • the doctor 271 may access the user space application (e.g., the doctor space application) through a doctor terminal device 270.
  • the patient 261 and the doctor 271 may communicate with each other remotely via a patient terminal device 260 and a doctor terminal device 270, so as to provide remote medical services, such as remote consultation service, remote ward round service, remote follow-up service, etc.
  • remote medical services such as remote consultation service, remote ward round service, remote follow-up service, etc.
  • the sensing device (s) 250, the patient terminal device (s) 260, and the doctor terminal device (s) 270 may be configured as data sources to provide information for the medical service system 200. For example, these devices may transmit collected data to the processing device 210, and the processing device 210 may provide user services based on the received data.
  • the medical service system 200 may include one or more additional components, such as terminal devices of other users, public terminal devices of the hospital, etc.
  • two or more components of the medical service system 200 may be integrated into a single component.
  • FIG. 3 is a schematic diagram illustrating an exemplary hospital support platform 300 according to some embodiments of the present disclosure.
  • the hospital support platform 300 may include a hardware layer 310 (also referred to as a hardware module) , an interface layer 320 (also referred to as an interface module) , a data processing layer 330 (also referred to as a data processing module) , an application development layer 340 (also referred to as an application development module) , and a service layer 350 (also referred to as a service module) .
  • a hardware layer 310 also referred to as a hardware module
  • an interface layer 320 also referred to as an interface module
  • a data processing layer 330 also referred to as a data processing module
  • an application development layer 340 also referred to as an application development module
  • service layer 350 also referred to as a service module
  • the hardware layer 310 may be configured to provide a hardware foundation for the interaction between a real world and a digital world, and may include one or more hardware devices related to hospital operation.
  • An exemplary hardware device may include a medical service device, a sensing device, a terminal device, and a basic device.
  • the interface layer 320 may be connected with the hardware layer 310 and the data processing layer 330.
  • the interface layer 320 may be configured to obtain the data collected by the hardware devices of the hardware layer 310 and send the data to the data processing layer 330 for storage and/or processing.
  • the interface layer 320 may also be configured to control at least a portion of the hardware devices of the hardware layer 310.
  • the interface layer 320 may include hardware interfaces and software interfaces (e.g., data interface, control interface) .
  • the data processing layer 330 may be configured to store and/or process data.
  • the data processing layer 330 may include a processing device, and multiple data processing units may be configured on the processing device.
  • the data processing layer 330 may be configured to obtain data from the interface layer 320 and process the data via at least one of the data processing units to implement user services related to the hospital business.
  • the data processing units may include various preset algorithms for implementing data processing.
  • the data processing layer 330 may include a processing device (e.g., the processing device 220 in FIG. 2) .
  • the data processing units may be configured on the processing device.
  • the data processing units may include XR units configured to process data using XR technologies to achieve XR services, AI units (e.g., intelligent agent units) configured to process the data using AI technologies to achieve AI services, digital twin units configured to process the data using digital twin technologies to achieve digital twin service, data circulation units configured to process the data using data circulation technologies (e.g., blockchain technologies, data privacy computing technologies) to achieve data circulation services, etc.
  • AI units e.g., intelligent agent units
  • digital twin units configured to process the data using digital twin technologies to achieve digital twin service
  • data circulation units configured to process the data using data circulation technologies (e.g., blockchain technologies, data privacy computing technologies) to achieve data circulation services, etc.
  • the data processing layer 330 may also include a data center configured to store data.
  • the data center may adopt a lake-warehouse integrated architecture, which may include a data lake and a data warehouse.
  • the data lake may be used to persistently store massive data in a tamper-proof manner.
  • the data warehouse may be used to store index data corresponding to the data in the data lake.
  • the data stored in the data lake may include native (or raw) data collected by the hardware devices, derived data generated based on the native data, etc.
  • the data in the data lakehouse may be processed by a processing device (e.g., the processing device 210) .
  • the application development layer 340 may be configured to support application development, publishing, subscription, etc.
  • the application development layer 340 is also referred to as an ecological suite layer.
  • the application development layer 340 may be configured to provide open interfaces for application developers to access or invoke at least a portion of the data processing units and utilize the at least a portion of the data processing units to develop applications.
  • the application development layer 340 may provide a development toolkit, an application marketplace, a multi-tenant operation platform, a cloud official website, a workspace, and other support kits to assist the developers in their work.
  • the service layer 350 may be configured for relevant users of the hospital business to access the user services relating to the hospital business via user space applications.
  • the present disclosure provides a hospital support platform designed for the comprehensive management of various resources within a hospital, including hardware resources, software resources, and data resources.
  • the platform further incorporates data processing units capable of supporting advanced technologies, such as AI, XR, digital twin, and blockchain.
  • advanced technologies are harnessed to enhance service efficiency and quality within the healthcare industry.
  • AI technologies enable autonomous evolution and continuous optimization of hospital operations
  • XR and digital twin technologies facilitate the creation and maintenance of a virtual hospital.
  • This virtual hospital can engage with users, offering an immersive and novel service experience.
  • the platform includes an application development layer that grants access to these advanced technologies to third-party developers within the healthcare industry. This access fosters an open ecosystem that promotes application development and innovation, thereby driving advancements in healthcare services.
  • FIG. 4 is a schematic diagram illustrating an exemplary system for hospital management 400 (also referred to as hospital management system 400) according to some embodiments of the present disclosure.
  • the hospital management system 400 may include a user 410, an interface 420, and resources 430 of a hospital.
  • the user 410 may manage the resources 430 of the hospital via the interface 420.
  • the user 410 may include a manager of the hospital such as a director of the hospital, a superintendent of a hospital department (e.g., a stomatology department, an internal medicine department, etc. ) of the hospital, a head nurse of a hospital department, or the like.
  • the resources 430 of the hospital may include devices, personnel, digital twins, digital intelligent resources (e.g., intelligent agents) , or the like, or any combination thereof.
  • different users 410 may have different administrative permissions with respect to different resources 430.
  • a specific user 410 only manages specific resources 430.
  • the director of the hospital may manage all resources 430 of the hospital.
  • the superintendent of the stomatology department only manages resources 430 relating to the stomatology department.
  • the interface 420 may be presented by a display of a terminal device of a manger.
  • the display may include a light-emitting diode (LED) display, a liquid crystal display screen, an electronic ink display screen, a touch LCD, an organic LED touch, or the like, or any combination thereof.
  • the terminal device may include a mobile device, an XR device, a smart wearable device, etc.
  • the interface 420 may be an interface presented by a manager space application. More descriptions regarding the terminal device and the manager space application may be found elsewhere in the present disclosure. See, e.g., FIG. 1 and relevant descriptions thereof.
  • the interface 420 may be configured to present a virtual character that is used to assist the user 410 in managing the resources.
  • a virtual character refers to a digital representation of a human or other entity created using computer graphics and artificial intelligence.
  • the virtual character may be configured to communicate with the user 410.
  • the interface 420 may be also configured to present an interface element for the user 410 to initiate a communication session with the virtual character.
  • the user 410 may initiate a communication session with the virtual character via the interface element to express his/her resource management requirements (e.g., view information relating to a specific type of resource, schedule the specific type of resource, update relevant parameters of the specific type of resources) via voices, text, gestures, etc.
  • a processing device e.g., the processing device 220
  • may analyze the users’ input e.g., using AI techniques, using intelligent agents
  • determine feedback information e.g., using intelligent agents
  • the content displayed via the interface 420 may be updated according to the communication content of the communication session.
  • FIG. 5 is a schematic diagram illustrating an exemplary interface 420 according to some embodiments of the present disclosure.
  • the interface 420 may include a search region 421 and a result display region 422.
  • the search region 421 may be used to search for information in managing the resources 430.
  • the search region 421 may present a search box for inputting information (e.g., text information) .
  • the search region 421 may present a virtual character 4221.
  • the virtual character 4221 may communicate with the user 410, for example, the virtual character 4221 may simulate human speech expressions, gestures, etc., providing the user 410 with a realistic communication experience.
  • the search region 4221 may present an interface element 4222 for the user 410 to initiate a communication session with the virtual character 4221.
  • the user 410 may interact with the virtual character 4221 via voice or text using natural language.
  • the result display region 422 may be configured to present information, for example, feedback information provided to the user 410 in the communication session. For example, as shown in FIG. 5, the communication content of the communication session between the user 410 and the virtual character 4221 indicates that the user 410 needs to obtain data relating to inpatient wards.
  • the result display region 422 may automatically present digital twin view corresponding to inpatient wards and inpatient operation data analysis result.
  • the content displayed via the result display region 422 may be updated according to the information input into the search box. In some embodiments, the content displayed via the result display region 422 may be updated according to the communication content of the communication session.
  • the search region 421 and the result display region 422 may be displayed on the interface 420 at the same time. Alternatively, the search region 421 and the result display region 422 may be displayed separately on the interface 420. For example, when the user 410 queries for information, the interface 420 only presents the search region 421. After the query is completed, the interface 420 only presents the result display region 422.
  • the interface 420 may also present interface elements corresponding to commonly used services. Since different users 410 can access different information, the interface elements corresponding to commonly used services displayed for different users 410 may be different.
  • interfaces in conventional hospital management systems are limited to providing users with predefined analysis results.
  • the interface of the hospital management systems described in the present disclosure enables users to retrieve data across various dimensions. Additionally, the inclusion of a virtual character permits users to articulate their requirements in natural language, thereby enhancing the user interaction experience and improving the quality and efficiency of resource management services.
  • the resources 430 of the hospital include digital twins 431.
  • the digital twins may map the status of corresponding physical entities and are generated according to a predefined data structure.
  • a digital twin refers to a virtual representation (or referred to as a digital copy) of a physical entity.
  • a physical entity refers to any object or phenomenon that exists in the physical world and can be observed, measured, or interacted with directly or indirectly.
  • FIG. 4 shows that as shown in FIG.
  • the physical entities corresponding to the digital twins 431 may include user services (e.g., medical services) , users, hardware devices (e.g., medical service devices, sensing devices) , public areas, medical service procedures (e.g., a consultation procedure, a hospitalization procedure, a surgery procedure) of the hospital, or the like, or any combination thereof.
  • the users may include a patient or a portion of the patient (e.g., an organ) , a medical service provider (e.g., a doctor, a nurse) , etc.
  • the predefined data structure of a digital twin may specify the format of the digital twin, the type of information reflected by the digital twin, the storage address of the digital twin, the access permission of the digital twin, the updating mode of the digital twin, the modification permission of the digital twin, the modification permission of the predefined data structure, or the like, or any combination thereof.
  • the predefined data structure may be a default data structure provided by the hospital or a customized data structure set by the user 410 via the interface 420.
  • the digital twin corresponding to a physical entity may be represented in any form that accurately depicts the physical entity, such as a model, an image, text, or numerical data (e.g., parameters) .
  • a digital twin corresponding to a patient’s organ may be represented using a 3D model of the organ.
  • a digital twin corresponding to a display device may be represented using various parameters of the display device.
  • the digital twins 431 may include one or more first digital twins.
  • the mapping the status of a corresponding physical entity may include that the first digital twin is updated based on an update of the status of the corresponding physical entity.
  • Exemplary first digital twins may include a digital twin corresponding to a public area in the hospital, a digital twin corresponding to a medical service, a digital twin corresponding to a user (e.g., a patient, an organ of the patient, a doctor) , a digital twin corresponding to a hardware device of the hospital, or the like.
  • the digital twins may include one or more second digital twins.
  • the mapping the status of a corresponding physical entity may include that the corresponding physical entity is updated based on an update of the second digital twin.
  • Exemplary second digital twins may include a digital twin corresponding to a hardware device, a digital twin corresponding to a user service, a digital twin corresponding to a medical service procedure, or the like.
  • a digital twin can be both a first digital twin and a second digital twin. More descriptions regarding the digital twins may be found elsewhere in the present disclosure (e.g., FIG. 6 and the descriptions thereof) .
  • the user 410 may manage the digital twins 431 via the interface 420. Since the digital twins map the status of the corresponding physical entities, the physical entities of the hospital can be managed via managing the digital twins 431.
  • the user 410 may view a first digital twin of a physical entity (e.g., a 3D digital twin model of a patient’s organ or a hardware device, a digital twin view of a public area) via the interface 420 to understood and evaluate the status of the physical entity.
  • the user may change the display angle, the display size, etc., of the displayed first digital twin. Exemplary digital twins displayed on the interface 420 may be shown in FIGs. 7A-7F or FIGs. 8A-8F.
  • the user 410 may input an updating instruction of a second digital twin via the interface 420 to update the status of the corresponding physical entity.
  • the resources 430 of the hospital include digital intelligent resources of the hospital.
  • Digital intelligent resources can encompass various types of digital assets and tools enhanced by artificial intelligence (AI) to support and improve different aspects of digital operations, learning, and management.
  • AI artificial intelligence
  • the digital intelligent resources may include intelligent agents 432.
  • an intelligent agent refers to an agent that carries out tasks on behalf of users with some degree of autonomy and intelligence.
  • the intelligent agents may include software entities built based on artificial intelligence algorithms.
  • Artificial intelligence algorithms include a machine learning algorithm (e.g., a supervised learning algorithm, a reinforcement learning algorithm, etc. ) , a deep learning algorithm (e.g., a neural network algorithm, etc. ) , an evolutionary algorithm, an ensemble learning algorithm, or the like, or any combination thereof.
  • at least a portion of the intelligent agents may be further built based on natural language processing algorithms.
  • Exemplary natural language processing algorithms may include a language modeling algorithm, a text preprocessing algorithm, a text classification and sentiment analysis algorithm, a sequence labeling algorithm, a named entity recognition (NER) algorithm, a machine translation algorithm, or the like, or any combination thereof.
  • NER named entity recognition
  • an intelligent agent may be represented by a virtual character, and a user may communicate with the virtual character via voices, text, gestures, etc., using natural language. Accordingly, the intelligent agent needs to be built based on natural language processing algorithms to understand and analyze the users’ input, determine feedback information, and communicate the feedback information to the user via the virtual character.
  • the intelligent agents may include embodied intelligence agents.
  • an embodied intelligence agent refers to an intelligent agent that leverages its physical body and sensory-motor capabilities to interact with and adapt to its environment.
  • nursing care devices of the hospital may include embodied intelligence agents such as a patient-care robot, an intelligent nursing trolley, etc.
  • the patient-care robot may include sensors, a robot arm, an actuator, a user interface, or the like, or any combination thereof.
  • the patient-care robot may provide nursing care services such as assisting the patient to drink, eat, or take medicines.
  • the intelligent nursing trolley may have autonomous driving functions and be able to move to different positions in the hospital.
  • the intelligent nursing trolley may be configured to guide a nurse to the hospital ward to perform an examination or a nursing operation on the patient.
  • the intelligent nursing trolley may be configured to present guidance information to guide the nurse to perform the examination or the nursing operation.
  • the intelligent nursing trolley may include one or more examination devices and/or nursing tools for the nurse to use to perform the examination and/or the nursing operation.
  • the user 410 may manage the intelligent agents 432 via the interface 420. For example, the user 410 may view and modify information relating to the intelligent agents via the interface 420. Since the intelligent agents 432 are engaged in processing data to achieve user services, the user services may be managed via managing the intelligent agents 432.
  • the interface 420 may present essential data used by at least a portion of the intelligent agents.
  • the essential data may be updatable by the user 410 via the interface 420.
  • the essential data includes information that is critical for an intelligent agent to rely on in providing a specific service.
  • Exemplary essential data may include at least one of a dictionary (e.g., a word list, a personnel directory) , a knowledge database, or a template.
  • the essential data may include a dictionary of departments of the hospital, a personnel dictionary including doctors of each department of the hospital, etc.
  • the essential data may include a consultation report template, etc.
  • knowledge database may include a knowledge graph.
  • knowledge database may include specifications of the corresponding department of the intelligent agent, such as disease description specifications, diagnosis specifications, prescription specifications, specifications of doctor's order, etc.
  • the interface 420 may present operating indicators of the at least a portion of the intelligent agents.
  • the operating indicators may reflect information relating to the quantity and quality of services provided by the intelligent agent.
  • the operating indicators of an intelligent agent may include a number of users served by the intelligent agent, a number of services provided by the intelligent agent, an amount of data processed by the intelligent agent, service quality of the intelligent agent, or the like, or any combination thereof.
  • FIG. 11 is a schematic diagram illustrating an exemplary interface 420 for presenting information relating to an intelligent agent according to some embodiments of the present disclosure.
  • the interface 420 may include a first display region 423 and a second display region 424.
  • the first display region 423 may be configured present the essential data used by the intelligent agent.
  • the essential data include a dictionary, a knowledge database, a template, etc.
  • the user 410 may modify the essential data via the first display region 423 to adjust the intelligent agent.
  • the user 410 may modify the consultation report template to direct the intelligent agent output a consultation report according to the modified consultation report template.
  • the second display region 424 be configured present operating indicators of the intelligent agent.
  • the operating indicators of the intelligent agent include a number of users served by the intelligent agent, a number of services provided by the intelligent agent, an amount of data processed by the intelligent agent, service quality of the intelligent agent, etc.
  • the first display region 423 and the second display region 424 may be displayed on the interface 420 at the same time. Alternatively, the first display region 423 and the second display region 424 may be displayed separately on the interface 420.
  • the intelligent agents include intelligent agents corresponding to different types of medical service providers.
  • the intelligent agent corresponding to a medical service provider may replace or assist the medical service provider to carries out tasks.
  • an intelligent agent corresponding to a doctor may replace or assist the doctor to provide a consultation service.
  • the medical service providers may include a doctor, a nurse, etc.
  • exemplary intelligent agents corresponding to the doctor may be shown in Table 1 below.
  • Table 1 Exemplary intelligent agents corresponding to a doctor
  • the intelligent agents may interact with the user 410 through a corresponding terminal device.
  • the intelligent agents may receive inputs of the user 410 from the terminal device and provide feedback for the terminal device to display.
  • the intelligent agent may be represented as a virtual digital character on the corresponding terminal device to communicate with the user 410.
  • exemplary intelligent agents corresponding to the nurse may be shown in Table 2 below.
  • Table 2 Exemplary intelligent agents corresponding to a nurse
  • the intelligent agents may include intelligent agents corresponding to different hospital departments.
  • the hospital departments may include any department of the hospital such as an emergency department, an internal medicine department, a stomatology department, etc.
  • An intelligent agent corresponding to a hospital department may be configured to perform some tasks relating to the hospital department.
  • the intelligent agents may include intelligent agents corresponding to different medical service procedures.
  • the intelligent agents may include at least one of a consultation intelligent agent, a hospitalization intelligent agent, or a surgery intelligent agent.
  • An intelligent agent corresponding to a medical service procedure may be configured to perform some tasks relating to the medical service procedure.
  • the intelligent agent corresponding to the medical service procedure may be configured for monitoring updates in data relating to a patient following the medical service procedure. More descriptions regarding the monitoring updates in data relating to the patient via the intelligent agent corresponding to the medical service procedure may be found elsewhere in the present disclosure (e.g., FIG. 12 and the descriptions thereof) .
  • the intelligent agents may include intelligent agents corresponding to different user services.
  • the user services may include user services provided to a patient, user services provided to a doctor, etc.
  • the user services may relate to different stages in different medical service procedure.
  • the user services provided to the patient may be accessible from a patient space application installed in a patient terminal.
  • the user services provided to the doctor may be accessible from a doctor space application in a doctor terminal.
  • An intelligent agent corresponding to a user service may be configured to perform some tasks relating to the user service.
  • the user service may relate to a stage in a medical service procedure
  • the intelligent agent corresponding to the user service may be configured for processing data relating to a patient at the stage in the medical service procedure, and providing the user service to relevant users of the stage based on a processing result of the data. More descriptions regarding the providing the user service to relevant users based on the data relating to the patient via the intelligent agent corresponding to the user service may be found elsewhere in the present disclosure (e.g., FIG. 13 and the descriptions thereof) .
  • different training data and training objectives are used to generate intelligent agents corresponding to different hospital departments, different medical service procedures, and different user services.
  • a specific intelligent agent can achieve self-optimization and evolution to better handle the corresponding task by continuously learning from specific data (e.g., data from a specific hospital department, data from a specific medical service procedure, data from a specific user service, etc. ) .
  • the configuration of various intelligent agents in the hospital can be customized, which may enhance the adaptability and application scope of the intelligent agents, thereby significantly improving the accuracy and efficiency of the user services supported by the intelligent agents, while also enhancing the patient treatment experience.
  • the hospital management system 400 may further comprise a processing device.
  • the processing device may process data and/or information obtained from the hospital management system 400.
  • the processing device may receive information and/or instructions input by the user 410 through the interface 420, and provide corresponding feedback after processing the information and instructions.
  • the processing device may receive updating information relating to a digital twin corresponding to a hardware device from a manager terminal that presents the interface 420, and control the hardware device to update its configuration based on the updating information.
  • the processing device may receive updating information relating to an intelligent agent input via the interface 420, and control the intelligent agent to perform specific operations.
  • FIG. 6 is a schematic diagram illustrating exemplary digital twins 431 according to some embodiments of the present disclosure.
  • the digital twins include one or more first digital twins 4311.
  • the mapping the status of a corresponding physical entity may include that the first digital twin 4311 is updated based on an update of the status of the corresponding physical entity.
  • the one or more first digital twins 4311 may include a digital twin corresponding to a public area in the hospital. When the status of the public area updates, the first digital twin corresponding to the public area may be updated.
  • the update of the status of the corresponding physical entity may be detected based on real-time information of the corresponding physical entity.
  • an intelligent agent or a machine learning model may be used to process the real-time information of the corresponding physical entity to determine whether the status of the corresponding physical entity is updated.
  • the intelligent agent or the machine learning model may further process historical data of the corresponding physical entity to detect the status update.
  • the real-time information of the corresponding physical entity may include information collected by hardware devices relating to the hospital, including one or more of sensing devices, user terminals, medical service devices, etc.
  • the sensing devices may include an image senor, an acoustic sensor, a temperature sensor, a humidity sensor, a particle sensor, or the like, or any combination thereof.
  • the user terminals may include patient terminals, doctor terminals, manager terminals, or public terminals in the hospital.
  • the medical service devices may include medical imaging devices, examination devices, etc. More descriptions regarding the hardware devices may be found elsewhere in the present disclosure. See, e.g., FIG. 1 and relevant descriptions thereof.
  • the real-time information may be collected by the corresponding physical entity itself.
  • the real-time information of the check-in area may include patient flow data collected by image sensors in the check-in area, patient check-in information collected by check-in terminal devices.
  • the update of the status of the check-in area may be detected based on the patient flow data and the patient check-in information.
  • the one or more first digital twins may include a digital twin corresponding to a public area in the hospital.
  • Public area monitoring may be achieved based on the digital twin corresponding to the public area in the hospital.
  • Exemplary public areas may include a check-in area, a waiting room, a consultation area, a consultation room, an operating area, an operating room, or the like, or any combination thereof.
  • the digital twin corresponding to the public area may reflect a digital twin view of the public area, which is generated based on the real-time information of the public area. The digital twin view may be used to monitor, analyze, and predict performance and operations of the public area in real-time, which may provide insights into the current state of the public area.
  • the digital twin view of the public area may present a real-time 3D map of the public area and monitoring indicators of the public area.
  • the monitoring indicators may include monitoring indicators relating to users in the public area, monitoring indicators relating to events in the public area, monitoring indicators relating to devices in the public area, or the like, or any combination thereof.
  • FIG. 7A is a schematic diagram illustrating an exemplary digital twin view of a check-in area according to some embodiments of the present disclosure.
  • the digital twin view of the check-in area may present a real-time 3D map of the check-in area, a monitoring indicator relating to the patient flow in the check-in area, a monitoring indicator relating to the check-in device in the check-in area, etc.
  • FIG. 7B is a schematic diagram illustrating an exemplary digital twin view of a waiting room according to some embodiments of the present disclosure.
  • the digital twin view of the waiting room may present a real-time 3D map of the waiting room, a monitoring indicator relating to waiting patient status of patients in the waiting room, a monitoring indicator relating to events in the waiting room, a monitoring indicator relating to an environmental status of the waiting room, etc.
  • FIG. 7C is a schematic diagram illustrating an exemplary digital twin view of a consultation area according to some embodiments of the present disclosure.
  • the digital twin view of the consultation area may present a real-time 3D map of the consultation area, a monitoring indicator relating to a medical worker schedule of the consultation area, a monitoring indicator relating to status (e.g., a use status or an idle status) of consultation rooms in the consultation area, a monitoring indicator relating to hardware and software materials of the consultation area, and consultation room windows, etc.
  • a consultation room window is clicked, a digital twin view of a corresponding consultation room may be presented.
  • FIG. 7D is a schematic diagram illustrating an exemplary digital twin view of a consultation room of the consultation area in FIG. 7C according to some embodiments of the present disclosure.
  • the digital twin view of the consultation room may present a real-time 3D map of the consultation room, a monitoring indicator relating to events in the consultation room, a monitoring indicator relating to diagnosis and treatment condition in the consultation room, a monitoring indicator relating to hardware and software materials of the consultation room, etc.
  • FIG. 7E is a schematic diagram illustrating an exemplary digital twin view of an operating area according to some embodiments of the present disclosure.
  • the digital twin view of the operating area may present a real-time 3D map of the operating area, a monitoring indicator relating to personnel in the operating area, a monitoring indicator relating to a surgery schedule, a monitoring indicator relating to events in the operating area, a monitoring indicator relating to status (e.g., a use status or an idle status) of operating rooms in the operating area, a monitoring indicator relating to hardware and software materials of the operating area, operating room windows, etc.
  • a digital twin view of a corresponding operating room may be presented.
  • FIG. 7F is a schematic diagram illustrating an exemplary digital twin view of an operating room of the operating area in FIG. 7E according to some embodiments of the present disclosure.
  • the digital twin view of the operating room may present a real-time 3D map of the operating room, a monitoring indicator relating to a surgery in the operating room, a monitoring indicator relating to hardware and software materials of the operating room, a monitoring indicator relating to medical images collected in the operating room, a monitoring indicator relating to events (e.g., an online consultation) in the operating room.
  • the real-time status of the public area can be monitored, and the department managers may be empowered to precisely control and optimize medical resource allocation.
  • the one or more first digital twins may include a digital twin corresponding to a medical service.
  • the digital twin corresponding to the medical service may be used to perform a medical service evaluation on the medical service.
  • the digital twin corresponding to the medical service may reflect operating indicators of the medical service, which are used to evaluate quality, efficiency, profit, etc., of the medical service.
  • the medical service may include an out-patient registration service, a treatment and nursing service, a daily surgery operation service, a medical consultation service, a hospitalization service, a department surgery service, or the like, or any combination thereof.
  • FIG. 8A is a schematic diagram illustrating an exemplary digital twin corresponding to an out-patient registration service according to some embodiments of the present disclosure.
  • the digital twin corresponding to the out-patient registration service may reflect operating indicators of the out-patient registration service.
  • Exemplary operating indicators of the out-patient registration service may include an online registration rate (e.g., 50%) , a heat map of appointment time period, a registration time distribution, or the like, or any combination thereof.
  • FIG. 8B is a schematic diagram illustrating an exemplary digital twin corresponding to a treatment and nursing service according to some embodiments of the present disclosure.
  • the digital twin corresponding to the treatment and nursing service may reflect operating indicators of the treatment and nursing service.
  • Exemplary operating indicators of the treatment and nursing service may include an operation compliance rate (e.g., 80%) , a document compliance rate (e.g., 64%) , a document scoring ranking, document scoring details, or the like, or any combination thereof.
  • FIG. 8C is a schematic diagram illustrating an exemplary digital twin corresponding to a daily surgery operation service according to some embodiments of the present disclosure.
  • the digital twin corresponding to the daily surgery operation service may reflect operating indicators of the daily surgery operation service.
  • Exemplary operating indicators of the daily surgery operation service may include a distribution of surgical levels, a delayed surgery rate (e.g., 14%) , a surgical safety score compliance rate (e.g., 87%) , personnel with unsatisfactory safety scores, or the like, or any combination thereof.
  • FIG. 8D is a schematic diagram illustrating an exemplary digital twin corresponding to a medical consultation service according to some embodiments of the present disclosure.
  • the digital twin corresponding to the medical consultation service may reflect operating indicators of the medical consultation service.
  • Exemplary operating indicators of the medical consultation service may include a medical quality, an operational efficiency, a service quality, or the like, or any combination thereof.
  • the medical quality may include high-risk data (e.g., a diagnosis rate (e.g., 27%) , a treatment rate (e.g., 50%) ) , a critical data trend, a prescription data trend, or the like, or any combination thereof.
  • the operational efficiency may include cost and revenue, comprehensive benefits of device, business volume, doctor workload, or the like, or any combination thereof.
  • the service quality may include patient service data, patient satisfaction, increase in consultation costs (e.g., 15%) , increase in drug costs (e.g., 4%) , or the like, or any combination thereof.
  • FIG. 8E is a schematic diagram illustrating an exemplary digital twin corresponding to a hospitalization service according to some embodiments of the present disclosure.
  • the digital twin corresponding to the hospitalization service may reflect operating indicators of the hospitalization service.
  • Exemplary operating indicators of the hospitalization service may include a service capability, a safety and quality, an operational efficiency, a quality of drug use, or the like, or any combination thereof.
  • the operational efficiency may include a diagnosis related groups (DRG) cost index, a DRG time index, an income and expense, or the like, or any combination thereof.
  • the quality of drug use may include an intensity of antimicrobial use, a drug use review and supervision, a quality of nursing (e.g., high-quality nursing, an average nursing time, etc. ) , or the like, or any combination thereof.
  • FIG. 8F is a schematic diagram illustrating an exemplary digital twin corresponding to a department surgery service according to some embodiments of the present disclosure.
  • the digital twin corresponding to the department surgery service may reflect operating indicators of the department surgery service.
  • Exemplary operating indicators of the department surgery service may include a service capability, an anesthesia quality, a safety and quality of surgery, an operational efficiency, or the like, or any combination thereof.
  • the service capability may include a day surgery rate (e.g., 12%) , a level 4 surgery rate (e.g., 13%) , etc.
  • the anesthesia quality may include an unplanned reoperation rate, a PACU transfer-out delay rate, etc.
  • the safety and quality of surgery may include a mortality rate, an unplanned reoperation rate, a complication rate, etc.
  • the operational efficiency may include a surgery cancellation rate (e.g., 17%) , an operating room utilization rate (e.g., 85%) , income and expense, infection control, etc.
  • the operating indicators of the medical services illustrated in FIGs. 8A-8F are merely provided for illustration purposes, and can be replaced by any other operating indicators.
  • the operating indicators of the out-patient registration service may include a ratio of online registration to offline registration, the registration times of the offline and online registrations, etc.
  • the operating indicators of a medical service may be set by a corresponding manager.
  • a manager may interact with the interface 420 to request for other operating indicators.
  • managers can identify key issues during the medical services to promptly intervene in operations of the medical services and adjust strategies, thereby improving the quality of the management of the medical services.
  • the one or more first digital twins may include other digital twins that are updated based on the status update of the corresponding physical entities.
  • the first digital twin (s) may include a digital twin of a patient or the patient’ organ, which may be updated once new medical data (e.g., a new medical image, new examination data) of the patient is collected.
  • the first digital twin (s) may include a digital twin of a hardware device, which may be updated once the usage state, the operation parameters, etc., of the hardware device are updated.
  • the first digital twin for each of at least a portion of the one or more first digital twins, the first digital twin maybe be updated in a first manner in response to detecting that the update of the status of the corresponding physical entity is normal, and the first digital twin may be updated in a second manner in response to detecting that the update of the status of the corresponding physical entity is abnormal.
  • the update of the status of the corresponding physical entity usually meets certain regular, for example, the update time is smaller than a certain threshold.
  • the update time is smaller than a certain threshold.
  • a surgery room is in use and the status of the surgery room is not updated for more than a period of time, it indicates the update of the status of the surgery room is abnormal.
  • the updated status of the corresponding physical entity is an abnormal state
  • the update of the status of the corresponding physical entity is deemed as abnormal.
  • the first manner may be different from the second manner.
  • a first digital twin may be updated in different manners when the corresponding physical entity has an abnormal status change and a normal status change. For example, in response to detecting that the update of the status of the corresponding physical entity is normal, the first digital twin may show a first mark symbol (or a first color) ; in response to detecting that the update of the status of the corresponding physical entity is abnormal, the first digital twin may show a second mark symbol (or a second color) that are different from the first mark symbol (or the first color) .
  • the first digital twin in response to detecting that the update of the status of the corresponding physical entity is normal, the first digital twin does not show any mark symbol; in response to detecting that the update of the status of the corresponding physical entity is abnormal, the first digital twin may show a specific mark symbol. In this way, the first digital twin may be used for performing an abnormal monitor on the physical entities, to facilitate timely adjustment of the physical entities.
  • the digital twins 431 include one or more second digital twins 4312 that are updatable via the interface.
  • the mapping the status of a corresponding physical entity includes that the corresponding physical entity is updated based on an update of the second digital twin 4312.
  • a second digital twin 4312 may be used to update a configuration of the corresponding physical entity. Specifically, after the second digital twin is updated, a configuration of the corresponding physical entity may be updated based on the updated second digital twin.
  • the one or more second digital twins may include a digital twin corresponding to a hardware device, and the digital twin corresponding to the hardware device reflects parameters of the hardware device.
  • the second digital twin corresponding to the hardware device may be used to update/set parameters of the hardware device.
  • Exemplary hardware devices may include a public terminal device (e.g., a display device or an XR device) , an intelligent hospital bed, an intelligent nursing trolley, an intelligent surgery terminal, an intelligent mechanical nurse, etc.
  • the hardware device may include a display device that presents information relating to a medical service.
  • the digital twin corresponding to the hardware device may reflect display parameters of the display device, which can be set or update by the user 410 via the interface 430. For example, by updating the digital twin corresponding to the hardware device, the user 410 may adjust the display content of the display device.
  • FIG. 9A is a schematic diagram illustrating an exemplary display device in a waiting room according to some embodiments of the present disclosure.
  • the display device may present consultation room information (e.g., department of cardiology F4A consulting room 01) , a pre-consultation QR code, information relating to a doctor, information relating to a current consultation patient, information relating to patients waiting for consultation, etc.
  • FIG. 9B is a schematic diagram illustrating an exemplary display device in a consultation room according to some embodiments of the present disclosure.
  • the display device may present pre-consultation information, a consultation suggestion, an electronic health record, a remote accompanying service, etc.
  • FIG. 9A is a schematic diagram illustrating an exemplary display device in a waiting room according to some embodiments of the present disclosure.
  • the display device may present pre-consultation information, a consultation suggestion, an electronic health record, a remote accompanying service, etc.
  • FIG. 9C is a schematic diagram illustrating an exemplary display device in an inpatient ward according to some embodiments of the present disclosure.
  • the display device may present a daily schedule, intelligent agent services, home pages (e.g., a caring plan, a hospitalization consultation, a ward round of doctor, a visitation application, etc. ) .
  • FIG. 9D is a schematic diagram illustrating an exemplary display device in a surgery waiting area according to some embodiments of the present disclosure.
  • the display device may present a surgery notice (e.g., a surgery serial number, a surgery starting time, an operating room serial number, a patient name, a surgery doctor name, a surgery status, etc. ) , a waiting area monitoring, an AI information consulting window, etc.
  • a surgery notice e.g., a surgery serial number, a surgery starting time, an operating room serial number, a patient name, a surgery doctor name, a surgery status, etc.
  • the hospital management 400 may further comprise a processing device.
  • the processing device may receive updating information relating to the digital twin corresponding to the hardware device from a manager terminal that presents the interface. Further, the processing device may control the hardware device to update its configuration based on the updating information. More descriptions regarding the controlling the hardware device to update its configuration based on the updating information may be found elsewhere in the present disclosure (e.g., FIG. 10 and the descriptions thereof) .
  • the one or more second digital twins may include a digital twin corresponding to a user service, and the digital twin corresponding to the user service may reflect parameters of the user service.
  • the user service may be accessible from a patient space application installed in a patient terminal or a doctor space application in a doctor terminal.
  • the digital twin corresponding to the user service may be used to update/set parameters of the user service.
  • Exemplary parameters of the user service may include a way of providing the user service, requirements for users using the user service, content of the user service, or the like, or any combination thereof.
  • the updated digital twin may reflect updated parameters of the user service.
  • the updated parameters of the user service may be sent to the processing device. Further, the processing device may update parameters of the user service based on the updated parameters.
  • the one or more second digital twins may include a digital twin corresponding to a medical service procedure, and the digital twin corresponding to the medical service procedure reflects parameters of the medical service procedure.
  • the parameters of the medical service procedure may include a standard operating procedure (SOP) specifying standard stages in the medical service procedure.
  • SOP standard operating procedure
  • the SOP of a medical consultation procedure may include a registration stage, a waiting stage, and a consultation stage.
  • the SOP may further specify data acquisition protocols corresponding to the standard stages.
  • the data acquisition protocol corresponding to a standard stage may specify the type of data to be collected in the standard stage, the manner of data collection, or the like.
  • the SOP may delineate the medical service procedure into detailed standard stages, and the corresponding data acquisition protocols may identify potential data sources associated with each standard stage to the greatest extent feasible. Consequently, this approach enables the collection of more comprehensive, finer-grained, and real-time data pertaining to the medical service procedure. The amassed data can subsequently be utilized to evaluate various facets of the medical service procedure, thereby facilitating the optimization of performance and enhancing the overall efficiency of the hospital management system.
  • the second digital twin corresponding to the medical service procedure may be configured to update/set parameters of the medical service procedure.
  • the update of the parameters of the medical service procedure may be performed in a similar manner as that of the user service.
  • the digital twins may be instantiated utilizing data harvested from sensors and additional sources to dynamically model the corresponding real-world entities in real-time.
  • the digital twins may be deployed for monitoring, analysis, simulation, and control, thereby furnishing valuable insights which optimize performance and enhance the overall efficiency of the hospital management system.
  • FIG. 10 is a flowchart illustrating an exemplary process 1000 for updating configuration of a hardware device according to some embodiments of the present disclosure.
  • the process 1000 may be stored in a storage as a form of instructions, and invoked and/or executed by a processing device (e.g., the processing device 210) .
  • the processing device may receive updating information relating to the digital twin corresponding to the hardware device from a manager terminal that presents an interface.
  • the manager terminal may be installed with a manager space application in the interface. For example, after a user logs into the manager space application, the interface for managing resources of the hospital (e.g., the interface 420) may be presented to the user.
  • the user may input a first request for viewing the digital twin corresponding to the hardware device via typing, speaking, touching the interface, making specific gestures, etc.
  • the user may input the first request by communicating with a virtual character presented on the interface.
  • the first request may be sent to the processing device, the processing device may retrieve the corresponding digital twin from a storage device or generate the corresponding digital twin based on real-time information of the hardware device.
  • the processing device may cause the manager terminal to present the digital twin via the interface.
  • the user may input a second request for updating the digital twin via the interface, and the updated information relating to the digital twin may be transmitted to the processing device by the manager terminal.
  • the digital twin corresponding to the hardware device may reflect parameters of the hardware device.
  • the updated digital twin may reflect updated parameters of the hardware device.
  • the updating information relating to the digital twin corresponding to the hardware device may include updated parameters of the hardware device. Then, the updated parameters of the hardware device may be sent to the processing device.
  • the processing device may control the hardware device to update its configuration based on the updating information.
  • the processing device may store the updating information into a storage device. Further, the processing device may send an update notification to the hardware device so that the hardware device acquires the updating information from the storage device to update its configuration. Specifically, after the hardware device receives the update notification, the hardware device may acquire the updated parameters of the hardware device from the storage device, and reset values of the corresponding parameters according to the updated parameters.
  • a subscription mechanism may be utilized so that once the updating information is received, the processing device may automatically send the update notification relating to the updating information to the corresponding hardware device.
  • the update of the configuration of the hardware device may affect a user service.
  • a registration terminal updates its configuration (e.g., requesting inputting a temperature of a patient)
  • the processing device may include a software module for providing the user service.
  • the configuration of the hardware device may be associated with the software module, and the software module may subscribe to an update notification relating to the configuration of the hardware device.
  • the processing device may receive and store the updated configuration into the storage device. Further, the processing device may send the update notification to the updated configuration to the software module.
  • the software module may acquire the updated configuration from the storage device to update the user service.
  • a hardware device may provide a plurality of user services.
  • the configuration parameters of the hardware device may correspond to different software modules providing different user services.
  • the corresponding relationship between the configuration parameters of the hardware device and software modules may be determined by an intelligent agent (e.g., the intelligent agent 432) .
  • the corresponding relationship may indicate specific software module needs to update the user service when specific configuration parameters of the hardware device are updated. As the hospital develops, the intelligent agent can determine this correspondence more accurately based on more and more data, thereby continuously updating the subscription mechanism and making management more intelligent.
  • FIG. 12 is a flowchart illustrating an exemplary process 1200 for providing user services to relevant users of a medical service procedure using a first intelligent agent according to some embodiments of the present disclosure.
  • the first intelligent agent corresponds to the medical service procedure.
  • the process 1200 may be stored in a storage as a form of instructions, and invoked and/or executed by the first intelligent agent (e.g., the first intelligent agent implemented by the processing device 210) .
  • the first intelligent agent may monitor updates in data relating to the medical service procedure of a patient.
  • the first intelligent agent may include a medical consultation intelligent agent, a hospitalization intelligent agent, a surgery intelligent agent, etc.
  • the medical service procedure may include a medical consultation service procedure, a hospitalization service procedure, a surgery service procedure, or the like, or any combination thereof.
  • the medical service procedure may include a plurality of stages.
  • each stage may correspond to one or more medical services.
  • the plurality of stages of the hospitalization service procedure may include a hospitalization admission stage, an admission inquiry stage, a hospitalization stage, a discharge stage, a follow-up stage, or the like, or any combination thereof.
  • Each stage may correspond to one or more hospitalization services.
  • the hospitalization admission stage may correspond to a hospitalization admission service
  • the admission inquiry stage may correspond to an admission inquiry service
  • the hospitalization stage may correspond to a hospital ward service (e.g., a nursing service, a ward round service, a visitation service, etc. )
  • the discharge stage may correspond to a discharge service
  • the follow-up stage may correspond to a follow-up service.
  • the data relating to the medical service procedure may indicate the progress of the medical service procedure, the status of a patient during the medical service procedure, and/or various aspects of the medical service procedure.
  • the data relating to the medical service procedure may include data relating to each stage of the medical service procedure.
  • the data relating to the medical service procedure may include data relating to each medical service provided to relevant users during the medical service procedure.
  • the first intelligent agent may monitor the updates in data (also referred as data update) relating to the medical service procedure by monitoring one or more data sources that collect the data relating to the medical service procedure.
  • data also referred as data update
  • a data source refers to a source (e.g., a hardware device) that provides (e.g., collects) the data relating to the medical service procedure.
  • the data source (s) may include a sensing device collecting sensed information.
  • exemplary sensing devices may include an image sensor, an acoustic sensor, a temperature sensor, a humidity sensor, an atmospheric pressure sensor, or the like, or any combination thereof.
  • the data source (s) may include a terminal device that interact with the relevant users of the medical service procedure.
  • the terminal device may include a terminal device that interacts with doctor of the patient, a terminal device that interacts with the patient, a publick terminal of the hospital, a terminal device that interacts with a nurse, a terminal device of a remote visitor, or the like, or any combination thereof.
  • the terminal device may include a terminal device provided by the hospital in the hospital ward of the patient, wherein the terminal device may be configured to present data (e.g., a notification, a virtual character, image data of a remote visitor) to the patient and/or receive instructions or requests input by the patient.
  • the patient may interact with the terminal device in the hospital ward via an input device (e.g., a controller) , voice, gesture, etc.
  • exemplary terminal device may include a presentation device, an XR device, a mobile device, a laptop computer, or the like, or any combination thereof.
  • the data source (s) may include examination devices, such as a vital sign monitor collecting vital signs of the patient.
  • exemplary vital signs may include a heart rate, a respiratory rate, a body temperature, a blood pressure, or the like, or any combination thereof.
  • the data source (s) may include a medical examination department collecting an examination result of the patient.
  • the medical examination department may include a medical imaging department, a clinical laboratory department, or the like, or any combination thereof.
  • the medical imaging department may be configured with medical imaging devices, such as, a computed tomography (CT) device, a digital subtraction angiography (DSA) device, a magnetic resonance (MR) device, an ultrasonography device, a positron emission tomography (PET) device, a single-photon emission computed tomography (SPECT) device, a positron emission tomography-computed tomography (PET-CT) device, a positron emission tomography-magnetic resonance imaging (PET-MRI) device, or the like, or any combination thereof.
  • CT computed tomography
  • DSA digital subtraction angiography
  • MR magnetic resonance
  • SPECT single-photon emission computed tomography
  • PET-CT positron emission tomography-computed
  • the data source (s) may include a nursing care device for providing nursing care services to the patient and/or assist a medical service provider (e.g., a doctor, a nurse, etc. ) to provide the nursing care services.
  • exemplary nursing care device may include a patient-care robot, an intelligent nursing trolley, etc.
  • the patient-care robot may include sensors, a robot arm, an actuator, a user interface, or the like, or any combination thereof.
  • the patient-care robot may provide nursing care services such as assisting the patient to drink, eat, or take medicines.
  • the intelligent nursing trolley may have autonomous driving functions and be able to move to different positions in the hospital.
  • the intelligent nursing trolley may be configured to guide a nurse to the hospital ward to perform an examination or a nursing operation on the patient.
  • the intelligent nursing trolley may be configured to present guidance information to guide the nurse to perform the examination or the nursing operation.
  • the intelligent nursing trolley may include one or more examination devices and/or nursing tools for the nurse to use to perform the examination and/or the nursing operation.
  • the first intelligent agent may monitor any data source that can collect data relating to the medical service procedure.
  • the data relating to the medical service procedure include various types of data, such as sensed information, examination data, interaction data, clinical data, doctor order data, etc.
  • the data relating to the medical service procedure may be regarded as multimodal data, which includes multiple types of data, multi-dimensional data, etc.
  • the data source (s) may include Internet of Things (IoT) devices collecting IoT data.
  • IoT devices refer to devices with sensors, processing ability, software, and other technologies that connect and exchange data with other devices and systems over the Internet or other communications networks.
  • the sensing device, the intelligent nursing trolley, the patient-care robot, and the medical imaging device may be in a communication connection through a wireless network. That is, the sensing device, the intelligent nursing trolley, the patient-care robot, and the medical imaging device may be referred to as the IoT devices.
  • a data source may be an independent device or be integrated into another device.
  • the acoustic sensor of the sensing device may be part of a hospital bed or a terminal device.
  • the data update may be detected when the data source (s) of the data sources collects updated data that have not been processed by the first intelligent agent. For example, assuming that the vital sign monitor collects the heart rate of the patient per hour, when a new heart rate of the patient is collected, the first intelligent agent may detect the data update in the vital sign monitor.
  • the first intelligent agent may have a direct communication connection with a data source, and directly monitor the data source. For example, the first intelligent agent may detect data update in the data source when the data source transmits updated data to the first intelligent agent.
  • the first intelligent agent may have a communication connection with storage device (s) (e.g., the storage device 230) that store data relating to the medical service procedure collected by the data source, and monitor the data source by monitoring the storage device (s) . For example, the first intelligent agent may detect data update in the data source when the storage device (s) receives updated data from the data source.
  • storage device e.g., the storage device 230
  • the first intelligent agent may monitor different data sources when the patient is in different stages in the medical service procedure. For example, the first intelligent agent may determine a current stage of the patient in the medical service procedure, and monitor a portion of the data source (s) corresponding to the current stage.
  • the first intelligent agent may monitor the sensing device (s) in the hospital ward.
  • the first intelligent agent may monitor the data sources according to a predefined data acquisition protocol corresponding to the medical service procedure.
  • the predefined data acquisition protocol may include data acquisition protocols corresponding to the stages of the medical service procedure.
  • a data acquisition protocol corresponding to a stage may specific data sources (e.g., hardware devices) that collect data relating to the stage, data interface standards of the data sources, data quality standards of the data sources, etc.
  • personalized monitoring can be provided to the patient, enabling continuous status monitoring, thereby allowing for timely responses to the patient’s needs and enhancing the efficiency and quality of the user service.
  • the first intelligent agent may proceed to operation 1220. In the meantime, the first intelligent agent may continue performing operation 1210 to continuously monitor the data sources.
  • the first intelligent agent may perform event of interest (EOI) detection based on the updated data.
  • EAI event of interest
  • the updated data refers to data collected by the data source (s) that has not been processed by the first intelligent agent.
  • the updated data may include IoT data.
  • the updated data may include sensed information collected by the sensing device, such as image data collected by an image sensor, acoustic data collected by an acoustic sensor, etc.
  • the data source (s) includes the terminal device of a doctor associated with the patient, the updated data may include input data with respect to the patient input by the doctor via the terminal device.
  • the updated data may include the vital signs of the patient.
  • the updated data may include an examination result of the patient.
  • the updated data may be obtained directly from the data source (s) or be obtained from a storage device.
  • An EOI refers to a specific occurrence or action that needs to be paid attention to.
  • the EOI detection refers to processing the updated data collected by the data source (s) to detect whether one or more EOIs occur.
  • exemplary EOIs may include that the patient is arrived at a specific location (e.g. a hospital ward, a consulting room, an examination room, etc. ) , that a doctor performs a special operation on the patient (e.g., that the doctor makes ward round in the hospital ward, that the doctor issues an instruction with respect to the patient, etc.
  • the data source (s) may include multiple data sources that collect data relating to the same EOI.
  • the image sensor and the acoustic sensor in the same room e.g., a hospital ward
  • the image sensor and the acoustic sensor in the hospital ward may collect data relating to the same EOI that occurs in the same room.
  • the image sensor and the acoustic sensor in the hospital ward may collect data relating to the same EOI that occurs in the hospital ward (e.g., that the patient is admitted to the hospital ward, that at least one doctor makes ward rounds in the hospital ward) .
  • the data source (s) may include a data source that collects data relating to multiple EOIs.
  • the image sensor in the same room e.g., a hospital ward
  • the image sensor in the same room may collect data relating to multiple EOIs that occur in the same room, including that the initial examination is performed on the patient, that the nursing operation or the medical examination is performed on the patient, etc.
  • the first intelligent agent may perform the EOI detection based on an EOI detection rule.
  • the EOI detection rule refers to a rule that needs to be followed when performing the EOI detection.
  • the EOI detection rule may specify the EOIs that need to be detected, algorithms or techniques used in detecting a specific EOI, algorithms or techniques used in analyzing data collected by a specific data source, EOIs corresponding to different stages in the medical service procedure, EOIs corresponding to different types of patients, or the like, or any combination thereof.
  • the EOI detection rule may be determined based on historical records of EOI detections, or set manually by a user (e.g., a doctor, a nurse, a technician, etc. ) .
  • the first intelligent agent may perform the EOI detection on the updated data based on a type of the updated data. For instance, if the updated data includes image data collected by an image sensor, the EOI detection may include performing at least one of moving object detection, abnormality detection, behavior detection, or identity recognition on the image data. As another example, if the updated data includes speech signals collected by an acoustic sensor, the EOI detection may include performing at least one of speech content recognition, speaker recognition, or key content extraction on the speech signals.
  • the EOI detection may include determining whether a data difference between the value and a historical value of the physiological parameter exceeds a data difference threshold, determining whether the value of physiological parameter exceeds a data range, etc.
  • the data difference threshold and/or the data range may be specified in the EOI detection rule.
  • the first intelligent agent may determine that the heart rate of the patient exceeds the heart rate range and an EOI (i.e., that the physiological status of the patient is abnormal) occurs.
  • each stage of the medical service procedure may correspond to one or more EOIs, and different stages of the medical service procedure may correspond to different types of EOIs. Therefore, the first intelligent agent may perform the EOI detection on the updated data based on the current stage of the medical service procedure. For example, the first intelligent agent may determine the current stage of the hospitalization process, and determine type data of EOIs that need to be detected based on the current stage of the medical service procedure. Further, the first intelligent agent may perform the EOI detection on the updated data based on the type data.
  • the first intelligent agent may determine that EOIs need to be detected including that the patient is admitted to the hospital ward, that the patient satisfies a condition to perform an initial examination, that an initial examination is performed on the patient, etc.
  • the first intelligent agent may determine that EOIs need to be detected including that at least one doctor makes ward rounds in the hospital ward, that a nursing operation or a medical examination is performed on the patient, that the patient initiates the service request, that the doctor’s order of the patient is obtained or updated, that the physiological status of the patient is abnormal, that the doctor issues the instruction with respect to the patient.
  • the essential data corresponding to an intelligent agent includes information that is critical for the intelligent agent to rely on in providing a specific service.
  • the EOI detection is performed based on the updated essential data.
  • the EOI detection rule of a specific medical service procedure may be determined with reference to an updated knowledge database corresponding to the specific medical service procedure, and the EOI detection is performed based on the determined EOI detection rule.
  • the first intelligent agent in response to detecting that an EOI occurs, may proceed to operation 1230. In the meantime, the first intelligent agent may continue performing operations 1210 and 1220 to continuously monitor the data sources and detect EOIs.
  • the first intelligent agent may perform one or more predetermined operations corresponding to the EOI to provide user services to relevant users of the medical service procedure.
  • the one or more predetermined operation may be performed based on the updated data and/or the updated essential data corresponding to the first intelligent agent.
  • the updated essential data includes the latest version of essential data of the first intelligent agent that has been updated or confirmed by the user.
  • the user 410 may update a portion of the essential data of the first intelligent agent via the interface 420, and the updated portion of the essential data and other original essential data of the first intelligent agent may be stored in a storage device as the updated essential data of the first intelligent agent for use.
  • the predetermined operations corresponding to the EOI refer to operation (s) that need to be performed when the EOI occurs.
  • the predetermined operation (s) may include a general operation and/or a specific operation.
  • the general operation refers to an operation that needs to be performed as long as an EOI occurs regardless of the type of the EOI.
  • the general operation may include generating a record relating to the EOI.
  • the first intelligent agent may generate a record relating to the EOI based on the updated data and/or the updated essential data (e.g., a record template, a knowledge database, a dictionary in the updated essential data) relating to the EOI.
  • Exemplary records may include a registration record, an admission record, a nursing record, a ward round record, a visitation record, a discharge record, a follow-up record, a consultation record, a surgical record, or the like, or any combination thereof.
  • the general operation may include transmitting the record relating to the EOI to a relevant user for confirmation or a storage device for storage.
  • the knowledge database and the dictionary in the updated essential data may be used to convert natural language into medical terminology or professional terminology, and the record template in the updated essential data may be used to organize the medical terminology or professional terminology into the structured record.
  • the specific operation refers to an operation that is performed when a specific type of EOI occurs. For example, updating a daily plan of the patient based on the updated data may be determined as a specific operation corresponding to the EOI that the doctor’s order of the patient is updated. As another example, providing a notification relating to the EOI to a medical service provider may be determined as a specific operation corresponding to the EOI that the physiological status of the patient is abnormal.
  • the one or more predetermined operations may include determining, based on patient data of the patient and an inquiry template in the updated essential data, inquiry content of an inquiry (also referred to as first inquiry content of a first inquiry) that is to be made for the patient after the patient is admitted to the hospital ward, causing a terminal device in the hospital ward to conduct the inquiry based on the inquiry content, obtaining sensed information collected by the one or more sensing devices in the hospital ward during the inquiry (also referred to as first sensed information) , and generating an admission record for the patient based on the sensed information and the admission record template in the updated essential data.
  • inquiry content of an inquiry also referred to as first inquiry content of a first inquiry
  • first sensed information also referred to as first sensed information
  • the one or more predetermined operations may include for every day when the patient is hospitalized, determining a daily plan of the patient based on the patient data of the patient and the doctor’s order or the updated doctor’s order, presenting the daily plan to the patient via the terminal device in the hospital ward of the patient, and presenting the daily plan to a nurse corresponding to the patient via a terminal device of the nurse.
  • the daily plan may include at least one medical operation needed to be performed on the patient in the day.
  • the one or more predetermined operations may include obtaining sensed information collected by the one or more sensing devices in the hospital ward when the at least one doctor makes ward round in the hospital ward (also referred to as fourth sensed information) , and generating a ward round record based on the sensed information, a ward round record template in the updated essential data, a knowledge database in the updated essential data, etc.
  • the one or more predetermined operations may include determining a follow-up plan for the patient based on a target hospitalization record of the patient and the knowledge database in the updated essential data.
  • the follow-up plan may include one or more follow-ups to be performed at one or more planned times.
  • the one or more predetermined operations may further include causing a terminal device of the attending doctor (also referred to as a second terminal device) and a terminal device of the patient (also referred to as a third terminal device) to remind the attending doctor and the patient based on the planned time of the follow-up, respectively.
  • the first intelligent agent may determine a corresponding relationship between EOIs and predetermined operations, and determine the one or more predetermined operations corresponding to the detected EOI based on the corresponding relationship.
  • the corresponding relationship may indicate one or more predetermined operations need to be performed when a specific type of EOI occurs.
  • the corresponding relationship may be in the form of a look-up table.
  • the corresponding relationship may be predetermined and stored in a storage device, and the first intelligent agent may obtain the corresponding relationship from the storage device. In some embodiments, the first intelligent agent may determine the corresponding relationship between EOIs and predetermined operations based on the historical records. In some embodiments, the first intelligent agent may determine the corresponding relationship based on the updated essential data (e.g., the knowledge database in the updated essential data) .
  • the updated essential data e.g., the knowledge database in the updated essential data
  • the one or more predetermined operations corresponding to the EOI may be determined further based on the patient data of the patient.
  • the patient data of the patient may include basic data, health data, historical data, registration data, or the like, or any combination thereof.
  • different types of patients e.g., with different diseases, having different ages
  • the one or more predetermined operations corresponding to the EOI that the hospitalization guidance request is obtained may be simplified.
  • the one or more predetermined operations can be customized for the patient, which can improve the accuracy of the providing the hospitalization services and optimize user satisfaction.
  • the one or more predetermined operations may be performed based on data source (s) corresponding to the EOI.
  • the data source (s) includes multiple data sources that collect data relating to the same EOI
  • the one or more predetermined operations may be performed based on a combination of the data relating to the same EOI collected by the multiple data sources.
  • the image sensor and the acoustic sensor in the same room may both collect data relating to the EOI that the patient is admitted to the same room, and the one or more predetermined operations may be performed based on the combination of the data relating to the EOI collected by the image sensor and the acoustic sensor.
  • the data source (s) includes a data source that collects data relating to multiple EOIs, and the one or more predetermined operations corresponding to at least two EOIs of the multiple EOIs may be different.
  • the acoustic sensor in the hospital ward may collect acoustic data relating to different EOIs that occur in the hospital ward, such as that the patient is admitted to the hospital ward, that the at least one doctor makes word rounds in the hospital ward of the patient, etc., and the one or more predetermined operations corresponding to the different EOIs may be different.
  • a predetermined operation corresponding to the EOI may be performed immediately after the EOI is detected.
  • the first intelligent agent may cause a terminal device to provide an alarm when the physiological status of the patient is abnormal.
  • a predetermined operation corresponding to the EOI may be performed after the EOI is completed.
  • the record relating to the EOI may be generated in response to detecting the completion of the EOI.
  • the data sources that capture information regarding a patient’s medical service procedure are monitored.
  • This monitoring facilitates timely detection of data updates and occurrence of EOIs, triggering corresponding predetermined operations promptly. Consequently, user services can be automatically and efficiently provided to relevant users, thereby enhancing service efficiency and quality.
  • the monitored data sources gather multimodal data across different stages of the whole medical service procedure, enabling patient-centric healthcare and comprehensive user services.
  • the first intelligent agent may learn the EOI detection rule from the historical records, and perform the EOI detection based on the EOI detection rule.
  • the EOI detection rule refers to a rule how performs the EOI detection on the updated data and/or the updated essential data. For instance, the first intelligent agent may learn from the historical records that what types of EOI need to be monitored, how to efficiently detect an EOI, what data needs to be analyzed to detect an EOI, etc.
  • the first intelligent agent may learn the corresponding relationship between EOIs and predetermined operations from the historical records, and determine the one or more predetermined operations corresponding to the EOI based on the corresponding relationship. For example, the first intelligent agent may learn from the historical records that what operations need to be perform when an EOI occurs.
  • the first intelligent agent may learn the EOI detection rule and/or the corresponding relationship between EOIs and predetermined operations further based on patient data of different patients. For example, the first intelligent agent may determine different EOI detection rules and different predetermined operations for different types of patients (e.g., with different diseases, having different ages) . Merely by way of example, the first intelligent agent may determine different heart rate ranges corresponding to different types of patients having different ages for the EOI detection.
  • the first intelligent agent is enabled to continuously learn the EOI detection rules and/or the corresponding relationships utilizing big data technology, machine learning techniques, and other advanced methodologies. This ongoing optimization of the EOI detection rules and/or corresponding relationships leads to enhanced accuracy, efficiency, and service quality in hospitalization services.
  • FIG. 13 is a flowchart illustrating an exemplary process 1300 for providing user services to relevant users using a second intelligent agent according to some embodiments of the present disclosure.
  • the second intelligent agent corresponds to the user service, and the user service relates to a stage in a medical service procedure.
  • the process 1300 may be stored in a storage as a form of instructions, and invoked and/or executed by the second intelligent agent (e.g., the second intelligent agent implemented by the processing device 210) .
  • the second intelligent agent may obtain data relating to the stage in the medical service procedure of a patient.
  • the medical service procedure may include a medical consultation service procedure, a hospitalization service procedure, a surgery service procedure, or the like, or any combination thereof. More descriptions regarding the medical service procedure may be found elsewhere in the present disclosure. See, for example, operation 1210 in FIG. 12 and the descriptions thereof.
  • the data relating to the stage in the medical service procedure may indicate the progress of the stage of the medical service procedure, the status of a patient during the stage of the medical service procedure, and/or various aspects of the stage of the medical service procedure.
  • the data relating to the stage of the medical service procedure may include data relating to each medical service provided to relevant users during the stage of the medical service procedure.
  • the data relating to the stage in the medical service procedure may be collected by data sources, and stored in a storage device.
  • the second intelligent agent may obtain the data relating to the patient from the storage device. More descriptions regarding the data sources may be found elsewhere in the present disclosure (e.g., FIG. 12 and the descriptions thereof) .
  • the second intelligent agent may process the data based on updated essential data corresponding to the second intelligent agent.
  • the essential data corresponding to an intelligent agent includes information that is critical for the intelligent agent to rely on in providing a specific service. Therefore, if the essential data corresponding to the second intelligent agent is updated, the second intelligent agent needs to using the updated essential data to process the data.
  • the updated essential data may be obtained via an interface (e.g., the interface 420) .
  • the essential data may include inquiry templates for different diseases, a specialist medical knowledge database, an admission record template, etc. If a user updates the specialist medical knowledge database or the admission record template via the interface, the second intelligent agent may use the updated specialist medical knowledge database or the updated admission record template to process the data.
  • the second intelligent agent may achieve self-evolution based on historical data relating to the stage of the medical service procedure and AI technology, and process the data based on rules learned from the historical data relating to the stage of the medical service procedure.
  • different intelligent agents may be trained, so as to correspond to different medical service procedures, different stages of a medical service procedure, different medical services, different departments, different diseases, different medical service providers (e.g., the nurse, the doctor, the scanning technician, the hospital manager) , etc.
  • the second intelligent agent may be the intelligent agent corresponding to the stage of the medical service procedure.
  • the second intelligent agent may provide the user service to relevant users of the stage based on a processing result of the data.
  • the user service may include services provided to the relevant users of the stage of the medical service procedure.
  • the relevant users may be the patient, and the user service provided to the patient may include a registration service, a pre-consultation service, an admission inquiry service, a route guidance service, a discharge service, a follow-up service, or the like, or any combination thereof.
  • the relevant user may be the hospital staff (e.g., the doctor, the nurse, the hospital manager) , and the user service provided to the hospital staff may include a record, a notification, a suggestion, etc., based on the processing result.
  • the processing result of the data may include information relating to the user services provided to the relevant users, information relating to the relevant users (e.g., a department, a type, etc. ) , or the like, or any combination thereof.
  • Exemplary information relating to the services provided to the relevant users may include types (e.g., a registration service, a pre-consultation service, an admission inquiry service, a route guidance service, a discharge service, etc. ) , contents, times, providing manners, etc., of the services.
  • Exemplary information relating to the relevant users may include departments to which the relevant users belong, types (e.g., the patient, hospital staff (e.g., the doctor, the nurse, the hospital manager) ) of the relevant users, or the like, or any combination thereof.
  • the second intelligent agent may provide the user service to the relevant users according to the information provided by the processing result of the data.
  • the second intelligent agent may provide the user service to the relevant users using a virtual character.
  • a virtual character corresponding to the second intelligent agent may be presented via a user space application (e.g., a patient space application) , and the user service may be provided based on the interactions between relevant users (e.g., the patient, hospital staff (e.g., the doctor, the nurse, the hospital manager) ) of the stage of the medical service procedure and the virtual character.
  • the user space application may provide the relevant users with access to the user service.
  • the user space application is an application program installed on a patient terminal device of the patient or a manager space application installed in a public terminal in a hospital (e.g., an XR device) .
  • a virtual character refers to a computer-generated person or entity designed to interact with the relevant users in a digital environment.
  • the virtual character may be configured to interact with the relevant users to provide the user service.
  • the virtual character may be a digital character with certain appearance features, acoustic features, etc.
  • Exemplary appearance features may include physical features, skin features, facial features, clothing features, or the like, or any combination thereof.
  • Exemplary acoustic features may include a frequency feature, a volume feature, a duration feature, a quality feature, a tone feature, a speed feature, an intonation feature, or the like, or any combination thereof.
  • the appearance features and/or the acoustic features of the virtual character may be determined based on patient data of the patient.
  • the patient data may include basic data (e.g., name, age, gender, weight, address, job, etc. ) , health data (e.g., the disease type, the disease symptom) , historical data (e.g., historical clinical data, historical hospitalization data, etc. ) , registration data (e.g., a target registration record, etc. ) , or the like, or any combination thereof.
  • the patient data may include an electronic health record of the patient.
  • the user services can be provided automatically, which can reduce the need for extensive human labor, lowering operational costs and enhancing the efficiency of the providing the user services.
  • the second intelligent agent can continuously optimize the learned rules to enhanced accuracy, efficiency, and service quality in the user services.
  • the processes 1000, 1200, and 1300 and the descriptions thereof are provided for the purposes of illustration, and not intended to limit the scope of the present disclosure.
  • various modifications and changes in the forms and details of the application of the above method and system may occur without departing from the principles of the present disclosure.
  • those variations and modifications also fall within the scope of the present disclosure.
  • the operations of the illustrated processes1000, 1200, and 1300 are intended to be illustrative.
  • the processes 1000, 1200, and 1300 may be accomplished with one or more additional operations not described, and/or without one or more of the operations discussed.
  • the order in which the operations of the processes 1000, 1200, and 1300and regarding descriptions are not intended to be limiting.
  • FIG. 14A is a flowchart illustrating an exemplary process 1400A for providing a pre-consultation service according to some embodiments of the present disclosure.
  • the pre-consultation service may be used to gather information about the patient by conducting an initial inquiry on the patient before the patient enters the consultation room for formal consultation.
  • the processing device 210 may conduct a pre-consultation inquiry on the patient through the patient terminal device of the patient or a waiting terminal configured in the waiting region to alleviate the anxiety of the patient while waiting, generate a record of the pre-consultation inquiry, and provide the record to the doctor for reference, so as to improve the consultation efficiency of the doctor.
  • at least a portion of the process 1400A is performed by a pre-consultation intelligent agent configured on the processing device 210 corresponding to the pre-consultation service.
  • inquiry content of a pre-consultation inquiry may be determined based on a department of a doctor (e.g., the registered doctor of the patient) .
  • the pre-consultation inquiry is used to preliminarily inquiry the patient before the formal consultation.
  • the pre-consultation inquiry may include multiple rounds of inquiry.
  • the inquiry content may include the inquiry content of each round of inquiry. Alternatively, the inquiry content may only include inquiry content of a first round of inquiry.
  • the processing device 210 may obtain a pre-consultation record template corresponding to the department of the doctor and determine the inquiry content based on the pre-consultation record template.
  • the processing device 210 may obtain known information (e.g., an electronic health record, chief complaint, etc. ) about the patient, and determine missing information that has not been collected in the pre-consultation record template by comparing the pre-consultation record template with the known information. Further, the processing device 210 may determine the inquiry content based on the missing information.
  • known information e.g., an electronic health record, chief complaint, etc.
  • the processing device 210 may determine the inquiry content based on the department of the doctor and the known information about the patient using an inquiry model.
  • the inquiry model may include a CNN model, an RNN model, an LSTM model, a BERT model, a ChatGPT model, etc.
  • the inquiry model may include a missing information determination model and a first inquiry content determination model.
  • the missing information determination model may be configured to output the missing information by processing the department of the doctor and the known information about the patient.
  • the first inquiry content determination model may be configured to output the inquiry content based on the missing information of the patient.
  • the patient terminal device of the patient may be caused to conduct the pre-consultation inquiry on the patient based on the inquiry content.
  • the processing device 210 may determine an estimated waiting time for the patient to receive the medical consultation service.
  • the estimated waiting time may be a time difference between a current moment and a registration time of the patient.
  • the estimated waiting time may be determined based on a daily consultation record of the doctor and the registration time of the patient.
  • the daily consultation record of the doctor refers to a record reflecting a consultation condition of the doctor on the day.
  • the processing device 210 may cause the patient terminal device of the patient to conduct the pre-consultation inquiry on the patient or present a recommendation to perform the pre-consultation inquiry. This approach can ensure that there is sufficient time for the pre-consultation, and prevent the doctor calls the patient in the process of the pre-consultation.
  • the processing device 210 may cause the patient terminal device of the patient to conduct the pre-consultation inquiry on the patient or present the recommendation to perform the pre-consultation inquiry.
  • the second preset time threshold may be greater than the first preset time threshold. For example, when it is detected that the current moment is shorter than 24 hours from the registration time (i.e., the estimated waiting time is smaller than 24 hours) , the patient terminal device may present the recommendation for conducting the pre-consultation inquiry (e.g., presenting the recommendation through a virtual character) to the patient, thereby reminding the patient to conduct the pre-consultation promptly.
  • the processing device 210 may detect that the patient initiates a pre-consultation request via the patient terminal device, and then cause the patient terminal device of the patient to conduct the pre-consultation inquiry on the patient.
  • a virtual character may be presented by the patient terminal device to conduct the pre-consultation inquiry based on the inquiry content.
  • the virtual character refers to a digitized character with specific features (e.g., specific appearance features, acoustic features, etc. ) , and may communicate with the patient to conduct the pre-consultation on the patient.
  • the processing device 210 may display a virtual character through a screen of the patient terminal device (e.g., an XR device) and play the inquiry content through a sound output device of the patient terminal device.
  • the virtual character may simulate human speech expressions, gestures, etc., providing patients with a realistic communication experience.
  • the virtual character may have preset appearance features. In some embodiments, the appearance features of the virtual character may be determined based on optical image data of the doctor with whom the patient is registered. In some embodiments, the appearance features of the virtual character may be determined based on basic patient information. In some embodiments, the processing device 210 may select a suitable virtual character from a library of virtual characters as the virtual character based on the appearance features of the doctor and/or the basic patient information.
  • the pre-consultation inquiry may include multiple rounds of inquiries.
  • the inquiry content may include inquiry content of each round of inquiry in the pre-consultation inquiry, and the pre-consultation inquiry may be performed by the process 1400B shown in FIG. 14B.
  • the processing device 210 may cause the patient terminal device to conduct the first round of inquiry based on the inquiry content corresponding to the first round of inquiry.
  • the processing device 210 may adjust the inquiry content of the current inquiry (also referred to as current inquiry content) based on reference data collected before the current inquiry, so as to make the inquiry content more consistent with the condition of the patient. Specifically, the processing device 210 may determine semantic information and emotional information of historical answers of the patient based on the reference data collected before the current inquiry.
  • the reference data may include speech signals, image data, text data, etc., collected by the patient terminal device.
  • the historical answers refer to answers of the patient to historical rounds of inquiries.
  • the semantic information of the historical answers may indicate the content of the historical answers.
  • the emotional information of the historical answers may indicate the emotion (e.g., calm, nervous, anxious, afraid, doubtful, irritable, etc. ) of the patient at the time of providing the historical answers.
  • the processing device 210 may determine the semantic information by performing text transcription, speech content recognition, etc., on the reference data.
  • the processing device 210 may determine the emotional information by analyzing features such as content, tone, intonation, speed of speech of the reference data, etc.
  • the processing device 210 may adjust the current inquiry content based on the semantic information and the emotional information. For example, when the emotional information of the patient is “nervous” or “afraid, ” the processing device 210 may add reassuring words to the current inquiry content. As another example, when the semantic information indicates that the patient has not explicitly answered the historical inquiry, the processing device 210 may adjust the current inquiry content to repeat the historical inquiry, so as to guide the patient to explicitly answer the historical inquiry. The current inquiry content originally determined may be used as the inquiry content of a next round of inquiry. In this way, that the current inquiry content may be adjusted in time according to the status of the patient, thereby improving the quality of the pre-consultation service.
  • acoustic features used for the current inquiry may be adjusted in real-time based on the status of the patient.
  • the acoustic features may include speech rate features, tone features, intonation features, volume features, etc.
  • the processing device 210 may determine the acoustic features of the current inquiry based on the semantic information and the emotional information of the historical answers of the patient, and cause the patient terminal device to conduct the current inquiry based on the adjusted inquiry content and the acoustic features of the current inquiry. This approach may better take care of emotional changes of the patient, thereby enhancing the anthropomorphizing effect of the virtual character, and improving the quality of the pre-consultation service.
  • the processing device 210 may further obtain physiological state information of the patient.
  • the physiological state information of the patient may reflect a real-time physiological state of the patient.
  • the physiological state information may include physiological parameter values (e.g., heart rate, pulse rate, respiratory rate, etc. ) of the patient.
  • the physiological state information may also include information relating to the posture, limb behavior, facial expression, muscle status, etc. of the patient.
  • the physiological state information of the patient may be obtained using a wearable device worn by the patient, an image sensor in the environment of the patient.
  • the processing device 210 may adjust the current inquiry content based on the semantic information, the emotional information, and the physiological state information. Specifically, the processing device 210 may update the emotional information of the patient based on the physiological state information of the patient. Understandably, the internal emotions of the patient may not always be fully expressed through the answers of the patient, so the emotional information of the patient may be updated or modified based on the physiological state information of the patient. Further, the processing device 210 may adjust the current inquiry content based on the semantic information and the updated emotional information.
  • the accuracy of the emotional information of the patient can be improved by further considering the physiological state data of the patient, which can improve the accuracy of the adjustment of the current inquiry content, thereby improving the service quality of the pre-consultation service.
  • the processing device 210 may determine feedback parameters based on at least a portion of the semantic information, the emotional information, and the physiological state information, and control a wearable device to apply feedback to the patient based on the feedback parameters.
  • the feedback may include at least one of force feedback or temperature feedback.
  • the feedback parameters may be used to control the way in which the feedback is applied, e.g., a type of feedback, a part of the body to which the feedback is applied, a strength of the feedback, etc.
  • the processing device 210 may determine the emotion and the emotion level of the patient based on the at least a portion of the semantic information, the emotional information, and the physiological state information, and determine the feedback parameters based on the emotion and the emotion level. This approach may provide timely appeasement of the patient’s bad emotions, thereby improving the quality of the pre-consultation service.
  • the processing device 210 may end the pre-consultation inquiry based on a preset condition.
  • the preset condition may be that a count of remaining missing information is 0.
  • the preset condition may be that a time difference between the current time and the estimated waiting time of the patient is smaller than a threshold.
  • the inquiry content determined in the operation 1410 may include only the inquiry content of the first round of inquiry.
  • the current inquiry content of each current inquiry other than the first round of inquiry may be determined during the pre-consultation inquiry.
  • the processing device 210 may input the inquiry content of the historical inquiry, the historical answers of the patient, the known information of the patient, etc. into a second inquiry content determination model, and the current inquiry content may be output by the second inquiry content determination model.
  • a pre-consultation record may be generated based on reference data collected by the patient terminal device during the pre-consultation inquiry.
  • the reference data may include speech data, text data, and image data input by the patient via the patient terminal device during the pre-consultation inquiry.
  • the pre-consultation record may be used to record patient information collected during the pre-consultation inquiry.
  • some known information of the patient may also be recorded in the pre-consultation record.
  • the pre-consultation record may be generated according to a pre-consultation record template.
  • the pre-consultation record template may be a template corresponding to the department of the doctor or a template set by the doctor.
  • the processing device 210 may first transcribe the speech signals into text, and extract a keyword from the text via a keyword extraction algorithm. Further, the processing device 210 may convert the keyword into medical terminology. Furthermore, the processing device 210 may obtain a plurality of template fields in the pre-consultation record template, retrieve content corresponding to each template field from the medical terminology, and fill the content in a corresponding position of the pre-consultation record template.
  • the conversion of the keyword may be performed based on a terminology conversion model or may be performed based on a knowledge dictionary.
  • the terminology conversion model may be configured to convert spoken descriptions into the medical terminology.
  • the pre-consultation inquiry may be performed through a terminal device other than the patient terminal device, such as a waiting terminal.
  • FIG. 15 is a flowchart illustrating an exemplary process 1500 for providing a medical consultation service based on sensed information according to some embodiments of the present disclosure.
  • the process 1500 may include one or more of sub-processes 1510, 1520, 1530, and 1540.
  • at least a portion of the process 1500 is performed by a consultation intelligent agent configured on the processing device 210 corresponding to the medical consultation service.
  • the patient may communicate with the registration doctor during the consultation stage to receive the consultation service (e.g., an on-site consultation service in the consultation room, a remote consultation service) .
  • the consultation service e.g., an on-site consultation service in the consultation room, a remote consultation service
  • user services relating to the consultation stage may be provided relevant users (e.g., a doctor, a patient, a remote companion) via at least one terminal device.
  • the at least one terminal device includes a public terminal device in the consultation room, the patient terminal device, the doctor terminal device, a terminal device of the remote companion, etc.
  • the public terminal device in the consultation room refers to a terminal device installed at the site of the consultation room and may include a display screen, a sound output device, an acoustic sensor, an XR device, a wearable device, or the like, or any combination thereof.
  • the sub-process 1510 may be used to provide a decision recommendation based on the sensed information.
  • the sub-process 1510 may be executed in a consultation stage. As shown in FIG. 15, the sub-process 1510 may include operations 1512 and 1514.
  • the decision recommendation may be generated based on sensed information and patient data of a patient.
  • the decision recommendation refers to a recommendation to assist a doctor in providing the medical consultation service.
  • An exemplary decision recommendation may include a supplemental inquiry recommendation, an examination recommendation, a prescription recommendation, a treatment scheme recommendation, etc.
  • the decision recommendation may be determined based on a knowledge database, consultation specifications, etc. corresponding to a registration department.
  • the processing device 210 may determine the communication content between the doctor and the patient based on the speech signals collected by the acoustic sensor, and determine the decision recommendation by searching the knowledge database, the consultation specifications, etc., based on the communication content and/or the patient data.
  • what information in the consultation specifications has not been collected may be determined by searching the consultation specifications based on the communication content and/or the patient data, and the supplemental inquiry recommendation may be provided based on the information.
  • the decision recommendation may be generated based on a diagnostic model.
  • the processing device 210 may determine a model input based on the sensed information and the patient data, input the model input to the diagnostic model, and the diagnostic model may output the decision recommendation corresponding to the model input.
  • the model input may include the patient data, the communication content determined based on the speech signals, status information of the patient determined based on the image data, or the like, or any combination thereof.
  • the decision recommendation may be generated by the consultation intelligent agent.
  • the consultation intelligent agent may learn a mechanism for generating the decision recommendation from various data (such as historical consultation records, the knowledge database, and the consultation specifications) , and provide the decision recommendation by processing the sensed information and the patient data based on the learned mechanism.
  • At least a portion of the at least one terminal device may be controlled to present the decision recommendation.
  • the processing device 210 may control the public terminal device or a doctor terminal device to present the decision recommendation.
  • the processing device 210 may control the doctor terminal device of the doctor and a patient terminal device of the patient to present the decision recommendation, respectively.
  • the decision recommendation may improve the accuracy of the diagnosis and prescription, and improve the efficiency of the medical consultation service.
  • the sub-process 1520 may be used to generate a target diagnosis record based on the sensed information.
  • the sub-process 1520 may be performed at the end of the consultation stage. As shown in FIG. 15, the sub-process 1520 may include operations 1522, 1524, and 1526.
  • a preliminary diagnosis record may be generated based on the sensed information.
  • the preliminary diagnosis record may be a diagnosis record automatically generated.
  • the preliminary diagnosis record may include a preliminary patient medical record, a preliminary diagnostic opinion, a preliminary diagnostic prescription (e.g., a preliminary treatment prescription and a preliminary examination prescription) , a preliminary doctor’s order, etc.
  • key content may be extracted from sensed information based on a diagnosis record template.
  • the key content refers to content relating to the template fields in the diagnosis record template.
  • the key content may be converted into professional content based on a knowledge dictionary or a terminology conversion model.
  • the preliminary diagnosis record may be generated by updating the diagnosis record template based on the professional content and a knowledge database.
  • the knowledge database refers to a knowledge database of the registration department, for example, including consultation specifications (e.g., disease description specifications, diagnosis specifications, prescription specifications, doctor’s order specifications, etc. ) of the department.
  • measurement data of the patient collected by one or more examination devices during the consultation process may be obtained, and the preliminary diagnosis record may be generated further based on the measurement data.
  • the preliminary diagnosis record may be generated by the consultation intelligent agent.
  • the consultation intelligent agent may learn a mechanism for generating the diagnosis record from various data (such as a diagnosis record template, a knowledge dictionary, a knowledge database, etc. ) and generate the diagnosis record by processing the sensed information and the patient data based on the learned mechanism.
  • the preliminary diagnosis record may be presented to the doctor.
  • the processing device 210 may control the public terminal device to present the preliminary diagnosis record, e.g., when the patient has started the consultation.
  • the processing device 210 may control the doctor terminal device to present the preliminary diagnosis record to the doctor.
  • the doctor terminal device may present the preliminary diagnosis record to the doctor at a preset time (e.g., after the doctor has finished the consultation on the day) .
  • the target diagnosis record may be generated based on the preliminary diagnosis record and the feedback information regarding the preliminary diagnosis record input by the doctor.
  • the feedback information input by the doctor may include modifications and/or confirmations of the preliminary diagnosis record input by the doctor.
  • the target diagnosis record refers to a diagnosis record modified and/or confirmed by the doctor.
  • the target diagnosis record may include a target patient medical record, a target diagnostic opinion, a target diagnostic prescription (e.g., a target treatment prescription and a target examination prescription) , a target doctor’s order, etc.
  • the target diagnosis record By generating the target diagnosis record, manual writing errors of the target diagnosis record may be reduced, and the efficiency of generating the target diagnosis record may be improved. On the other hand, the paperwork of the doctor may be reduced, so that the doctor can focus more on direct patient care rather than administrative tasks, thereby improving the quality of the medical consultation service.
  • the sub-process 1530 may be used to provide the remote accompanying service based on the sensed information.
  • the patient may issue a request for the remote accompanying service before the consultation process.
  • the sub-process 1530 may be performed in the consultation stage. As shown in FIG. 15, the sub-process 1530 may include operations 1532 and 1534.
  • whether the patient needs to communicate with a remote companion may be determined based on the sensed information.
  • the processing device 210 may detect, based on the sensed information (e.g., speech data and/or image data) , whether the patient has issued a request to communicate with the remote companion. In some embodiments, the processing device 210 may determine status information of the patient based on the sensed information, and determine whether the patient needs to communicate with the remote companion based on the status information of the patient. For example, the processing device 210 may determine that the patient needs to communicate with the remote companion when the status information indicates that the patient is in a status of high tension, fear, etc.
  • the sensed information e.g., speech data and/or image data
  • the processing device 210 may perform operation 1534.
  • At least a portion of the at least one terminal device may be controlled to enlarge an interface element.
  • the processing device 210 may control the public terminal device to enlarge the interface element.
  • the processing device 210 may control the patient terminal device of the patient to enlarge the interface element. With the enlarged interface element, the patient may view a real-time picture of the remote companion and better communicate with the remote companion.
  • the processing device 210 may remind the patient to wear an XR device and control the XR device to present image data of the remote companion.
  • the communication need of the patient may be detected based on the sensed information and the communication need may be promptly satisfied, thereby providing more humanized care for the patient, and providing a more realistic and immersive companion experience.
  • the sub-process 1540 may be used to present medical data to target users based on the sensed information. As shown in FIG. 15, the sub-process 1540 may include operations 1542 and 1544.
  • a control instruction issued by at least one of the target users may be obtained based on the sensed information for retrieving at least a portion of the medical data.
  • the target users may include at least the patient and a doctor. In some embodiments, the target users further include the remote companion of the patient.
  • the medical data of the patient may include various data (e.g., an electronic health record, a medical image, a medical examination result, etc. ) reflecting a health condition of the patient.
  • the control instruction refers to an instruction to retrieve at least a portion of medical data (e.g., the electronic health record) for display.
  • the control instruction may be used to retrieve a three-dimensional model of an organ of interest of the patient in the electronic health record for display.
  • the control instruction may be used to set display parameters (e.g., display angle, display size, or display position) .
  • the control instruction may be used to label key data on the medical data (e.g., the three-dimensional model of the organ of interest) .
  • the sensed information may include speech signals collected by an acoustic sensor, and the control instruction may be obtained by performing semantic analysis on the speech signals.
  • the target users may issue a control instruction by saying preset wake-up words.
  • the sensed information may include optical image data of the target users (e.g., the patient and/or the doctor) collected by an image sensor, and the control instruction may be obtained by performing gesture recognition on the target users in the optical image data.
  • the target users may issue the control instructions using a control device (e.g., a remote controller, a smart control glove, etc. ) .
  • the target users may adjust the display content and/or the display parameters flexibly, such as by speech, gestures, etc., so that the user experience may be optimized, and the efficiency of the medical consultation may be improved.
  • the at least a portion of the medical data may be retrieved and the at least a portion of the medical data may be presented via the at least one terminal device.
  • the processing device 210 may retrieve the at least a portion of the medical data from a storage device and control the at least one terminal device to present the at least a portion of the medical data.
  • the control instruction includes the display parameters
  • the processing device 210 may control the at least one terminal device to present the at least a portion of the medical data based on the display parameters.
  • the plurality of target users may browse the medical data together via the at least one terminal device, and the presentation content and presentation mode of the medical data on different terminal devices may be changed synchronously, which may help to improve the communication efficiency of the target users and enhance the interactivity of the consultation process.
  • FIG. 16 is a flowchart illustrating an exemplary process 1600 for providing user services relating to a hospitalization admission stage according to some embodiments of the preset disclosure.
  • the patient may handle related procedures to be admitted to a hospital.
  • at least a portion of the process 1600 is performed by a hospitalization intelligent agent corresponding to the hospitalization service configured on the processing device 210.
  • at least a portion of the process 1600 (e.g., operations 1630-1650) is performed by a nursing intelligent agent corresponding to nursing services configured on the processing device 210.
  • the processing device 210 may guide a patient to a hospital ward.
  • the processing device 210 may direct a patient terminal device of the patient to guide the patient to the hospital ward.
  • the processing device 210 may obtain a first position of the patient terminal device of the patient and a second position of the hospital ward, and determine a planned route from the first position to the second position based on a real-time map of the hospital. And then, the processing device 210 may direct the patient terminal device to present guidance information relating to the planned route to the patient.
  • the processing device 210 may deliver admission education to the patient.
  • the admission education may be used to introduce admission information (e.g., admission formalities, admission operations, pre-admission fee, payment manners, etc. ) , admission hospitalization rules, hospital environment, a doctor and/or a nurse of the patient, etc., to the patient.
  • admission information e.g., admission formalities, admission operations, pre-admission fee, payment manners, etc.
  • admission hospitalization rules e.g., admission hospital environment, a doctor and/or a nurse of the patient, etc.
  • the processing device 210 may cause the patient terminal device (e.g., the XR device 260-2) to present a virtual character that provides the admission education.
  • the processing device 210 may assist a nurse to perform admission preparation.
  • the admission preparation may be performed by the nurse to prepare hospital supplies for the patient.
  • the processing device 210 may present an admission notification of the patient through a nurse terminal device 1605 in a nurse’s workstation or the intelligent nursing trolley 240-4, so as to assist the nurse to perform the admission preparation.
  • the admission notification may include the patient data of the patient, a list of the hospital supplies of the patient, ward information of the patient, information of an initial examination to be performed on the patient, etc.
  • the initial examination may also be referred to as an inpatient examination, which is performed once the patient is admitted to the hospital ward.
  • the initial examination may be used to collect information relating to a current medical condition (e.g., vital signs, basic health data, etc. ) of the patient.
  • the initial examination may include examinations of blood pressure, blood glucose, heart rate, body temperature, or the like, or any combination thereof.
  • the processing device 210 may issue a reminder for performing the initial examination.
  • the reminder may include a message reminder, an acoustic reminder, a pop-up reminder, etc.
  • the processing device 210 may direct the nurse terminal device 1605 or the intelligent nursing trolley 240-4 to present the reminder.
  • the processing device 210 may determine whether the patient satisfies a condition for performing the initial examination in the hospital ward.
  • the condition for performing the initial examination in the hospital ward may include that the patient has been arrived at the hospital ward for a certain time period. If the patient satisfies the condition, the processing device 210 may issue the reminder for performing the initial examination.
  • the processing device 210 may guide the nurse to the hospital ward. In some embodiments, the processing device 210 may control the movement of the intelligent nursing trolley 240-4 to guide the nurse to the hospital ward.
  • the initial examination may be performed on the patient.
  • the initial examination may be performed on the patient using one or more examination devices to collect measurement data of the patient.
  • the processing device 210 may direct the intelligent nursing trolley to present information relating to the initial examination to the nurse during the initial examination.
  • the intelligent nursing trolley may present initial examination illustrations, an electronic health record of the patient, etc.
  • the processing device 210 may generate a registration record.
  • the registration record refers to a record that indicates the patient has been admitted to the hospital ward and/or the status of the patient when he/she is admitted to the hospital ward.
  • the registration record may include admission information (e.g., admission number, clinical information, admission time, amount of hospitalization fees received in advance, payment manner, etc. ) , the measurement data collected during the initial examination, etc.
  • the processing device 210 may generate the registration record based on a registration temple and the measurement data. In some embodiments, the processing device 210 may generate the registration record further based on the electronic health record of the patient. In some embodiments, the processing device 210 may present the registration record to the nurse via the intelligent nursing trolley 240-4 or the nurse terminal device 1605, and generate the target registration record based on the registration record and feedback information regarding the registration record input by the nurse via the intelligent nursing trolley 240-4 or the nurse terminal device 1605. The feedback information may include a confirmation instruction, a modification instruction, etc., input by the nurse.
  • the hospitalization admission service can be provided to the patient in a semi-automated manner with the assistance of the medical service system (e.g., the intelligent nursing trolley 240-4) and/or the intelligent agent, which can reduce labor costs and enhance the efficiency of the hospitalization admission service.
  • the medical service system e.g., the intelligent nursing trolley 240-4
  • the intelligent agent e.g., the intelligent agent
  • FIG. 17 is a schematic diagram illustrating an exemplary process 1700 for providing a nursing service according to some embodiments of the present disclosure.
  • the process 1700 may be performed for every day when the patient is hospitalized to provide a nursing service for the patient.
  • at least a portion of the process 1700 is performed by a hospitalization intelligent agent corresponding to a hospitalization service configured on the processing device 210.
  • at least a portion of the process 1700 is performed by a nursing intelligent agent corresponding to nursing services configured on the processing device 210.
  • the processing device 210 may determine, based on patient data of the patient and a doctor’s order of the patient, a daily plan of the patient.
  • the doctor’s order of the patient refers to instructions or directives given by a doctor to the patient.
  • the doctor’s order of the patient may be stored in a storage device and be updated if any doctor gives a new doctor’s order for the patient.
  • the processing device 210 may obtain the latest version of the doctor’s order from the storage device.
  • the processing device 210 may monitor various hardware devices to detect whether the doctor’s order of the patient is updated. For example, when an admission inquiry service and/or a ward round service is provided to the patient, a doctor of the patient may give a new doctor’s order to the patient.
  • the processing device 210 may detect the new doctor’s order based on sensed information collected by sensing device (s) during the admission inquiry service and/or the ward round service. Once the new doctor’s order is detected, the new doctor’s order may be stored in the storage device. As another example, the doctor may update the doctor’s order of the patient stored in the storage device via the doctor terminal device. In some embodiments, the processing device 210 may determine the doctor’s order based on the electronic health record of the patient.
  • the processing device 210 may determine the daily plan of the patient based on the patient data of the patient and the doctor’s order of the patient.
  • the daily plan may include at least one medical operation needed to be performed on the patient in the day.
  • Exemplary medical operations may include a nursing operation, an examination operation, etc.
  • the processing device 210 may present the daily plan to the patient via a public terminal device in the hospital ward (e.g., the bedside terminal 240-6) .
  • the processing device 210 may present the daily plan to a nurse corresponding to the patient via a nurse terminal device, such as a terminal device in the nurse’s workstation, etc.
  • the nurse may perform the at least one nursing operation on the patient, and the processing device 210 may assist the nurse to perform the at least one nursing operation based on the daily plan.
  • the processing device 210 may control an intelligent nursing trolley to guide the nurse to the hospital ward to perform the nursing operation based on a planned time of the nursing operation. For example, before the planned time of a nursing operation, the intelligent nursing trolley may be controlled to move to the nurse’s workstation to notify the nurse that the nursing operation needs to be performed for the patient. Then, the intelligent nursing trolley may be controlled to move and guide the nurse to the hospital ward of the patient. The processing device 210 may further control the intelligent nursing trolley to present nursing illustrations regarding the nursing operation after the nurse arrives at the hospital ward.
  • the processing device 210 may generate a nursing record.
  • the nursing record refers to a record regarding nursing operations that have been applied to the patient and/or the patient’s status (e.g., vital signs and other physiological measurements) before, after, or when the nursing operations are performed.
  • the processing device 210 may obtain sensed information collected by one or more sensing devices in the hospital ward when the at least one nursing operation is performed, and generate the nursing record based on the sensed information.
  • the nursing record may be displayed to the nurse via the intelligent nursing trolley or the nurse terminal device for confirmation.
  • the automatic generation of the daily plan and the nursing record can significantly alleviate the workload of nurses.
  • This automation allows nurses to focus more on direct patient care rather than administrative tasks.
  • the monitoring of updates to doctor’s orders ensures timely updates to the daily plan.
  • This proactive approach enhances nursing effectiveness and quality of care by ensuring that interventions and care plans are promptly adjusted according to the latest medical instructions.
  • FIG. 18 is a schematic diagram illustrating an exemplary preoperative guidance process according to some embodiments of the present disclosure.
  • at least a portion of the process 1800 is performed by a surgery intelligent agent corresponding to the surgery service configured on the processing device 210.
  • the preoperative guidance may include patient escort, patient verification, preoperative education, preoperative cleaning, intravenous access establishment, etc.
  • the patient escort refers to transporting the patient from his/her current position to a waiting area of an operating room.
  • the patient verification refers to verifying whether a patient meets surgery criteria.
  • the patient verification may include: verifying that identity information of a verification subject matches a target patient for whom the current surgery process is to be performed; verifying that the surgery process of the verification subject is currently scheduled; verifying that a current physical condition of the verification subject meets the requirements for the surgery process. It can be understood that if the verification subject does not meet any one of the surgery criteria, the surgery process for the patient may be postponed or delayed.
  • the processing device 210 may collect biological information of the patient through one or more sensing devices in the waiting area and verify the patient’s identity based on the biological information. For example, as shown in FIG. 18, after the patient is transported to the waiting area 1810, the processing device 210 may collect the biological information of the patient 261 through one or more sensing devices 1811 (such as an image capture device, a microphone, a fingerprint sensor, etc. ) in the waiting area 1810, and verify an identity of the patient 261 based on the biological information. In some embodiments, the processing device 210 may utilize a nurse intelligent agent to verify the patient’s identity. For example, the nurse intelligent agent may verify the collected biological information or verify the patient’s identity through voice interaction with the patient (such as asking the patient's age, name, gender, etc. ) .
  • the processing device 210 may utilize a nurse intelligent agent to verify the patient’s identity. For example, the nurse intelligent agent may verify the collected biological information or verify the patient’s identity through voice interaction with the patient (such as asking the patient's age
  • the preoperative care includes a preoperative reassurance and preoperative education.
  • the preoperative reassurance refers to preoperative preparations that help reduce the patient’s negative emotions (such as anxiety, tension, fear, etc. ) through language communication, videos, music, etc.
  • the preoperative education refers to the preoperative preparations that help the patient understand the surgery process.
  • the preoperative cleaning refers to preoperative preparations such as body cleaning, hair removal (such as hair, body hair, etc. ) , the patient puts on surgery clothes, etc.
  • the intravenous access establishment refers to establishing a venous access for drug injection on the patient’s body to ensure that drugs can be effectively administered to the patient during the surgery process.
  • the processing device 210 may determine a planned route from the patient’s current position to the waiting area and control an intelligent chair to transport the patient to the waiting area along the planned route. For example, as shown in FIG. 18, before performing preoperative procedures on the patient based on the surgery plan, the processing device 210 may determine the planned route from the current position of the patient 261 (such as a hospital ward 1803) to the waiting area 1810. The processing device 210 may control an intelligent chair 240-5 to transport the patient 261 from the hospital ward 1803 to the waiting area 1810 along the planned route.
  • the processing device 210 may determine the planned route from the current position to the waiting area based on a hospital map. In some embodiments, the processing device 210 may be configured with a nurse intelligent agent that replaces a nurse in performing some tasks and may present a virtual nurse character. The processing device 210 may use the nurse intelligent agent to control the intelligent chair to transport the patient from the current position to the waiting area. In some embodiments, after the patient is transported to the waiting area, the processing device 210 may perform the patient verification.
  • the processing device 210 may determine preoperative care materials for the patient based on the patient data and the surgery plan. During the process of transporting the patient to the waiting area, the processing device 210 may use the patient terminal device to provide the preoperative education to the patient based on the preoperative care materials.
  • the preoperative care materials may include a video, a music, an image, a text, and other materials related to surgery explanations and/or emotional relaxation.
  • the processing device 210 may use the nurse intelligent agent to provide the preoperative education to the patient. For example, as shown in FIG. 18, the processing device 210 may present a virtual nurse character 1823 on the XR device 260-2 worn by the patient 261, and the virtual nurse character 1823 explains the preoperative care materials to the patient 261. In some embodiments, the virtual nurse character 1823 may engage in voice interaction with the patient 261 to alleviate the patient’s negative emotions or answer the patient's questions through communication. In some embodiments, the processing device 210 may determine whether it is necessary to alleviate the patient’s emotions by collecting the patient's facial expressions, physical signs, tone of voice, etc.
  • the processing device 210 may use the nurse intelligent agent to guide a nurse in performing the preoperative cleaning and/or the intravenous access establishment.
  • the processing device 210 may obtain sensed information related to a portion of the planned route from the current position of the intelligent chair to the waiting area (e.g., the portion of the planned route that the intelligent chair has not traveled) through one or more sensing devices in the hospital. Based on the sensed information, the processing device 210 may determine potential risks in the untraveled portion of the planned route and update the untraveled portion based on the potential risks.
  • the one or more sensing devices may include an image capture device (such as an infrared surveillance camera 1813) , a lidar, etc.
  • the one or more sensing devices may be installed in positions such as the intelligent chair, the hospital ceiling, or hospital walls.
  • a humanized, transparent, and efficient preoperative preparation process may be provided, and preoperative preparation items may be dynamically adjusted based on patient feedback to improve preoperative preparation efficiency.
  • preoperative preparation items may be dynamically adjusted based on patient feedback to improve preoperative preparation efficiency.
  • FIG. 19 is a schematic diagram illustrating an exemplary process 1900 of a surgery execution according to some embodiments of the present disclosure.
  • the surgery execution process may include the preoperative preparation, intraoperative matters, and postoperative matters.
  • at least a portion of the process 1900 is performed by a surgery intelligent agent corresponding to a surgery service configured on the processing device 210.
  • the preoperative preparation e.g., steps before the surgery execution
  • Activating the operating room may include opening an operating room door, activating surgery equipment within the operating room, monitoring equipment, adjusting parameters within the operating room, verifying a status of surgery equipment, etc.
  • the processing device 210 may control the intelligent robotic nurse to activate the operating room or guide a nurse to activate the operating room. For example, the processing device 210 may control the intelligent robotic nurse to automatically activate the operating room equipment at the scheduled time of the operation, and adjust the indoor temperature, the humidity, and the air quality.
  • the surgery tools may include surgery instruments and surgery consumables.
  • the processing device 210 may, based on the surgery plan, control the intelligent robotic nurse to prepare the surgery tools in the operating room before the surgery process.
  • the processing device 210 may further control the intelligent robotic nurse to disinfect an operating table and arrange the operating table (e.g., arrange the positions of various surgery tools on the operating table) .
  • the patient is confirmed and/or anesthetized.
  • the patient is confirmed refers that the patient’s identity is confirmed.
  • the patient is anesthetized refers that administering an anesthetic to the patient.
  • matters e.g., intraoperative matters
  • matters may include a remote collaboration, a tool delivery, an image interaction, an intraoperative planning and navigation, and a real-time alert.
  • the remote collaboration refers to a remote participation and/or guidance in the surgery process.
  • the tool delivery refers to a delivery of surgery tools to a surgery executor during the surgery process.
  • the processing device 210 may identify instructions for target surgery tools issued by surgery participants based on first sensed information collected by one or more first sensing devices in the operating room during the surgery. Based on these instructions, the processing device 210 may control the intelligent robotic nurse to deliver the target surgery tools to the surgery participants.
  • the image interaction refers to displaying the patient’s digital body model (e.g., a three-dimensional anatomical model of the surgery site) , the patient’s electronic medical record, a surgery plan for the current surgery, a real-time image of the patient’s surgery site, etc., to the surgery participants (e.g., the local surgery participants, the remote surgery participants) and/or patients through interactive devices (e.g., a display screen in the operating room, a doctor terminal device 270) in the operating room.
  • the surgery participants e.g., the local surgery participants, the remote surgery participants
  • interactive devices e.g., a display screen in the operating room, a doctor terminal device 270
  • the intraoperative planning and navigation refer to fusing the patient’s lesion images (e.g., CT scan images of the lesion) with the patient’s digital body model during the surgery process, projecting the lesion images on the patient’s physical body, or overlaying a positioning and tracking of the surgery tools, to guide the surgery participants in the surgery process.
  • lesion images e.g., CT scan images of the lesion
  • the real-time alert may include a behavior alert of the surgery participants, a patient vital sign alert, and an equipment operating status alert, etc.
  • the behavior alerts refer to a monitor and an alert of intraoperative operational behaviors of the surgery participants.
  • the patient vital sign alert may be activated when the patient's vital signs (such as electrocardiogram, blood pressure, etc. ) are abnormal.
  • the equipment operation status alert refers to a warning when there is an abnormal operation status of a surgery equipment.
  • the process (e.g., post-surgery matters) after the surgery execution may include operations 1931, 1933, and 1935.
  • the patient is transferred.
  • the patient being transferred refers to a process of moving the patient from the operating room to a rehabilitation area after the surgery process is completed.
  • transferring the patient may be performed by a healthcare professional assisted by an intelligent robotic nurse.
  • a room cleanup is operated.
  • Operating the room cleanup refers to a process of cleaning or sanitizing surgery equipment and tools of the surgery process.
  • the processing device 210 may control an intelligent robotic nurse to perform the operating the room cleanup.
  • the surgery report may include surgery-related information, patient-related records, participant-related records, etc.
  • the processing device 210 may generate a preliminary surgery report based on data (such as sensed information collected by one or more sensing devices in the operating room) collected during the surgery process.
  • the processing device 210 may generate the surgery report based on the preliminary surgery report and feedback information input by the doctor regarding the preliminary surgery report.
  • the processing device 210 may also monitor the patient’s postoperative signs through a vital sign monitoring equipment (e.g., an ECG monitor, a blood pressure monitor, etc. ) in the hospital ward to determine whether the patient's postoperative vital signs are within a normal range, whether there are any abnormalities, or whether the recovery progress is normal. Further, the processing device 210 may update the medical advice report based on the patient’s postoperative signs. In some embodiments, the processing device 210 may update the medical advice report based on doctor’s instructions. In some embodiments, the processing device 210 may send the updated medical advice report to the display device of the nurse’s workstation and/or the display device of the doctor’s workstation.
  • a vital sign monitoring equipment e.g., an ECG monitor, a blood pressure monitor, etc.
  • the processing device 210 may determine a postoperative care plan based on the updated medical advice report.
  • the postoperative care plan refers to nursing tasks that need to be performed by a nursing staff (e.g., a nurse, a nursing assistant, etc. ) during the patient’s postoperative hospital stay.
  • the processing device 210 may control the intelligent surgery equipment (e.g., the intelligent nursing trolley 240-4) to provide care to the patient based on the postoperative care plan.
  • the processing device 210 may send the postoperative care plan to the nurse so that the nurse may provide postoperative care to the patient.
  • the processing device 210 may update the postoperative care plan in real-time based on the patient’s condition during the care process.
  • the execution of the postoperative care plan is similar to the daily plan as described in connection with FIG. 17.
  • the processing device 210 may generate a doctor’s surgery outcome and an operation record based on the surgery report and the medical advice report, so that the doctor may review the surgery process.
  • the surgery outcome refers to data reflecting the results of the surgery process.
  • the surgery outcome also includes summary data of the doctor’s surgery results within a predetermined time period (e.g., one month) .
  • the operation record refers to a behavior record of the doctor during the surgery process.
  • the operation record may include action records, force records, standing position records, etc.
  • the processing device 210 may generate the surgery outcome and the operation record based on the surgery report and the medical advice report.
  • the surgery process is reviewed.
  • the processing device 210 may present the doctor’s surgery achievements and operational records to the doctor, thereby allowing the doctor to review the surgery process.
  • aspects of the present disclosure may be illustrated and described herein in any of a number of patentable classes or context including any new and useful process, machine, manufacture, or composition of matter, or any new and useful improvement thereof. Accordingly, aspects of the present disclosure may be implemented entirely hardware, entirely software (including firmware, resident software, micro-code, etc. ) or combining software and hardware implementation that may all generally be referred to herein as a “unit, ” “module, ” or “system. ” Furthermore, aspects of the present disclosure may take the form of a computer program product embodied in one or more computer readable media having computer readable program code embodied thereon.
  • the numbers expressing quantities or properties used to describe and claim certain embodiments of the application are to be understood as being modified in some instances by the term “about, ” “approximate, ” or “substantially. ”
  • “about, ” “approximate, ” or “substantially” may indicate ⁇ 1%, ⁇ 5%, ⁇ 10%, or ⁇ 20%variation of the value it describes, unless otherwise stated.
  • the numerical parameters set forth in the written description and attached claims are approximations that may vary depending upon the desired properties sought to be obtained by a particular embodiment.
  • the numerical parameters should be construed in light of the number of reported significant digits and by applying ordinary rounding techniques. Notwithstanding that the numerical ranges and parameters setting forth the broad scope of some embodiments of the application are approximations, the numerical values set forth in the specific examples are reported as precisely as practicable.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Medical Informatics (AREA)
  • Business, Economics & Management (AREA)
  • Public Health (AREA)
  • General Business, Economics & Management (AREA)
  • Primary Health Care (AREA)
  • Epidemiology (AREA)
  • General Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Pathology (AREA)
  • Medical Treatment And Welfare Office Work (AREA)

Abstract

Un système de gestion d'hôpital peut être fourni. Le système peut comprendre une interface prévue pour un utilisateur pour gérer des ressources d'un hôpital. Les ressources peuvent comprendre des jumeaux numériques qui mappent l'état d'entités physiques correspondantes et sont générés selon une structure de données prédéfinie.
PCT/CN2024/109060 2024-07-31 2024-07-31 Systèmes de gestion d'hôpital Pending WO2026025416A1 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
PCT/CN2024/109060 WO2026025416A1 (fr) 2024-07-31 2024-07-31 Systèmes de gestion d'hôpital
CN202510054032.8A CN119964757A (zh) 2024-07-31 2024-11-29 一种医院管理系统
CN202411743195.9A CN119580978A (zh) 2024-07-31 2024-11-29 一种医院管理系统

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2024/109060 WO2026025416A1 (fr) 2024-07-31 2024-07-31 Systèmes de gestion d'hôpital

Publications (1)

Publication Number Publication Date
WO2026025416A1 true WO2026025416A1 (fr) 2026-02-05

Family

ID=94815302

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2024/109060 Pending WO2026025416A1 (fr) 2024-07-31 2024-07-31 Systèmes de gestion d'hôpital

Country Status (2)

Country Link
CN (2) CN119580978A (fr)
WO (1) WO2026025416A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN120047259B (zh) * 2025-04-24 2025-07-01 四川省医学科学院·四川省人民医院 一种基于多维数据融合的医院智能财务管理系统

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022217263A1 (fr) * 2021-04-07 2022-10-13 Marc Garbey Architecture d'un système de raisonnement par ordinateur heuristique
CN116504373A (zh) * 2023-05-17 2023-07-28 湖南超视物联智能网络科技有限公司 数智病房综合管理信息平台
CN117851558A (zh) * 2023-12-08 2024-04-09 成都知识视觉科技有限公司 一种基于大语言模型的医学问答系统

Also Published As

Publication number Publication date
CN119964757A (zh) 2025-05-09
CN119580978A (zh) 2025-03-07

Similar Documents

Publication Publication Date Title
JP6949128B2 (ja) システム
WO2026025411A1 (fr) Systèmes et procédés de soins médicaux
WO2026025413A1 (fr) Méthodes, systèmes et supports de stockage pour fournir des services de consultation médicale
WO2026025416A1 (fr) Systèmes de gestion d'hôpital
WO2026025414A1 (fr) Systèmes et procédés pour fournir des services d'hospitalisation
WO2026025419A1 (fr) Plateformes de support d'hôpital
CN119811610A (zh) 一种提供住院护理服务的系统和方法
Jenefa et al. The Application of Artificial Intelligence and Robotics in Healthcare Services
WO2026025412A1 (fr) Systèmes et procédés de service médical
WO2026025420A1 (fr) Systèmes, dispositifs et méthodes de service médical
WO2026025417A1 (fr) Procédés, systèmes et supports de stockage pour la fourniture de soins médicaux
Monroy Rodríguez et al. Wearable and Pervasive Architecture for Digital Companions in Chronic Disease Care
WO2026025418A1 (fr) Procédés et systèmes d'assistance aux médecins dans leur travail
CN119964751A (zh) 一种医疗服务系统、装置、设备和方法
Mehta et al. Patient health record system
Nadeem Integration of hybrid knowledge graph models for real-time decision support in emergency medical care
Clipper et al. Emerging Trends in Healthcare
Tripathi 3 The Application of
Alanazi Exploring Policies and Strategies for the Diffusion of Remote Patient Monitoring (RPM) for the Care of Senior Population

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24949157

Country of ref document: EP

Kind code of ref document: A1