WO2020173055A1 - VRDS 4D医学影像多设备Ai联动显示方法及产品 - Google Patents
VRDS 4D医学影像多设备Ai联动显示方法及产品 Download PDFInfo
- Publication number
- WO2020173055A1 WO2020173055A1 PCT/CN2019/101162 CN2019101162W WO2020173055A1 WO 2020173055 A1 WO2020173055 A1 WO 2020173055A1 CN 2019101162 W CN2019101162 W CN 2019101162W WO 2020173055 A1 WO2020173055 A1 WO 2020173055A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- display
- display device
- image data
- spatial
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—Three-dimensional [3D] image rendering
- G06T15/10—Geometric effects
- G06T15/20—Perspective computation
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/37—Surgical systems with images on a monitor during operation
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
- G06T19/20—Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
- G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
- G16H40/67—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for remote operation
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/37—Surgical systems with images on a monitor during operation
- A61B2090/373—Surgical systems with images on a monitor during operation using light, e.g. by using optical scanners
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30084—Kidney; Renal
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30096—Tumor; Lesion
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30101—Blood vessel; Artery; Vein; Vascular
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2210/00—Indexing scheme for image generation or computer graphics
- G06T2210/41—Medical
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/07—Target detection
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2380/00—Specific applications
- G09G2380/08—Biomedical applications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
- G09G3/003—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background to produce spatial visual effects
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
Definitions
- This application relates to the technical field of medical imaging devices, and in particular to a VRDS 4D medical image multi-device Ai linkage display method and product.
- the embodiments of the present application provide a VRDS 4D medical image multi-device Ai linkage display method and product, in order to improve the real-time performance and intelligence of the medical imaging device for multi-device medical image linkage display.
- an embodiment of the present application provides a VRDS 4D medical image multi-device Ai linkage display method, which is applied to a server of a medical imaging device, and the medical imaging device includes the server, a first display device, and a second display device, The server connects the first display device and the second display device; the method includes:
- the target four-dimensional 4D image data extract the first part of the target 4D image data according to the preset original spatial attitude information and the display screen parameters of the first display device, and extract the first part of the target 4D image data according to the original spatial attitude information and the
- the display screen parameter of the second display device extracts the second part of the image data in the target 4D image data, the target 4D image data includes the image data of the inner space and the image data of the outer contour of the displayed target object;
- the first spatial posture information When receiving the first spatial posture information from the first display device and the second spatial posture information from the second display device, determine whether to enable the linked display function, and the first spatial posture information is the first display
- the space attitude control information collected by the device the second space attitude information is the space attitude control information collected by the second display device, and the first space attitude information is different from the original space attitude information
- the low display priority display device adjust the image data displayed by the low display priority display device, and output the image data based on the low display priority display device
- the linkage prompt information of the display device with high display priority
- embodiments of the present application provide a VRDS 4D medical imaging multi-device Ai linkage display device, which is applied to a server of a medical imaging device, and the medical imaging device includes the server, a first display device, and a second display device, The server connects the first display device and the second display device;
- the VRDS 4D medical image multi-device Ai linkage display device includes a processing unit and a communication unit, wherein:
- the processing unit is configured to obtain the target four-dimensional 4D image data through the communication unit, and extract the first part of the target 4D image data according to the preset original spatial attitude information and the display screen parameters of the first display device Data, extracting a second part of image data in the target 4D image data based on the original spatial attitude information and the display screen parameters of the second display device, the target 4D image data including the internal space of the target object being displayed
- the image data of the image data and the image data of the outer contour and the image data for displaying the first part of the image data on the first display device, and the image data of the second part for displaying on the second display device; and
- the collected space attitude control information, the second space attitude information is the space attitude control information collected by the second display device, and the first space attitude information is different from the original space attitude information; and if so, Then select the spatial posture information
- an embodiment of the present application provides a medical imaging device, including a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and configured by the above Executed by a processor, the above-mentioned program includes instructions for executing steps in any method of the first aspect of the embodiments of the present application.
- an embodiment of the present application provides a computer-readable storage medium, wherein the foregoing computer-readable storage medium stores a computer program for electronic data exchange, wherein the foregoing computer program enables a computer to execute In one aspect, some or all of the steps described in any method.
- embodiments of the present application provide a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute For example, some or all of the steps described in any method of the first aspect.
- the computer program product may be a software installation package.
- the medical imaging device first obtains the target 4D image data, and extracts the first part of the target 4D image data according to the preset original spatial posture information and the display screen parameters of the first display device.
- the original spatial posture information and the display screen parameters of the second display device extract the second part of the image data in the target 4D image data.
- the first part of the image data is displayed on the first display device, and the second part is displayed on the second display device.
- Image data and then, when receiving the first spatial posture information from the first display device and the second spatial posture information from the second display device, determine whether to enable the linked display function, and if so, select the display with high display priority
- the space attitude information of the device is used as the reference space attitude information.
- the image data displayed by the display device with low display priority is adjusted, and the display priority is lower.
- Level display devices output linkage prompt information based on high display priority display devices. It can be seen that the medical imaging device of the present application can perform real-time linkage display control of multiple devices for 4D images, and can handle linkage display control conflicts of multiple devices based on the priority mechanism, rationally arrange active and passive display devices, and improve the performance of medical imaging devices. The real-time and intelligence of the equipment medical image linkage display.
- FIG. 1 is a schematic structural diagram of a VRDS-based 4D medical image intelligent analysis and processing system provided by an embodiment of the present application;
- FIG. 2 is a schematic flowchart of a VRDS 4D medical image multi-device Ai linkage display method provided by an embodiment of the present application
- FIG. 3 is a schematic structural diagram of a medical imaging device provided by an embodiment of the present application.
- FIG. 4 is a block diagram of functional units of a VRDS 4D medical image multi-device Ai linkage display device provided by an embodiment of the present application.
- the medical imaging devices involved in the embodiments of this application refer to various instruments that use various media as information carriers to reproduce the internal structure of the human body as images.
- the image information and the actual structure of the human body have spatial and temporal distributions.
- DICOM data refers to the original image file data that reflects the internal structural characteristics of the human body collected by medical equipment, which can include Computed Tomography (CT), Magnetic Resonance Imaging (MRI), Diffusion Tensor Imaging (Diffusion Tensor Imaging, DTI), Positron Emission Computed Tomography (PET) and other information.
- CT Computed Tomography
- MRI Magnetic Resonance Imaging
- DTI Diffusion Tensor Imaging
- PET Positron Emission Computed Tomography
- Image source refers to the Texture2D/3D image volume data generated by analyzing the original DICOM data.
- VRDS refers to the Virtual Reality Doctor system (VRDS for short).
- FIG. 1 is a schematic structural diagram of a VRDS-based 4D medical image intelligent analysis and processing system 100 according to an embodiment of the present application.
- the system 100 includes a medical imaging device 110 and a network database 120.
- the medical imaging device 110 can It includes a server 111, a first display device 112, and a second display device 113.
- the server 111 is connected to the first display device 112 and the second display device 113.
- the medical imaging device 110 is configured to use the original DICOM data.
- multi-device linkage displays four-dimensional medical images (the four-dimensional medical image specifically refers to the medical image including the internal spatial structure characteristics of the displayed tissue and the external space Structural characteristics, the internal spatial structural characteristics mean that the slice data inside the tissue is not lost, that is, the medical imaging device can present the internal structure of target organs, blood vessels and other tissues, and the external spatial structural characteristics refer to the environmental characteristics between tissues, Including the spatial location characteristics between tissues (including crossing, spacing, fusion), etc., such as the edge structure characteristics of the crossing position between the kidney and the artery, etc.), the medical imaging device 110 can also be used to edit the image source data , Forming the transfer function result of the four-dimensional human body image, the transfer function result may include the transfer function result of the surface of the internal organs and the tissue structure in the internal organs of the human body, and the transfer function result of the cube space, such as the cube edit box required by the transfer function The number
- the network database 120 may be, for example, a cloud server.
- the network database 120 is used to store the image source generated by analyzing the original DICOM data and the transfer function result of the four-dimensional human body image edited by the medical imaging device 110.
- the image source may come from multiple sources.
- the medical imaging device 110 realizes interactive diagnosis of multiple doctors.
- Figure 2 is a flow diagram of a VRDS 4D medical image multi-device Ai linkage display method according to an embodiment of the present application, which is applied to the medical imaging device described in Figure 1; as shown in the figure, the VRDS 4D
- the Ai linkage display method of multiple medical imaging equipment includes:
- the medical imaging device acquires the target four-dimensional 4D image data, extracts the first part of the target 4D image data according to the preset original spatial posture information and the display screen parameters of the first display device, and according to the original space
- the posture information and the display screen parameters of the second display device extract the second part of the image data in the target 4D image data.
- the target 4D image data includes the image data of the inner space and the outer contour of the target object being displayed. Image data.
- the four-dimensional 4D image data refers to data related to the presentation of four-dimensional images
- the original spatial posture information refers to the initial spatial posture of the target object, that is, the initial spatial posture of the target object displayed by the medical imaging device.
- the original spatial posture information of the display device is the same.
- the display screen parameters refer to parameters such as screen material, number of colors, contrast, and brightness.
- the display screen parameters of the first display device and the display screen parameters of the second display device may be completely different or partly the same. As far as the same display parameters are concerned, they can be the same or different.
- the display can be LED display, STN display, UFB display, TFD display, TFT display, IPS display and OLED display, where the display of the first display device and the display of the second display device may be the same, for example, the display of the first display device and the display of the second display device
- the screens are all TFD displays, and the display screen of the first display device and the display screen of the second display device may be different.
- the display screen of the first display device is a UFB display screen
- the display screen of the second display device The display is a TFD display.
- first part of image data and the second part of image data may be completely different or partially intersect, which is not specifically limited.
- the first part of image data may be image data of the internal space of the target object displayed in the target 4D image data
- the second part of image data may be image data of the outer contour of the target object displayed in the target 4D image data.
- the medical imaging device can determine the spatial constraint conditions of the pixels of the display screen according to the display screen parameters, and determine the image data to be displayed of the target object in the initial spatial posture information state according to the spatial constraint conditions.
- the initial view angle of the human eye corresponds to the image data seen.
- the implementation manner for the medical imaging device to acquire the target four-dimensional 4D image data may be that the medical imaging device acquires the target four-dimensional 4D image data from the database of the network environment; the medical imaging device acquires the target four-dimensional 4D image data
- the image data may also be realized by the medical imaging device acquiring target four-dimensional 4D image data from other terminal devices; the medical imaging device may also acquire target four-dimensional 4D image data by acquiring a scan image for the target user.
- the scanned image includes any one of the following: CT image, MRI image, DTI image, PET-CT image, and then the bitmap BMP data source is determined according to the image, and then the target medical image data is generated according to the BMP data source, Finally, the medical imaging device screens the enhanced data with a quality score greater than a preset score from the target medical image data as 4D image data, wherein the quality score can be comprehensively evaluated from the following dimensions: average gradient, information entropy, and vision Information fidelity, peak signal-to-noise ratio PSNR, structural similarity SSIM, mean square error MSE, etc., can refer to common image quality scoring algorithms in the image field for details, which will not be repeated here; the medical imaging device can also be implemented by other The way to obtain the target four-dimensional 4D image data is not specifically limited.
- the medical imaging device can extract 4D image data corresponding to the display screen parameters of the display device from the 4D image data according to the display screen parameters of the display device, so as to improve the pertinence of the display device to display 4D image data.
- the medical imaging apparatus displays the first partial image data on the first display device, and displays the second partial image data on the second display device.
- the medical imaging device displays the first part of the image data on the first display device, and the second part of the image data is displayed on the second display device.
- the first part of image data is displayed on a display device, and the second part of image data is displayed on the second display device.
- the first part of the image data may be the image data of the inner space of the target object displayed in the target 4D image data
- the second part of the image data may be the outer contour of the target object displayed in the target 4D image data
- the medical imaging device displays the first part of the image data on the first display device, and displays the second part of the image data on the second display device may be implemented by: The image data of the internal space of the target object displayed in the target 4D image data is displayed on the first display device, and the outer contour of the target object displayed in the target 4D image data is displayed on the first display device Image data.
- the medical imaging device can extract the corresponding 4D image data from the 4D image data according to the display screen parameters of the display device, and perform the corresponding display, and finally realize the different analysis of the data in the target 4D image data. Screen display.
- the spatial attitude control information refers to information that controls the orientation of the target object.
- the spatial attitude control information collected by the display device may be information collected by the display device to control the spatial attitude generated by the user's operation action.
- the operation action refers to the operation control performed by the user on the four-dimensional human image through the external intake equipment of the medical imaging device, such as a mouse, a keyboard, etc., to realize human-computer interaction, and the operation action includes at least one of the following: (1) Change the color and/or transparency of a specific organ/tissue, (2) locate the zoom view, (3) rotate the view, realize the multi-view 360-degree observation of the four-dimensional human body image, (4) "enter" the internal structure of the human organ , Real-time cutting effect rendering, (5) Move the view up and down.
- the method for determining whether to enable the linked display function may be to detect whether the linked display switch of the server is turned on; if it is detected that the linked display switch is turned on, it is determined to enable the linked display function; When the linkage display switch is turned off, it is determined not to enable the linkage display function.
- the linked display switch may be a physical switch or a virtual function button.
- the physical switch may be set on the server, or dedicated settings may be made on the first or second display device, and the virtual function button may be set in the first or In the display interface of the second display device.
- the medical imaging device supports the active setting of the linkage display function, which improves the convenience and flexibility of use.
- the implementation of determining whether to enable the linked display function may also be detecting whether the difference between the first spatial posture information and the second spatial posture information is within a preset range; if so, then Determine to enable the linkage display function; if not, determine not to enable the linkage display function.
- the specific implementation manner of the medical imaging apparatus detecting whether the difference between the first spatial posture information and the second spatial posture information is within a preset range may be: the medical imaging apparatus acquires the first spatial posture information , Second spatial posture information; calculate the difference between the first spatial posture information and the second spatial posture information; compare the difference with a preset range; if the difference falls within the preset range, It is determined to enable the linkage display function; if the difference is not within the preset range, it is determined not to enable the linkage display function.
- the medical imaging apparatus judges whether to enable the linked display function based on the spatial posture information of multiple display devices, which improves the intelligence of the medical imaging apparatus for linked display.
- the method for determining whether to enable the linkage display function may be to detect whether the first display device and the second display device are used by the same user through a camera; if so, determine whether to enable linkage Display function; if not, it is determined not to enable the linked display function.
- the medical imaging device uses a camera to detect whether the first display device and the second display device are used by the same user.
- the implementation manner may be that the medical imaging device obtains information within the coverage area of the camera through the camera.
- One or more image frames the image frame includes the first display device, the second display device, and a user; the medical imaging device recognizes whether the user in the image frame is one or not according to the image frame If yes, determine that the first display device and the second display device are used by the same user; if not, determine the distance between multiple users and the first display device and the second display device Whether it is used by the same user.
- the medical imaging device can detect the current use scene as an independent user's use scene through the camera.
- the automatic linkage display function is more in line with the user's potential needs for positioning specific images, and the intelligence of the medical imaging device for linkage display is improved. .
- selecting the spatial posture information of the display device with a high display priority as the reference spatial posture information may be selecting the spatial posture information of the display device with a high display priority set by the user as the reference spatial posture information;
- the spatial posture information of the display device with the display priority can be used as the reference spatial posture information, or the security level of the display device can be obtained, and the spatial posture information of the display device with the high security level is used as the reference spatial posture information; select the high display priority
- the spatial posture information of the display device as the reference spatial posture information may also be obtained as historical data of the display device with a high display priority, and the spatial posture information of the display device with high frequency is used as the reference spatial posture information.
- the medical imaging device selects the corresponding spatial posture information as the reference spatial posture information according to the priority of the display device, which improves the intelligence of the medical imaging device for linked display.
- the medical imaging apparatus adjusts the image data displayed by the display device with low display priority according to the reference space attitude information and the display screen parameters of the display device with low display priority, and adjusts the image data displayed by the display device with low display priority.
- Level display devices output linkage prompt information based on high display priority display devices.
- the medical imaging device adjusts the implementation manner of the image data displayed by the display device with low display priority based on the reference spatial attitude information and the display screen parameters of the display device with low display priority It may be: the medical imaging device extracts the third part of the image data in the target 4D image data according to the reference space attitude information and the display screen parameters of the display device with low display priority; The image data displayed by the display device is updated to the third part of the image data.
- the third part of image data in the 4D image data may be completely different from the first part of image data and the second part of image data in the target 4D image data, or may be partly the same.
- the medical imaging device can extract additional image data for update display based on the reference spatial posture information and the display screen parameters of the display device with low display priority, which improves the intelligence of the medical imaging device for linked display.
- the target 4D image data includes multiple image data of the target object, and each image data includes pixel information and spatial position information of a corresponding pixel, and the spatial position information is used to indicate the The spatial location attribute of the pixel point in the 4D pixel space structure of the target object, the 4D pixel space structure corresponds to the real space structure of the target object;
- the medical imaging device is based on the reference space attitude information and low display priority Extracting the third part of the image data from the target 4D image data from the display screen parameters of the display device of the high-level display device includes: the medical imaging device determines according to the reference space attitude information and the display screen parameters of the display device with low display priority A spatial screening range of image data; multiple image data belonging to the spatial screening range are filtered from the multiple image data, and the multiple image data are the third part of the image data.
- the medical imaging device adjusts the image data displayed by the display device with low display priority according to the reference spatial attitude information and the display parameters of the display device with low display priority, and adjusts the image data displayed by the display device with low display priority.
- the display device outputs the linkage prompt information based on the display device with high display priority to improve the effect of multi-device linkage display.
- the first display device includes a virtual reality VR display device
- the second display device includes a personal computer PC display device
- the target 4D image data includes image data of the kidney of the target user
- the kidney part includes a kidney, a tumor, and blood vessels.
- the kidney has a blood supply relationship with the tumor.
- the blood vessels include a first blood vessel adjacent to the tumor and a second blood vessel connected to the tumor, and the The position of the first blood vessel and the second blood vessel are different and there is an intersection; the method further includes: if it is determined that the linked display function is not enabled, displaying the first blood vessel on the VR display device and simultaneously Display the second blood vessel on a PC display device; when a selection instruction for the first blood vessel and the second blood vessel is detected, extract image data of the intersection position of the first blood vessel and the second blood vessel; The image including the image data of the intersection is displayed on the VR display device and the PC display device, respectively.
- the medical imaging device can display different images on different VR display devices according to user operations, and intelligently screen blood vessel crossing positions and perform image display, thereby improving the intelligence and convenience of image display.
- the medical imaging device first obtains the target 4D image data, and extracts the first part of the target 4D image data according to the preset original spatial posture information and the display screen parameters of the first display device.
- the original spatial posture information and the display screen parameters of the second display device extract the second part of the image data in the target 4D image data.
- the first part of the image data is displayed on the first display device, and the second part is displayed on the second display device.
- Image data and then, when receiving the first spatial posture information from the first display device and the second spatial posture information from the second display device, determine whether to enable the linked display function, and if so, select the display with high display priority
- the space attitude information of the device is used as the reference space attitude information.
- the image data displayed by the display device with low display priority is adjusted, and the display priority is lower.
- Level display devices output linkage prompt information based on high display priority display devices. It can be seen that the medical imaging device of the present application can perform real-time linkage display control of multiple devices for 4D images, and can handle linkage display control conflicts of multiple devices based on the priority mechanism, rationally arrange active and passive display devices, and improve the performance of medical imaging devices. The real-time and intelligence of the equipment medical image linkage display.
- FIG. 3 is a schematic structural diagram of a medical imaging device 300 provided by an embodiment of the present application.
- the medical imaging device 300 includes processing The processor 310, the memory 320, the communication interface 330, and one or more programs 321, wherein the one or more programs 321 are stored in the memory 320 and configured to be executed by the processor 310, and the one or more programs 321 are
- a program 321 includes instructions for performing the following steps; acquiring target four-dimensional 4D image data, and extracting the first part of the target 4D image data according to preset original spatial posture information and the display screen parameters of the first display device Data, extracting a second part of image data in the target 4D image data based on the original spatial attitude information and the display screen parameters of the second display device, the target 4D image data including the internal space of the target object being displayed
- the medical imaging device first obtains the target 4D image data, and extracts the first part of the target 4D image data according to the preset original spatial posture information and the display screen parameters of the first display device.
- the original spatial posture information and the display screen parameters of the second display device extract the second part of the image data in the target 4D image data.
- the first part of the image data is displayed on the first display device, and the second part is displayed on the second display device.
- Image data and then, when receiving the first spatial posture information from the first display device and the second spatial posture information from the second display device, determine whether to enable the linked display function, and if so, select the display with high display priority
- the space attitude information of the device is used as the reference space attitude information.
- the image data displayed by the display device with low display priority is adjusted, and the display priority is lower.
- Level display devices output linkage prompt information based on high display priority display devices. It can be seen that the medical imaging device of the present application can perform real-time linkage display control of multiple devices for 4D images, and can handle linkage display control conflicts of multiple devices based on the priority mechanism, rationally arrange active and passive display devices, and improve the performance of medical imaging devices. The real-time and intelligence of the equipment medical image linkage display.
- the instructions in the program are specifically used to perform the following operations: detecting whether the linkage display switch of the server is turned on; if the linkage display switch is detected If it is turned on, it is determined to enable the linkage display function; if it is detected that the linkage display switch is turned off, it is determined not to enable the linkage display function.
- the instructions in the program are specifically used to perform the following operations: detecting the difference between the first spatial posture information and the second spatial posture information Whether it is within the preset range; if so, it is determined to enable the linkage display function; if not, it is determined not to enable the linkage display function.
- the instructions in the program are specifically used to perform the following operations: detecting whether the first display device and the second display device are the same through a camera. Used by a user; if yes, determine to enable the linkage display function; if not, determine not to enable the linkage display function.
- the program The instructions in are specifically used to perform the following operations: extract the third part of the image data in the target 4D image data according to the reference space attitude information and the display screen parameters of the display device with low display priority; prioritize the low display
- the image data displayed by the display device of the first level is updated to the third part of the image data.
- the target 4D image data includes multiple image data of the target object, and each image data includes pixel information and spatial position information of a corresponding pixel, and the spatial position information is used to indicate the The spatial position attribute of the pixel point in the 4D pixel space structure of the target object, the 4D pixel space structure corresponds to the real space structure of the target object; in the reference space attitude information and the low display priority
- the instructions in the program are specifically used to perform the following operations: according to the reference spatial attitude information and the display device with low display priority
- the parameters of the display screen determine the spatial screening range of the image data; multiple image data belonging to the spatial screening range are selected from the multiple image data, and the multiple image data are the third part of the image data.
- the first display device includes a virtual reality VR display device
- the second display device includes a personal computer PC display device
- the target 4D image data includes image data of the kidney of the target user, so
- the kidney part includes a kidney, a tumor, and blood vessels.
- the kidney has a blood supply relationship with the tumor.
- the blood vessels include a first blood vessel adjacent to the tumor and a second blood vessel connected to the tumor.
- the position of a blood vessel and the second blood vessel are different and there is an intersection; the one or more programs 321 also include instructions for executing the following steps; if it is determined that the linked display function is not enabled, display on the VR display device While the first blood vessel, the second blood vessel is displayed on the PC display device; when a selection instruction for the first blood vessel and the second blood vessel is detected, the first blood vessel and the second blood vessel are extracted The image data of the intersection position of the second blood vessel; and an image containing the image data of the intersection position is displayed on the VR display device and the PC display device, respectively.
- the medical imaging apparatus includes hardware structures and/or software modules corresponding to each function.
- this application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed by hardware or computer software-driven hardware depends on the specific application and design constraint conditions of the technical solution. Professionals and technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered beyond the scope of this application.
- the embodiment of the present application may divide the medical imaging device into functional units according to the foregoing method examples.
- each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit.
- the above-mentioned integrated unit can be implemented in the form of hardware or software functional unit. It should be noted that the division of units in the embodiments of the present application is illustrative, and is only a logical function division, and there may be other division methods in actual implementation.
- the VRDS 4D medical image multi-device Ai linkage display device 400 is applied to a medical imaging device.
- the VRDS 4D medical image multiple device Ai linkage display device 400 includes a processing unit 401 and a communication unit 402. Among them,
- the processing unit 401 is configured to obtain the target four-dimensional 4D image data through the communication unit, and extract the first part of the target 4D image data according to the preset original spatial attitude information and the display screen parameters of the first display device Image data, extracting a second part of image data in the target 4D image data according to the original spatial attitude information and the display screen parameters of the second display device, the target 4D image data including the interior of the target object being displayed Image data of the space and image data of the outer contour; and used for displaying the first part of image data on the first display device, and for displaying the second part of image data on the second display device; and When receiving the first spatial posture information from the first display device and the second spatial posture information from the second display device, determine whether to enable the linked display function, and the first spatial posture information is the first display
- the space attitude control information collected by the device, the second space attitude information is the space attitude control information collected by the second display device, and the first space attitude information is different from the original space attitude information; and , Select the spatial attitude information of the display device with
- the VRDS 4D medical image multi-device Ai linkage display device 400 further includes a storage unit 403, the processing unit 401 may be a processor, the communication unit 402 may be a transceiver, and the storage unit may be a memory.
- the medical imaging device first obtains the target 4D image data, and extracts the first part of the target 4D image data according to the preset original spatial posture information and the display screen parameters of the first display device.
- the original spatial posture information and the display screen parameters of the second display device extract the second part of the image data in the target 4D image data.
- the first part of the image data is displayed on the first display device, and the second part is displayed on the second display device.
- Image data and then, when receiving the first spatial posture information from the first display device and the second spatial posture information from the second display device, determine whether to enable the linked display function, and if so, select the display with high display priority
- the space attitude information of the device is used as the reference space attitude information.
- the image data displayed by the display device with low display priority is adjusted, and the display priority is lower.
- Level display devices output linkage prompt information based on high display priority display devices. It can be seen that the medical imaging device of the present application can perform real-time linkage display control of multiple devices for 4D images, and can handle linkage display control conflicts of multiple devices based on the priority mechanism, rationally arrange active and passive display devices, and improve the performance of medical imaging devices. The real-time and intelligence of the equipment medical image linkage display.
- the processing unit 401 is specifically configured to: detect whether the linkage display switch of the server is turned on; if it is detected that the linkage display switch is turned on, determine Enable the linkage display function; if it is detected that the linkage display switch is turned off, it is determined not to enable the linkage display function.
- the processing unit 401 is specifically configured to: detect whether the difference between the first spatial posture information and the second spatial posture information is within a preset value. Within the range; if yes, determine to enable the linkage display function; if not, determine not to enable the linkage display function.
- the processing unit 401 is specifically configured to: use a camera to detect whether the first display device and the second display device are used by the same user ; If yes, determine to enable the linkage display function; if not, determine not to enable the linkage display function.
- the processing The unit 401 is specifically configured to: extract the third part of the image data in the target 4D image data according to the reference spatial attitude information and the display screen parameters of the display device with low display priority; The displayed image data is updated to the third part of the image data.
- the target 4D image data includes multiple image data of the target object, and each image data includes pixel information and spatial position information of a corresponding pixel, and the spatial position information is used to indicate the The spatial position attribute of the pixel point in the 4D pixel space structure of the target object, the 4D pixel space structure corresponds to the real space structure of the target object; in the reference space attitude information and the low display priority
- the processing unit 401 is specifically configured to: according to the reference space attitude information and the display screen parameters of the display device with low display priority Determine the spatial screening range of the image data; filter multiple image data belonging to the spatial screening range from the multiple image data, and the multiple image data are the third part of the image data.
- the first display device includes a virtual reality VR display device
- the second display device includes a personal computer PC display device
- the target 4D image data includes image data of the kidney of the target user, so
- the kidney part includes a kidney, a tumor, and blood vessels.
- the kidney has a blood supply relationship with the tumor.
- the blood vessels include a first blood vessel adjacent to the tumor and a second blood vessel connected to the tumor.
- a blood vessel and the second blood vessel are at a different position and have an intersection; the processing unit 401 is also used to, if it is determined that the linked display function is not enabled, display the first blood vessel on the VR display device while simultaneously The second blood vessel is displayed on the PC display device; when a selection instruction for the first blood vessel and the second blood vessel is detected, an image of the intersection of the first blood vessel and the second blood vessel is extracted Data; respectively display images containing the image data of the intersection on the VR display device and the PC display device.
- An embodiment of the present application also provides a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, and the computer program enables a computer to execute part or all of the steps of any method as recorded in the above method embodiment ,
- the aforementioned computer includes a medical imaging device.
- the embodiments of the present application also provide a computer program product.
- the above-mentioned computer program product includes a non-transitory computer-readable storage medium storing a computer program. Part or all of the steps of the method.
- the computer program product may be a software installation package, and the computer includes a medical imaging device.
- the disclosed device may be implemented in other ways.
- the device embodiments described above are only illustrative.
- the division of the above-mentioned units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components can be combined or integrated. To another system, or some features can be ignored, or not implemented.
- the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical or other forms.
- the units described above as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
- the functional units in the various embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
- the above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.
- the above integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable memory.
- the technical solution of the present application essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a memory, A number of instructions are included to enable a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the foregoing methods of the various embodiments of the present application.
- the aforementioned memory includes: U disk, Read-Only Memory (ROM, Read-Only Memory), Random Access Memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes.
- the program can be stored in a computer-readable memory, and the memory can include: flash disk , Read-only memory (English: Read-Only Memory, abbreviation: ROM), random access device (English: Random Access Memory, abbreviation: RAM), magnetic disk or optical disc, etc.
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Radiology & Medical Imaging (AREA)
- Human Computer Interaction (AREA)
- Public Health (AREA)
- Primary Health Care (AREA)
- Epidemiology (AREA)
- Biomedical Technology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Surgery (AREA)
- Life Sciences & Earth Sciences (AREA)
- Multimedia (AREA)
- Computer Graphics (AREA)
- Quality & Reliability (AREA)
- Animal Behavior & Ethology (AREA)
- Gynecology & Obstetrics (AREA)
- Veterinary Medicine (AREA)
- Molecular Biology (AREA)
- Pathology (AREA)
- Heart & Thoracic Surgery (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Computing Systems (AREA)
- General Business, Economics & Management (AREA)
- Geometry (AREA)
- Business, Economics & Management (AREA)
- Architecture (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Apparatus For Radiation Diagnosis (AREA)
- Processing Or Creating Images (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
Description
Claims (20)
- 一种VRDS 4D医学影像多设备Ai联动显示方法,其特征在于,应用于医学成像装置的服务器,所述医学成像装置包括所述服务器、第一显示设备和第二显示设备,所述服务器连接所述第一显示设备和所述第二显示设备;所述方法包括:获取目标四维4D影像数据,根据预设的原始空间姿态信息和所述第一显示设备的显示屏参数提取所述目标4D影像数据中的第一部分影像数据,根据所述原始空间姿态信息和所述第二显示设备的显示屏参数提取所述目标4D影像数据中的第二部分影像数据,所述目标4D影像数据包括被显示的目标物体的内部空间的影像数据和外部轮廓的影像数据;在所述第一显示设备上显示所述第一部分影像数据,在所述第二显示设备上显示所述第二部分影像数据;在接收到来自第一显示设备的第一空间姿态信息和来自所述第二显示设备的第二空间姿态信息时,判断是否启用联动显示功能,所述第一空间姿态信息是所述第一显示设备采集的空间姿态控制信息,所述第二空间姿态信息是所述第二显示设备采集的空间姿态控制信息,且所述第一空间姿态信息不同于所述原始空间姿态信息;若是,则选取高显示优先级的显示设备的空间姿态信息作为参考空间姿态信息;根据所述参考空间姿态信息和低显示优先级的显示设备的显示屏参数,调整所述低显示优先级的显示设备所显示的影像数据,并在所述低显示优先级的显示设备上输出基于高显示优先级的显示设备的联动提示信息。
- 根据权利要求1所述的方法,其特征在于,所述判断是否启用联动显示功能,包括:检测所述服务器的联动显示开关是否开启;若检测到所述联动显示开关开启,则确定启用联动显示功能;若检测到所述联动显示开关关闭,则确定不启用所述联动显示功能。
- 根据权利要求1所述的方法,其特征在于,所述判断是否启用联动显示功能,包括:检测所述第一空间姿态信息和所述第二空间姿态信息的差值是否在预设范围内;若是,则确定启用联动显示功能;如否,则确定不启用所述联动显示功能。
- 根据权利要求3所述的方法,其特征在于,所述检测所述第一空间姿态信息和所述第二空间姿态信息的差值是否在预设范围内,包括:获取第一空间姿态信息、第二空间姿态信息;计算所述第一空间姿态信息、第二空间姿态信息的差值;将所述差值与预设范围进行比较;若所述差值落入所述预设范围,则确定启用联动显示功能;若所述差值不在所述预设范围内,则确定不启用所述联动显示功能。
- 根据权利要求1所述的方法,其特征在于,所述判断是否启用联动显示功能,包括:通过摄像头检测所述第一显示设备和所述第二显示设备是否为同一个用户所使用;若是,则确定启用联动显示功能;如否,则确定不启用所述联动显示功能。
- 根据权利要求4所述的方法,其特征在于,所述通过摄像头检测所述第一显示设备和所述第二显示设备是否为同一个用户所使用,包括:通过所述摄像头获取所述摄像头覆盖范围内的一帧或者多帧图像帧,所述图像帧包括所述第一显示设备、所述第二显示设备、以及用户;根据所述图像帧识别出图像帧中的用户是否为同一个用户所使用。
- 根据权利要求1-6任一项所述的方法,其特征在于,所述根据所述参考空间姿态信 息和低显示优先级的显示设备的显示屏参数,调整所述低显示优先级的显示设备所显示的影像数据,包括:根据所述参考空间姿态信息和低显示优先级的显示设备的显示屏参数提取所述目标4D影像数据中的第三部分影像数据;将所述低显示优先级的显示设备所显示的影像数据更新为所述第三部分影像数据。
- 根据权利要求7所述的方法,其特征在于,所述目标4D影像数据包括所述目标物体的多个影像数据,每个影像数据包括对应像素点的像素信息和空间位置信息,所述空间位置信息用于表示所述像素点在所述目标物体的4D像素空间结构的空间位置属性,所述4D像素空间结构与所述目标物体的真实空间结构对应;所述根据所述参考空间姿态信息和低显示优先级的显示设备的显示屏参数提取所述目标4D影像数据中的第三部分影像数据,包括:根据所述参考空间姿态信息和低显示优先级的显示设备的显示屏参数确定影像数据的空间筛选范围;从所述多个影像数据中筛选出属于所述空间筛选范围内的多个影像数据,所述多个影像数据为第三部分影像数据。
- 根据权利要求1-8任一项所述的方法,其特征在于,所述第一显示设备包括虚拟现实VR显示设备,所述第二显示设备包括个人电脑PC显示设备;所述目标4D影像数据包括目标用户的肾脏部位的影像数据,所述肾脏部位包括肾脏、肿瘤及血管,所述肾脏与所述肿瘤存在供血关系,所述血管包括与所述肿瘤相邻的第一血管和与所述肿瘤相连的第二血管,且所述第一血管与所述第二血管位置不同且有交叉;所述方法还包括:若判断出未启用联动显示功能,则在所述VR显示设备上显示所述第一血管的同时,在所述PC显示设备上显示所述第二血管;在检测到针对所述第一血管和所述第二血管的选择指令时,提取所述第一血管和所述第二血管的交叉位置的影像数据;分别在所述VR显示设备上和所述PC显示设备上显示包含所述交叉位置的影像数据的影像。
- 一种VRDS 4D医学影像多设备Ai联动显示装置,其特征在于,应用于医学成像装置的服务器,所述医学成像装置包括所述服务器、第一显示设备和第二显示设备,所述服务器连接所述第一显示设备和所述第二显示设备;所述VRDS 4D医学影像多设备Ai联动显示装置包括处理单元和通信单元,其中,所述处理单元,用于通过所述通信单元获取目标四维4D影像数据,根据预设的原始空间姿态信息和所述第一显示设备的显示屏参数提取所述目标4D影像数据中的第一部分影像数据,根据所述原始空间姿态信息和所述第二显示设备的显示屏参数提取所述目标4D影像数据中的第二部分影像数据,所述目标4D影像数据包括被显示的目标物体的内部空间的影像数据和外部轮廓的影像数据;以及用于在所述第一显示设备上显示所述第一部分影像数据,在所述第二显示设备上显示所述第二部分影像数据;以及用于在接收到来自第一显示设备的第一空间姿态信息和来自所述第二显示设备的第二空间姿态信息时,判断是否启用联动显示功能,所述第一空间姿态信息是所述第一显示设备采集的空间姿态控制信息,所述第二空间姿态信息是所述第二显示设备采集的空间姿态控制信息,且所述第一空间姿态信息不同于所述原始空间姿态信息;以及用于若是,则选取高显示优先级的显示设备的空间姿态信息作为参考空间姿态信息;以及用于根据所述参考空间姿态信息和低显示优先级的显示设备的显示屏参数,调整所述低显示优先级的显示设备所显示的影像数据,并在所述低显示优先级的显示设备上输出基于高显示优先级的显示设备的联动提示信息。
- 根据权利要求10所述的装置,其特征在于,在所述判断是否启用联动显示功能方面,所述处理单元具体用于:检测所述服务器的联动显示开关是否开启;若检测到所述联动显示开关开启,则确定启用联动显示功能;若检测到所述联动显示开关关闭,则确定不启用所述联动显示功能。
- 根据权利要求10所述的装置,其特征在于,在所述判断是否启用联动显示功能方面,所述处理单元具体用于:检测所述第一空间姿态信息和所述第二空间姿态信息的差值是否在预设范围内;若是,则确定启用联动显示功能;如否,则确定不启用所述联动显示功能。
- 根据权利要求12所述的装置,其特征在于,在所述检测所述第一空间姿态信息和所述第二空间姿态信息的差值是否在预设范围内方面,所述处理单元具体用于:获取第一空间姿态信息、第二空间姿态信息;计算所述第一空间姿态信息、第二空间姿态信息的差值;将所述差值与预设范围进行比较;若所述差值落入所述预设范围,则确定启用联动显示功能;若所述差值不在所述预设范围内,则确定不启用所述联动显示功能。
- 根据权利要求10所述的装置,其特征在于,在所述判断是否启用联动显示功能方面,所述处理单元具体用于:通过摄像头检测所述第一显示设备和所述第二显示设备是否为同一个用户所使用;若是,则确定启用联动显示功能;如否,则确定不启用所述联动显示功能。
- 根据权利要求14所述的装置,其特征在于,在所述通过摄像头检测所述第一显示设备和所述第二显示设备是否为同一个用户所使用方面,所述处理单元具体用于:通过所述摄像头获取所述摄像头覆盖范围内的一帧或者多帧图像帧,所述图像帧包括所述第一显示设备、所述第二显示设备、以及用户;根据所述图像帧识别出图像帧中的用户是否为同一个用户所使用。
- 根据权利要求10-15任一项所述的装置,其特征在于,在所述根据所述参考空间姿态信息和低显示优先级的显示设备的显示屏参数,调整所述低显示优先级的显示设备所显示的影像数据方面,所述处理单元具体用于:根据所述参考空间姿态信息和低显示优先级的显示设备的显示屏参数提取所述目标4D影像数据中的第三部分影像数据;将所述低显示优先级的显示设备所显示的影像数据更新为所述第三部分影像数据。
- 根据权利要求16所述的装置,其特征在于,在所述目标4D影像数据包括所述目标物体的多个影像数据,每个影像数据包括对应像素点的像素信息和空间位置信息,所述空间位置信息用于表示所述像素点在所述目标物体的4D像素空间结构的空间位置属性,所述4D像素空间结构与所述目标物体的真实空间结构对应;所述根据所述参考空间姿态信息和低显示优先级的显示设备的显示屏参数提取所述目标4D影像数据中的第三部分影像数据方面,所述处理单元具体用于:根据所述参考空间姿态信息和低显示优先级的显示设备的显示屏参数确定影像数据的空间筛选范围;从所述多个影像数据中筛选出属于所述空间筛选范围内的多个影像数据,所述多个影像数据为第三部分影像数据。
- 根据权利要求10-17任一项所述的装置,其特征在于,在所述第一显示设备包括虚拟现实VR显示设备,所述第二显示设备包括个人电脑PC显示设备;所述目标4D影像数据包括目标用户的肾脏部位的影像数据,所述肾脏部位包括肾脏、肿瘤及血管,所述肾脏与所述肿瘤存在供血关系,所述血管包括与所述肿瘤相邻的第一血管和与所述肿瘤相连的第二血管,且所述第一血管与所述第二血管位置不同且有交叉方面,所述处理单元还具体用于:若判断出未启用联动显示功能,则在所述VR显示设备上显示所述第一血管的同时,在所述PC显示设备上显示所述第二血管;在检测到针对所述第一血管和所述第二血管的选择指令时,提取所述第一血管和所述第二血管的交叉位置的影像数据;分别在所述VR显示设 备上和所述PC显示设备上显示包含所述交叉位置的影像数据的影像。
- 一种医学成像装置,其特征在于,包括处理器、存储器、通信接口,以及一个或多个程序,所述一个或多个程序被存储在所述存储器中,并且被配置由所述处理器执行,所述程序包括用于执行如权利要求1-9任一项所述的方法中的步骤的指令。
- 一种计算机可读存储介质,其特征在于,存储用于电子数据交换的计算机程序,其中,所述计算机程序使得计算机执行如权利要求1-9任一项所述的方法。
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| AU2019431324A AU2019431324B2 (en) | 2019-02-28 | 2019-08-16 | VRDS 4D medical image multi-device Ai interconnected display method and product |
| EP19917106.7A EP3933847A4 (en) | 2019-02-28 | 2019-08-16 | 4D VRDS MEDICAL IMAGE MULTI-DEVICE AI INTERCONNECTED DISPLAY METHOD AND PRODUCT |
| US17/433,234 US20220137909A1 (en) | 2019-02-28 | 2019-08-16 | Method and product for multi-device ai linkage displaying of a vrds 4d medical image |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910152226.6 | 2019-02-28 | ||
| CN201910152226.6A CN111627528A (zh) | 2019-02-28 | 2019-02-28 | VRDS 4D医学影像多设备Ai联动显示方法及产品 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2020173055A1 true WO2020173055A1 (zh) | 2020-09-03 |
Family
ID=72238978
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2019/101162 Ceased WO2020173055A1 (zh) | 2019-02-28 | 2019-08-16 | VRDS 4D医学影像多设备Ai联动显示方法及产品 |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US20220137909A1 (zh) |
| EP (1) | EP3933847A4 (zh) |
| CN (1) | CN111627528A (zh) |
| AU (1) | AU2019431324B2 (zh) |
| WO (1) | WO2020173055A1 (zh) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113240645B (zh) * | 2021-05-17 | 2024-04-16 | 赤峰学院附属医院 | 显示处理方法、装置、存储介质、处理器及终端设备 |
| CN115565479B (zh) * | 2022-09-20 | 2025-03-28 | 杭州海康慧影科技有限公司 | 一种多显示屏图像显示方法、装置及存储介质 |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012020695A1 (ja) * | 2010-08-09 | 2012-02-16 | シャープ株式会社 | 表示装置、表示制御方法、表示制御プログラム、及びコンピュータ読み取り可能な記録媒体 |
| CN102982233A (zh) * | 2012-11-01 | 2013-03-20 | 华中科技大学 | 具有立体视觉显示的医学影像工作站 |
| US20160350503A1 (en) * | 2015-05-26 | 2016-12-01 | Samsung Electronics Co., Ltd. | Medical image display apparatus and method of providing user interface |
| CN107885476A (zh) * | 2017-11-06 | 2018-04-06 | 上海联影医疗科技有限公司 | 一种医学影像显示方法及装置 |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070248261A1 (en) * | 2005-12-31 | 2007-10-25 | Bracco Imaging, S.P.A. | Systems and methods for collaborative interactive visualization of 3D data sets over a network ("DextroNet") |
| JP2013128725A (ja) * | 2011-12-22 | 2013-07-04 | Hitachi Medical Corp | 検査情報表示装置及びシステム |
| US10231704B2 (en) * | 2013-12-20 | 2019-03-19 | Raghu Raghavan | Method for acquiring ultrasonic data |
| KR101728044B1 (ko) * | 2015-02-02 | 2017-04-18 | 삼성전자주식회사 | 의료 영상을 디스플레이 하기 위한 방법 및 장치 |
| JP6298432B2 (ja) * | 2015-10-19 | 2018-03-20 | 株式会社コロプラ | 画像生成装置、画像生成方法、及び画像生成プログラム |
| JP6688536B2 (ja) * | 2016-09-07 | 2020-04-28 | エレクタ、インク.Elekta, Inc. | 放射線療法治療計画のモデルを学習して放射線療法の線量分布を予測するためのシステムおよび方法 |
| US10751548B2 (en) * | 2017-07-28 | 2020-08-25 | Elekta, Inc. | Automated image segmentation using DCNN such as for radiation therapy |
-
2019
- 2019-02-28 CN CN201910152226.6A patent/CN111627528A/zh active Pending
- 2019-08-16 EP EP19917106.7A patent/EP3933847A4/en not_active Withdrawn
- 2019-08-16 US US17/433,234 patent/US20220137909A1/en active Pending
- 2019-08-16 WO PCT/CN2019/101162 patent/WO2020173055A1/zh not_active Ceased
- 2019-08-16 AU AU2019431324A patent/AU2019431324B2/en not_active Ceased
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012020695A1 (ja) * | 2010-08-09 | 2012-02-16 | シャープ株式会社 | 表示装置、表示制御方法、表示制御プログラム、及びコンピュータ読み取り可能な記録媒体 |
| CN102982233A (zh) * | 2012-11-01 | 2013-03-20 | 华中科技大学 | 具有立体视觉显示的医学影像工作站 |
| US20160350503A1 (en) * | 2015-05-26 | 2016-12-01 | Samsung Electronics Co., Ltd. | Medical image display apparatus and method of providing user interface |
| CN107885476A (zh) * | 2017-11-06 | 2018-04-06 | 上海联影医疗科技有限公司 | 一种医学影像显示方法及装置 |
Non-Patent Citations (1)
| Title |
|---|
| See also references of EP3933847A4 * |
Also Published As
| Publication number | Publication date |
|---|---|
| EP3933847A4 (en) | 2023-07-26 |
| AU2019431324A1 (en) | 2021-09-16 |
| CN111627528A (zh) | 2020-09-04 |
| AU2019431324B2 (en) | 2022-09-08 |
| EP3933847A1 (en) | 2022-01-05 |
| US20220137909A1 (en) | 2022-05-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113645896B (zh) | 手术计划、手术导航和成像用系统 | |
| US10692272B2 (en) | System and method for removing voxel image data from being rendered according to a cutting region | |
| US10248756B2 (en) | Anatomically specific movie driven medical image review | |
| WO2018095346A1 (zh) | 一种基于hmds的医学成像系统 | |
| WO2021081771A1 (zh) | 基于vrds ai医学影像的心脏冠脉的分析方法和相关装置 | |
| US12073508B2 (en) | System and method for image processing | |
| AU2019430369B2 (en) | VRDS 4D medical image-based vein Ai endoscopic analysis method and product | |
| AU2019430773B2 (en) | VRDS 4D medical image-based AI processing method and product for tumors | |
| WO2020173055A1 (zh) | VRDS 4D医学影像多设备Ai联动显示方法及产品 | |
| WO2021030995A1 (zh) | 基于vrds ai下腔静脉影像的分析方法及产品 | |
| AU2019430258B2 (en) | VRDS 4D medical image-based tumor and blood vessel ai processing method and product | |
| AU2019431568B2 (en) | Method and product for processing of vrds 4d medical images | |
| AU2019429940B2 (en) | AI identification method of embolism based on VRDS 4D medical image, and product | |
| WO2021081850A1 (zh) | 基于vrds 4d医学影像的脊椎疾病识别方法及相关装置 | |
| AU2019430854B2 (en) | VRDS 4D medical image-based artery and vein Ai processing method and product |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19917106 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 2019431324 Country of ref document: AU Date of ref document: 20190816 Kind code of ref document: A |
|
| ENP | Entry into the national phase |
Ref document number: 2019917106 Country of ref document: EP Effective date: 20210928 |