WO2024252494A1 - Dispositif, procédé et programme de traitement vidéo - Google Patents
Dispositif, procédé et programme de traitement vidéo Download PDFInfo
- Publication number
- WO2024252494A1 WO2024252494A1 PCT/JP2023/020873 JP2023020873W WO2024252494A1 WO 2024252494 A1 WO2024252494 A1 WO 2024252494A1 JP 2023020873 W JP2023020873 W JP 2023020873W WO 2024252494 A1 WO2024252494 A1 WO 2024252494A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- behavior
- video
- composite
- label
- basic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
Definitions
- Embodiments of the present invention relate to a video processing device, method, and program.
- Non-Patent Document 1 prepares a video dataset annotated with the action labels of the recognition target as training data in advance, and acquires a model trained to recognize actions shown in the input video.
- the action labels defined in the video dataset are the recognition target, and these action labels are basic action labels as generic action labels such as actions that may commonly occur in the business of various industries, for example, "walking", "holding” or "putting”.
- an action label specific to a certain industry for example, "displaying a product”
- a composite action label which is a combination of the basic action labels "holding a product” and "placing a product.”
- This invention was made in light of the above circumstances, and its purpose is to provide a video processing device, method, and program that can appropriately estimate the combination of units of the actions of a person shown in a video.
- An image processing device includes an image feature extraction unit that extracts feature information indicative of features of an image, and an estimation unit that estimates a composite behavior, which is a combination of basic behaviors indicative of a general-purpose behavior of a subject, based on features based on the relationship between linguistic information related to the behavior of a subject appearing in the image and the feature information extracted by the image feature extraction unit.
- the image processing method is a method performed by an image processing device, and includes: extracting feature information indicating features of an image by an image feature extraction unit of the image processing device; and estimating, by an estimation unit of the image processing device, a composite behavior that is a combination of basic behaviors indicating general-purpose behavior of the subject, based on features based on the relationship of linguistic information related to the behavior of the subject appearing in the image and the feature information extracted by the image feature extraction unit.
- the present invention makes it possible to appropriately estimate the combination of units of a person's actions shown in a video.
- FIG. 1 is a diagram showing an application example of a video processing device according to an embodiment of the present invention.
- FIG. 2 is a diagram showing an example of the concept of each function of the video processing device according to one embodiment of the present invention.
- FIG. 3 is a diagram showing an example of an action dictionary in the medical and nursing industry.
- Figure 4 is a flow chart showing a first example of a learning processing routine executed by the video processing device.
- FIG. 5 is a flowchart showing a second example of a learning process routine executed by the video processing device.
- FIG. 6 is a flowchart showing a first example of an inference processing routine executed by the video processing device.
- FIG. 7 is a flowchart showing a second example of an inference processing routine executed by the video processing device.
- Figure 8 is a block diagram showing an example of the hardware configuration of an image processing device according to one embodiment of the present invention.
- FIG. 1 is a diagram showing an application example of a video processing device according to an embodiment of the present invention.
- the video processing device 100 shown in FIG. 1 is configured as a computer having a CPU (Central Processing Unit), a RAM (Random Access Memory), and a ROM (Read Only Memory) in which a program for executing a video processing routine described below is stored, and is functionally configured as follows.
- CPU Central Processing Unit
- RAM Random Access Memory
- ROM Read Only Memory
- the video processing device 100 includes a memory unit 1, a video feature extraction unit 2, a label feature creation unit 3, a basic behavior inference unit 4, a composite behavior inference unit 5, a parameter update unit 6, an output unit 7, and a correct composite behavior label creation unit 8.
- the storage unit 1 stores a video x, an action dictionary D, a correct basic action label j, a pseudo correct composite action label l, a video feature extraction model a, a label feature creation model b, a basic action inference model c, a composite action inference model d, and a correct composite action label estimator e.
- FIG. 2 is a diagram showing an example of the concept of each function of the video processing device according to one embodiment of the present invention.
- FIG. 2 an example of a concept showing the configuration of an image x, an action dictionary D, a correct basic action label j, a pseudo correct composite action label l, an image feature extraction model a, a label feature creation model b, a basic action inference model c, a composite action inference model d, and a correct composite action label estimator e is shown.
- Image x may be any data that constitutes certain video data, for example a collection of images of multiple frames.
- image x may be provided with depth information for each frame and optical flow information that indicates changes in appearance between frames.
- the behavior dictionary D is a dictionary in which nodes are linguistic information that represents a person's behavior, edges are relational labels y that indicate the relationship between the linguistic information of each node, and the relationships between the basic behavior labels and composite behavior labels below, as well as the relationships between the composite behavior labels, are structured.
- the data in the behavior dictionary D can be any data that is composed of these nodes and edges.
- Figure 3 shows an example of the behavior dictionary D in the medical and nursing industry.
- thermometer holding a thermometer
- placing a thermometer placing a thermometer
- holding a compress basic action labels in the medical and nursing industry.
- taking body temperature is one of the composite action labels that combines the basic action labels "holding a thermometer” and “placing a thermometer.”
- the correct basic action label j can be any label that indicates the basic action of the person appearing in the video x, i.e., any correct information about linguistic information related to the basic action.
- basic actions are generic actions that can occur in a variety of industries. For example, “walking,” “touching,” or “holding.”
- video x is a collection of images with N frames
- basic actions are a set of N labels that indicate the basic actions of people in each frame.
- the pseudo-correct composite action label l is a label indicating the composite action of a person appearing in the video x, i.e., correct information of linguistic information related to basic actions, and can be any correct information of the composite action label output by the correct composite action label estimator e by inputting the action dictionary D and the correct basic action label j.
- a composite action label is a label that indicates an action that may occur in a particular industry, for example, "take temperature” or “cool down” in the medical and nursing industry.
- video x is a set of images with N frames
- a composite action label is M composite action labels output from action dictionary D, which is obtained by inputting a set of N labels that indicate the basic actions of people in each frame into action dictionary D.
- the image feature extraction model a may be any neural network that inputs an image x and outputs a tensor indicating the features of the image x.
- the image feature extraction model a is MViT (Multiscale Vision Transformers) disclosed in Non-Patent Document 1.
- the image feature x′ may be any tensor that indicates the features of the image x, and is, for example, the output tensor when the image x is input to MViT disclosed in Non-Patent Document 1.
- the label feature creation model b can be any neural network that inputs a relational label y indicating the relationship between each node in the behavior dictionary D and outputs a vector indicating the features of the relational label y, for example a neural network with one fully connected layer.
- the relational label feature y' can be any vector that indicates the features of the relational label y, for example the output tensor when the relational label y is input to a neural network with one fully connected layer.
- the basic behavior inference model c may be any neural network that inputs the video feature x' and outputs a basic behavior label.
- the composite behavior inference model d may be any neural network that receives an image feature x' and a relational label feature y' and outputs a composite behavior label.
- the correct composite behavior label estimator e may be any system that has the function of inputting the behavior dictionary D and the correct basic behavior label j and outputting the pseudo correct composite behavior label l.
- the correct composite behavior label estimator e may be a program that searches the behavior dictionary D for a node that contains the correct basic behavior label j, and outputs multiple nodes linked to that node by the relationship label y as a composite behavior label.
- the image feature extraction unit 2 receives the image x and the image feature extraction model a from the storage unit 1, inputs the image x to the image feature extraction model a, and outputs the image feature x'.
- the label feature creation unit 3 receives the relational label y and the label feature creation model b from the storage unit 1, inputs the relational label y to this label feature creation model b, and outputs the relational label feature y'.
- the basic behavior inference unit 4 receives the basic behavior inference model c from the memory unit 1 and receives the video feature x' from the video feature extraction unit 2, inputs this video feature x' to the basic behavior inference model c, and outputs the estimated basic behavior label i.
- the composite behavior inference unit 5 receives the composite behavior inference model d from the memory unit 1, receives the video feature x' from the video feature extraction unit 2, and receives the relational label feature y' from the label feature creation unit 3, inputs the video feature x' and the relational label feature y' to the composite behavior inference model d, and outputs the estimated composite behavior label k.
- the parameter update unit 6 receives the video feature extraction model a, the label feature creation model b, the basic behavior inference model c, the composite behavior inference model d, the correct basic behavior label j, and the pseudo-correct composite behavior label l from the memory unit 1, receives the estimated basic behavior label i from the basic behavior inference unit 4, and receives the estimated composite behavior label k from the composite behavior inference unit 5, and updates the parameters of each neural network so as to satisfy the following two constraints.
- the first constraint is to update the parameters of each neural network so that the estimated basic action label i and the correct basic action label j approach or become the same, and any learning method that is set to satisfy this constraint is acceptable.
- the difference between the estimated basic action label i and the correct basic action label j is also called loss.
- each neural network may be a video feature extraction model a, a label feature creation model b, a basic behavior inference model c, and a composite behavior inference model d, or a video feature extraction model a, a label feature creation model b, and a basic behavior inference model c, or a label feature creation model b and a basic behavior inference model c, or a video feature extraction model a and a basic behavior inference model c, or just a basic behavior inference model c.
- the parameter update unit 6 calculates the cross-entropy error between the estimated basic behavior label i and the correct basic behavior label j as shown in the following formula (1), and updates the parameters of the video feature extraction model a, the label feature creation model b, the basic behavior inference model c, and the composite behavior inference model d so as to reduce this error or set it to zero.
- m in formula (1) is an index of the estimated basic behavior label i and the correct basic behavior label j
- ym is a value in the estimated basic behavior label i
- tm is a value in the correct basic behavior label j.
- the index value of the correct class is "1"
- the other index values are "0".
- the second constraint is to update the parameters of each neural network so that the estimated composite action label k and the pseudo-ground truth composite action label l approach or become the same, and any learning method that is configured to satisfy this constraint is acceptable.
- each neural network may be composed of a video feature extraction model a, a label feature creation model b, a basic behavior inference model c, and a composite behavior inference model d, or may be composed of a video feature extraction model a, a label feature creation model b, and a composite behavior inference model d, or may be composed of a label feature creation model b and a composite behavior inference model d, or may be composed of a video feature extraction model a and a composite behavior inference model d, or may be composed of only a composite behavior inference model d.
- the parameter update unit 6 calculates the cross-entropy error for the estimated composite behavior label k and the pseudo-ground-truth composite behavior label l as in the above formula (1), and updates the parameters of the video feature extraction model a, the label feature creation model b, the basic behavior inference model c, and the composite behavior inference model d so as to reduce this error or make it zero.
- m in formula (1) is an index of the estimated composite behavior label k and the pseudo correct composite behavior label l
- ym is a value in the estimated composite behavior label k
- tm is a value in the pseudo correct composite behavior label l. In this tm, only the index value of the correct class is "1", and the other index values are "0".
- the output unit 7 receives the estimated basic behavior label i from the basic behavior inference unit 4 and receives the estimated composite behavior label k from the composite behavior inference unit 5, and outputs the inference result.
- the estimation result may be only the estimated composite behavior label k, or may include the estimated basic behavior label i in addition to the estimated composite behavior label k.
- the correct composite behavior label creation unit 8 receives the correct composite behavior label estimator e, the behavior dictionary D, and the correct basic behavior label j from the memory unit 1, inputs the behavior dictionary D and the correct basic behavior label j to the correct composite behavior label estimator e, and outputs the pseudo-correct composite behavior label l.
- the video processing device 100 executes a learning processing routine and an inference processing routine, which will be described below.
- step S101 the correct composite behavior label creation unit 8 receives the correct composite behavior label estimator e, the behavior dictionary D, and the correct basic behavior label j from the storage unit 1.
- the correct composite behavior label creation unit 8 inputs the behavior dictionary D and the correct basic behavior label j to the correct composite behavior label estimator e, and transmits the pseudo correct composite behavior label l output from the correct composite behavior label estimator e to the storage unit 1.
- step S102 the video feature extraction unit 2 receives the video x and the video feature extraction model a from the memory unit 1.
- the video feature extraction unit 2 inputs the video x to this video feature extraction model a, and transmits the video feature x' output from this video feature extraction model a to the basic behavior inference unit 4 and the composite behavior inference unit 5.
- step S103 the label feature creation unit 3 receives the relational label y and the label feature creation model b from the memory unit 1, inputs the relational label y to the label feature creation model b, and transmits the relational label feature y' output from the label feature creation model b to the composite behavior inference unit 5.
- step S104 the basic behavior inference unit 4 receives the basic behavior inference model c from the memory unit 1, and receives the video feature x' from the video feature extraction unit 2.
- the basic behavior inference unit 4 inputs this video feature x' to the basic behavior inference model c, and transmits the estimated basic behavior label i output from this basic behavior inference model c to the parameter update unit 6.
- step S105 the composite behavior inference unit 5 receives the composite behavior inference model d from the memory unit 1, receives the video feature x' from the video feature extraction unit 2, and receives the relational label feature y' from the label feature creation unit 3.
- the composite behavior inference unit 5 inputs the video feature x' and the relational label feature y' to the composite behavior inference model d, and transmits the estimated composite behavior label k output from this composite behavior inference model d to the parameter update unit 6.
- the parameter update unit 6 receives the video feature extraction model a, the label feature creation model b, the basic behavior inference model c, the composite behavior inference model d, the correct basic behavior label j, and the pseudo-correct composite behavior label l from the memory unit 1, receives the estimated basic behavior label i from the basic behavior inference unit 4, and receives the estimated composite behavior label k from the composite behavior inference unit 5.
- the parameter update unit 6 updates the parameters of each neural network so as to satisfy the above two constraints.
- the parameter update unit 6 receives the video feature extraction model a, the label feature creation model b, the composite behavior inference model d, and the pseudo-ground-truth composite behavior label l from the memory unit 1, receives the estimated composite behavior label k from the composite behavior inference unit 5, and updates the parameters of each neural network to satisfy the constraint that the estimated composite behavior label k and the pseudo-ground-truth composite behavior label l approach or become the same.
- step S206 the output unit 7 receives the estimated basic behavior label i from the basic behavior inference unit 4 and receives the estimated composite behavior label k from the composite behavior inference unit 5, and outputs the received estimated composite behavior label k and estimated basic behavior label i.
- step S207 the output unit 7 receives the estimated composite action label k from the composite action inference unit 5, and outputs the received estimated composite action label k.
- an action dictionary is constructed that structures the relationships between basic action labels and composite action labels and the relationships between the composite action labels, and pseudo-correct composite action labels are estimated from correct basic action labels, thereby creating learning data annotated with correct basic action labels and pseudo-correct composite action labels, and a model is learned that infers composite action labels simultaneously with basic action labels by utilizing the created learning data.
- FIG. 8 is a block diagram showing an example of a hardware configuration of a video processing device according to an embodiment of the present invention.
- the video processing device 100 according to the embodiment is configured, for example, by a server computer or a personal computer, and has a hardware processor 111A such as a CPU.
- a program memory 111B, a data memory 112, an input/output interface 113, and a communication interface 114 are connected to the hardware processor 111A via a bus 115.
- the communication interface 114 includes, for example, one or more wireless communication interface units, and enables the transmission and reception of information to and from the communication network NW.
- a wireless interface for example, an interface that adopts a low-power wireless data communication standard such as a wireless LAN (Local Area Network) is used.
- the input/output interface 113 is connected to an input device 200 and an output device 300 that are attached to the video processing device 100 and are used by users, etc.
- the input/output interface 113 takes in operation data input by a user or the like through an input device 200 such as a keyboard, touch panel, touchpad, mouse, etc., and outputs the output data to an output device 300 including a display device using liquid crystal or organic EL (Electro Luminescence), etc., for display.
- the input device 200 and the output device 300 may be devices built into the video processing device 100, or may be input devices and output devices of other computers or information terminals that can communicate with the video processing device 100 via the network NW.
- the program memory 111B is a non-transient tangible storage medium that combines a non-volatile memory such as a hard disk drive (HDD) or solid state drive (SSD) that can be written to and read from at any time, with a non-volatile memory such as a ROM, and stores the programs necessary to execute various control processes, etc. according to one embodiment.
- a non-volatile memory such as a hard disk drive (HDD) or solid state drive (SSD) that can be written to and read from at any time
- SSD solid state drive
- the data memory 112 is a tangible storage medium that is, for example, a combination of the non-volatile memory described above and a volatile memory such as RAM, and is used to store various data acquired and created during various processing steps.
- the video processing device 100 can be configured as an information processing device having a software-based processing function unit.
- This processing function unit corresponds to each unit of the video processing device 100 in FIG. 1.
- the storage device used as a work memory or the like by the video processing device 100 can be configured by using the data memory 112 shown in FIG. 11.
- these configured storage areas are not essential components within the video processing device 100, and may be areas provided in a storage device such as an external storage medium such as a USB (Universal Serial Bus) memory, or a database server located in the cloud.
- an external storage medium such as a USB (Universal Serial Bus) memory, or a database server located in the cloud.
- processing function units in the above-mentioned components can be realized by having the hardware processor 111A read and execute a program stored in the program memory 111B. Note that some or all of these processing function units may be realized in a variety of other forms, including integrated circuits such as application specific integrated circuits (ASICs (Application Specific Integrated Circuits)) or field-programmable gate arrays (FPGAs).
- ASICs Application Specific Integrated Circuits
- FPGAs field-programmable gate arrays
- the methods described in each embodiment can be stored as a program (software means) that can be executed by a computer on a recording medium such as a magnetic disk (floppy disk, hard disk, etc.), optical disk (CD-ROM, DVD, MO, etc.), semiconductor memory (ROM, RAM, flash memory, etc.), and can be distributed by transmitting it via a communication medium.
- the programs stored on the medium also include a setting program that configures the software means (including not only execution programs but also tables and data structures) that the computer executes.
- the computer that realizes this device reads the program recorded on the recording medium, and in some cases configures the software means using the setting program, and executes the above-mentioned processing by having the operation controlled by this software means.
- the recording medium referred to in this specification is not limited to a recording medium for distribution, but also includes storage media such as a magnetic disk or semiconductor memory installed inside the computer or in a device connected via a network.
- the present invention is not limited to the above-described embodiments, and can be modified in various ways during implementation without departing from the gist of the invention.
- the embodiments may also be implemented in appropriate combination, in which case the combined effects can be obtained.
- the above-described embodiments include various inventions, and various inventions can be extracted by combinations selected from the multiple constituent elements disclosed. For example, if the problem can be solved and an effect can be obtained even if some constituent elements are deleted from all the constituent elements shown in the embodiments, the configuration from which these constituent elements are deleted can be extracted as an invention.
- REFERENCE SIGNS LIST 100 video processing device 1: memory unit 2: video feature extraction unit 3: label feature creation unit 4: basic behavior inference unit 5: composite behavior inference unit 6: parameter update unit 7: output unit 8: correct composite behavior label creation unit
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Image Analysis (AREA)
Abstract
La présente invention porte sur un dispositif de traitement vidéo selon un mode de réalisation qui comprend : une unité d'extraction de caractéristiques vidéo qui extrait des informations de caractéristiques indiquant une caractéristique d'une vidéo ; et une unité d'estimation qui estime, sur la base d'une caractéristique basée sur une relation entre des éléments d'informations de langue relatives à une action d'un sujet apparaissant dans la vidéo et les informations de caractéristiques extraites par l'unité d'extraction de caractéristiques vidéo, une action composite qui est une combinaison d'actions de base indiquant une action générale du sujet.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2025525468A JPWO2024252494A1 (fr) | 2023-06-05 | 2023-06-05 | |
| PCT/JP2023/020873 WO2024252494A1 (fr) | 2023-06-05 | 2023-06-05 | Dispositif, procédé et programme de traitement vidéo |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/JP2023/020873 WO2024252494A1 (fr) | 2023-06-05 | 2023-06-05 | Dispositif, procédé et programme de traitement vidéo |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2024252494A1 true WO2024252494A1 (fr) | 2024-12-12 |
Family
ID=93795311
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/JP2023/020873 Ceased WO2024252494A1 (fr) | 2023-06-05 | 2023-06-05 | Dispositif, procédé et programme de traitement vidéo |
Country Status (2)
| Country | Link |
|---|---|
| JP (1) | JPWO2024252494A1 (fr) |
| WO (1) | WO2024252494A1 (fr) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012226597A (ja) * | 2011-04-20 | 2012-11-15 | Toshiba Corp | 行動推定装置、行動推定方法およびプログラム |
| JP2022073882A (ja) * | 2020-10-30 | 2022-05-17 | 株式会社Vaak | 行動推定装置、行動推定方法、プログラム及び行動推定システム |
-
2023
- 2023-06-05 WO PCT/JP2023/020873 patent/WO2024252494A1/fr not_active Ceased
- 2023-06-05 JP JP2025525468A patent/JPWO2024252494A1/ja active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012226597A (ja) * | 2011-04-20 | 2012-11-15 | Toshiba Corp | 行動推定装置、行動推定方法およびプログラム |
| JP2022073882A (ja) * | 2020-10-30 | 2022-05-17 | 株式会社Vaak | 行動推定装置、行動推定方法、プログラム及び行動推定システム |
Also Published As
| Publication number | Publication date |
|---|---|
| JPWO2024252494A1 (fr) | 2024-12-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Dinov | Methodological challenges and analytic opportunities for modeling and interpreting Big Healthcare Data | |
| CN113661487A (zh) | 使用机器训练词条频率加权因子的产生密集嵌入向量的编码器 | |
| CN111626319A (zh) | 计算环境中可解释人工智能的误用指标 | |
| CN113656587B (zh) | 文本分类方法、装置、电子设备及存储介质 | |
| CN112400165B (zh) | 利用无监督学习来改进文本到内容建议的方法和系统 | |
| CN110622175A (zh) | 神经网络分类 | |
| JP2012058972A (ja) | 評価予測装置、評価予測方法、及びプログラム | |
| CN113557535A (zh) | 基于训练数据与性能趋势的相关性的计算机模型机器学习 | |
| US11037073B1 (en) | Data analysis system using artificial intelligence | |
| CN113924560B (zh) | 利用半监督深度学习理解对医学人工智能系统的查询意图 | |
| JP2021500692A (ja) | 系図エンティティ解決システムおよび方法 | |
| CN110020653A (zh) | 图像语义分割方法、装置及计算机可读存储介质 | |
| WO2019085118A1 (fr) | Procédé d'analyse de mot associé basé sur un modèle de sujet, et appareil électronique et support d'informations | |
| CN113722507A (zh) | 基于知识图谱的住院费用预测方法、装置及计算机设备 | |
| EP3472760A1 (fr) | Construction d'un réseau de neurones convolutif | |
| US20140149465A1 (en) | Feature rich view of an entity subgraph | |
| US12260301B2 (en) | Data generation and annotation for machine learning | |
| JP6770709B2 (ja) | 機械学習用モデル生成装置及びプログラム。 | |
| CN114281990A (zh) | 文档分类方法及装置、电子设备和介质 | |
| JP2020021343A (ja) | 解析装置、解析方法及びプログラム | |
| JP2019159918A (ja) | クラスタリングプログラム、クラスタリング方法およびクラスタリング装置 | |
| CN107430600A (zh) | 可扩展的web数据提取 | |
| US11829386B2 (en) | Identifying anonymized resume corpus data pertaining to the same individual | |
| WO2024252494A1 (fr) | Dispositif, procédé et programme de traitement vidéo | |
| WO2025120694A1 (fr) | Dispositif de reconnaissance, procédé, et programme |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23940601 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 2025525468 Country of ref document: JP Kind code of ref document: A |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |