CN116734412A - Refrigeration equipment control method and device, refrigerator and computer readable storage medium - Google Patents

Refrigeration equipment control method and device, refrigerator and computer readable storage medium Download PDF

Info

Publication number
CN116734412A
CN116734412A CN202310500487.9A CN202310500487A CN116734412A CN 116734412 A CN116734412 A CN 116734412A CN 202310500487 A CN202310500487 A CN 202310500487A CN 116734412 A CN116734412 A CN 116734412A
Authority
CN
China
Prior art keywords
refrigeration equipment
target image
power
target
preset
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310500487.9A
Other languages
Chinese (zh)
Inventor
杨涛
孙川川
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
TCL Home Appliances Hefei Co Ltd
Original Assignee
TCL Home Appliances Hefei Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by TCL Home Appliances Hefei Co Ltd filed Critical TCL Home Appliances Hefei Co Ltd
Priority to CN202310500487.9A priority Critical patent/CN116734412A/en
Publication of CN116734412A publication Critical patent/CN116734412A/en
Pending legal-status Critical Current

Links

Classifications

    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24HEATING; RANGES; VENTILATING
    • F24FAIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
    • F24F11/00Control or safety arrangements
    • F24F11/62Control or safety arrangements characterised by the type of control or by internal processing, e.g. using fuzzy logic, adaptive control or estimation of values
    • F24F11/63Electronic processing
    • F24F11/64Electronic processing using pre-stored data
    • FMECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F24HEATING; RANGES; VENTILATING
    • F24FAIR-CONDITIONING; AIR-HUMIDIFICATION; VENTILATION; USE OF AIR CURRENTS FOR SCREENING
    • F24F11/00Control or safety arrangements
    • F24F11/70Control systems characterised by their outputs; Constructional details thereof
    • F24F11/80Control systems characterised by their outputs; Constructional details thereof for controlling the temperature of the supplied air
    • F24F11/86Control systems characterised by their outputs; Constructional details thereof for controlling the temperature of the supplied air by controlling compressors within refrigeration or heat pump circuits

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Mechanical Engineering (AREA)
  • General Engineering & Computer Science (AREA)
  • Fuzzy Systems (AREA)
  • Mathematical Physics (AREA)
  • Thermal Sciences (AREA)
  • Devices That Are Associated With Refrigeration Equipment (AREA)

Abstract

本申请提供了一种制冷设备控制方法、装置、冰箱及计算机可读存储介质,该方法包括:获取目标图像,目标图像表征制冷设备所处空间的环境图像;对目标图像进行特征检测,得到目标图像中的物体特征;根据物体特征,确定目标图像中的物体姿态;根据目标图像中的物体姿态,确定制冷设备的工作功率。本申请提供的制冷设备控制方法,通过获取制冷设备的所处空间的目标图像,通过提取目标图像中的物体特征,以及基于物体特征的物体姿态,确定目标物体需要较低的环境噪音需求。此时可以调整制冷设备的工作功率,能够避免制冷设备的工作功率较大,降低了制冷设备发出的噪音分贝。

This application provides a refrigeration equipment control method, device, refrigerator and computer-readable storage medium. The method includes: acquiring a target image, which represents the environment image of the space where the refrigeration equipment is located; performing feature detection on the target image to obtain the target Characteristics of objects in the image; determine the posture of the object in the target image based on the characteristics of the object; determine the working power of the refrigeration equipment based on the posture of the object in the target image. The refrigeration equipment control method provided by this application determines that the target object requires lower environmental noise by acquiring the target image of the space where the refrigeration equipment is located, extracting object features in the target image, and object posture based on the object features. At this time, the working power of the refrigeration equipment can be adjusted, which can avoid the large working power of the refrigeration equipment and reduce the decibels of noise emitted by the refrigeration equipment.

Description

Refrigeration equipment control method and device, refrigerator and computer readable storage medium
Technical Field
The application relates to the technical field of household appliances, in particular to a refrigeration equipment control method and device, a refrigerator and a computer readable storage medium.
Background
At present, the high-speed operation of the refrigerator compressor is a main reason for noise generation of the refrigerator, the operation of the refrigerator compressor is controlled by a main control board of the refrigerator, the main control board mainly controls the rotation speed of the refrigerator compressor in the following modes, the first mode is to detect the ambient temperature through a temperature sensing head, the higher the ambient temperature is, the larger the cooling capacity required by the default refrigerator is, the rotation speed of the compressor is correspondingly larger, the second mode is to determine the rotation speed of the compressor together with the difference between the set temperature of the refrigerator and the compartment temperature, and the amount of the cooling capacity required by the refrigerator is determined together with the difference between the ambient temperature and the set temperature of the refrigerator and the compartment temperature. And thirdly, the temperature sensor in the box senses the large temperature rise in a short time caused by the placement of a large amount of objects in the box, and the rotation speed of the compressor is determined to be improved. And fourthly, determining to increase the rotating speed of the compressor according to the running time of the compressor in the previous period and the temperature drop sensed by the temperature sensor of the intermediate room. And fifthly, determining the rotating speed of the compressor according to the opening and closing times of each door body of the refrigerator in a period of time. The sixth is any combination of the above five forms to determine the rotational speed of the compressor.
Because the existing refrigerator can generate noise at any time because the compressor runs at a high speed, the noise is easy to be perceived by a user, and the noise is very serious in sense of body in the use process of a customer.
Disclosure of Invention
The application provides a control method of refrigeration equipment, which adjusts the running power by detecting whether a human body exists in an environment image of the equipment and determining the posture of the human body, so that larger noise is avoided.
In a first aspect, the present application provides a refrigeration apparatus control method, the method comprising:
acquiring a target image, wherein the target image represents an environment image of a space where refrigeration equipment is located;
performing feature detection on the target image to obtain object features in the target image;
determining the object posture in the target image according to the object characteristics;
and determining the working power of the refrigeration equipment according to the object gesture in the target image.
In some embodiments of the present application, the acquiring the target image includes:
determining a target distance between a target object and the refrigeration equipment;
and if the target distance is smaller than a preset first object distance threshold value, acquiring a target image.
In some embodiments of the present application, after the determining the target distance between the target object and the refrigeration equipment, the method further includes:
and if the target distance is smaller than a preset second object distance threshold, adjusting the working power of the refrigeration equipment to the preset working power, wherein the second object distance threshold is smaller than the first object distance threshold.
In some embodiments of the present application, if the target distance is smaller than a preset second distance threshold, adjusting the working power of the refrigeration device to the preset working power includes:
determining an object distance difference between the target distance and the second object distance threshold;
and adjusting the working power of the refrigeration equipment to the working power matched with the object distance difference according to a preset difference power corresponding relation, wherein the difference power corresponding relation represents the corresponding relation between the object distance difference and the preset working power.
In some embodiments of the present application, before the capturing the target image, the method further includes:
if the current moment is outside the preset night time period, executing the step of acquiring the target image;
and if the current moment is within the night time period and if the current working power of the refrigeration equipment is larger than the preset working power, reducing the working power of the refrigeration equipment.
In some embodiments of the present application, the determining the object pose in the target image according to the object feature includes:
determining each feature key point in the object features;
and determining the object posture in the target image according to the position relation among the characteristic key points.
In some embodiments of the present application, the determining the working power of the refrigeration device according to the object pose in the target image includes:
determining a preset power adjustment value matched with the object gesture according to a preset gesture power mapping relation, wherein the gesture power mapping relation represents the corresponding relation between the object gesture and the preset power adjustment value;
and determining the working power of the refrigeration equipment according to the power adjustment value.
In a second aspect, the present application also provides a refrigeration apparatus control device, the device comprising:
the acquisition module is used for acquiring a target image, wherein the target image represents an environment image of a space where the refrigeration equipment is located;
the detection module is used for carrying out feature detection on the target image to obtain object features in the target image;
the first determining module is used for determining the object gesture in the target image according to the object characteristics;
and the second determining module is used for determining the working power of the refrigeration equipment according to the object gesture in the target image.
In some embodiments of the present application, the obtaining module is specifically configured to:
determining a target distance between a target object and the refrigeration equipment;
And if the target distance is smaller than a preset first object distance threshold value, acquiring a target image.
In some embodiments of the present application, the second determining module is specifically configured to:
and if the target distance is smaller than a preset second object distance threshold, adjusting the working power of the refrigeration equipment to the preset working power, wherein the second object distance threshold is smaller than the first object distance threshold.
In some embodiments of the present application, the second determining module is specifically further configured to:
determining an object distance difference between the target distance and the second object distance threshold;
and adjusting the working power of the refrigeration equipment to the working power matched with the object distance difference according to a preset difference power corresponding relation, wherein the difference power corresponding relation represents the corresponding relation between the object distance difference and the preset working power.
In some embodiments of the present application, the second determining module is specifically further configured to:
if the current moment is outside the preset night time period, executing the step of acquiring the target image;
and if the current moment is within the night time period and if the current working power of the refrigeration equipment is larger than the preset working power, reducing the working power of the refrigeration equipment.
In some embodiments of the present application, the first determining module is specifically configured to:
determining each feature key point in the object features;
and determining the object posture in the target image according to the position relation among the characteristic key points.
In some embodiments of the present application, the second determining module is specifically further configured to:
determining a preset power adjustment value matched with the object gesture according to a preset gesture power mapping relation, wherein the gesture power mapping relation represents the corresponding relation between the object gesture and the preset power adjustment value;
and determining the working power of the refrigeration equipment according to the power adjustment value.
In a third aspect, the present application also provides a refrigerator comprising a processor, a memory and a computer program stored in the memory and executable on the processor, the processor executing the computer program to carry out the steps of any one of the refrigeration appliance control methods.
In a fourth aspect, the present application also provides a computer-readable storage medium having stored thereon a computer program that is executed by a processor to implement the steps in the refrigeration appliance control method of any of the above.
According to the refrigeration equipment control method provided by the application, the object image of the space where the refrigeration equipment is located is obtained, the object features in the object image are extracted, and the object posture based on the object features is used for determining that the object needs lower environmental noise. The working power of the refrigeration equipment can be adjusted at the moment, the large working power of the refrigeration equipment can be avoided, and the noise decibel sent by the refrigeration equipment is reduced.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic view of a refrigeration equipment control system provided in an embodiment of the present application;
FIG. 2 is a schematic flow chart of one embodiment of a method for controlling a refrigeration appliance according to an embodiment of the present application;
FIG. 3 is a schematic diagram of a functional module of a control device for a refrigeration appliance according to an embodiment of the present application;
fig. 4 is a schematic view of a refrigerator in an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to fall within the scope of the application.
In the description of the present application, it should be understood that the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature. In the description of the present application, the meaning of "a plurality" is two or more, unless explicitly defined otherwise.
In the present application, the term "exemplary" is used to mean "serving as an example, instance, or illustration. Any embodiment described as "exemplary" in this disclosure is not necessarily to be construed as preferred or advantageous over other embodiments. Meanwhile, it can be understood that, in the specific embodiment of the present application, related data such as user information and user data are related, when the above embodiment of the present application is applied to specific products or technologies, user permission or consent needs to be obtained, and the collection, use and processing of related data need to comply with related laws and regulations and standards of related countries and regions.
The following description is presented to enable any person skilled in the art to make and use the application. In the following description, details are set forth for purposes of explanation. It will be apparent to one of ordinary skill in the art that the present application may be practiced without these specific details. In other instances, well-known structures and processes have not been described in detail so as not to obscure the description of the application with unnecessary detail. Thus, the present application is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features disclosed herein.
The application provides a refrigeration equipment control method, a refrigeration equipment control device, a refrigerator and a computer readable storage medium, and the refrigeration equipment control method, the device, the refrigerator and the computer readable storage medium are respectively described in detail below.
Referring to fig. 1, fig. 1 is a schematic diagram of a refrigeration device control system according to an embodiment of the present application, where the refrigeration device control system may include a refrigeration device 100 and a storage device 200, and the storage device 200 may transmit data to the refrigeration device 100. As in the refrigeration appliance 100 of fig. 1, the image data stored in the storage appliance 200 may be acquired to perform the refrigeration appliance control method of the present application.
In an embodiment of the present application, the refrigeration appliance 100 includes, but is not limited to, a refrigerator, an air conditioner, and the like.
In an embodiment of the present application, the storage device 200 includes, but is not limited to, a mobile storage device, a cloud storage device, and the like.
In embodiments of the present application, communication between the refrigeration appliance 100 and the storage appliance 200 may be accomplished by any means of communication including, but not limited to, mobile communication based on the third generation partnership project (3rd Generation Partnership Project,3GPP), long term evolution (Long Term Evolution, LTE), worldwide interoperability for microwave access (Worldwide Interoperability for Microwave Access, wiMAX), or computer network communication based on the TCP/IP protocol suite (TCP/IP Protocol Suite, TCP/IP), user datagram protocol (User Datagram Protocol, UDP), and the like.
It should be noted that, the schematic view of the scenario of the refrigeration equipment control system shown in fig. 1 is only an example, and the refrigeration equipment control system and scenario described in the embodiment of the present application are for more clearly describing the technical solution of the embodiment of the present application, and do not constitute a limitation on the technical solution provided by the embodiment of the present application, and those skilled in the art can know that, with the evolution of the refrigeration equipment control system and the appearance of a new service scenario, the technical solution provided by the embodiment of the present application is equally applicable to similar technical problems.
As shown in fig. 2, fig. 2 is a schematic flow chart of an embodiment of a control method of a refrigeration device according to an embodiment of the present application, where the control method of the refrigeration device may include the following steps 201 to 204:
201. and acquiring a target image, wherein the target image represents an environment image of a space in which the refrigeration equipment is located.
In the embodiment of the application, the target image can be acquired in various modes. For example: at least one image sensor may be installed around the refrigeration appliance; or at least one image sensor is installed on the refrigeration equipment, and then the image sensor is started to acquire an environment image, namely a target image, of the space where the refrigeration equipment is located. It should be noted that, the setting of the image acquisition area of the image sensor for image acquisition may be set according to the specific situation of the space where the refrigeration device is located, and the embodiment of the present application is still not limited.
In addition, in the embodiment of the application, the target image can be acquired by setting the image pickup device. When the image capturing apparatus is started, video information may be obtained, where each video frame in the video information may be regarded as a target image, and the present application is not limited thereto.
In the embodiment of the application, the image sensor or the image pickup device for acquiring the target image can be in an activated state for a long time, so that the target image can be acquired at any time, and the refrigeration equipment can conveniently judge in real time based on the target image.
After the image sensor acquires the target image, the target image may be transmitted to the refrigeration appliance for subsequent steps by the refrigeration appliance.
The refrigeration equipment is mechanical equipment for refrigeration and is widely applied to the fields of refrigerators, air conditioners, freezers and the like. The main working principle of the refrigeration equipment is that the low-temperature heat is transferred from the indoor or outdoor to the other place through the state change of the refrigerant in the processes of compression, expansion, condensation, evaporation and the like, so that the purpose of reducing the temperature is achieved. Common refrigeration equipment includes: compression refrigeration equipment: the temperature and pressure of the refrigerant are increased by compressing the refrigerant, heat is emitted through the condenser, the refrigerant is condensed into liquid, and finally the refrigerant is evaporated and cooled through the expansion valve, so that the refrigerating effect is realized. Absorption refrigeration equipment: by utilizing the solubility difference of the absorbent and the refrigerant, the refrigerant is released by heating the absorber and then is evaporated and cooled by the expansion valve, so that the refrigeration effect is realized. The equipment is suitable for occasions such as large-scale air conditioners, refrigeration houses and the like. Heat pump: the heat pump circulation system is used for providing low-grade heat energy by using low-temperature sources such as external air, underground water, surface water and the like, and then the low-grade heat energy is lifted to high temperature for refrigeration or heat supply. Heat exchanger: the indoor air and the outdoor air are subjected to heat exchange by the heat exchange principle, so that the aim of cooling is fulfilled. In summary, the refrigeration equipment has various kinds, and different equipment has different characteristics and advantages and disadvantages, and the embodiment of the application is not limited.
202. And performing feature detection on the target image to obtain object features in the target image.
In the embodiment of the present application, obtaining the object feature in the target image may include various manners, for example: based on the feature detection of template matching, an object similar to the template image is found from the target image by matching a preset template with the target image. The process of matching the template with the target image is the process of feature detection. If the object similar to the template exists in the target image based on the feature comparison, the relevant features are extracted, and therefore the object features in the target image are obtained.
Or based on the feature detection of the deep learning, the target image is identified and classified by training a target detection model by using the deep learning technology, and the features of the target object are extracted. The method needs to construct a deep learning model firstly, and training is carried out on a large amount of sample data so as to learn the characteristics of a target object; the trained model is then applied to the target image, thereby extracting features of the target object.
Or, based on the feature detection of the convolutional neural network, extracting object features in the target image by performing convolution and pooling operations on the target image by using the Convolutional Neural Network (CNN). In the method, a CNN model is required to be constructed, and training is performed on a large amount of data so as to learn the characteristics of a target object; the trained CNN model is then applied to the target image, thereby extracting its features and. It should be noted that, in the embodiment of the present application, any mode may be adopted to obtain the object feature in the target image, and the embodiment of the present application is not limited. In addition, the object in the embodiment of the present application may refer to a human body.
203. And determining the object posture in the target image according to the object characteristics.
The above steps provide a variety of ways to extract the features of the object. Thus, after the object features are extracted, different poses can also be determined according to different ways. For example: the attitude of the object can be determined by means of the comparison of the templates. By setting the multi-stage templates, the object features existing in the target image are determined through the first-stage templates. And extracting object features, and comparing the object features with the secondary template. The secondary templates can represent the gestures of different objects and can also be templates carrying the gesture labels of different objects. Thus, when the object features are compared to a plurality of secondary templates, a best matching secondary template may be determined. The label or the corresponding gesture corresponding to the best matching secondary template is the object gesture of the object in the target image.
Alternatively, a classifier may be added after the feature extraction module of machine learning based on machine learning, and the extracted object features are classified to obtain the object pose classification of the object, so as to output a specific object pose. For example: after the object pose is acquired, the working power matched with the object pose can be determined to adjust the noise emitted by the refrigeration equipment.
Similarly, based on the convolutional neural network, a classifier can still be added after each convolutional layer, and the extracted object features are classified, so that the object posture classification of the object is obtained, and a specific object posture is output. For example: after the object pose is acquired, the working power matched with the object pose can be determined to adjust the noise emitted by the refrigeration equipment. In particular, the embodiments provided by the present application are not to be construed as limiting the application.
204. And determining the working power of the refrigeration equipment according to the object gesture in the target image.
According to the steps, the specific object posture can be obtained, and the related object posture can be determined through template comparison, machine learning and convolutional neural network in the embodiment. Thus, based on the above embodiment, a two-stage classifier may be further provided. Each object pose in the secondary classifier corresponds to a specific power adjustment value. Thus, after the object pose obtained in the above step is input into the secondary classifier, a power adjustment value can be output. Furthermore, the power of the refrigeration equipment can be adjusted based on the power adjustment value, so that noise emitted by the refrigeration equipment is reduced. It should be noted that, in the embodiment of the present application, if the refrigeration device is currently in a condition requiring refrigeration, for example: the refrigerating apparatus does not perform power adjustment when the temperature in the freezing chamber or the refrigerating chamber of the refrigerator is higher than a preset temperature. In other words, when the refrigeration equipment is in a refrigeration working state for the refrigeration area, but not in a heat preservation state, the refrigeration equipment can firstly adjust the working power of the current refrigeration equipment not according to the power adjustment value. When the refrigeration equipment is in a non-refrigeration working state, the refrigeration equipment can adjust the working power of the refrigeration equipment according to the power adjustment value.
According to the refrigeration equipment control method provided by the application, the object image of the space where the refrigeration equipment is located is obtained, the object features in the object image are extracted, and the object posture based on the object features is used for determining that the object needs lower environmental noise. The working power of the refrigeration equipment can be adjusted at the moment, the large working power of the refrigeration equipment can be avoided, and the noise decibel sent by the refrigeration equipment is reduced.
In order to better implement the embodiment of the present application, in an embodiment of the present application, acquiring a target image includes:
determining a target distance between a target object and the refrigeration equipment; and if the target distance is smaller than a preset first object distance threshold value, acquiring a target image.
The above embodiment provides a scheme that the image sensor or the photographing device is always standby, so that the target image can be acquired in real time. However, this approach may cause the image sensor or the camera to be capturing the target image all the time, resulting in the refrigeration equipment needing real-time analysis, wasting computing resources of the refrigeration equipment. For example: as available according to the above embodiments, an object may refer to a human body. Therefore, if the image sensor or the photographing device is always in an operating state, when the target image is acquired in real time, the human body is not necessarily present in the image acquisition area of the image sensor or the photographing device, so that the human body is not present in the target image. Therefore, when there is no human body in the target image, the refrigerating apparatus also performs analysis, thereby wasting calculation resources.
In addition, if the refrigeration equipment needs to perform feature analysis on the target image which does not include the human body, the refrigeration equipment also needs to store the related target image which does not include the human body, and a certain storage space is wasted. Therefore, in order to solve these problems, the embodiment of the present application also provides a scheme of performing acquisition only when a human body is present in an image acquisition area of an image sensor or a photographing device. Specifically, an infrared sensor may be installed on the refrigeration appliance. When a human body approaches the infrared sensor, the infrared sensor can sense the distance between the human body and the refrigeration equipment. When the distance is less than the first object distance threshold, it may be determined that the human body has entered the image acquisition area, thereby reactivating the image sensor or the camera. The method can ensure that human bodies appear in the target images, avoid the refrigeration equipment from carrying out image feature analysis on the target images which do not contain the human bodies, and avoid the storage space from storing the target images which do not contain the human bodies. It should be noted that, the first object distance threshold may be set according to an installation angle of the image capturing device or the image sensor, and the value of the first object distance threshold is not limited in the embodiment of the present application.
In order to better implement the embodiment of the present application, in one embodiment of the present application, after determining the target distance between the target object and the refrigeration device, the method further includes:
and if the target distance is smaller than a preset second object distance threshold, adjusting the working power of the refrigeration equipment to the preset working power, wherein the second object distance threshold is smaller than the first object distance threshold.
The above embodiments disclose that the working power of the refrigeration equipment is adjusted by determining the object posture, thereby determining the corresponding power adjustment value according to the object posture. However, in actual situations, when the distance between the human body and the refrigerating apparatus is too short, the user does not want to feel loud noise regardless of the posture of the human body. Therefore, in order to further reduce the interference of noise to the user, when the distance between the user and the refrigerator is short enough, the working power of the refrigeration equipment can be directly adjusted, so that the noise decibel emitted by the refrigeration equipment is reduced. The setting value of the second distance threshold in the embodiment of the present application may be set according to a specific practical situation, and the embodiment of the present application is not limited. Meanwhile, it should be noted that, in actual situations, the user is less far from the refrigerator, for example: when a user takes food materials from the refrigerator, the distance between the user and the refrigerator is relatively short. At this time, the user does not stay in the vicinity of the refrigerator for a long time, and thus a short temperature rise does not cause deterioration of food in the refrigerator. Therefore, the operation of the refrigerator can be controlled directly according to the preset working power, and whether the refrigerator is in refrigeration at present is not considered.
In order to better implement the embodiment of the present application, in an embodiment of the present application, if the target distance is smaller than a preset second distance threshold, adjusting the working power of the refrigeration device to the preset working power includes:
determining an object distance difference between the target distance and a second object distance threshold; and adjusting the working power of the refrigeration equipment to the working power matched with the object distance difference according to a preset difference power corresponding relation, wherein the difference power corresponding relation represents the corresponding relation between the object distance difference and the preset working power.
The above embodiment provides a solution for adjusting the working power of the refrigeration device based on the second distance threshold. In practice, the closer the user is to the refrigeration appliance, the easier the user perception is to perceive noise. Therefore, in order to further improve the influence of the noise reduction of the refrigeration equipment on the user, the corresponding working power required to be reduced by the refrigeration equipment can be determined according to the distance between the user and the refrigeration equipment. According to the above embodiment, the second distance threshold may be used to indicate that the target distance between the user and the refrigeration equipment is within the distance, and the refrigeration equipment needs to start adjusting the working power. Thus, the greater the difference between the target distance and the second distance threshold, the closer the user is characterized to the refrigeration appliance. Therefore, as the difference is larger, the operating power of the refrigeration equipment is smaller. Specifically, the difference between the second distance threshold and the target distance may be a linear relationship of negative correlation or an exponential relationship of negative correlation, which is not limited herein. Therefore, after the specific difference value a is obtained, an actual working power a matched with the difference value a is determined according to the linear relationship of the negative correlation or the exponential relationship of the negative correlation, and then when the refrigeration equipment is not in a refrigeration state, that is, if the current working power of the refrigeration equipment is greater than the preset working power, the working power of the refrigeration equipment is adjusted to the actual working power a.
In order to better implement the embodiment of the present application, in an embodiment of the present application, before the target image is acquired, the method further includes:
if the current moment is outside the preset night time period, executing the step of acquiring the target image; if the current moment is within the night time period and if the current working power of the refrigeration equipment is larger than the preset working power, the working power of the refrigeration equipment is reduced.
The embodiment of the application also provides a scheme for determining whether the refrigeration equipment needs to reduce the working power according to the current time, and the scheme can meet different practical conditions. While in the night phase, the user may be at rest, for example: sleep state. When a person is in a sleep state, noise can affect the sleep quality of the person. Therefore, when the current time is at night, the refrigeration appliance may not need to consider whether the target image is acquired or not, nor whether the user is around the refrigeration appliance. Thus, if the current time is within the night time period, and if the current operating power of the refrigeration appliance is greater than the preset operating power, the refrigeration appliance may operate at the preset and lower operating power. Of course, how much working power needs to be reduced specifically can be determined according to the actual running condition of the refrigeration equipment, and the embodiment of the application is not limited.
Furthermore, if the current time is outside the preset night time period, the user may not need to sleep. Therefore, it is necessary to determine whether the user needs a relatively quiet environment based on the actual situation. Therefore, it is necessary to acquire a target image including the user to determine whether the user is in a posture such as sleeping, sitting, or the like, thereby determining whether the user needs a quiet environment.
In order to better implement the embodiment of the present application, in an embodiment of the present application, determining an object pose in a target image according to an object feature includes:
determining each feature key point in the object features; and determining the object posture in the target image according to the position relation among the characteristic key points.
The above embodiments provide a scheme for determining a user gesture based on machine learning, neural network, and the like. However, in determining the object pose from the object features, the pose of the user may not be determined by a neural network or a classifier in machine learning. For example: still, in the stage of acquiring the object characteristics, the method can be realized by means of machine learning, neural networks and the like. Specifically, the object features may be obtained through machine learning, neural network, and other modes, so as to determine key points of the object, including: head keypoints, ankle keypoints, etc. of the user may be determined based on object features. However, according to the actual situation, if the user is in a sleeping state, the user can be in a lying state, at this time, a straight line can be determined based on the head key point and the ankle key point of the user, and if the angle between the straight line and the horizontal line is smaller; or the straight line and the horizontal line are in a parallel state, the lying state can be determined, and then the sleeping state can be determined, so that the working power of the refrigeration equipment can be reduced.
Alternatively, a user's hip keypoints, knee keypoints, and ankle keypoints may be determined. If the hip key point is at a certain distance from the horizontal line, the three points of the hip key point, the knee key point and the ankle key point form a triangle. At this time, it is determined that the user is in a sitting posture, and when the user is in a sitting posture, the user may be reading, working, etc., and thus a certain quiet space is also required, and the working power of the refrigeration equipment can be reduced in this posture. Of course, other schemes for determining the gesture of the user through the positions between the key points may also be included, and the embodiments of the present application will not be described again.
In order to better implement the embodiment of the present application, in an embodiment of the present application, determining the working power of the refrigeration device according to the object pose in the target image includes:
determining a preset power adjustment value matched with the object gesture according to a preset gesture power mapping relation, wherein the gesture power mapping relation represents the corresponding relation between the object gesture and the preset power adjustment value; and determining the working power of the refrigeration equipment according to the power adjustment value.
The above embodiments provide a scheme for determining the operating power of the corresponding refrigeration equipment according to the machine learning or the primary classifier and the secondary classifier in the neural network, or the positional relationship of the key points. The embodiment of the application also provides a scheme for determining the operation power corresponding to each object gesture according to the mapping relation table.
The mapping relation table at least comprises two parameters, wherein one parameter is an attitude type, and the other parameter is operation power corresponding to the attitude type. After a specific object gesture is obtained according to any of the above embodiments, the operating power corresponding to the specific object gesture may be determined based on the gesture power mapping table. This has the advantage that the computational consumption of the refrigeration device can be reduced. Of course, when determining the working power corresponding to the object gesture according to the gesture power mapping relation table, it may also be determined whether the refrigeration device is performing refrigeration work, or whether the current running power is greater than a preset power threshold. When the refrigeration equipment is in a refrigeration state or is larger than the power threshold, determining the working power corresponding to the object gesture according to the gesture power mapping relation table.
In order to better implement the method for controlling a refrigeration device according to the embodiment of the present application, above the method for controlling a refrigeration device, the embodiment of the present application further provides a refrigeration device control apparatus, as shown in fig. 3, where the apparatus 300 includes:
the acquisition module 301 is configured to acquire a target image, where the target image represents an environmental image of a space where the refrigeration device is located;
The detection module 302 is configured to perform feature detection on the target image to obtain an object feature in the target image;
a first determining module 303, configured to determine an object pose in the target image according to the object feature;
and a second determining module 304, configured to determine the working power of the refrigeration equipment according to the object gesture in the target image.
According to the refrigeration equipment control device provided by the application, the acquisition module 301 is used for acquiring the environment image of the space where the refrigeration equipment is located, and the detection module 302 is used for detecting whether a target object exists in the environment space; if the target object exists, and when the first determining module 303 determines that the target object is in a certain object posture, the second determining module 304 may determine that the target object needs a lower environmental noise requirement. The working power of the refrigeration equipment can be adjusted at the moment, the large working power of the refrigeration equipment can be avoided, and the noise decibel sent by the refrigeration equipment is reduced.
In some embodiments of the present application, the obtaining module 301 is specifically configured to:
determining a target distance between a target object and the refrigeration equipment;
and if the target distance is smaller than a preset first object distance threshold value, acquiring a target image.
In some embodiments of the present application, the apparatus 300 further includes a third determining module 305, where the third determining module 305 is specifically configured to:
And if the target distance is smaller than a preset second object distance threshold, adjusting the working power of the refrigeration equipment to the preset working power, wherein the second object distance threshold is smaller than the first object distance threshold.
In some embodiments of the present application, the second determining module 304 is specifically configured to:
determining an object distance difference between the target distance and a second object distance threshold;
and adjusting the working power of the refrigeration equipment to the working power matched with the object distance difference according to a preset difference power corresponding relation, wherein the difference power corresponding relation represents the corresponding relation between the object distance difference and the preset working power.
In some embodiments of the present application, the apparatus 300 further includes a fourth determining module 306, where the fourth determining module 306 is specifically configured to:
if the current moment is outside the preset night time period, executing the step of acquiring the target image;
if the current moment is within the night time period and if the current working power of the refrigeration equipment is larger than the preset working power, the working power of the refrigeration equipment is reduced.
In some embodiments of the present application, the first determining module 303 is specifically configured to:
determining each feature key point in the object features;
and determining the object posture in the target image according to the position relation among the characteristic key points.
In some embodiments of the present application, the second determining module 304 is specifically further configured to:
determining a preset power adjustment value matched with the object gesture according to a preset gesture power mapping relation, wherein the gesture power mapping relation represents the corresponding relation between the object gesture and the preset power adjustment value;
and determining the working power of the refrigeration equipment according to the power adjustment value.
The embodiment of the application also provides a refrigerator, which comprises a processor, a memory and a computer program stored in the memory and capable of running on the processor, wherein the processor executes the computer program to realize the steps in the refrigeration equipment control method of any one of the embodiments of the application. The refrigerator integrates any one of the control methods of the refrigeration equipment provided by the embodiment of the application, as shown in fig. 4, which shows a schematic structural diagram of the refrigerator according to the embodiment of the application, specifically:
the refrigerator may include one or more processors 401 of a processing core, one or more memories 402 of a computer readable storage medium, a power supply 403, and an input unit 404, etc. It will be appreciated by those skilled in the art that the refrigerator structure shown in fig. 4 is not limiting and may include more or fewer components than shown, or certain components may be combined, or a different arrangement of components. Wherein:
The processor 401 is a control center of the refrigerator, connects various parts of the entire refrigerator using various interfaces and lines, and performs various functions of the refrigerator and processes data by running or executing software programs and/or modules stored in the memory 402 and calling data stored in the memory 402, thereby performing overall monitoring of the refrigerator. Optionally, processor 401 may include one or more processing cores; the processor 401 may be a central processing unit (Central Processing Unit, CPU), but may also be other general purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), off-the-shelf programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like, preferably, the processor 401 may integrate an application processor, which primarily handles operating systems, user interfaces, applications, etc., with a modem processor, which primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 401.
The memory 402 may be used to store software programs and modules, and the processor 401 executes various functional applications and data processing by executing the software programs and modules stored in the memory 402. The memory 402 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required for at least one function, and the like; the storage data area may store data created according to the use of the refrigerator, etc. In addition, memory 402 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 402 may also include a memory controller to provide the processor 401 with access to the memory 402.
The refrigerator further includes a power supply 403 for supplying power to the respective components, and preferably, the power supply 403 may be logically connected to the processor 401 through a power management system, so that functions of managing charge, discharge, power consumption management, etc. are implemented through the power management system. The power supply 403 may also include one or more of any of a direct current or alternating current power supply, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and the like.
The refrigerator may further include an input unit 404, and the input unit 404 may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.
Although not shown, the refrigerator may further include a display unit or the like, which is not described herein. In this embodiment, the processor 401 in the refrigerator loads executable files corresponding to the processes of one or more application programs into the memory 402 according to the following instructions, and the processor 401 executes the application programs stored in the memory 402, so as to implement various functions, for example:
acquiring a target image, wherein the target image represents an environment image of a space where refrigeration equipment is located;
performing feature detection on the target image to obtain object features in the target image;
determining the object posture in the target image according to the object characteristics;
and determining the working power of the refrigeration equipment according to the object gesture in the target image.
Those of ordinary skill in the art will appreciate that all or a portion of the steps of the various methods of the above embodiments may be performed by instructions, or by instructions controlling associated hardware, which may be stored in a computer-readable storage medium and loaded and executed by a processor.
To this end, an embodiment of the present application provides a computer-readable storage medium, which may include: read Only Memory (ROM), random access Memory (RAM, random Access Memory), magnetic or optical disk, and the like. On which a computer program is stored, the computer program being loaded by a processor for executing the steps of any one of the control methods of the refrigeration equipment provided by the embodiments of the present application. For example, the loading of the computer program by the processor may perform the steps of:
acquiring a target image, wherein the target image represents an environment image of a space where refrigeration equipment is located;
performing feature detection on the target image to obtain object features in the target image;
determining the object posture in the target image according to the object characteristics;
and determining the working power of the refrigeration equipment according to the object gesture in the target image.
In the foregoing embodiments, the descriptions of the embodiments are focused on, and the portions of one embodiment that are not described in detail in the foregoing embodiments may be referred to in the foregoing detailed description of other embodiments, which are not described herein again.
In the implementation, each unit or structure may be implemented as an independent entity, or may be implemented as the same entity or several entities in any combination, and the implementation of each unit or structure may be referred to the foregoing method embodiments and will not be repeated herein.
The specific implementation of each operation above may be referred to the previous embodiments, and will not be described herein.
The above describes in detail a method and apparatus for controlling a refrigeration device provided by the embodiments of the present application, and specific examples are applied to describe the principles and embodiments of the present application, where the descriptions of the above embodiments are only used to help understand the method and core ideas of the present application; meanwhile, as those skilled in the art will vary in the specific embodiments and application scope according to the ideas of the present application, the present description should not be construed as limiting the present application in summary.

Claims (10)

1.一种制冷设备控制方法,其特征在于,所述方法包括:1. A refrigeration equipment control method, characterized in that the method includes: 获取目标图像,所述目标图像表征制冷设备所处空间的环境图像;Obtaining a target image that represents an environmental image of the space where the refrigeration equipment is located; 对所述目标图像进行特征检测,得到所述目标图像中的物体特征;Perform feature detection on the target image to obtain object features in the target image; 根据所述物体特征,确定所述目标图像中的物体姿态;Determine the posture of the object in the target image according to the object characteristics; 根据所述目标图像中的物体姿态,确定所述制冷设备的工作功率。The operating power of the refrigeration equipment is determined according to the posture of the object in the target image. 2.根据权利要求1所述的制冷设备控制方法,其特征在于,所述获取目标图像,包括:2. The refrigeration equipment control method according to claim 1, characterized in that said obtaining the target image includes: 确定目标物体与所述制冷设备之间的目标距离;Determine the target distance between the target object and the refrigeration equipment; 若所述目标距离小于预设的第一物距阈值,获取目标图像。If the target distance is less than the preset first object distance threshold, a target image is obtained. 3.根据权利要求2所述的制冷设备控制方法,其特征在于,所述确定所述目标物体与所述制冷设备之间的目标距离之后,所述方法还包括:3. The refrigeration equipment control method according to claim 2, wherein after determining the target distance between the target object and the refrigeration equipment, the method further includes: 若所述目标距离小于预设的第二物距阈值,将所述制冷设备的工作功率调整至预设的工作功率,所述第二物距阈值小于所述第一物距阈值。If the target distance is less than a preset second object distance threshold, the operating power of the refrigeration equipment is adjusted to the preset operating power, and the second object distance threshold is less than the first object distance threshold. 4.根据权利要求3所述的制冷设备控制方法,其特征在于,所述若所述目标距离小于预设的第二物距阈值,将所述制冷设备的工作功率调整至预设的工作功率,包括:4. The refrigeration equipment control method according to claim 3, wherein if the target distance is less than a preset second object distance threshold, the working power of the refrigeration equipment is adjusted to the preset working power. ,include: 确定所述目标距离与所述第二物距阈值之间的物距差值;Determine the object distance difference between the target distance and the second object distance threshold; 根据预设的差值功率对应关系,将所述制冷设备的工作功率调整至与所述物距差值匹配的工作功率,所述差值功率对应关系表征物距差值与预设的工作功率的对应关系。According to the preset difference power correspondence relationship, the working power of the refrigeration equipment is adjusted to the working power that matches the object distance difference. The difference power correspondence relationship represents the object distance difference and the preset working power. corresponding relationship. 5.根据权利要求1所述的制冷设备控制方法,其特征在于,所述根据所述物体特征,确定所述目标图像中的物体姿态,包括:5. The refrigeration equipment control method according to claim 1, wherein determining the object posture in the target image according to the object characteristics includes: 确定所述物体特征中的各个特征关键点;Determine each feature key point in the object features; 根据各所述特征关键点之间的位置关系,确定所述目标图像中的物体姿态。According to the positional relationship between the feature key points, the posture of the object in the target image is determined. 6.根据权利要求1所述的制冷设备控制方法,其特征在于,所述根据所述目标图像中的物体姿态,确定所述制冷设备的工作功率,包括:6. The refrigeration equipment control method according to claim 1, wherein determining the operating power of the refrigeration equipment according to the object posture in the target image includes: 根据预设的姿态功率映射关系,确定所述物体姿态匹配的预设的功率调整值,所述姿态功率映射关系表征物体姿态与预设的功率调整值的对应关系;Determine a preset power adjustment value matching the object posture according to a preset posture power mapping relationship, where the posture power mapping relationship represents the corresponding relationship between the object posture and the preset power adjustment value; 根据所述功率调整值,确定所述制冷设备的工作功率。According to the power adjustment value, the operating power of the refrigeration equipment is determined. 7.根据权利要求1至6任一项所述的制冷设备控制方法,其特征在于,所述获取目标图像之前,所述方法还包括:7. The refrigeration equipment control method according to any one of claims 1 to 6, characterized in that before acquiring the target image, the method further includes: 若当前时刻处于预设的夜间时间段之外,则执行获取目标图像的步骤;If the current time is outside the preset night time period, perform the step of obtaining the target image; 若所述当前时刻处于所述夜间时间段之内,且所述制冷设备的当前工作功率大于预设的工作功率,则降低所述制冷设备的工作功率。If the current time is within the night time period and the current working power of the refrigeration equipment is greater than the preset working power, the working power of the refrigeration equipment is reduced. 8.一种制冷设备控制装置,其特征在于,所述装置包括:8. A refrigeration equipment control device, characterized in that the device includes: 获取模块,用于获取目标图像,所述目标图像表征制冷设备所处空间的环境图像;An acquisition module, used to acquire a target image, which represents an environmental image of the space where the refrigeration equipment is located; 检测模块,用于对所述目标图像进行特征检测,得到所述目标图像中的物体特征;A detection module, used to perform feature detection on the target image to obtain object features in the target image; 第一确定模块,用于根据所述物体特征,确定所述目标图像中的物体姿态;A first determination module, configured to determine the posture of the object in the target image according to the characteristics of the object; 第二确定模块,用于根据所述目标图像中的物体姿态,确定所述制冷设备的工作功率。The second determination module is used to determine the working power of the refrigeration equipment according to the posture of the object in the target image. 9.一种冰箱,其特征在于,所述冰箱包括处理器、存储器以及存储于所述存储器中并可在所述处理器上运行的计算机程序,所述处理器执行所述计算机程序以实现权利要求1至7任一项所述的制冷设备控制方法中的步骤。9. A refrigerator, characterized in that the refrigerator includes a processor, a memory and a computer program stored in the memory and executable on the processor, and the processor executes the computer program to realize the rights The steps in the refrigeration equipment control method according to any one of claims 1 to 7. 10.一种计算机可读存储介质,其特征在于,所述计算机可读存储介质上存储有计算机程序,所述计算机程序被处理器执行以实现权利要求1至7任一项所述的制冷设备控制方法中的步骤。10. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, and the computer program is executed by a processor to implement the refrigeration equipment according to any one of claims 1 to 7 Control the steps in the method.
CN202310500487.9A 2023-05-04 2023-05-04 Refrigeration equipment control method and device, refrigerator and computer readable storage medium Pending CN116734412A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310500487.9A CN116734412A (en) 2023-05-04 2023-05-04 Refrigeration equipment control method and device, refrigerator and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310500487.9A CN116734412A (en) 2023-05-04 2023-05-04 Refrigeration equipment control method and device, refrigerator and computer readable storage medium

Publications (1)

Publication Number Publication Date
CN116734412A true CN116734412A (en) 2023-09-12

Family

ID=87908735

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310500487.9A Pending CN116734412A (en) 2023-05-04 2023-05-04 Refrigeration equipment control method and device, refrigerator and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN116734412A (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102227601A (en) * 2008-12-24 2011-10-26 松下电器产业株式会社 Refrigerator and compressor
CN106016951A (en) * 2016-05-26 2016-10-12 青岛海尔股份有限公司 Running state control method of refrigerator and refrigerator
CN106123473A (en) * 2016-06-24 2016-11-16 合肥华凌股份有限公司 The control method of a kind of refrigerator, control device and refrigerator
CN113865254A (en) * 2021-09-29 2021-12-31 Tcl家用电器(合肥)有限公司 Control method and device of refrigeration equipment, storage medium and electronic equipment
CN114067358A (en) * 2021-11-02 2022-02-18 南京熊猫电子股份有限公司 Human body posture recognition method and system based on key point detection technology

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102227601A (en) * 2008-12-24 2011-10-26 松下电器产业株式会社 Refrigerator and compressor
CN106016951A (en) * 2016-05-26 2016-10-12 青岛海尔股份有限公司 Running state control method of refrigerator and refrigerator
CN106123473A (en) * 2016-06-24 2016-11-16 合肥华凌股份有限公司 The control method of a kind of refrigerator, control device and refrigerator
CN113865254A (en) * 2021-09-29 2021-12-31 Tcl家用电器(合肥)有限公司 Control method and device of refrigeration equipment, storage medium and electronic equipment
CN114067358A (en) * 2021-11-02 2022-02-18 南京熊猫电子股份有限公司 Human body posture recognition method and system based on key point detection technology

Similar Documents

Publication Publication Date Title
CN108088041B (en) Control method of electronic expansion valve, radiation air conditioner and storage medium
CN104406251B (en) Air conditioner dehumanization method and air conditioner
WO2015021853A1 (en) Control method, control device for inverter air conditioner and inverter air conditioner
CN107013978A (en) Indoor apparatus of air conditioner and its air supply method
CN108826585B (en) Control method and device of air conditioner, storage medium and air conditioner
CN109579213B (en) Air conditioner temperature control method, storage device and air conditioner
CN105042798B (en) A kind of method for controlling air conditioner
CN106196441B (en) Method and device for realizing air conditioning refrigeration control
CN105042795A (en) Control method for wall-mounted frequency conversion air conditioner
WO2019075821A1 (en) Method for controlling air conditioner in multimedia classroom
CN108800465B (en) Air conditioner control method, air conditioner control device, and electronic device
CN108917117A (en) Air-conditioning and its control method, device
CN105042797A (en) Control method for wall-mounted inverter air-conditioner
CN106052012A (en) Variable frequency air conditioner refrigeration control method and device based on distance
CN106642549A (en) Method and device for achieving refrigeration control of air conditioner based on distance
CN114963429A (en) Air conditioner dehumidification control method and system, storage medium and air conditioner
CN115371217B (en) Air conditioning control method, device, air conditioner and storage medium
CN116558188A (en) A kind of operation control method of refrigerator and compressor
CN116734412A (en) Refrigeration equipment control method and device, refrigerator and computer readable storage medium
CN110940031A (en) Air conditioner control method, kitchen air conditioning system and storage medium
CN120627364A (en) air conditioner
CN106610087A (en) Air conditioner refrigeration control achieving method and device
CN106679071A (en) Method and device for realizing refrigeration control of air conditioner
CN117490201A (en) Air conditioner operation method and device, air conditioner and storage medium
CN116576606A (en) A refrigerator and a method for controlling the operation of the refrigerator

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination