WO2020111961A1 - Frigidaire intelligent - Google Patents

Frigidaire intelligent Download PDF

Info

Publication number
WO2020111961A1
WO2020111961A1 PCT/RU2018/000772 RU2018000772W WO2020111961A1 WO 2020111961 A1 WO2020111961 A1 WO 2020111961A1 RU 2018000772 W RU2018000772 W RU 2018000772W WO 2020111961 A1 WO2020111961 A1 WO 2020111961A1
Authority
WO
WIPO (PCT)
Prior art keywords
shelves
door
controller
refrigerator
head controller
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/RU2018/000772
Other languages
English (en)
Russian (ru)
Inventor
Алексей Вячеславович ЕРОШКИН
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sberbank PAO
Original Assignee
Sberbank PAO
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sberbank PAO filed Critical Sberbank PAO
Publication of WO2020111961A1 publication Critical patent/WO2020111961A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D11/00—Self-contained movable devices, e.g. domestic refrigerators
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D23/00—General constructional features
    • F25D23/02—Doors; Covers
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D25/00—Charging, supporting, and discharging the articles to be cooled
    • F25D25/02—Charging, supporting, and discharging the articles to be cooled by shelves
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D29/00—Arrangement or mounting of control or safety devices

Definitions

  • This technical solution generally relates to the field of computer technology, and in particular to “smart” devices in the concept of the Internet of things.
  • a technical problem or task to be solved in this technical solution is the determination of the products contained in the refrigerator by measuring their physical characteristics, including by analyzing images stored in the refrigerator, obtained using one or more cameras.
  • the technical result achieved in solving the above problem is to increase the accuracy of determining the physical properties of products and goods in the refrigerator through their remote monitoring.
  • the specified technical result is achieved due to the device, which is developed in the concept of the Internet of things and is a device connected to the network for collecting data and their subsequent processing on the server. Data from the server can be viewed through a web service or mobile application. The online refrigerator user gets access to information about the products in the refrigerator, their weight and length of stay.
  • FIG. 1 illustrates the shelves of the main department of a smart refrigerator.
  • FIG. 2 shows the circuit mounting of the shelf on the door and the impact on the strain gauge.
  • FIG. Figure 3 shows an example of a video camera capturing products in a refrigerator and displaying weight through the operation of video analytics.
  • FIG. 4 shows an embodiment of the architecture of a technical solution.
  • a system including a computer system, a computer (electronic computer), CNC (numerical control), PLC (programmable logic controller), computerized control systems, and any other devices that can perform a given , clearly defined sequence of operations (actions, instructions).
  • An instruction processing device is understood to mean an electronic unit or an integrated circuit (microprocessor) executing machine instructions (programs).
  • An instruction processing device reads and executes machine instructions (programs) from one or more data storage devices.
  • Hard drives (HDD), flash memory, ROM (read-only memory), solid state drives (SSD), optical drives can act as storage devices.
  • a program is a sequence of instructions for execution by a computer control device or an instruction processing device.
  • the size of the filled row (for example, eggs or other goods in a storage format - rows);
  • the indicated data may be displayed in a graphical user interface on a mobile user communication device.
  • the container is part of a shelf or balcony, for example, open, mounted on a door.
  • a strain gauge sensor can be integrated on the back of the inner front panel of the door, so when removing the shelves you do not need to open the contact groups, you can move the shelves and change the size.
  • a strain gauge sensor is a sensor that converts the measured deformation of solids (shelves) into an electrical signal.
  • the device is a strain gauge with a contact element. It is mounted on the top panel of the device, which is in contact with the measured body. To connect the sensor to the network, special electric taps are used that are connected to the sensitive plate.
  • the change in the resistance of the strain gauge conductor under the action of deformation is explained by 2 reasons: a change in the geometric dimensions (length, wire diameter) and a change in the resistivity of the material of the strain gauge.
  • the operation of the strain gauge is characterized by a strain sensitivity coefficient (S), which is equal to the quotient of dividing the relative change in the resistance of the strain gauge by its relative deformation.
  • S strain sensitivity coefficient
  • foil or film, or wire can be used in this technical solution: foil or film, or wire.
  • a set of sensors sends information through a switching controller via a data bus to the head controller.
  • gas sensors can be integrated into the door panel to detect the presence of spoiled products and also direct this information to the head controller.
  • the data bus can be based on USART, Ethernet, or Arcnet, or Token Ring, or FDDI.
  • the head controller may be a microprocessor that implements all the computational actions that make the smart refrigerator as a whole, which is enclosed in the housing of the smart refrigerator or located on the body.
  • the switching controller receives information from the strain gauge sensors and redirects it to the head controller.
  • a switching controller provides control of four components: a RAM bus, an AGP, a system bus, and an I / O controller.
  • the switching controller can include controllers for drives, keyboards, mice, and other external interfaces, which provides control of the external interfaces of an intelligent refrigerator (USB, COM, LPT, etc.).
  • a single set of transport and logical protocols may include TCP / IP, UDP / IP, MODBUS, BACnet.
  • the shelves (balconies) of the door of the smart refrigerator have the ability to be configured in the likeness of an organizer to the user's requirements.
  • several different shelves are provided, both in size and purpose (for example, egg, butter, cheese, bottle, under plastic trays, etc.).
  • Shelves are a predefined set that can be interchanged and in height. It is possible to purchase additional additional shelves separately and make, for example, A - three classic balconies in full width, or B - 15 different shelves with a width of 10 cm. 2. If the product is in the tray, it presses on the strain gauge with a certain pressure, which is used to determine the weight.
  • the door controller closes the door at a predetermined optimal angle of rotation, it photographs the contents of the refrigerator using installed cameras (from 2 pcs or more).
  • the camera or camcorder is located close to the door (otherwise it will be covered by products in the main section), and therefore photographing is not carried out in the closed position. If you open the door completely, then the goods are not visible due to the fact that the camera is installed on the door. Cameras are built into the side panel from the inside, and into the top panel. In some embodiments, cameras are partially immersed in a panel to save space.
  • the number of cameras or camcorders can vary from 2, because one camera in a particular implementation is not enough to obtain a viewing angle, and therefore the quality of the resulting image decreases.
  • Obtaining images from cameras installed on the side door is carried out automatically in case of opening the side door of the smart refrigerator at a predetermined opening angle of this door. This angle is selected empirically and can lie in the range from 1 to 90 degrees.
  • Implementation when opening the door to a predetermined angle is carried out using a door opening angle sensor.
  • the operation of this device is based on the principle of operation of all optical sensors: the emitting element directs the light flux, the electronic data processing unit determines the rate of return of the beam.
  • This sensor has extensive configuration options:
  • the main department of the smart refrigerator has rotary shelves and cameras installed on the side panels (set), and when analyzing the contents of the main department, the shelves are scrolled 360 degrees, data from the cameras are transmitted to the head controller, as shown in FIG. 3.
  • the user scrolls the shelves to any angle by using a mobile application and sending control commands to the switching controller, which redirects them to the rotary shelves (their microcontroller).
  • Cameras can be installed in at least one far corner above each shelf or in several corners, without limitation.
  • the head controller preprocesses data and photographs.
  • the head controller sends a control signal to the cameras (its controllers) to take a picture (image acquisition), and then transfers it to the server via a wireless data transfer protocol.
  • the head controller performs visual editing of the received frames, for example, gluing several, working with white balance, straightening, etc. Segmented information is sent to the server via wireless data transfer technology, for example, Wi-Fi, BLE, GSM or another, at the user's choice.
  • Each strain gauge has its own unique identification number. To connect the area of the received frame from the set of cameras and the sensor number, the sensor is calibrated and the head controller.
  • the images obtained from the head controller are processed either on the server or locally on the smart refrigerator, and using the computer vision / artificial intelligence methods, the name of the product is determined from the existing database of product images.
  • This database of images can be either borrowed from third manufacturers or its own.
  • an artificial neural network previously trained on a test data set, classifies the received image from the head controller and determines its physical characteristics.
  • a user in a mobile application or web interface can configure:
  • the lower critical limit (for example, by weight) for the sensor is pre-configured by the user according to his requirements.
  • a user consumes 200 grams per day. milk, on the basis of which a limit of 250 gr.
  • display or automatic milk ordering occurs in the user's mobile application (in its graphical user interface).
  • the impression is a photograph of the door / main compartment of the smart refrigerator, on which a mask with weight data is applied. If the user chose a threshold of 250 gr. , and the weight is less than 250 gr, then the mask lights up in red, and if the weight of the product is in the required interval - green. In other embodiments, highlighting a mask with a color may indicate expiration of the product.
  • the shelf life of the product, physical data can be used as a mask.
  • Custom settings may include SMS alerts, auto-order, purge activation in the event of a souring product, etc.
  • the user can make decisions about ordering, purchasing goods, or setting up their order automatically.
  • the communication component of the technical solution is configured to maintain communication, wired or wireless, between the smart refrigerator and other devices.
  • the device may provide access to a wireless network based on a communication standard such as WiFi, 2G or 3G, or a combination thereof.
  • the communication component receives a broadcast signal or information related to a broadcast transmission from an external broadcast control system via a broadcast channel.
  • the communication component further includes a short-range (NFC) communication module for maintaining near-field communication.
  • the NFC module can be implemented based on the technology of radio frequency identification (RFID), technology Association data transmission in the infrared range (IrDA), Ultra Wide Band (UWB) technology, Bluetooth (BT) technology and other technologies.
  • RFID radio frequency identification
  • IrDA technology Association data transmission in the infrared range
  • UWB Ultra Wide Band
  • Bluetooth Bluetooth
  • the switching or head controller can be implemented using one or more specialized integrated circuits (ASICs), digital signal processors (DSP), digital signal processing devices (DSPD), programmable logic devices (PLD), programmable logic arrays type FPGA (FPGA), microcontrollers, microprocessors or other electronic components designed to perform the above methods.
  • ASICs specialized integrated circuits
  • DSP digital signal processors
  • DSPD digital signal processing devices
  • PLD programmable logic devices
  • FPGA programmable logic arrays type FPGA
  • microcontrollers microprocessors or other electronic components designed to perform the above methods.
  • the head controller provides the following interfaces and functions:
  • VHF channel for two-way communication with readers through a radiating cable.
  • the above functional elements of an intelligent refrigerator form a structurally functional unity and are connected through assembly operations to the refrigerator body and to each other, for example, by means of threaded or bolted joints, soldering, etc., depending on configuration requirements when creating the claimed device.

Landscapes

  • Engineering & Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Physics & Mathematics (AREA)
  • Mechanical Engineering (AREA)
  • Thermal Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)

Abstract

L'invention concerne des équipements informatiques et notamment des dispositifs intelligents dans l'Internet des choses. Le frigidaire intelligent comprend un ensemble de rayons latéraux disposés dans la porte. Sous chaque rayon latéral on a disposé un capteur tensiométrique réalisé de manière à permettre de déterminer le poids des rayons et la direction des résultats des mesures vers un contrôleur de commutation. Un ensemble de caméras vidéos est intégré au panneau latéral du corps de l'intérieur et dans le panneau supérieur. Les caméras vidéos ont été réalisées avec la possibilité d'obtenir des images vidéos et les diriger sur le contrôleur de tête. Le contrôleur de commutation est intégré du côté arrière du panneau de face interne et est réalisé de manière à pouvoir obtenir des données provenant des capteurs tensiométriques et les rediriger vers le contrôleur de tête. L'ensemble de rayons orientables est disposé principalement dans la section principale du corps. Les rayons orientables ont été réalisés avec la possiblité de tourner lors de la réception d'un signal provenant du contrôleur. Le contrôleur de tête a été réalisé avec la possibilité d'effectuer la prise d'images vidéo du contenu du frigidaire au moyen des caméras installées lors de la fermeture de la porte à un angle d'orientation voulu. Le résultat technique consiste à améliorer la précistion de détermination des propriétés physiques des produits et marchandises se trouvant dans le frigidaire
PCT/RU2018/000772 2018-11-27 2018-11-27 Frigidaire intelligent Ceased WO2020111961A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
RU2018141787 2018-11-27
RU2018141787 2018-11-27

Publications (1)

Publication Number Publication Date
WO2020111961A1 true WO2020111961A1 (fr) 2020-06-04

Family

ID=70853064

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/RU2018/000772 Ceased WO2020111961A1 (fr) 2018-11-27 2018-11-27 Frigidaire intelligent

Country Status (1)

Country Link
WO (1) WO2020111961A1 (fr)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11841188B2 (en) 2022-02-15 2023-12-12 Haier Us Appliance Solutions, Inc. Refrigerator appliance and cantilever track with sensor
US11936489B2 (en) 2021-02-02 2024-03-19 True Manufacturing Co., Inc. Systems, methods, and appliances that enable regional control of refrigeration appliances
US12254113B2 (en) 2022-10-03 2025-03-18 Haier Us Appliance Solutions, Inc. Multi-camera vision system facilitating authentication and secure data transfer
US12379144B2 (en) 2022-03-10 2025-08-05 True Manufacturing Co., Inc. Ice maker and system and method for monitoring water filter of the ice maker
US12526682B2 (en) 2022-07-28 2026-01-13 True Manufacturing Co., Inc. Asset management and IOT device for refrigerated appliances
US12613504B2 (en) 2021-02-02 2026-04-28 True Manufacturing Co., Inc. Systems and methods for managing leased appliances

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1995007645A1 (fr) * 1993-09-15 1995-03-23 L & P Property Management Company Presentoirs de marchandises
RU97108876A (ru) * 1997-05-29 1999-04-27 Е.М. Бумажный Холодильник
WO2014016212A1 (fr) * 2012-07-27 2014-01-30 BSH Bosch und Siemens Hausgeräte GmbH Réfrigérateur intelligent, système de réfrigérateur comprenant le réfrigérateur intelligent et procédé de commande associé
EP2975343A1 (fr) * 2013-03-12 2016-01-20 Kabushiki Kaisha Toshiba Réfrigérateur et dispositif de prise de vues
US20160223250A1 (en) * 2013-10-18 2016-08-04 Lg Electronics Inc. Refrigerator and control method for the same
US20170263100A1 (en) * 2016-03-14 2017-09-14 Amazon Technologies, Inc. Scent-based spoilage sensing refrigerator

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1995007645A1 (fr) * 1993-09-15 1995-03-23 L & P Property Management Company Presentoirs de marchandises
RU97108876A (ru) * 1997-05-29 1999-04-27 Е.М. Бумажный Холодильник
WO2014016212A1 (fr) * 2012-07-27 2014-01-30 BSH Bosch und Siemens Hausgeräte GmbH Réfrigérateur intelligent, système de réfrigérateur comprenant le réfrigérateur intelligent et procédé de commande associé
EP2975343A1 (fr) * 2013-03-12 2016-01-20 Kabushiki Kaisha Toshiba Réfrigérateur et dispositif de prise de vues
US20160223250A1 (en) * 2013-10-18 2016-08-04 Lg Electronics Inc. Refrigerator and control method for the same
US20170263100A1 (en) * 2016-03-14 2017-09-14 Amazon Technologies, Inc. Scent-based spoilage sensing refrigerator

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11936489B2 (en) 2021-02-02 2024-03-19 True Manufacturing Co., Inc. Systems, methods, and appliances that enable regional control of refrigeration appliances
US12613504B2 (en) 2021-02-02 2026-04-28 True Manufacturing Co., Inc. Systems and methods for managing leased appliances
US11841188B2 (en) 2022-02-15 2023-12-12 Haier Us Appliance Solutions, Inc. Refrigerator appliance and cantilever track with sensor
US12379144B2 (en) 2022-03-10 2025-08-05 True Manufacturing Co., Inc. Ice maker and system and method for monitoring water filter of the ice maker
US12526682B2 (en) 2022-07-28 2026-01-13 True Manufacturing Co., Inc. Asset management and IOT device for refrigerated appliances
US12532211B2 (en) 2022-07-28 2026-01-20 True Manufacturing Co., Inc. Asset management and IOT device for refrigerated appliances
US12574788B2 (en) 2022-07-28 2026-03-10 True Manufacturing Co., Inc. Asset management and IOT device for refrigerated appliances
US12598504B2 (en) 2022-07-28 2026-04-07 True Manufacturing Co., Inc. Asset management and IOT device for refrigerated appliances
US12254113B2 (en) 2022-10-03 2025-03-18 Haier Us Appliance Solutions, Inc. Multi-camera vision system facilitating authentication and secure data transfer

Similar Documents

Publication Publication Date Title
WO2020111961A1 (fr) Frigidaire intelligent
US10803315B2 (en) Electronic device and method for processing information associated with food
US12167817B2 (en) Systems and methods for automated cooking
US11030775B2 (en) Minimal user input video analytics systems and methods
WO2018142136A1 (fr) Appareil d'imagerie
US20180181827A1 (en) Apparatus and method for processing image
KR102209741B1 (ko) 음식과 관련된 정보를 처리하기 위한 전자 장치 및 방법
CN113418606B (zh) 分光计模块
KR20200058798A (ko) 피부 상태 측정용 다중 이미지 획득 모듈
US20170199576A1 (en) Interactive Mirror
JP2022128496A (ja) 情報処理装置、移動体、撮影システム、撮影制御方法およびプログラム
EP3476269B1 (fr) Procédé permettant d'évaluer automatiquement le type de détergent utilisé dans un lave-vaisselle
US20210214095A1 (en) Motor control optimizations for unmanned aerial vehicles
CN106403488A (zh) 智能冰箱及其管理方法
WO2018156970A1 (fr) Systèmes et procédés de détection en temps réel d'un mouvement périodique
RU188020U1 (ru) Интеллектуальный холодильник
WO2019137013A1 (fr) Four à micro-ondes intelligent et dispositif intelligent comportant une fonction d'identification d'aliments
US12335655B2 (en) Thermal imaging asset inspection systems and methods
WO2020019111A1 (fr) Procédé d'acquisition d'informations de profondeur d'un objet cible, et plate-forme mobile
KR101753298B1 (ko) IoT 센서 기반의 시약 등록 장치 및 방법
KR20190048922A (ko) 스마트 테이블 및 스마트 테이블의 제어방법
KR102200619B1 (ko) 스마트 음식물 분석 시스템 및, 이를 이용한 분석 방법
US20230126197A1 (en) Distance compensation for thermal imaging temperature measurement of inner canthus systems and methods
CN110598591A (zh) 一种信息处理方法及装置、设备、存储介质
CN217931508U (zh) 一种可联网带rs485信号输出的点型可燃气体探测器

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18941373

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18941373

Country of ref document: EP

Kind code of ref document: A1