WO2023080406A1 - 서빙 순서에 따른 아이템 보호 장치 및 방법 - Google Patents
서빙 순서에 따른 아이템 보호 장치 및 방법 Download PDFInfo
- Publication number
- WO2023080406A1 WO2023080406A1 PCT/KR2022/012581 KR2022012581W WO2023080406A1 WO 2023080406 A1 WO2023080406 A1 WO 2023080406A1 KR 2022012581 W KR2022012581 W KR 2022012581W WO 2023080406 A1 WO2023080406 A1 WO 2023080406A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- serving
- electronic device
- item
- tray
- destination
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J11/00—Manipulators not otherwise provided for
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J5/00—Manipulators mounted on wheels or on carriages
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Program-controlled manipulators
- B25J9/16—Program controls
Definitions
- Certain exemplary embodiments relate to an item protecting device and method based at least on serving order.
- Such an electronic device may perform an operation such as processing a customer's order request or carrying it to a customer.
- An electronic device may allow a clerk to place cooked food on the robot without thinking about the serving order and table position.
- the electronic device may provide a service in which a customer at a table may take only the ordered food without taking food from another table.
- An electronic device may provide a solution that accurately delivers food from a corresponding table while simultaneously serving food to a plurality of tables and prevents or reduces the possibility of taking food from another table.
- An electronic device includes a plurality of serving trays each capable of accommodating items; a driving unit that moves the electronic device; a memory in which computer-executable instructions are stored; and a processor (including processing circuitry) that accesses the memory and executes the instructions, wherein the instructions correspond to items disposed on the plurality of serving trays and order information of a plurality of destinations. determining the serving order in which the items of the plurality of serving trays should be delivered based on the above, and while delivering the item to one of the plurality of destinations, a serving order subsequent to the serving order of the corresponding destination is mapped. It can provide protection for trays.
- a processor-implemented method includes determining a serving order in which an item of a plurality of serving trays should be delivered based at least on an item disposed on a plurality of serving trays and order information of a plurality of destinations; and providing protection to a serving tray mapped with a serving order later than that of the corresponding destination while delivering the item to one of the plurality of destinations.
- the electronic device may automatically identify the serving order for each tray and perform serving even if the clerk places the cooked food on the robot without thinking about the serving order and table position.
- An electronic device prevents and/or misdeliveries by accurately delivering food from a table while serving food to a plurality of tables at the same time, and preventing access to food from other tables and/or reducing the possibility of such food. can reduce
- FIG. 1 is a block diagram of an electronic device in a network environment, according to various embodiments.
- FIG. 2 illustrates an example of implementing a serving robot of an electronic device according to various embodiments.
- 3 and 4 are flowcharts illustrating an item protection method according to various embodiments.
- FIG. 5 is a diagram illustrating item matching according to various embodiments.
- FIG. 6 is a diagram illustrating determination of a serving order according to various embodiments.
- FIG. 7 is a diagram illustrating protection of a serving tray based on a serving order according to various embodiments.
- FIGS. 8 and 9 are diagrams illustrating sequential delivery of protected items according to a serving order according to various embodiments.
- 10 is a diagram illustrating intrusion detection of an unallowed object according to various embodiments.
- 11 to 17 show examples of protection modules according to various embodiments.
- FIG 18 illustrates orientation-based protection of an electronic device according to various embodiments.
- 19 is a flowchart illustrating a method of processing a serving error according to various embodiments.
- FIG. 1 is a block diagram of an electronic device 101 within a network environment 100, according to various embodiments.
- an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or through a second network 199. It may communicate with at least one of the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to one embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 .
- a first network 198 eg, a short-range wireless communication network
- the server 108 e.g, a long-distance wireless communication network
- the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, motor 187, power management module 188, battery 189, communication module 190, subscriber An identification module 196 or an antenna module 197 may be included.
- at least one of these components eg, the connection terminal 178) may be omitted or one or more other components may be added.
- some of these components are integrated into a single component (eg, display module 160). It can be.
- the processor 120 for example, executes software (eg, the program 140) to cause at least one other component (eg, hardware or software component) of the electronic device 101 connected to the processor 120. It can control and perform various data processing or calculations. According to one embodiment, as at least part of data processing or operation, the processor 120 transfers instructions or data received from other components (e.g., sensor module 176 or communication module 190) to volatile memory 132. , processing commands or data stored in the volatile memory 132 , and storing resultant data in the non-volatile memory 134 .
- software eg, the program 140
- the processor 120 transfers instructions or data received from other components (e.g., sensor module 176 or communication module 190) to volatile memory 132. , processing commands or data stored in the volatile memory 132 , and storing resultant data in the non-volatile memory 134 .
- the processor 120 may include a main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit ( NPU: neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor).
- a main processor 121 eg, a central processing unit or an application processor
- a secondary processor 123 eg, a graphic processing unit, a neural network processing unit ( NPU: neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor.
- NPU neural network processing unit
- NPU neural processing unit
- the secondary processor 123 may, for example, take the place of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, running an application). ) state, together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states.
- the auxiliary processor 123 eg, image signal processor or communication processor
- the auxiliary processor 123 may include a hardware structure specialized for processing an artificial intelligence model.
- AI models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself where the artificial intelligence model is performed, or may be performed through a separate server (eg, the server 108).
- the learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning or reinforcement learning, but in the above example Not limited.
- the artificial intelligence model may include a plurality of artificial neural network layers.
- Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the foregoing, but is not limited to the foregoing examples.
- the artificial intelligence model may include, in addition or alternatively, software structures in addition to hardware structures.
- the memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101 .
- the data may include, for example, input data or output data for software (eg, program 140) and commands related thereto.
- the memory 130 may include volatile memory 132 or non-volatile memory 134 .
- the program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142 , middleware 144 , or an application 146 .
- the input module 150 may include an input circuit, and transmits a command or data to be used to a component of the electronic device 101 (eg, the processor 120 including a processing circuit) to the outside of the electronic device 101 ( Example: user).
- the input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).
- the sound output module 155 may output sound signals to the outside of the electronic device 101 .
- the sound output module 155 may include, for example, a speaker or a receiver.
- the speaker can be used for general purposes such as multimedia playback or recording playback.
- a receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.
- the display module 160 may visually provide information to the outside of the electronic device 101 (eg, a user).
- the display module 160 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the device.
- the display module 160 may include a touch sensor set to detect a touch or a pressure sensor set to measure the intensity of force generated by the touch.
- the audio module 170 may convert sound into an electrical signal or vice versa. According to one embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device connected directly or wirelessly to the electronic device 101 (eg: Sound may be output through the electronic device 102 (eg, a speaker or a headphone).
- the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device connected directly or wirelessly to the electronic device 101 (eg: Sound may be output through the electronic device 102 (eg, a speaker or a headphone).
- the sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, a user state), and generates an electrical signal or data value corresponding to the detected state. can do.
- the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a bio sensor, It may include a temperature sensor, humidity sensor, or light sensor.
- the interface 177 may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device 101 to an external electronic device (eg, the electronic device 102).
- the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
- HDMI high definition multimedia interface
- USB universal serial bus
- SD card interface Secure Digital Card interface
- audio interface audio interface
- connection terminal 178 may include a connector through which the electronic device 101 may be physically connected to an external electronic device (eg, the electronic device 102).
- the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).
- the haptic module 179 may convert electrical signals into mechanical stimuli (eg, vibration or motion) or electrical stimuli that a user may perceive through tactile or kinesthetic senses.
- the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
- the camera module 180 may capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.
- the driving module may drive the electronic device 101 .
- the driving module may include a motor 187 and a wheel coupled to the motor 187 .
- a pair of wheels are spaced apart from the center of the lower portion of the electronic device 101 along an axis (eg, a lateral axis) perpendicular to a driving direction (eg, a longitudinal axis).
- a driving direction eg, a longitudinal axis
- An example of being arranged is shown, but is not limited thereto.
- the arrangement and number of motors 187 and wheels of the driving module may vary depending on the design.
- the power management module 188 may manage power supplied to the electronic device 101 .
- the power management module 188 may be implemented as at least part of a power management integrated circuit (PMIC), for example.
- PMIC power management integrated circuit
- the battery 189 may supply power to at least one component of the electronic device 101 .
- the battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.
- the communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). Establishment and communication through the established communication channel may be supported.
- the communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication.
- the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : a local area network (LAN) communication module or a power line communication module).
- a wireless communication module 192 eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module
- GNSS global navigation satellite system
- wired communication module 194 eg, : a local area network (LAN) communication module or a power line communication module.
- a corresponding communication module is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a telecommunications network such as a computer network (eg, a LAN or a WAN).
- a telecommunications network such as a computer network (eg, a LAN or a WAN).
- These various types of communication modules may be integrated as one component (eg, a single chip) or implemented as a plurality of separate components (eg, multiple chips).
- the wireless communication module 192 uses subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199.
- subscriber information eg, International Mobile Subscriber Identifier (IMSI)
- IMSI International Mobile Subscriber Identifier
- the electronic device 101 may be identified or authenticated.
- the wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, NR access technology (new radio access technology).
- NR access technologies include high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and access of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low latency (URLLC)).
- eMBB enhanced mobile broadband
- mMTC massive machine type communications
- URLLC ultra-reliable and low latency
- -latency communications can be supported.
- the wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example.
- the wireless communication module 192 uses various technologies for securing performance in a high frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. Technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna may be supported.
- the wireless communication module 192 may support various requirements defined for the electronic device 101, an external electronic device (eg, the electronic device 104), or a network system (eg, the second network 199).
- the wireless communication module 192 is a peak data rate for eMBB realization (eg, 20 Gbps or more), a loss coverage for mMTC realization (eg, 164 dB or less), or a U-plane latency for URLLC realization (eg, Example: downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) may be supported.
- eMBB peak data rate for eMBB realization
- a loss coverage for mMTC realization eg, 164 dB or less
- U-plane latency for URLLC realization eg, Example: downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less
- the antenna module 197 may transmit or receive signals or power to the outside (eg, an external electronic device).
- the antenna module 197 may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (eg, PCB).
- the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is selected from the plurality of antennas by the communication module 190, for example. can be chosen A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna.
- other components eg, a radio frequency integrated circuit (RFIC) may be additionally formed as a part of the antenna module 197 in addition to the radiator.
- RFIC radio frequency integrated circuit
- the antenna module 197 may form a mmWave antenna module.
- the mmWave antenna module is a printed circuit board, an RFIC disposed on, adjacent to, or close to a first surface (eg, bottom surface) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band).
- a plurality of antennas eg, an array antenna
- a second surface eg, a top surface or a side surface
- peripheral devices eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)
- signal e.g. commands or data
- commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 .
- Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 .
- all or part of operations executed in the electronic device 101 may be executed in one or more external electronic devices among the external electronic devices 102 , 104 , or 108 .
- the electronic device 101 when the electronic device 101 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 instead of executing the function or service by itself.
- one or more external electronic devices may be requested to perform the function or at least part of the service.
- One or more external electronic devices receiving the request may execute at least a part of the requested function or service or an additional function or service related to the request, and deliver the execution result to the electronic device 101 .
- the electronic device 101 may provide the result as at least part of a response to the request as it is or additionally processed.
- cloud computing distributed computing, mobile edge computing (MEC), or client-server computing technology may be used.
- the electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing.
- the external electronic device 104 may include an internet of things (IoT) device.
- Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199 .
- the electronic device 101 may be applied to intelligent services (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.
- Electronic devices may be devices of various types.
- the electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance.
- a portable communication device eg, a smart phone
- a computer device e.g., a smart phone
- a portable multimedia device e.g., a portable medical device
- a camera e.g., a portable medical device
- a camera e.g., a portable medical device
- a camera e.g., a portable medical device
- a camera e.g., a camera
- a wearable device e.g., a smart bracelet
- first, second, or first or secondary may simply be used to distinguish a given component from other corresponding components, and may be used to refer to a given component in another aspect (eg, importance or order) is not limited.
- a (e.g., first) component is said to be “coupled” or “connected” to another (e.g., second) component, with or without the terms “functionally” or “communicatively.”
- the certain component may be connected to the other component directly (eg by wire), wirelessly, or at least through a third component.
- module used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logical blocks, parts, or circuits.
- a module may be an integrally constructed component or a minimal unit of components or a portion thereof that performs one or more functions.
- the module may be implemented in the form of an application-specific integrated circuit (ASIC).
- ASIC application-specific integrated circuit
- a storage medium eg, internal memory 136 or external memory 138
- a machine eg, electronic device 101
- a processor eg, the processor 120
- a device eg, the electronic device 101
- the one or more instructions may include code generated by a compiler or code executable by an interpreter.
- the device-readable storage medium may be provided in the form of a non-transitory storage medium.
- the storage medium is a tangible device and does not contain a signal (e.g. electromagnetic wave), and this term refers to the case where data is stored semi-permanently in the storage medium. It does not discriminate when it is temporarily stored.
- a signal e.g. electromagnetic wave
- the method according to various embodiments disclosed in this document may be included and provided in a computer program product.
- Computer program products may be traded between sellers and buyers as commodities.
- a computer program product is distributed in the form of a device-readable storage medium (e.g. compact disc read only memory (CD-ROM)), or through an application store (e.g. Play Store TM ) or on two user devices (e.g. It can be distributed (eg downloaded or uploaded) online, directly between smart phones.
- a device e.g. compact disc read only memory (CD-ROM)
- an application store e.g. Play Store TM
- It can be distributed (eg downloaded or uploaded) online, directly between smart phones.
- at least part of the computer program product may be temporarily stored or temporarily created in a storage medium readable by a device such as a manufacturer's server, an application store server, or a relay server's memory.
- each component (eg, module or program) of the above-described components may include a single object or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. there is.
- one or more components or operations among the aforementioned corresponding components may be omitted, or one or more other components or operations may be added.
- a plurality of components eg modules or programs
- the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by a corresponding component of the plurality of components prior to the integration. .
- the actions performed by a module, program, or other component are executed sequentially, in parallel, iteratively, or heuristically, or one or more of the actions are executed in a different order, or omitted. or one or more other actions may be added.
- FIG. 2 illustrates an example of implementing a serving robot of an electronic device according to various embodiments.
- the electronic device 210 (eg, the electronic device 101 of FIG. 1 ) according to various embodiments may be implemented as a serving robot as shown in FIG. 2 .
- the electronic device 101 is a mobile robot for public use and may be a serving robot that visits a plurality of destinations (eg, tables) by autonomously driving.
- the electronic device 101 establishes communication with the order server 220 (eg, the server 108 of FIG. 1) (eg, a point of sale (POS) system server), and from the order server 220 to a plurality of destinations. You may receive information related to your order.
- the order server 220 eg, the server 108 of FIG. 1
- POS point of sale
- the order server 220 may manage order information of each destination.
- the order server 220 may provide order information (eg, POS data) for customers at each destination from an external device (eg, a customer's mobile terminal, an employee's tablet terminal, or a kiosk terminal) and/or electronic device 210 . ) can be collected.
- the order information may include standing information, order receipt information, order menu information, and serving information.
- the standing information of each destination may include identification information (eg, table number) of the corresponding destination, whether or not customers are standing at the corresponding destination, and the number of standing customers.
- the order reception information of each destination may include whether or not a customer standing at the corresponding destination placed an order and an order time.
- the order menu information of each destination may include the type of item ordered by the customer standing at the corresponding destination and the quantity of the ordered item.
- the serving information of each destination may include whether serving of each item ordered at the corresponding destination is complete.
- order information includes side items (e.g., side menu) accompanying the ordered main item (e.g., main dish), special order (e.g., whether additional dishes are required), additional food, whether or not the customer has a reservation, and the customer The number of visits, and whether or not the corresponding customer is a VIP customer.
- the electronic device 210 includes a display module 211 (eg, the display module 160 of FIG. 1), a camera module 212 (eg, the camera module 180 of FIG. 1), a lighting module 213, and a serving tray. 214, sensor module 215 (e.g. sensor module 176 of FIG. 1), sound output module 216 (e.g. sound output module 155 of FIG. 1), communication module 218 (e.g. It may include the communication module 190 of FIG. 1), and a driving unit (eg, the motor 187 of FIG. 1). Also, the electronic device 210 may include a protection module 250 and a tray light 260 . In FIG.
- the base travel platform may further include a battery (eg, battery 189 in FIG. 1 ) and a power management module (eg, power management module 188 in FIG. 1 ).
- a battery eg, battery 189 in FIG. 1
- a power management module eg, power management module 188 in FIG. 1
- the display module 211 may visually output information related to item delivery to at least one of a user and a customer. For example, the display module 211 may output visual information (eg, text and images) for guiding an item to be delivered at the destination reached by the electronic device 210 . The display module 211 may output visual information for guiding an item to be protected at the destination.
- visual information eg, text and images
- the electronic device 210 may further include an input module integrally integrated with the display module 211 (eg, the input module 150 of FIG. 1 ).
- the electronic device 210 may receive at least one of a touch input and a voice input from at least one of a user and a customer through an input module.
- a camera module 212 may be positioned facing each serving tray. Illustratively, in FIG. 2 , the camera module 212 may face the serving tray from a ceiling facing the corresponding serving tray. In other words, the camera module 212 may have a field of view capable of capturing the serving tray. The camera module 212 may capture images including items (eg, food) placed on the serving tray.
- the processor of the electronic device 210 eg, the processor 120 of FIG. 1
- the item is mainly food is described, but is not limited thereto, and the item may be an item such as tableware.
- the lighting module 213 may be a module capable of projecting light toward the serving tray.
- the lighting module 213 may illuminate the corresponding serving tray and the target item disposed on the serving tray when the electronic device 210 arrives at the target destination to which the target item disposed on the serving tray should be delivered. .
- Each serving tray 214 may be a tray capable of storing items.
- three serving trays are shown as a structure spaced apart from each other along a direction perpendicular to the ground, but the number and structure of the serving trays 214 are not limited thereto and may vary depending on the design.
- At least one serving tray of the plurality of serving trays may be disposed along the same plane as the other serving trays.
- Electronic device 210 may include one or more serving trays 214 .
- the sensor module 215 may include a sensor for driving the electronic device 210 .
- the sensor module 215 may include one or a combination of two or more of a light detection and ranging (LIDAR) sensor, a depth sensor (eg, a time of flight (TOF) sensor), and an ultrasonic sensor.
- LIDAR light detection and ranging
- TOF time of flight
- the electronic device 210 may detect objects and backgrounds around the electronic device 210 through the sensor module 215 and set a driving path or perform maneuvers to avoid obstacles.
- the sound output module 216 may output a sound signal (eg, voice guidance) indicating information related to delivery of items (eg, the name and quantity of currently delivered items) to the customer.
- the sound output module 216 may record a sound signal to be transmitted from the user to the customer (eg, instructions to the customer) and a sound signal to be transmitted from the customer to the user (eg, the customer's request).
- the speaker part of the sound output module 216 is illustratively shown at the bottom of the electronic device 210, and the microphone part of the sound output module 216 may be integrated with the display module 211.
- the communication module 218 includes a communication circuit and can establish communication with the order server 220 by wire or wirelessly. For example, the communication module 218 can receive POS data from the order server 220 . When delivery of the target item is completed by the electronic device 210 , the communication module 218 may report the delivered item (eg, food that has been served) to the order server 220 . In addition, the communication module 218 may establish communication with other terminals (eg, wearable devices) of the user in addition to the order server 220 . The communication module 218 may transmit the abnormality detected by the electronic device 210 to another terminal of the user.
- the communication module 218 may transmit the abnormality detected by the electronic device 210 to another terminal of the user.
- the traveling unit 219 may move the electronic device 210 .
- the traveling unit 219 may include a motor and wheels.
- the driving unit 219 may move the electronic device 210 forward, backward, and rotate on the ground by driving a motor.
- the protection module 250 may include a protector and provide protection for items disposed on the serving tray 214 .
- the protection module 250 may physically prohibit, restrict, or hinder or reduce the possibility of an intrusion of an object (eg, a third party's hand) that is not allowed access to the tray space where the item is placed and the corresponding item.
- the protection module 250 may physically at least partially block or reduce the possibility of unauthorized physical access to items disposed on the serving tray 214 .
- the protection module 250 may cover at least a portion of the tray space including the serving tray 214 by actuating the protection guard.
- the protection module 250 may be one or a combination of two or more of one side of the tray space (eg, one side with respect to the driving axis), both sides of the tray space (eg, both sides with respect to the driving axis), and the entire tray space. It may be configured to be able to cover. For another example, the protection module 250 may move the serving tray or fix the serving tray. The protection module 250 may provide individual protection for each of the plurality of serving trays. As will be described later, the protection module 250 may provide protection for only some items among a plurality of items at the destination, and may sequentially release protection as the serving order progresses. Examples of the protection module 250 are described in FIGS. 11 to 17 below.
- the tray light 260 may indicate light (eg, a light emitting diode) disposed on at least one side of the tray.
- the tray lighting 260 may provide feedback based on lighting in a serving tray corresponding to the destination at the destination where the electronic device 210 arrives. 2 shows an example in which the electronic device 210 is disposed on one side (eg, the left side) of the driving axis (eg, the longitudinal axis), but is not limited thereto, and the electronic device 210 is disposed on the basis of the driving axis.
- Tray lights 260 may be disposed on both sides of the.
- the tray lighting 260 outputs light of a first color (eg, green) when delivery of items placed on the corresponding tray is allowed in each destination, and outputs light of a second color (eg, red) when delivery is restricted. can output
- the electronic device 210 may serve items prepared simultaneously (eg, foods cooked simultaneously) in a service space (eg, a restaurant) to multiple destinations (eg, several tables) in one run. there is. Even if items are randomly placed on serving trays by a user (eg, an employee) who does not consider the serving order, the electronic device 210 identifies the items placed on each serving tray and sends them to the corresponding destinations in the serving order. can visit In addition, when a plurality of items are placed on each serving tray 214, the electronic device 210 performs a protection operation (eg, warning output and physical protective action) to prevent or reduce the possibility.
- a protection operation eg, warning output and physical protective action
- 3 and 4 are flowcharts illustrating an item protection method according to various embodiments.
- the electronic device determines the serving items to be delivered from the plurality of serving trays based on the items placed on the plurality of serving trays and the order information of the plurality of destinations. order can be determined.
- the electronic device may sense items placed on a plurality of serving trays. Likewise, the electronic device may obtain an image of an item disposed on a corresponding serving tray through a camera sensor installed corresponding to each of the plurality of serving trays. The electronic device may identify the type and quantity of items appearing in each image by analyzing the captured image of the item. For example, the electronic device may determine the type and quantity of the item by comparing the image captured for each serving tray with an item image (eg, food image) for each menu of an item database (eg, restaurant food database) for the service space. . The electronic device may also determine whether an item is placed on each serving tray based on the above-described captured image. Sensing of an item is described in FIG. 5 below. However, the identification of the item is not limited to the above, and information on the item disposed on each serving tray may be received from the user based on a user input.
- the electronic device may match order information and items for each serving tray.
- the electronic device may receive POS data from the order server.
- the electronic device may match order information for each destination among the POS data with items identified for each serving tray.
- the order information may include, for example, order time, destination identifier (eg, table number), item type (eg, food type), and information about items that have been served and items that have not been served.
- the electronic device may determine the destination to which the item of each serving tray should be delivered based on the order information. Matching of order information and items is described in FIG. 6 below.
- the electronic device may determine a serving order for each tray according to the order information.
- the serving order may indicate the order in which items placed on the electronic device should be delivered. For example, when the electronic device stores a first item in a first order and a second item in a second order subsequent to the first order, the electronic device first delivers the first item in the first order to the first destination. and the second item in the second order can then be delivered to the second destination.
- the protection order of the serving trays may be determined according to the aforementioned serving order. For example, each serving tray may be protected at a destination in a serving order that precedes that serving tray's serving order. In other words, the electronic device may determine to protect a serving tray mapped to a lower priority serving order than the visited destination's serving order.
- the electronic device while delivering an item to a first destination (eg, one destination) among a plurality of destinations, the electronic device performs a serving in which a serving order later than that of the first destination (eg, one destination) is mapped. It can provide protection for trays. According to an embodiment, in operation 421, the electronic device may perform a protection operation on a serving tray that is not in the current serving order.
- the electronic device may perform a non-physical protection operation.
- the electronic device may perform an approach warning operation.
- the electronic device may monitor other customers' actions to take items (eg, food) (eg, hands, gloves, and tongs into the tray space).
- the electronic device may output one or a combination of two or more of a warning sound, speech, and lighting to warn of approaching.
- a non-physical protection operation is described in FIG. 10 below.
- the electronic device may perform a physical protection operation.
- the electronic device may protect a serving tray having a subsequent serving order from the arrival destination by driving at least one of the protection guard and the serving tray through the protection module.
- the electronic device may release protection for the serving tray to be delivered at the destination and maintain protection for the serving tray on which the remaining items are placed.
- the electronic device may perform the above-described non-physical protection operation and physical protection operation individually or in combination and concurrently.
- the electronic device may sequentially visit a plurality of destinations according to a serving order.
- the electronic device may notify a serving tray on which an item corresponding to the arrived destination is placed. For example, the electronic device may illuminate the corresponding serving tray by activating a lighting module corresponding to the serving tray mapped to the arrival destination. In addition, the electronic device may activate tray lighting of the corresponding serving tray. The electronic device may emit light of the tray in the first color. The electronic device may output at least one of an image and a sound signal for guiding a serving tray on which an item delivered from a corresponding destination is placed along with the above-described lighting operation.
- FIG. 5 is a diagram illustrating item matching according to various embodiments.
- the electronic device 500 responds to a case where an item is placed on at least one serving tray among a plurality of serving trays, and the item is placed on the corresponding serving tray.
- the electronic device 500 may capture images 510 through a camera sensor disposed for each serving tray.
- the electronic device 500 may compare the captured images 510 with the item database 590 of the service space.
- the electronic device 500 may generate an identification result for an item disposed on each serving tray through comparison between the captured images 510 and the item database 590 .
- the identification result is a result of identifying the item placed on each serving tray, and may exemplarily include the name of the identified item.
- the item database may include a list of items provided to customers within the service space, and may include, for example, a name of the item (eg, food menu name) and an image of the item (eg, food image).
- the electronic device 500 may recognize pasta from images captured on the first and second serving trays, and steak from images captured on the third serving tray. The electronic device may determine that pasta is disposed on the first serving tray and the second serving tray, respectively, and steak is disposed on the third serving tray.
- FIG. 6 is a diagram illustrating determination of a serving order according to various embodiments.
- an electronic device selects a plurality of serving trays on which items are disposed among a plurality of serving trays based on order information of a plurality of destinations and item identification results. You can map to one of the destinations.
- the electronic device may generate a mapping result 620 in which each serving tray and a destination to which an item of the corresponding serving tray is to be delivered are mapped. For example, the electronic device may compare items 610 identified in the plurality of serving trays with order information 615 .
- the order information 615 includes order time, serving order, destination identifier 615a (eg, table number and table name), name 615b and quantity of the ordered item, and special requested by the customer. It may include information about the order and the item 615c that has been served to the corresponding destination.
- An example is shown in which customers at table C ordered steak, and customers at tables B and E ordered pasta.
- the mapping result 620 the first serving tray with pasta is mapped to table B, the second serving tray with pasta is mapped to table E, and the third serving tray with steak is mapped to table C. It can be.
- the electronic device maps the destination of the preceding serving order to the upper serving tray among the plurality of serving trays and the destination of the subsequent serving order to the lower serving tray. can be mapped. Therefore, even if the user arranges the items regardless of the serving order, the customer at the destination where the item is delivered first can receive the item at a more convenient position (eg, a higher position) to pick up the item.
- the electronic device may determine a serving order of serving trays on which items are placed, based on a mapping result of serving trays and order information of a plurality of destinations. For example, the electronic device may determine a serving order 630 of a plurality of items disposed on a plurality of serving trays based on time information related to item delivery in order information of a plurality of destinations. The electronic device may determine a quick serving order from among the plurality of serving trays to a serving tray on which an ordered item is placed first according to an order time. 6 shows an example in which the order of table C is received at 11:30, the order of table B is received at 11:35, and the order of table E is received at 11:36. The electronic device may determine the serving order 630 as 1st for table C, 2nd for table B, and 3rd for table E. However, the determination of the serving order 630 is not limited thereto and may vary depending on the design.
- FIG. 7 is a diagram illustrating protection of a serving tray based on a serving order according to various embodiments.
- the electronic device 700 may determine a serving tray to be protected according to the serving order determined in FIG. 6 .
- the protection tray information 710 may indicate a serving tray to be protected according to a serving order.
- the electronic device may determine serving trays mapped to a serving order subsequent to the serving order of the target destination as objects to be protected. For example, according to the protection tray information 710 shown in FIG. 7 , the electronic device 700 delivering steak to table C may deactivate the protection of the third serving tray 723 corresponding to table C. .
- the electronic device 700 activates protection for the first serving tray 721 and the second serving tray 722 on which the pasta to be delivered to the B table and the E table is placed, and reaches the destination corresponding to each serving tray. You can keep active protection until you do.
- a bar-shaped guard is shown as a protector as an example of a protection module in FIG. 7, it is not limited thereto, and various examples of the protection module will be described in FIGS. 11 to 17 below.
- FIGS. 8 and 9 are diagrams illustrating sequential delivery of protected items according to a serving order according to various embodiments.
- An electronic device may provide a guide indicating a serving tray on which the target item is placed in response to reaching the target destination of the target item.
- the electronic device is a guide indicating the serving tray on which the target item is placed, activating a light disposed on one side of the serving tray on which the target item is placed, activating a light illuminating the target item, and describing the target item on the display.
- One or a combination of two or more of outputting visual information and outputting auditory information describing a target item may be performed.
- the electronic device may deliver steak to table C according to the examples described above in FIGS. 5 to 7 .
- the electronic device may guide the customer by visually outputting that steaks are arranged on the third serving tray through the display module 810 .
- the electronic device may output light 820 through the lighting module to the third serving tray on which the steaks are placed.
- the electronic device may also light up the tray light 830 disposed on one side of the third serving tray.
- the electronic device may release protection of the serving tray on which the target item is placed in response to reaching the target destination of the target item.
- the plurality of destinations may include a first destination and a second destination corresponding to a subsequent serving order than the first destination.
- the first destination may be table C
- the second destination may be table B or table E.
- the electronic device may activate a protection module (including a protector) of a first tray mapped to a first destination and a protection module of a second tray mapped to a second destination.
- the user input may be an input instructing start of protection and an input instructing start of driving.
- the electronic device may activate protection modules of the first destination and the second destination in response to starting driving for delivery of the item.
- the electronic device may deactivate the protection module of the first tray while maintaining activation of the protection module of the second tray.
- the electronic device that has reached the first destination, table C may deactivate the protection module of the third serving tray where the steaks are placed.
- the electronic device may determine that the delivery of the target item is completed in response to detecting the delivery of the target item placed on the serving tray at the target destination. For example, in the example shown in FIG. 9 , a steak may be taken out by a customer at table C, which is the target destination. While staying at the target destination, the electronic device may monitor the serving tray mapped to the target destination through a camera sensor. When the electronic device detects removal of the target item from the serving tray through the camera sensor, it may be determined that delivery of the target item is completed. When delivery is completed, the electronic device may turn off the light 920 of the lighting module 920 directed toward the upper surface of the serving tray and the tray lighting 930 disposed on one side of the serving tray. The electronic device may output serving completion to the customer through the display module 910 . The electronic device may transmit data related to completion of serving (eg, destination identifier, name and quantity of items that have been served) to the order server.
- data related to completion of serving eg, destination identifier, name and quantity of items that have been served
- the electronic device may deactivate the protection module of the second tray in response to reaching the second destination. For example, in the example shown in FIG. 9 , when the electronic device arrives at table B, which is the second destination, the electronic device lights 950 of the lighting module of the first serving tray mapped to table B and lights the tray ( 960) and disable the protection module.
- the electronic device may provide information about an item to be delivered through the display module 940 .
- the electronic device may open a bar-shaped guard covering a part of the tray space of the first serving tray mapped to the B table.
- the electronic device may provide item delivery and protection by repeating the operations described in FIGS. 8 and 9 whenever each destination is sequentially visited.
- 10 is a diagram illustrating intrusion detection of an unallowed object according to various embodiments.
- An electronic device may provide a non-physical protection operation. While delivering a target item from one of a plurality of destinations, the electronic device detects the approach of a thing 1080 within a sensing area defined based on a serving tray on which another item of a lower order than the target item is placed. can sense The electronic device may monitor the intrusion of an object into a serving tray mapped to a subsequent serving order rather than a current destination through a field of view 1010 of a camera sensor disposed facing each serving tray. The camera sensor 1010 may have a wider field of view 1011 than an area 1090 in which items can be placed on the serving tray. The electronic device may detect the presence or absence of an object 1080 (eg, a person's hand, glove, or tongs) within the viewing range 1011 around the placed item.
- an object 1080 eg, a person's hand, glove, or tongs
- the electronic device may perform a protection operation on another item in response to sensing the proximity of an object within the sensing area.
- the electronic device may perform one or a combination of two or more of auditory information for warning of theft of another item, visual information for warning of theft, and lighting of a light disposed on one side of the serving tray.
- the electronic device outputs light of a first color from a light disposed on one side of a serving tray on which a target item is disposed, and a light of a second color different from the first color is emitted from a light disposed on one side of a serving tray on which another item is disposed. Colored light can be output.
- the electronic device may change all tray lights of all serving trays to light 1022 of a second color (eg, red).
- the electronic device may output a warning image (eg, an emoji with a warning expression), output a warning sound, and output a warning utterance through the display module 1021 .
- the aforementioned non-physical protection operation may be provided along with the physical protection operation.
- the electronic device may determine that the safety of the serving tray is secured in response to the case where the intruding object 1080 disappears while the item remains without being stolen.
- the electronic device may determine that the abnormal situation has ended.
- the electronic device may output a screen before an abnormal situation occurs in the display module 1031 and change tray lights to light 1032 of a first color (eg, green).
- the electronic device may also output sounds and utterances indicating the safety of the item (eg, utterance "food is being delivered"). Accordingly, the electronic device may provide feedback to the user and customer that the item is safe.
- the electronic device may determine that the item on the serving tray 1091 is stolen in response to the case where the object 1080 disappears outside the viewing range 1011 while the item is stolen.
- the electronic device may call the user and manager according to FIG. 19 to be described later for this error situation.
- 11-17 show an example of a protection module (including a protector) according to various embodiments.
- the electronic device eg, the electronic device 101 of FIG. 1
- the electronic device is a bar-shaped guard movably disposed along an axis 1193 perpendicular to the plane of the corresponding serving tray on at least one side of each of the plurality of serving trays.
- a protection module that drives the (bar shaped guard) 1110 may be further included.
- FIG. 11 an example in which a bar-shaped guard 1110 is disposed on one side of each serving tray is shown, but is not limited thereto.
- the bar-shaped guards 1110 may be disposed on both sides of a driving axis (eg, a longitudinal axis 1191) of the electronic device.
- the plane of the serving tray may be a plane defined by a longitudinal axis 1191 and a transverse axis 1192 .
- the electronic device may raise the bar-shaped guard 1110 along the vertical axis 1193 in response to starting protection of the corresponding serving tray item.
- the electronic device may be housed in the bar-shaped groove 1120 by lowering the bar-shaped guard 1110 along a vertical axis.
- the bar-shaped guard 1110 is configured to be movable along an internal rail along a vertical axis 1193, and the protection module responds to an electrical signal depending on whether each serving tray is protected, and the linkage connected to the motor, the chain
- the bar-shaped guard 1110 may be vertically moved through a power transmission structure in which one or two or more of a , a belt, and a thread structure are combined.
- Figure 12 illustrates the protection module for moving the serving tray.
- the electronic device may further include a protection module capable of moving each of the plurality of serving trays along one axis of the electronic device.
- the electronic device can slide the serving tray along the transverse axis 1292 of the electronic device.
- the transverse axis 1292 may be perpendicular to the longitudinal axis 1291 and the vertical axis 1293 of the electronic device.
- the electronic device may move a serving tray on which the target item is disposed among a plurality of serving trays in one direction along one axis.
- the electronic device may move another serving tray on which an item different from the target item is disposed at the target destination in a direction opposite to the one direction along one axis.
- the electronic device may slide the serving tray 1210 mapped to the target destination toward the customer along one axis and move the remaining serving trays 1220 away from the customer.
- the electronic device may guide the serving tray on which the item to be delivered explicitly to the customer is placed by activating the lighting module and the tray lighting for the serving tray 1210 that has moved forward toward the customer.
- the electronic device may hinder the customer's accessibility by intuitively notifying the customer of the item to be delivered, but moving the limited delivery item away from the customer.
- the electronic device may further include a protection module that drives a partition guard configured to open and close at least a portion of the tray space of each of the plurality of serving trays. While delivering the target item at the target destination, the electronic device may open a tray space corresponding to a serving tray on which the target item is disposed among a plurality of serving trays. While delivering the target item, the electronic device may block at least a portion of a tray space corresponding to a serving tray on which other items are placed.
- the barrier rib guard may be implemented with one or a combination of two or more of a mesh type, a perforated type, an origami type, a curtain type, a sliding door type, a comb type, a chain type, and a fabric type material.
- the bulkhead guard is made of a mesh material and can be configured to be movable through a slide structure.
- the barrier rib guard may have a transparent or translucent material so that the interior of the tray space is visible. Ventilation for preservation of food is ensured by the partition wall guard made of mesh material, prevention of obstruction of food identification by steam or condensation, protection from pests, and inflow of saliva, dust or foreign substances from customers at other tables is prevented or possible. this may be reduced.
- the barrier rib guard when the barrier rib guard is closed, a portion of one surface of the tray space of each serving tray may be covered.
- the height of the bulkhead guard along the vertical axis 1393 may be less than the height of the tray space of each serving tray along the vertical axis 1393.
- the closed bulkhead guard 1310 may cover half of one side of the tray space.
- a customer's access to an item may be hindered by the closed bulkhead guard 1310 .
- the bulkhead guard is configured to be rotatable about an axis parallel to the longitudinal axis 1391 and/or transverse axis 1392 and the protection module can be opened or closed by rotating the bulkhead guard.
- the bulkhead guard may have a rotational hinge structure.
- a bulkhead guard may be opened at the destination where the food is to be delivered. Through the open bulkhead guard 1311, the customer can explicitly recognize that the placed item can be taken by the customer.
- the bulkhead guard 1411 before driving starts may be mounted invisible.
- the barrier rib guard 1411 may have a shape and size capable of covering one side of the tray space.
- the bulkhead guard 1411 may be spaced apart from both sides along the transverse axis 1492 based on the longitudinal axis 1491 and accommodated therein.
- the bulkhead guards disposed on both sides of the electronic device may have a sliding hinge structure.
- the electronic device may move the bulkhead guard 1412 along the vertical axis 1493 toward the serving tray to be protected.
- the electronic device may maintain the position of the barrier rib guard 1413 arriving at the serving tray to be protected.
- the electronic device may expand the barrier rib guard 1414 .
- the electronic device may overlap a plurality of barrier rib guards and sequentially move each barrier rib guard, or may extend a barrier rib guard made of an elastic material.
- a movable barrier rib guard 1511 may be stored in an invisible manner at the front end of the electronic device based on the longitudinal axis 1591 .
- the electronic device may move the bulkhead guard through the sliding hinge structure 1512 .
- the electronic device may move the barrier rib guard 1513 corresponding to the serving tray on which the object to be protected is disposed.
- the electronic device may hinder or reduce the possibility of an unauthorized customer's access to the item by closing the tray space through the partition wall guard 1514 that has been moved.
- the longitudinal axis 1591 is a driving axis of the electronic device, and may be illustratively perpendicular to the transverse/transverse axis 1592 and the vertical axis 1593 .
- the protection module of FIGS. 11 to 15 may move the protection guard on only one side or on both sides of the longitudinal axis of the electronic device.
- An electronic device arriving at each destination may identify a direction in which a destination in which an item is to be served is located based on a longitudinal axis, and may drive a protective guard in the identified direction.
- the electronic device may rotate the body on the basis of a vertical axis so that the customer at the corresponding destination faces the customer with a side where they can be served comfortably.
- the electronic device may further include a protection module that drives the fixing unit 1620 capable of fixing the shelf 1630 in each of the plurality of serving trays. While delivering the target item at the target destination, the electronic device may release the fixation of the shelf 1630 from the serving tray on which the target item is placed, and maintain the fixation of the shelf 1630 on the serving tray on which other items are placed.
- the unlocked fixing part 1621 may unlock the shelf 1630 .
- the fixing part 1620 may hold the shelf 1630 by mechanically locking the vertical height of the catch hooked on the shelf 1630 . Therefore, the electronic device can prevent another customer from stealing or reduce the possibility by locking the shelf 1630 where other items are placed.
- FIG. 17 illustrates the operation of raising and lowering the serving tray along the vertical axis.
- the electronic device further includes a protection module capable of protecting the plurality of serving trays by accommodating the plurality of serving trays in the protection space 1710 defined by the protection guard and moving the plurality of serving trays along an axis perpendicular to the serving tray.
- a protection module capable of protecting the plurality of serving trays by accommodating the plurality of serving trays in the protection space 1710 defined by the protection guard and moving the plurality of serving trays along an axis perpendicular to the serving tray.
- a protective guard made of a transparent, translucent, or mesh material may be disposed along the outer circumference of the electronic device, and serving trays accommodated therein may be visible from the outside.
- the protective guard may be implemented as part of the housing of the electronic device.
- a common tray 1701 is a tray on which common items (eg, tableware) provided for the convenience of all customers are disposed, and may be disposed at the top of the protection space. Since the serving tray on which the main item (eg, main dish) can be placed is housed in the protection space 1710 defined by the protection guard, the item can be protected. Thus, during item delivery, the item's hygiene, freshness, and temperature can be maintained.
- common items eg, tableware
- the electronic device may expose the serving tray on which the target item is placed by elevating it higher than the protection space 1710 .
- the electronic device may raise the first serving tray 1721 higher than the protection space 1710 at the first destination.
- the electronic device may raise the second serving tray 1722 higher than the protection space 1710 at the second destination.
- the second serving tray 1722 may be lower than the first serving tray 1721, and the first serving tray 1721 and the second serving tray 1722 may be raised and lowered together as one body.
- FIG 18 illustrates orientation-based protection of an electronic device according to various embodiments.
- An electronic device selectively blocks entry of an object from both sides of a plurality of serving trays based on one axis (eg, a driving axis or a longitudinal axis) of an electronic device (eg, the electronic device 101 of FIG. 1 ). It may further include a protection module capable of preventing or reducing the possibility.
- a protection module capable of preventing or reducing the possibility.
- the electronic device may provide protection to a side corresponding to the target destination based on one axis in a serving tray on which the target item and other items are placed. there is.
- the electronic device may recognize a serving direction at the corresponding destination, deploy a protective guard in the recognized serving direction, rotate in the serving direction, and provide an item.
- FIG. 18 illustrates an example in which an electronic device visits table C, table B, and table E sequentially from a starting position 1801.
- the electronic device 1881 traveling along the first route 1811 and reaching the C table may recognize that the C table is located on the right side with respect to the driving axis.
- the electronic device 1881 may activate the protective guard 1821 on the right side with respect to the driving axis.
- the protection module of the third serving tray on which the item to be delivered is placed may be deactivated.
- the electronic device 1882 may travel along the second path 1812 to reach table B.
- the electronic device 1882 may recognize that the B table is located on the left side of the driving axis.
- the electronic device 1882 may activate the left protective guard 1822.
- a protection module of the first serving tray on which the item to be delivered is placed may be deactivated.
- the electronic device 1883 may reach the E table along the third path 1813. Since table E is the left side of the electronic device, the electronic device can provide items to customers by inactivating the protection module on the left side of the second serving table.
- 19 is a flowchart illustrating a method of processing a serving error according to various embodiments.
- the electronic device may call a manager when a serving error in which an item to be served is stolen or lost occurs.
- the electronic device may recognize a serving error (eg, misdelivery). For example, the electronic device may determine that a serving error has occurred in response to at least one of a case where the destination identifier does not match and a case where the item is lost at a destination different from the serving order.
- a serving error eg, misdelivery
- the electronic device may inform the customer of a serving error.
- the electronic device may provide a guide to a customer of the corresponding destination that the item is not ordered at the corresponding destination through one or a combination of two or more among visual information, auditory information, and tactile information.
- the electronic device may request return of the item from the customer.
- the electronic device may request return of the target item from a customer at another destination.
- the electronic device may output one or a combination of two or more of visual information, auditory information, and tactile information recommending that the customer return the item to the existing serving tray.
- the electronic device may sense whether or not the electronic device returns within a predetermined time. For example, the electronic device may monitor whether the same item is re-detected on the serving tray within a critical time from the point in time when a serving error is recognized and notified to the customer.
- the electronic device may call a manager (eg, user) in response to a case where the return of the target item is not sensed.
- a manager eg, user
- the electronic device recognizes that the item has completely disappeared, it can call the corresponding destination by sending a notification message to the manager's (eg, user's) terminal (eg, mobile phone or wearable device).
Landscapes
- Engineering & Computer Science (AREA)
- Robotics (AREA)
- Mechanical Engineering (AREA)
- Telephone Function (AREA)
Abstract
Description
Claims (15)
- 전자 장치에 있어서,각각 아이템을 수납 가능한 복수의 서빙 트레이들;상기 전자 장치를 이동시키는 주행부(driving unit);컴퓨터로 실행 가능한 명령어들(computer-executable instructions)이 저장된 메모리; 및상기 메모리에 억세스(access)하여 적어도 상기 명령어들을 실행하는 프로세서를 포함하고,상기 명령어들은 상기 프로세서에 의해 실행될 시 상기 전자 장치로 하여금,상기 복수의 서빙 트레이들에 배치되는 아이템 및 복수의 목적지들의 주문 정보에 적어도 기초하여 상기 복수의 서빙 트레이들의 아이템이 배달되는 서빙 순서를 결정하고,상기 복수의 목적지들 중 제1 목적지로 아이템을 배달하는 것에 적어도 기초하여, 상기 제1 목적지의 서빙 순서보다 후속(subsequent) 서빙 순서가 매핑된 서빙 트레이에 대한 보호를 제공하도록 구성된,전자 장치.
- 제1항에 있어서,상기 명령어들은,상기 복수의 서빙 트레이들 중 적어도 한 서빙 트레이에 대해 아이템이 배치되는 경우에 응답하여, 해당 서빙 트레이에 배치된 아이템을 식별하고,상기 복수의 목적지들의 주문 정보 및 아이템의 식별 결과에 적어도 기초하여, 상기 복수의 서빙 트레이들 중 아이템이 배치된 서빙 트레이를 상기 복수의 목적지들 중 한 목적지에 매핑하도록 더 구성된,전자 장치.
- 제1항 내지 제2항 중 어느 한 항에 있어서,상기 명령어들은,상기 서빙 트레이의 매핑 결과 및 상기 복수의 목적지들의 주문 정보에 적어도 기초하여, 상기 아이템이 배치된 서빙 트레이의 서빙 순서를 결정하도록 더 구성된,전자 장치.
- 제1항 내지 제3항 중 어느 한 항에 있어서,상기 명령어들은,상기 복수의 목적지들의 주문 정보에서 아이템의 전달과 관련된 시간 정보에 기초하여, 상기 복수의 서빙 트레이들에 배치된 복수의 아이템들의 서빙 순서를 결정하도록 더 구성된,전자 장치.
- 제1항 내지 제4항 중 어느 한 항에 있어서,상기 복수의 목적지들은 상기 제1 목적지 및 상기 제1 목적지보다 후속 서빙 순서에 대응하는 제2 목적지를 포함하고,상기 명령어들은,사용자 입력에 기반하여, 상기 제1 목적지에 매핑된 제1 트레이의, 프로텍터(protector)를 포함하는, 보호 모듈 및 상기 제2 목적지에 매핑된 제2 트레이의, 프로텍터를 포함하는, 보호 모듈을 활성화하고,상기 제1 목적지에 도달한 경우에 응답하여 상기 제2 트레이의 보호 모듈의 활성화를 유지하면서 상기 제1 트레이의 보호 모듈을 비활성화하고,상기 제2 목적지에 도달한 경우에 응답하여 상기 제2 트레이의 보호 모듈을 비활성화하도록 더 구성된,전자 장치.
- 제1항 내지 제5항 중 어느 한 항에 있어서,상기 명령어들은,대상 아이템의 대상 목적지에 도달한 경우에 응답하여, 상기 대상 아이템이 배치된 서빙 트레이를 지시하는 안내를 제공하도록 더 구성된,전자 장치.
- 제1항 내지 제6항 중 어느 한 항에 있어서,상기 명령어들은,상기 대상 아이템이 배치된 서빙 트레이를 지시하는 안내로서, 상기 대상 아이템이 배치된 서빙 트레이의 제1 측에 배치된 조명의 활성화, 상기 대상 아이템을 비추는 조명의 활성화, 디스플레이에서 상기 대상 아이템을 설명하는 시각 정보의 출력, 및 상기 대상 아이템을 설명하는 청각 정보의 출력 중 하나 또는 둘 이상의 조합을 수행하도록 더 구성된,전자 장치.
- 제1항 내지 제7항 중 어느 한 항에 있어서,상기 명령어들은,대상 목적지에서 서빙 트레이에 배치됐던 대상 아이템의 반출을 감지하는 경우에 응답하여, 상기 대상 아이템의 배달이 완료된 것으로 결정하도록 더 구성된,전자 장치.
- 제1항 내지 제8항 중 어느 한 항에 있어서,상기 명령어들은,상기 복수의 목적지들 중 상기 제1 목적지에서 대상 아이템을 배달하는 동안, 상기 대상 아이템보다 후속 순위의 다른 아이템이 배치된 서빙 트레이에 적어도 기초하여 정의된 감지 영역 내에서 물체(thing)의 접근을 센싱하고,상기 감지 영역 내에서 물체의 접근이 센싱되는 경우에 응답하여, 상기 다른 아이템에 대한 보호 동작을 수행하도록 더 구성된,전자 장치.
- 제1항 내지 제9항 중 어느 한 항에 있어서,상기 명령어들은,상기 다른 아이템에 대한 보호 동작으로서 상기 다른 아이템의 탈취를 경고하는 청각 정보, 상기 탈취를 경고하는 시각 정보, 및 서빙 트레이의 일측에 배치된 조명의 점등 중 하나 또는 둘 이상의 조합을 수행하고,상기 대상 아이템이 배치된 서빙 트레이의 일측에 배치된 조명에서 제1 색상의 광을 출력하고 상기 다른 아이템이 배치된 서빙 트레이의 일측에 배치된 조명에서 상기 제1 색상과 다른 제2 색상의 광을 출력하도록 더 구성된,전자 장치.
- 제1항 내지 제10항 중 어느 한 항에 있어서,상기 복수의 서빙 트레이들의 각각의 적어도 일측에서, 해당하는 서빙 트레이의 평면에 수직하는 축을 따라 이동 가능하게 배치되는 구동가능한 바 형상의 가드(bar shaped guard)을 더 포함하고,상기 명령어들은,해당하는 서빙 트레이의 아이템의 보호를 개시하는 경우에 응답하여, 상기 바 형상의 가드를 상기 수직하는 축을 따라 상승시키고,해당하는 서빙 트레이의 아이템의 보호를 종료하는 경우에 응답하여, 상기 바 형상의 가드를 상기 수직하는 축을 따라 하강시킴으로써 바 형상의 홈(bar shaped groove) 내에 수납하도록 더 구성된,전자 장치.
- 제1항 내지 제11항 중 어느 한 항에 있어서,상기 복수의 서빙 트레이들의 각각을 상기 전자 장치의 일축을 따라 이동시킬 수 있는, 프로텍터를 포함하는, 보호 모듈을 더 포함하고,상기 명령어들은,대상 목적지에서 대상 아이템을 배달하는 동안, 상기 복수의 서빙 트레이들 중 상기 대상 아이템이 배치된 서빙 트레이를 상기 일축을 따라 일방향으로 이동시키도록 더 구성된,전자 장치.
- 제1항 내지 제12항 중 어느 한 항에 있어서,상기 명령어들은,상기 대상 목적지에서 상기 대상 아이템과 다른 아이템이 배치된 다른 서빙 트레이를 상기 일축을 따라 상기 일방향에 반대되는 방향으로 이동시키도록 더 구성된,전자 장치.
- 제1항 내지 제13항 중 어느 한 항에 있어서,상기 복수의 서빙 트레이들 각각의 트레이 공간의 적어도 일부를 개폐 가능하게 구성되는 구동가능한 격벽 가드(partition guard)을 더 포함하고,상기 명령어들은,대상 목적지에서 대상 아이템을 배달하는 동안, 상기 복수의 서빙 트레이들 중 상기 대상 아이템이 배치된 서빙 트레이에 대응하는 트레이 공간을 개방하고,상기 대상 아이템을 배달하는 동안 다른 아이템이 배치된 서빙 트레이에 대응하는 트레이 공간의 적어도 일부를 차단하도록 더 구성되는,전자 장치.
- 프로세서로 구현되는 방법에 있어서,복수의 서빙 트레이들에 배치되는 아이템 및 복수의 목적지들의 주문 정보에 기초하여 상기 복수의 서빙 트레이들의 아이템이 배달되어야 하는 서빙 순서를 결정하는 동작; 및상기 복수의 목적지들 중 제1 목적지로 아이템을 배달하는 동안, 상기 제1 목적지의 서빙 순서보다 나중의 서빙 순서가 매핑된 서빙 트레이에 대한 보호를 제공하는 동작을 포함하는 방법.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP22890142.7A EP4353427A4 (en) | 2021-11-02 | 2022-08-23 | DEVICE AND METHOD FOR STORING ARTICLE ACCORDING TO SERVICE ORDER |
| US17/956,418 US12311528B2 (en) | 2021-11-02 | 2022-09-29 | Device and method of protecting item based on serving order |
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR20210148733 | 2021-11-02 | ||
| KR10-2021-0148733 | 2021-11-02 | ||
| KR10-2021-0150690 | 2021-11-04 | ||
| KR1020210150690A KR20230063815A (ko) | 2021-11-02 | 2021-11-04 | 서빙 순서에 따른 아이템 보호 장치 및 방법 |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US17/956,418 Continuation US12311528B2 (en) | 2021-11-02 | 2022-09-29 | Device and method of protecting item based on serving order |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2023080406A1 true WO2023080406A1 (ko) | 2023-05-11 |
Family
ID=86241254
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/KR2022/012581 Ceased WO2023080406A1 (ko) | 2021-11-02 | 2022-08-23 | 서빙 순서에 따른 아이템 보호 장치 및 방법 |
Country Status (1)
| Country | Link |
|---|---|
| WO (1) | WO2023080406A1 (ko) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2009172410A (ja) * | 2007-06-05 | 2009-08-06 | Asa:Kk | 配膳装置 |
| KR20200085658A (ko) * | 2019-01-02 | 2020-07-15 | 엘지전자 주식회사 | 서빙 모듈 및 그를 갖는 로봇 |
| KR20200087362A (ko) * | 2019-01-03 | 2020-07-21 | 삼성전자주식회사 | 이동 로봇 및 그의 동작 방법 |
| KR20210015577A (ko) * | 2019-07-31 | 2021-02-10 | 삼성전자주식회사 | 전자 장치 및 그 제어 방법 |
| KR20210119886A (ko) * | 2020-03-25 | 2021-10-06 | 주식회사 우아한형제들 | 기능확장이 용이한 이동로봇 및 그 제공방법 |
-
2022
- 2022-08-23 WO PCT/KR2022/012581 patent/WO2023080406A1/ko not_active Ceased
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2009172410A (ja) * | 2007-06-05 | 2009-08-06 | Asa:Kk | 配膳装置 |
| KR20200085658A (ko) * | 2019-01-02 | 2020-07-15 | 엘지전자 주식회사 | 서빙 모듈 및 그를 갖는 로봇 |
| KR20200087362A (ko) * | 2019-01-03 | 2020-07-21 | 삼성전자주식회사 | 이동 로봇 및 그의 동작 방법 |
| KR20210015577A (ko) * | 2019-07-31 | 2021-02-10 | 삼성전자주식회사 | 전자 장치 및 그 제어 방법 |
| KR20210119886A (ko) * | 2020-03-25 | 2021-10-06 | 주식회사 우아한형제들 | 기능확장이 용이한 이동로봇 및 그 제공방법 |
Non-Patent Citations (1)
| Title |
|---|
| See also references of EP4353427A4 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102839303B1 (ko) | 적재 모듈 및 이를 구비한 운반 로봇 | |
| JP7243110B2 (ja) | 情報処理装置及び情報処理方法、コンピュータプログラム、並びに荷物受け取り支援システム | |
| KR20210019218A (ko) | 스마트 도어 | |
| CN109195752A (zh) | 模块型家庭机器人 | |
| WO2015199304A1 (ko) | 이동 단말기 및 이의 제어 방법 | |
| WO2018080109A1 (ko) | 전자 장치와 전자 장치가 외부 장치의 접속 단자를 인식하는 방법 | |
| WO2018143509A1 (ko) | 이동 로봇 및 그 제어방법 | |
| WO2018117514A1 (ko) | 공항용 로봇 및 그의 동작 방법 | |
| KR20210019211A (ko) | 스마트 도어 | |
| WO2022124829A1 (ko) | 사용자 음성에 기초한 인터랙션을 제공하는 전자 장치 및 그 방법 | |
| CN106796629A (zh) | 向用户提供发送者标识信息同时向其他人隐藏该信息 | |
| US12586450B2 (en) | Line-powered wireless communications systems | |
| WO2017018552A1 (ko) | 이어셋 및 그 제어 방법 | |
| WO2022005248A1 (ko) | 주변 오디오 신호의 감지 방법 및 전자 장치 | |
| WO2023080406A1 (ko) | 서빙 순서에 따른 아이템 보호 장치 및 방법 | |
| US12311528B2 (en) | Device and method of protecting item based on serving order | |
| WO2024043370A1 (ko) | 주행로봇 | |
| WO2023286992A1 (ko) | 화면 확장시 프라이빗 정보를 제공하는 전자 장치 및 방법 | |
| KR20230063815A (ko) | 서빙 순서에 따른 아이템 보호 장치 및 방법 | |
| WO2022265765A1 (en) | Locating a wearable device case | |
| WO2016153223A1 (ko) | 무인기를 활용한 유저 모니터링 시스템 | |
| WO2023080398A1 (ko) | 경로를 따라 아이템을 배달하는 장치 및 방법 | |
| WO2023080404A1 (ko) | 아이템의 배달을 위한 목적지를 제시하는 장치 및 방법 | |
| TWI833652B (zh) | 儲物裝置 | |
| WO2023068628A1 (ko) | 근접 센싱 방법 및 전자 장치 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22890142 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 22890142.7 Country of ref document: EP Ref document number: 2022890142 Country of ref document: EP |
|
| ENP | Entry into the national phase |
Ref document number: 2022890142 Country of ref document: EP Effective date: 20240110 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |