WO2023074792A1 - 通信装置、通信システム及び通信方法 - Google Patents
通信装置、通信システム及び通信方法 Download PDFInfo
- Publication number
- WO2023074792A1 WO2023074792A1 PCT/JP2022/040130 JP2022040130W WO2023074792A1 WO 2023074792 A1 WO2023074792 A1 WO 2023074792A1 JP 2022040130 W JP2022040130 W JP 2022040130W WO 2023074792 A1 WO2023074792 A1 WO 2023074792A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- information
- internal state
- communication
- relay
- state information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W52/00—Power management, e.g. Transmission Power Control [TPC] or power classes
- H04W52/02—Power saving arrangements
- H04W52/0209—Power saving arrangements in terminal devices
- H04W52/0261—Power saving arrangements in terminal devices managing power supply demand, e.g. depending on battery level
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W24/00—Supervisory, monitoring or testing arrangements
- H04W24/02—Arrangements for optimising operational condition
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W24/00—Supervisory, monitoring or testing arrangements
- H04W24/04—Arrangements for maintaining operational condition
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W28/00—Network traffic management; Network resource management
- H04W28/02—Traffic management, e.g. flow control or congestion control
- H04W28/06—Optimizing the usage of the radio link, e.g. header compression, information sizing, discarding information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W36/00—Hand-off or reselection arrangements
- H04W36/0005—Control or signalling for completing the hand-off
- H04W36/0055—Transmission or use of information for re-establishing the radio link
- H04W36/0072—Transmission or use of information for re-establishing the radio link of resource information of target access point
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W52/00—Power management, e.g. Transmission Power Control [TPC] or power classes
- H04W52/02—Power saving arrangements
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Definitions
- the present invention relates to a communication device, a communication system and a communication method.
- This application claims priority to Japanese Patent Application No. 2021-175223 filed in Japan on October 27, 2021, and the contents thereof are incorporated herein.
- a communication device includes an internal state acquisition unit that acquires internal state information indicating an internal state of the first device from a first device that is separate from itself; an internal state storage unit that stores information; a calculation unit that performs processing based on the stored internal state information; and an internal state output unit that outputs to a second device that is separate from the device.
- the internal state information stored in the internal state storage unit is updated based on the processing performed by the calculation unit.
- the computing unit includes a machine learning algorithm
- the internal state information includes learned parameters learned by the machine learning algorithm
- the machine learning algorithm is a reinforcement learning algorithm
- the internal state information includes an action-value function used by the reinforcement learning algorithm
- the calculation unit calculates communication parameters for information communication based on the internal state information stored in the internal state storage unit, and the calculation unit and a wireless communication unit that performs information communication according to the communication parameter calculated by.
- the communication device further includes a inheritance timing information acquisition unit that acquires inheritance timing information including information about the inheritance timing, and the internal state output unit outputs The internal state information is output based on the included information about the inherited timing.
- the inheritance timing information acquisition unit acquires information regarding the remaining battery level of a power source that drives the self-device as the inheritance timing information
- the internal state output unit is configured to: The internal state information is output when the remaining battery level falls below a predetermined threshold.
- the communication device further includes a failure determination unit that determines whether or not the device is in a failure state, and the inheritance timing information acquisition unit receives the result determined by the failure determination unit. is acquired as the inheritance timing information, and the internal state output unit outputs the internal state information when the own device is in a failure state.
- the inheritance timing information includes information about a predetermined cycle
- the internal state output unit outputs the internal state at a predetermined cycle included in the acquired inheritance timing information. Output information.
- the calculation unit when the internal state acquisition unit acquires the internal state information, the calculation unit is in a resting state, and the internal state acquisition unit and the internal state output unit Not hibernating.
- a communication system includes any one of the communication devices described above and a relay device that transmits and receives the internal state information to and from one or more of the communication devices, and the relay device
- the device comprises: a relay information acquisition unit that acquires the internal state information output by the communication device as relay information; a relay information storage unit that stores the acquired relay information; and a relay information output unit that outputs internal state information to the communication device, and the relay device is the second device.
- the internal state output unit included in the communication device outputs the internal state information to the relay device based on a predetermined cycle
- the relay device included in the relay device outputs the internal state information to the relay device based on a predetermined cycle.
- the information output unit outputs the relay information when the relay information acquisition unit has not acquired the internal state information from the communication device for a predetermined period of time or longer.
- the relay device further includes a shared relay information generating unit that generates shared relay information based on the relay information acquired from the plurality of communication devices, and the relay information
- the storage unit stores the shared relay information as the relay information
- the relay information output unit outputs the shared relay information as the relay information.
- the shared relay information generation unit generates the shared relay information triggered by the relay information acquisition unit acquiring the relay information.
- the communication device includes a state storage unit that stores state information that is information acquired at a specific moment among information that changes according to at least one of the position of the device itself and the time. Further, the internal state storage unit associates information used for calculation of the communication parameter with the state information and stores the state information as the internal state information, and the calculation unit stores the information stored in the state storage unit. The communication parameter is calculated based on the state information and the internal state information stored in the internal state storage unit.
- the state storage unit stores a plurality of pieces of the state information acquired at a plurality of instants, and the calculation unit, based on the accumulated plurality of pieces of state information, determine the communication parameters;
- a communication method includes an internal state acquiring step of acquiring internal state information indicating an internal state of the first device from a first device that is separate from itself; an internal state storing step of storing internal state information; a processing step of performing processing based on the stored internal state information; and storing the stored internal state information separately from the first device at a predetermined succession timing. and an internal state output step of outputting to a second device which is a device of
- the learned result can be inherited.
- FIG. 1 is a diagram for explaining an example of a device configuration of a communication system according to a first embodiment
- FIG. FIG. 2 is a diagram for explaining an example of information communication of the communication system according to the first embodiment
- FIG. 3 is a block diagram showing an example of a functional configuration of a transmission device according to the first embodiment
- FIG. FIG. 4 is a diagram for explaining a series of operations of the transmission device according to the first embodiment
- FIG. FIG. 4 is a diagram for explaining search and utilization of communication parameters according to the first embodiment
- 4 is a timing chart showing an example of timing of data transmitted by the transmission device according to the first embodiment
- 4 is a diagram for explaining communication history information according to the first embodiment
- FIG. 10 is a diagram for explaining an example of the configuration of a communication system according to a second embodiment
- FIG. FIG. 11 is a block diagram showing an example of a functional configuration of a transmission device according to a second embodiment
- FIG. FIG. 12 is a block diagram showing a first modification of the functional configuration of the transmission device according to the second embodiment
- FIG. 11 is a block diagram showing a second modified example of the functional configuration of the transmission device according to the second embodiment
- FIG. 11 is a diagram for explaining inheritance between transmitting apparatuses according to the second embodiment
- FIG. 12 is a diagram for explaining an example of a configuration of a communication system according to a third embodiment
- FIG. FIG. 11 is a diagram for explaining inheritance in the case of relaying the relay device according to the third embodiment
- FIG. 12 is a diagram for explaining proxy inheritance when relaying the relay device according to the third embodiment
- FIG. 11 is a block diagram showing an example of a functional configuration of a relay device according to a third embodiment
- FIG. 12 is a block diagram showing a modification of the functional configuration of the relay device according to the third embodiment
- FIG. 11 is a block diagram showing an example of a functional configuration of a relay device according to a third embodiment
- FIG. 12 is a block diagram showing a modification of the functional configuration of the relay device according to the third embodiment
- FIG. 1 is a diagram for explaining an example of the device configuration of a communication system according to the first embodiment.
- the communication system 1 will be described with reference to the figure.
- a communication system 1 includes a transmitting device 20 and a receiving device 30 .
- the transmitting device 20 and the receiving device 30 perform information communication with each other.
- the communication system 1 may include multiple transmitters 20 and multiple receivers 30 .
- each transmitting device 20 communicates information with one or more receiving devices 30 .
- a case in which one transmission device 20 and a plurality of reception devices 30 are provided as an example of the communication system 1 will be described with reference to FIG. Specifically, as an example of the receiving device 30, a case of including a receiving device 30-1, a receiving device 30-2, and a receiving device 30-3 will be described.
- the transmitting device 20 and the receiving device 30 perform information communication with each other by short-range wireless communication.
- the transmitting device 20 and the receiving device 30 are wireless communication conforming to the Bluetooth (registered trademark) standard, particularly conforming to the BLE (Bluetooth Low Energy) standard, as an example of short-range wireless communication.
- BLE Bluetooth Low Energy
- An example in which information communication is performed by wireless communication will be described.
- the short-range wireless communication in this embodiment is not limited to an example of BLE, and various communication schemes can be adopted.
- near field communication may be NFC (Near Field Communication), Wi-Fi (registered trademark), IrDA (Infrared Data Association), TransferJet (registered trademark), ZigBee (registered trademark), and the like.
- wireless communication is not limited to short-distance communication, and may be LPWA (Low Power Wide Area) or the like.
- the transmitting device 20 may be the peripheral and the receiving device 30 may be the central.
- the transmitting device 20 as a peripheral transmits the transmission information IS without specifying the receiving device 30 .
- the receiving device 30 located near the transmitting device 20 transmits the receiving information IR when receiving the transmitting information IS.
- Information communication performed between the transmitting device 20 and the receiving device 30 may be a communication method in which a plurality of communication channels are defined within a predetermined frequency band.
- the transmitting device 20 and the receiving device 30 may exchange information using an advertisement packet in wireless communication conforming to the BLE standard.
- FIG. 2 is a diagram for explaining an example of information communication in the communication system according to the first embodiment.
- An example of information communication performed between the transmitting device 20 and the receiving device 30 included in the communication system 1 will be described with reference to FIG.
- the transmitting device 20 transmits the transmission information IS based on the communication parameters calculated by the algorithm 231.
- the communication parameters may include, for example, a frequency band used for communication, a signal transmission interval or number of transmissions, transmission power, or the like.
- the transmission device 20 includes a control section 21 and a wireless communication section 22 .
- the wireless communication unit 22 controls radio waves transmitted from the antenna 221 based on communication parameters acquired from the control unit 21 . Also, the wireless communication unit 22 outputs information based on radio waves received by the antenna 221 to the control unit 21 .
- the control unit 21 has an algorithm 231 and calculates communication parameters.
- the control unit 21 is provided with an algorithm 231 to calculate communication parameters based on the communication history information 233 .
- the control unit 21 updates the calculated communication parameters as the guideline information 232 as needed.
- the control unit 21 outputs the calculated communication parameters to the wireless communication unit 22 . Further, the control unit 21 acquires information on radio waves received by the antenna 221 from the wireless communication unit 22 .
- the control unit 21 updates the guideline information 232 based on the deterioration rate included in the acquired radio wave information.
- the deterioration rate is a value indicating the degree of deterioration of communication quality, and may be calculated based on whether or not the transmission information IS transmitted by the transmitting device 20 reaches any of the receiving devices 30, for example. That is, the deterioration rate may be a value indicating whether or not communication between the transmitting device 20 and the receiving device 30 is successful. In this case, the deterioration rate may be binary. When the deterioration rate is binary, the control unit 21 calculates it using a control signal (for example, an ACK signal) or the like returned when the receiving device 30 correctly receives the transmission information IS.
- a control signal for example, an ACK signal
- the presence or absence of a scan response request to the BLE advertisement packet may be used as the degradation rate, or the presence or absence of a connection request from the central (that is, the receiving device 30) may be used as the degradation rate. good too.
- the reception device 30 may inform whether or not the transmission information IS has been correctly received using a different communication means without using wireless communication.
- the control unit 21 sets the deterioration rate low when the receiving device 30 correctly receives the transmission information IS.
- the control unit 21 may set the deterioration rate to 0 (zero) when the receiving device 30 correctly receives the transmission information IS.
- the deterioration rate may be based on information regarding the intensity of radio waves included in the radio waves received by the antenna 221 from the receiving device 30 .
- the information about the radio wave intensity may be, for example, RSSI (Received Signal Strength Indicator).
- the receiving device 30 includes a radio wave intensity measuring unit (not shown) and measures the radio wave intensity when the transmission information IS is received.
- the receiving device 30 transmits the measured radio wave intensity to the transmitting device 20 as reception information IR.
- the control unit 21 sets the deterioration rate to be higher as the radio wave intensity included in the received reception information IR is lower. That is, the smaller the deterioration rate, the less the radio waves transmitted to the receiving device 30 are deteriorated.
- the deterioration rate may be calculated from the error rate when the receiving device 30 receives information encoded with an error detection code or an error correction code.
- the control unit 31 included in the receiving device 30 calculates the error rate of the transmission information IS acquired from the transmitting device 20 .
- the receiving device 30 transmits the calculated error rate to the transmitting device 20 as reception information IR.
- the control unit 21 provided in the transmission device 20 sets the deterioration rate to be higher as the error rate included in the received reception information IR is higher.
- the signal transmitted to the receiving device 30 based on the output communication parameter is encoded by an encoding method having an error detection function, and the deterioration rate is obtained by decoding the signal received from the receiving device 30. Based on actual error rate.
- the receiving device 30 includes a control section 31 and a wireless communication section 32 .
- the wireless communication unit 32 receives radio waves from the transmitting device 20 via the antenna 321 .
- the control unit 31 calculates the radio wave intensity (RSSI) of the received radio wave, the error rate, etc., based on the received radio wave information input from the wireless communication unit 32 .
- the wireless communication unit 32 outputs the radio wave intensity, error rate, etc. calculated by the control unit 31 as reception information IR.
- the transmitting device 20 and the receiving device 30 may have the same device configuration. That is, in the communication system 1 , a device that acts as a transmitter at a certain point in time is called a transmitter 20 , and a device that receives radio waves transmitted by the transmitter 20 is called a receiver 30 . In the following description, when the transmitting device 20 and the receiving device 30 are not distinguished, they are also referred to as the communication device 10 .
- FIG. 3 is a block diagram illustrating an example of the functional configuration of the transmission device according to the first embodiment; An example of the functional configuration of the transmission device 20 will be described with reference to the same drawing. Configurations that have already been described in the description of the communication system 1 may be omitted by assigning the same reference numerals.
- the transmission device 20 includes a control section 21 and a wireless communication section 22 .
- the transmission device 20 includes a CPU (Central Processing Unit) (not shown) connected by a bus, a storage device such as a ROM (Read only memory) or a RAM (Random access memory), and executes a transmission program to control a control unit. 21 and a wireless communication unit 22 .
- Control unit 21 includes internal state storage unit 242 , calculation unit 212 , output unit 213 , storage control unit 215 , state storage unit 251 , and state information acquisition unit 252 .
- All or part of each function of the transmission device 20 may be realized using hardware such as ASIC (Application Specific Integrated Circuit), PLD (Programmable Logic Device), or FPGA (Field-Programmable Gate Array).
- the transmission program may be recorded on a computer-readable recording medium.
- Computer-readable recording media include portable media such as flexible disks, magneto-optical disks, ROMs and CD-ROMs, and storage devices such as hard disks incorporated in computer systems.
- a transmission program may be transmitted via an electric communication line.
- State storage unit 251 stores state information IC.
- the state information IC is information obtained at a specific moment, among information that changes according to at least one of the position of the device itself and the time.
- the state information IC may be, for example, time information indicating time, position information indicating the position of the device itself, environmental information around the device itself, and the like.
- the position information indicating the position of the device may be position information indicating the position of the device in a three-dimensional space, or position information indicating the position of the device in two-dimensional coordinate information. good too. Two-dimensional coordinate information does not require height (altitude) information.
- the state storage unit 251 may store the current time measured by a clock unit (not shown) included in the transmission device 20 .
- the time information may be updated by the timer.
- the state information IC is location information, it may be, for example, location coordinates obtained using a positioning system.
- the position coordinates are acquired by a GPS (Global Positioning System) communication unit (not shown) provided in the transmitting device 20 .
- the GPS communication unit receives radio waves from satellites such as GPS.
- the position of the device itself is measured from the received radio waves.
- the state storage unit 251 stores environmental information such as temperature, humidity, illuminance, UV (ultraviolet rays), air pressure, noise, and acceleration.
- the state information IC is obtained from environmental sensors (environmental information acquisition department).
- the clock unit, GPS communication unit, and environment sensor may be provided outside the transmission device 20 .
- the transmission device 20 acquires the state information IC from an externally provided timer, GPS communication unit, and environment sensor.
- the location information may be estimated based on the information of the connected access point. Also, the location information may be estimated based on the location information of the access point and the distance information from the access point to the device itself. That is, the position information may be estimated based on radio waves for obtaining the state information IC. Also, the position information may be estimated based on radio waves for information communication that are different from radio waves for acquiring the state information IC. That is, the position information may be estimated based on both or one of the radio waves for obtaining the status information IC and the radio waves for information communication.
- the state information acquisition device 50 is also used when the devices for acquiring the state information IC such as the timekeeping unit, the GPS communication unit, and the environment information acquisition unit are not distinguished.
- the state information acquisition unit 252 may acquire the state information IC from the state information acquisition device 50 .
- the state storage unit 251 may store a plurality of pieces of state information IC acquired at a plurality of moments. That is, the state storage unit 251 may store the history of the state information IC.
- the internal state storage unit 242 stores internal state information ISI.
- the internal state information ISI is information in which state information IC is associated with information used for calculation of the communication parameter PM used when the transmitting device 20 performs information communication.
- the information used to calculate the communication parameter PM may be, for example, a learned parameter learned by a machine learning algorithm, or an action value function used by a reinforcement learning algorithm.
- the internal state storage unit 242 may function as the communication history information storage unit 211 that stores the communication history information IH.
- the communication history information IH is an example of the internal state information ISI.
- the communication history information IH is information in which a communication parameter PM for performing information communication and a deterioration rate D when information communication is performed using the communication parameter PM are associated with each other.
- the deterioration rate D is a value based on radio waves transmitted using the communication parameter PM when transmitting information to the receiving device 30 and radio waves received from the receiving device 30 .
- the communication history information storage unit 211 may include a volatile RAM (Random Access Memory) or a nonvolatile ROM (Read Only Memory).
- the computation unit 212 computes the communication parameter PM based on the state information IC stored in the state storage unit 251 and the internal state information ISI stored in the internal state storage unit 242 .
- the calculation unit 212 determines the communication parameter PM based on the accumulated plurality of state information ICs.
- the state information IC is information indicating time
- information corresponding to the time indicated in the state information IC is obtained from the internal state storage unit 242, and the communication parameter PM is calculated based on the obtained information. That is, the calculation unit 212 calculates the communication parameter PM based on the information stored in the internal state storage unit 242 and corresponding to the time indicated by the state information IC stored in the state storage unit 251 .
- the calculation unit 212 calculates the communication parameter PM based on the information stored in the internal state storage unit 242 and corresponding to the environmental information indicated by the state information IC stored in the state storage unit 251. .
- the state information IC is information indicating the position information of the device itself
- information corresponding to the position information indicated by the state information IC is acquired from the internal state storage unit 242, and communication parameters are calculated based on the acquired information.
- Calculate PM That is, the calculation unit 212 calculates the communication parameter PM based on the information stored in the internal state storage unit 242 and corresponding to the position information indicated by the state information IC stored in the state storage unit 251. .
- the state information IC may be image information in which the surroundings of the device are captured, or audio information collected and recorded in the surroundings of the device.
- the state information acquisition unit 252 acquires image information or audio information from a camera or microphone (not shown).
- the calculation unit 212 performs estimation based on the acquired image information, and calculates the communication parameter PM based on the estimated result.
- the computation unit 212 performs estimation based on the acquired voice information, and computes the communication parameter PM based on the estimated result.
- the computing unit 212 may estimate the radio wave congestion state from the state information IC and compute the communication parameter PM based on the estimated congestion state. That is, the calculation unit 212 estimates the radio wave congestion state around the device from the state information IC stored in the state storage unit 251, and calculates the communication parameter IC based on the estimated congestion state IC.
- the calculation unit 212 may estimate the density of people instead of the radio wave congestion.
- the computing unit 212 estimates the density of people around the device from the state information IC stored in the state storage unit 251, and computes the communication parameter PM based on the estimated density of people.
- the state information IC may be information indicating the weather around the device itself.
- the calculation unit 212 acquires information corresponding to the information indicating the weather indicated by the state information IC from the internal state storage unit 242, and stores the information in the acquired information.
- the communication parameter PM is calculated based on this. That is, the calculation unit 212 calculates the communication parameter PM based on the information stored in the internal state storage unit 242 and corresponding to the information indicating the weather indicated in the state information stored in the state storage unit 251.
- the weather information includes weather information such as temperature, humidity, visibility, wind, amount of clouds, rain, snow, and thunder, and is acquired by various sensors (not shown). Alternatively, it may be acquired from the outside by some communication method.
- the computing unit 212 computes the communication parameter PM using a machine learning algorithm.
- the machine learning algorithm may be, for example, a reinforcement learning algorithm that uses state information, such as Q-learning, deep reinforcement learning, or the like.
- the machine learning algorithm is a reinforcement learning algorithm
- the machine learning algorithm uses a value calculated from the deterioration rate D as a reward and learns the communication parameter PM for maximizing the reward. It is preferable that the higher the deterioration rate D, the smaller the reward.
- the machine learning algorithm may be a pre-learned model. Note that the machine learning algorithm may not be learned at the time of the first operation. Therefore, if the machine learning algorithm is untrained, the results may be determined by random numbers.
- a machine learning algorithm is learned based on the communication history information IH.
- the communication history information IH is information in which the communication parameter PM output by the output unit 213 is associated with the deterioration rate D obtained as a result of information communication using the communication parameter PM. That is, the calculation unit 212 learns based on the deterioration rate D obtained as a result of information communication using the communication parameter PM output from the output unit 213 .
- the internal state storage unit 242 may store a plurality of pieces of internal state information ISI.
- the calculation unit 212 calculates the communication parameter PM based on the internal state information ISI corresponding to the state information IC stored in the state storage unit 251 among the plurality of stored internal state information ISI.
- the calculation unit 212 outputs parameter information IP including the calculated communication parameter PM to the output unit 213 .
- the output unit 213 outputs parameter information IP including the communication parameter PM calculated by the calculation unit 212 to the wireless communication unit 22 .
- the wireless communication unit 22 performs information communication with the receiving device 30 based on the communication parameter PM included in the parameter information IP output by the output unit 213 .
- the storage control unit 215 acquires the deterioration information ID including the deterioration rate D from the wireless communication unit 22.
- the storage control unit 215 associates the acquired deterioration information ID with the communication parameter PM and stores it in the communication history information storage unit 211 as the communication history information IH.
- the storage control unit 215 obtains the parameter information IP from at least one of the output unit 213 and the wireless communication unit 22, and stores the communication history by associating the communication parameter PM and the deterioration rate D included in the obtained parameter information IP.
- Information IH is generated, and the generated communication history information IH is stored in the communication history information storage unit 211 .
- FIG. 4 is a diagram for explaining a series of operations of the transmission device according to the first embodiment. An example of the operation of the transmission device 20 will be described with reference to the figure.
- Calculation unit 212 refers to state information IC stored in state storage unit 251 and internal state information ISI stored in internal state storage unit 242 to determine communication parameter PM.
- the internal state information ISI is information in which "communication environment”, "value function A”, and “value function B” are associated with each other.
- “Communication environment” is information corresponding to the type of state information IC.
- the state information IC is time information
- the "communication environment” is information about time.
- the state information IC is positional information
- the "communication environment” is positional information.
- the state information IC is environment information
- the "communication environment” is information about the environment.
- Both “value function A” and “value function B” may be action value functions in reinforcement learning.
- environment 1 is associated with “communication environment”
- A1 is associated with “value function A”
- B1 is associated with “value function B”
- A2 is associated with B2 as “value function B”
- environment 3 is associated with “communication environment”
- A3 is associated with “value function A”
- B3 is associated with “value function B”
- environment 4 is associated with "communication environment”.
- A4 is associated as "value function A”
- B4 is associated as "value function B”
- An is “value function A”
- Bn as "value function B” (n is a natural number equal to or greater than 1).
- the calculation unit 212 acquires the state information IC from the state storage unit 251, selects a value function according to the communication environment based on the state information IC and the internal state information ISI, and performs communication based on the selected value function.
- Communication parameters PM include, for example, communication channel and communication strength. In one example shown in FIG. 4, a value function corresponding to the environment 2 is selected, and the communication channel and communication strength are determined based on the selected value function. Specifically, channel 37 and channel 38 are determined as the communication channels, and -8 [dBm] is determined as the communication strength.
- the calculation unit 212 updates the internal state information ISI stored in the internal state storage unit 242 according to the parameters used for communication and the communication result. In this way, the calculation unit 212 repeats “search”, which is an operation of learning suitable communication parameters, and “utilization”, which is an operation of performing communication using the communication parameters PM determined in the search, while performing information communication.
- search which is an operation of learning suitable communication parameters
- utilization which is an operation of performing communication using the communication parameters PM determined in the search
- FIG. 5 is a diagram for explaining search and utilization of communication parameters according to the first embodiment.
- the "search” and “utilization” of the algorithm 231 will be described with reference to FIG.
- Algorithm 231 is an example of computing unit 212 .
- “Parameter A” and “Parameter B” are examples of communication parameters PM. That is, in one example described with reference to the figure, the communication parameter PM has two parameters. The time change of each parameter is shown with time on the horizontal axis.
- Communication indicates whether the algorithm 231 is “searching” or “exploiting” with time on the horizontal axis.
- Search is indicated by a black rectangle
- “utilization” is indicated by a white rectangle.
- algorithm 231 performs a "search.” Algorithm 231 determines the value of parameter A to be "A1" and the value of parameter B to be “B1". From time t11 to time t12 , the transmitting device 20 performs information communication using the determined communication parameter PM. That is, from time t11 to time t12 , "utilization” is performed. At time t- 12 , the algorithm 231 "searches" for more suitable communication parameters PM based on the accumulated communication history information IH as a result of being "utilized” from time t- 11 to time t- 12 .
- algorithm 231 determines the value of parameter A from “A1” to “A2” and the value of parameter B from “B1" to “B2". From time t12 to time t13 , the transmitting device 20 performs information communication using the determined communication parameter PM.
- the algorithm 231 determines a more suitable communication parameter PM based on the accumulated communication history information IH as a result of being "utilized” from time t11 to time t12 and from time t12 to time t13 . "Explore. As a result of the search, algorithm 231 determines the value of parameter A from “A2" to "A3" and the value of parameter B from "B2" to "B3". From time t13 to time t14 , the transmitting device 20 performs information communication using the determined communication parameter PM.
- the algorithm 231 repeats "searching” and "utilization” to derive suitable communication parameters PM, and performs information communication based on the derived communication parameters PM.
- time t 11 , time t 12 , time t 13 , and time t 14 which are timings for “searching”, are predetermined timings determined by the algorithm 231 .
- the timing of "searching” may be irregular as in this example, or may be regular timing.
- Algorithm 231 is specifically a machine learning algorithm. More specifically, the algorithm 231 may be a MAB (Multi Armed Bandit) algorithm or the like. That is, the calculation unit 212 may be trained using the MAB algorithm (multi-armed bandit algorithm). By using the MAB algorithm, the transmitting device 20 can reliably transmit information to the receiving device 30 with low power consumption.
- MAB Multi Armed Bandit
- the MAB algorithm is an algorithm used to solve the problem of maximizing the reward in a limited number of trials when there are multiple slot machines with unclear reward probabilities.
- the amount of reward is set in consideration of the trade-off between the power consumption required for transmission and whether or not the receiving device 30 has correctly received the information. There must be.
- the transmission device 20 acquires the amount of power required for communication by a predetermined method.
- the transmitting device 20 may measure the amount of power actually consumed, for example, by including a power measuring device (not shown). Further, the transmission device 20 stores a power consumption correspondence table (not shown) in which the communication parameter PM and the estimated power consumption are associated with each other, and obtains the power consumption by referring to the power consumption correspondence table. good too.
- algorithm 231 which is the MAB algorithm, will determine the communication parameter PM to reduce power consumption, which can limit the amount of power required for transmission. Since the lower the deterioration rate D, the higher the quality (that is, the more reliable) the information has been transmitted, the lower the deterioration rate D, the more the reward amount is preferably increased.
- Algorithm 231 uses the calculated deterioration rate D to configure communication history information IH.
- the communication history information IH may be time-series data of the deterioration rate D.
- FIG. Algorithm 231 determines a suitable communication parameter PM based on communication history information IH, which is time-series data of deterioration rate D.
- the communication history information IH may be a single value calculated based on the deterioration rate D accumulated in the past.
- the communication history information IH may be acquired from another device.
- the other device may be the receiving device 30, for example. That is, in another example, receiving device 30 holds communication history information IH instead of transmitting device 20 .
- the receiving device 30 may count the number of times that information has been successfully received from the transmitting device 20 and estimate the deterioration rate based on the counted number of times. In this case, the receiving device 30 transmits the communication history information IH to the transmitting device 20 at a predetermined timing.
- the algorithm 231 can select one from all possible combinations of the communication parameter PM. can. That is, the algorithm 231 calculates the communication parameter PM by selecting one combination from among the combinations of the constituent elements included in the communication parameter PM. Specifically, a case in which the communication parameter PM has components x, components y, and components z will be described.
- the communication parameter PM can be determined by selecting one from (3 ⁇ 2 ⁇ 3) combinations. By configuring in this way, the algorithm 231 can easily optimally select the communication parameter PM composed of multiple elements.
- the algorithm 231 can use the UCB (Upper Confidence Bound) 1 algorithm when the combination of communication parameters PM is somewhat complicated.
- the calculator 212 is trained using the UCB1 algorithm.
- the algorithm 231 can use a lighter TOW (Tug Of War) algorithm when it is necessary to operate on a low-spec microcomputer.
- the calculator 212 is trained using the TOW algorithm.
- the UCB1 algorithm here includes the UCB1 algorithm and the UCB1-tuned algorithm.
- FIG. 6 is a timing chart showing an example of timing of data transmitted by the transmission device according to the embodiment.
- the communication parameter PM has "communication channel”, “first transmission interval SI1", “second transmission interval SI2", “transmission number ST”, and “transmission power” as its components.
- three advertising channels, 37ch (2402 MHz), 38ch (2426 MHz), and 39ch (2480 MHz), which are advertising channels used for BLE advertising, are used as "communication channels”.
- the horizontal axis represents the temporal change of the data transmitted to each channel.
- the wireless communication unit 22 sequentially outputs data A to each of 37ch, 38ch and 39ch.
- a period T21 indicates a period required for data A to be sent. Specifically, the wireless communication unit 22 outputs data A to 37ch at time t21 , then outputs data A to 38ch, and then outputs data A to 39ch. After outputting the data A to each channel, the wireless communication unit 22 outputs the data A to each channel again after a first transmission interval SI1. This is repeated until a predetermined number of transmissions ST is reached. According to the example shown in FIG. 7, the number of transmissions ST is 4, so the same data is output four times for each channel. That is, the communication parameter PM includes the first transmission interval SI1, and the wireless communication unit 22 transmits the signal to the receiving device 30 based on the first transmission interval SI1.
- the first transmission interval SI1 is an interval for transmitting the same data to each channel.
- an advertisement process is a process that is performed for each of a plurality of advertising channels, and is performed separately for three advertising channels, 37, 38, and 39 channels, for example.
- each channel may interfere with other radio waves existing in space. If interference occurs in all three channels, or if the receiving device 30 is not ready for reception, the information transmitted by the transmitting device 20 may not reach the receiving device 30 . In preparation for such a situation, a packet in which the same data is encoded is periodically transmitted a plurality of times. Note that the case where the receiving apparatus is not ready for reception is, for example, the case where the BLE receiving side (central) performs the receiving operation intermittently in order to reduce power consumption.
- the wireless communication unit 22 starts outputting data B different from data A after the second transmission interval SI2 has elapsed since the start of outputting data A at time t21 . That is, from time t23 to time t24 , the wireless communication unit 22 outputs data B to 37ch, 38ch, and 39ch.
- the second transmission interval SI2 is the interval until data is updated and newly transmitted.
- the wireless communication unit 22 completes the information transmission processing to the receiving device 30 during the transmission time, which is the time from the start of signal generation to the end of transmission.
- the calculation unit 212 may adjust the communication parameter PM so as to reduce the transmission time when the receiving device 30 continuously and stably receives the information transmitted by the wireless communication unit 22 .
- the calculation unit 212 may adjust the communication parameter PM based on information included in the reception information IR received from the reception device 30 so as to reduce the transmission time.
- the case where the receiving device 30 continuously and stably receives the information transmitted by the wireless communication unit 22 may be determined by the receiving device 30 or may be determined by the transmitting device 20 .
- the determination may be made by the transmitting device 20, the determination may be made based on whether or not there is reception information IR as a response to the transmission information IS.
- the wireless communication unit 22 repeatedly performs transmission processing from the time the system is started until the expected operating life.
- the system is, for example, a system that operates the transmitting device 20, and the time when the system is activated may be when the power of the transmitting device 20 is turned on.
- the transmitter 20 When the transmitter 20 is powered on, it may be the first power on before shipment from the factory or the first power on after the shipment from the factory.
- the calculation unit 212 sets the communication parameter PM so as to reduce the total time required for the information transmission process when the receiving device 30 continuously and stably receives the information transmitted by the wireless communication unit 22. adjust.
- the calculation unit 212 may adjust the communication parameter PM based on information included in the reception information IR received from the reception device 30 so as to reduce the total time required for information transmission processing.
- the radio communication unit 22 transmits the first data (data A) encoded with the same data based on the first transmission interval SI1 until the number of times of transmission ST reaches a specific number of transmissions ST.
- a different second data (data B) is transmitted based on the second transmission interval SI2.
- the communication parameter PM includes the second transmission interval SI2 and the number of transmissions ST.
- the calculation unit 212 adjusts the communication parameter PM so as to decrease the number of times of transmission ST when the receiving device 30 continuously and stably receives the information sent by the wireless communication unit 22 .
- the calculation section 212 may adjust the communication parameter PM so as to decrease the number of transmissions ST based on information included in the reception information IR received from the reception device 30 .
- the second transmission interval SI2 When the second transmission interval SI2 is included in the communication parameter PM, the second transmission interval SI2 is increased when the receiving device 30 continuously and stably receives the information transmitted by the wireless communication unit 22. , the communication parameter PM may be adjusted. Further, when the information transmitted by the wireless communication unit 22 is not continuously received by the receiving device 30, the calculation unit 212 may adjust the communication parameter PM so as to increase the second transmission interval SI2. good. Also, when the communication environment improves and data can be received stably, the second transmission interval SI2 may be decreased or restored to its original value. By decreasing the second transmission interval SI2 or returning it to the original value, the time until connection with the receiving device 30 can be shortened, and stable connection can be achieved. Also, the second transmission interval SI2 may be reduced when transmitting data with high urgency. As a result, it is possible to suppress power consumption when transmitting normal data, and to transmit data with high urgency to the receiving device 30 without delay.
- a channel mask is a communication parameter for determining a channel to be used when using a communication method in which a plurality of channels are defined within a use band.
- the communication parameter PM may include a channel mask for determining the channel to be used.
- the channels specified by the channel mask may be channels that are not used for communication.
- the communication channel may be an advertising channel defined by the BLE standard. Advertising may be connectable advertising.
- the deterioration rate D may be a value calculated based on whether or not a connection request has been answered.
- the calculation unit 212 determines the communication parameter PM so that the deterioration rate D decreases when communication is performed with the receiving device 30 of a specific partner via the channel mask included in the calculated communication parameter PM.
- the BLE advertising process is performed separately for the three advertising channels 37, 38, and 39 channels.
- the advertising process is performed by the 37th channel and the 39th channel, and if the 38th channel and the 39th channel are masked, the advertising process is performed by the 37th channel.
- the less channels are used the less the power required for transmission can be naturally reduced, but on the other hand, there is a trade-off relationship that the probability that information cannot be transmitted due to interference increases.
- the number of channels to be used should be minimized by channel masking, and should be limited to channels with the lowest probability of interference. Also, if the environment in which the transmitting device 20 is placed is a communication environment with a lot of interference, more channels should be used even if power consumption is sacrificed.
- the transmission device 20 cannot know the situation of the communication environment in advance, it adapts to the existing communication environment by "utilizing" and “searching" the channel mask, and transmits information with low power consumption. A channel mask can be selected.
- the algorithm 231 considers the trade-off between reliable transmission of information and power consumption and appropriately updates the channel mask.
- advertising may accept scan requests.
- the central receiving the advertising packet can send a scan request, and the degradation rate D is calculated based on whether the scan request is answered.
- the deterioration rate D may be calculated based on the number of advertising packets received by a specific one or a plurality of receiving devices 30.
- the first transmission interval SI1 is a time interval for transmitting the same data. This reduces the probability of interference by distributing (redundant) the transmission of information over time. However, it is not realistic to simply define the procedure for the deterioration rate, and for example, it is desirable to lengthen the time interval when continuous interference occurs over a relatively long period of time. On the other hand, it is desirable to shorten the time interval when interference occurs frequently in bursts (in a form condensed into a short period of time). Since it is difficult to estimate the time-dependent degree of interference in such a communication environment in advance, the transmitting device 20 uses "exploitation” and "search” to derive a suitable communication parameter PM.
- the algorithm 231 adjusts these values independently.
- the calculation unit 212 may adjust the communication parameter PM so as to decrease the first transmission interval SI1 when the receiving device 30 continuously and stably receives the information transmitted by the wireless communication unit 22. good.
- the second transmission interval SI2 is an interval for newly transmitting updated information. For example, when information is not updated frequently, it is desirable to increase the second transmission interval SI2 when the deterioration rate D can be considered sufficiently small.
- the second transmission interval SI2 also affects the power consumption during the period from start to finish of operation of the device.
- the number of channels and the transmission power should be maintained as they are in case the receiving apparatus 30, which is the other party of communication, recovers, but the frequency of presence confirmation should be reduced.
- the time elements (first transmission interval SI1, number of transmissions ST and second transmission interval SI2) as described above do not necessarily have to be used with values that exactly match the values determined by algorithm 231 .
- the numerical value determined by the algorithm 231 may be given some width and used as the communication interval. That is, the first transmission interval SI1, the number of transmissions ST, and the second transmission interval SI2 may be time intervals based on random values.
- a time interval based on a random value may be realized by adding or subtracting a random value to or from the determined numerical value.
- the method of using time intervals based on random values is useful for preventing interference due to matching intervals when multiple devices use the technique of the communication system 1 .
- interference may continue because the timings match. Even in such a case, interference can be avoided by determining the time interval based on a random value.
- the components of the transmitting device 20 have been described as the communication parameters PM, the components of the receiving device 30 may be used as the communication parameters.
- the components of the receiving device 30 may be, for example, the ON duty ratio of the communication section of the receiving device 30, the number of stages of the multi-stage amplifier, the response speed of responses to received packets, and the like.
- FIG. 7 is a diagram showing a modification of communication history information according to the embodiment.
- the communication history information IHA will be described with reference to FIG.
- the communication history information IHA is a modification of the communication history information IH. Configurations similar to those of the communication history information IH may be denoted by similar reference numerals, and description thereof may be omitted.
- the communication history information IHA further has a parameter identifier PMID, and includes a channel mask CM, first transmission interval SI1, number of transmissions ST, second transmission interval SI2, and power consumption PC as communication parameters PM. It differs from the communication history information IH in that it has
- the communication history information IHA is stored in the communication history information storage unit 211, and the calculation unit 212 calculates the communication parameter PM based on the communication history information IHA stored in the communication history information storage unit 211.
- the power consumption PC is power consumption generated by transmitting radio waves using the communication parameter PM included in the communication history information IHA.
- the communication history information IHA is associated with the deterioration rate D when the communication parameter PM is used. That is, the calculation unit 212 calculates the communication parameter PM based on the power consumption PC generated by transmitting radio waves using the communication parameter PM included in the communication history information IHA and the corresponding deterioration rate D. More specifically, the computing unit 212 computes the communication parameter PM so as to reduce the power consumption PC.
- the communication history information IHA has, as communication parameters PM, a channel mask CM, a first transmission interval SI1, the number of times of transmission ST, a second transmission interval SI2, and power consumption PC. It is possible to perform communication using a suitable communication parameter PM with higher accuracy, taking into account the trade-off between communication reliability and power consumption.
- the communication history information IHA has the parameter identifier PMID, all combinations of possible values for each communication parameter PM can be examined without omission. Also, since the communication history information IHA has the parameter identifier PMID, the algorithm 231 can easily find suitable parameters.
- the transmission device 20 includes the state storage unit 251 to store the state information IC, the internal state storage unit 242 to store the internal state information ISI, and the calculation unit 212.
- the communication parameter PM is calculated based on the state information IC and the internal state information ISI by being provided, and the communication parameter PM calculated by being provided with the output unit 213 is output. Therefore, according to this embodiment, since the communication parameter PM is determined based on the state information IC, it is possible to quickly adapt to the communication environment.
- the computing unit 212 includes a machine learning algorithm, and the internal state information ISI includes learned parameters learned by the machine learning algorithm. Therefore, according to this embodiment, by using machine learning, it is possible to determine a suitable communication parameter PM based on a plurality of input variables (communication results, a plurality of state information).
- the machine learning algorithm is a reinforcement learning algorithm
- the internal state information ISI includes an action-value function used by the reinforcement learning algorithm. Therefore, according to the present embodiment, it is possible to repeat the search and utilization by itself and quickly determine the communication parameter PM adapted to the environment.
- the state storage unit 251 stores a plurality of state information ICs acquired at a plurality of instants, and the calculation unit 212 calculates the communication parameters based on the plurality of accumulated state information ICs. Determine PM. Therefore, according to this embodiment, not only the current state but also the past state can be stored and utilized. Therefore, according to this embodiment, a more suitable communication parameter PM can be determined.
- the transmission device 20 further includes the state information acquisition unit 252 for acquiring state information. Therefore, according to the present embodiment, the transmission device 20 can acquire information from sensors provided inside or outside the device itself.
- the state information IC is information indicating time.
- the communication status may change depending on the time zone.
- the communication conditions may be poor during the daytime hours when many people use radio waves, and the communication conditions may be good during nighttime hours when many people do not use radio waves.
- the transmitting device 20 can adapt to a communication environment in which communication conditions fluctuate depending on the time of day.
- the state information IC is information indicating environmental information.
- the communication situation may change depending on the surrounding environment.
- the number of people using radio waves may differ between rainy days and sunny days.
- the transmission device 20 can adapt to a communication environment in which the communication status varies depending on the surrounding environment.
- the state information IC is information indicating the position information of the own device.
- the communication status may change depending on the position of the own device.
- the number of people using radio waves may differ between urban and rural areas.
- the transmission device 20 can adapt to a communication environment in which the communication status varies depending on the position of the device itself.
- the positional information is not limited to absolute positional information, and includes relative positional information such as distance and positional relationship with the target object.
- the position information is position coordinates obtained using a positioning system. Therefore, according to this embodiment, the transmitting device 20 can acquire position information or coordinate information from an external positioning system.
- the position information is estimated based on both or either of the radio waves for acquiring the state information IC and the radio waves for information communication. Therefore, according to this embodiment, it is possible to acquire position information even in a building where GPS radio waves cannot be acquired. Further, according to this embodiment, in addition to position information estimated by GPS, position information is specified by radio waves, so position information can be estimated more easily and in more detail.
- the calculation unit 212 estimates the radio wave congestion situation around the own device from the state information IC stored in the state storage unit 251, and performs communication based on the estimated congestion situation. Compute the parameter PM. Therefore, according to the present embodiment, it is possible to estimate the degree of crosstalk in the communication environment in which the transmitting device 20 is placed, and quickly adapt to the communication environment in which the device itself is placed based on the estimated state of crosstalk. .
- the calculation unit 212 estimates the density of people around the device from the state information IC stored in the state storage unit 251, and communicates based on the estimated density of people. Compute the parameter PM. Therefore, according to the present embodiment, it is possible to estimate the radio wave congestion situation based on the density of surrounding people, and quickly adapt to the communication environment in which the device itself is located based on the estimated congestion situation. .
- the state information IC is image information obtained by imaging the surroundings of the device itself.
- the communication parameter PM is calculated based on this. Therefore, according to the present embodiment, by estimating the state of congestion based on the image acquired by the camera, the state of congestion is estimated from the number of people in the vicinity. According to this embodiment, it is possible to quickly adapt to the communication environment in which the device itself is placed based on the estimated degree of crosstalk.
- the state information IC is sound information collected around the device itself, and the calculation unit 212 performs estimation based on the sound information, and the estimated result A communication parameter PM is calculated based on. Therefore, according to the present embodiment, by estimating the state of congestion based on the voice information acquired by the microphone, it is possible to estimate the state of congestion with low-load processing, thereby reducing power consumption and miniaturizing the device. can do
- the state information IC is information indicating the weather around the own device
- the calculation unit 212 is information stored in the internal state storage unit 242
- Communication parameters are calculated based on information corresponding to the information indicating the weather indicated in the state information IC stored in section 251 . Therefore, according to this embodiment, even when the communication system 1 performs communication using a communication method that is affected by the weather, the transmission device 20 can adapt to the environment.
- the internal state storage unit 242 stores a plurality of pieces of internal state information ISI
- the calculation unit 212 stores the stored plurality of pieces of internal state information ISI in the state storage unit 251.
- Communication parameters are calculated based on the internal state information ISI corresponding to the stored state information IC. That is, the calculation unit 212 refers to the internal state information ISI corresponding to the state information IC and determines the communication parameter PM. Therefore, according to this embodiment, the state information IC can be easily utilized by simple processing.
- FIG. A communication system 1A in the second embodiment includes a plurality of transmitters 20A.
- the transmitting device 20A differs from the transmitting device 20 in that information communication is performed among a plurality of transmitting devices 20A.
- information communication between transmission devices 20A is also referred to as "inheritance”.
- 20 A of transmitter which concerns on 2nd Embodiment assume operating in the place where a stable external power supply does not exist. When operating in locations where a stable external power supply is not present, once the battery life expires, the transmitter 20A will not be able to continue its operation and will remain inoperable until the battery is recharged or replaced.
- the battery of the transmitter 20A may not be rechargeable and is disposable. If the battery of the transmitting device 20A is disposable, the transmitting device 20A is discarded when the battery life expires.
- the sensing information obtained by transmitter 20A is important, and inoperability can be a problem if it is undesirable to interrupt the transmission of data. In such a case, the transmitting device 20A takes over its function to another transmitting device 20A that is on standby in the vicinity of itself.
- FIG. 8 is a diagram for explaining an example of the configuration of a communication system according to the second embodiment. "Inheritance" in the second embodiment will be described with reference to FIG.
- the communication system 1A includes a transmission device 20A-1, a transmission device 20A-2, and a transmission device 20A-3.
- the transmitting device 20A-1 transmits inheritance information II to the transmitting device 20A-2.
- the transmitting device 20A-2 transmits inheritance information II to the transmitting device 20A-3. That is, the transmission device 20A-1 takes over to the transmission device 20A-2, and the transmission device 20A-2 takes over to the transmission device 20A-3.
- the inherited information II is, for example, information including the result of learning by the transmitting device 20A. That is, according to this embodiment, the information learned by the transmission device 20A-1 is inherited by the transmission device 20A-2. Therefore, according to the present embodiment, even if the transmission device 20A-1 becomes unusable due to product life or failure, the transmission device 20A-2 replaces the transmission device 20A-1, thereby learning Information can still be used. Similarly, even if the transmitter 20A-2 becomes unusable due to product life or failure, etc., the learned information can be continuously utilized by replacing the transmitter 20A-3 with the transmitter 20A-2. can be done.
- FIG. 9 is a block diagram showing an example of the functional configuration of a transmission device according to the second embodiment.
- An example of the functional configuration of the transmission device 20A will be described with reference to this figure.
- the same reference numerals are given to the same configurations as those of the transmission device 20, and the description may be omitted.
- the transmitting device 20A differs from the transmitting device 20 in that it further includes an inheritance control section 240 .
- Inheritance control section 240 includes internal state acquisition section 241 and internal state output section 244 .
- the inheritance control unit 240 controls inheritance of the internal state information ISI between the transmitters 20A.
- the transmitting device 20A-1 inherits the internal state information ISI from the transmitting device 20A-2, and inherits the internal state information ISI to the transmitting device 20A-3.
- the transmission device 20A-2 is also referred to as the first device, and the transmission device 20A-3 as the second device.
- the internal state acquisition unit 241 acquires internal state information ISI indicating the internal state of the first device from the transmitting device (first device) 20A-2, which is a device separate from itself.
- the internal state acquisition unit 241 causes the internal state storage unit 242 to store the acquired internal state information ISI. That is, the internal state storage unit 242 stores the internal state information ISI acquired by the internal state acquisition unit 241 .
- a device separate from itself means an independent device that communicates with each other. Therefore, even separate bodies of the same standard are devices separate from themselves.
- the calculation unit 212 performs processing based on the internal state information ISI stored in the internal state storage unit 242.
- the process based on the internal state information ISI may be, for example, a process of calculating a communication parameter PM for information communication based on the internal state information ISI.
- the calculation unit 212 updates the internal state information ISI stored in the internal state storage unit 242 as a result of the processing. That is, the internal state information ISI stored in internal state storage unit 242 is updated based on the processing performed by arithmetic unit 212 .
- the internal state output unit 244 outputs the internal state information ISI stored in the internal state storage unit 242 at predetermined inheritance timing. Specifically, the internal state output unit 244 outputs to a transmission device (second device) 20A-3, which is a separate device from the transmission device (first device) 20A-2.
- some functions of the successor device may be in a dormant state.
- Some of the functions in the dormant state may be, for example, functions that are not related to inherited functions such as the computing unit 212 . That is, when the internal state acquisition unit 241 acquires the internal state information ISI, the calculation unit 212 is in the hibernation state, and the internal state acquisition unit 241 and the internal state output unit 244 are not in the hibernation state.
- FIG. 10 is a block diagram showing a first modification of the functional configuration of the transmission device according to the second embodiment.
- a first modification of the transmission device 20A will be described with reference to the same figure.
- a first modified example of the transmission device 20A is different from the above-described transmission device 20A in that the transmission device 20A includes a inheritance timing information acquisition unit 245.
- FIG. 10 shows a first modification of the functional configuration of the transmission device according to the second embodiment.
- a first modification of the transmission device 20A will be described with reference to the same figure.
- a first modified example of the transmission device 20A is different from the above-described transmission device 20A in that the transmission device 20A includes a inheritance timing information acquisition unit 245.
- the inheritance timing information acquisition unit 245 acquires inheritance timing information IT.
- the inheritance timing information IT includes information about the inheritance timing, which is the timing that triggers the inheritance.
- the internal state output unit 244 outputs the internal state information ISI based on the information about the inheritance timing included in the acquired inheritance timing information IT.
- the succession timing information acquisition unit 245 may acquire information about the remaining battery level of the battery 60 that drives the self device as the succession timing information IT.
- the information regarding the remaining battery level of the battery 60 may be the power supply voltage.
- the internal state output unit outputs internal state information ISI when the remaining battery level of the battery 60 included in the acquired inheritance timing information IT falls below a predetermined threshold. If the information about the remaining battery level of the battery 60 is the power supply voltage, the internal status output unit outputs the internal status information ISI when the power supply voltage is below a predetermined threshold.
- the transmission device 20A may inherit based on a predetermined cycle.
- the inheritance timing information IT may contain information about a predetermined cycle.
- the internal state output unit outputs the internal state information at a predetermined cycle included in the acquired inheritance timing information.
- FIG. 11 is a block diagram showing a second modification of the functional configuration of the transmission device according to the second embodiment.
- a second modification of the transmission device 20A will be described with reference to FIG.
- the second modification of the transmission device 20A differs from the above-described first modification of the transmission device 20A in that a failure determination section 246 is provided.
- the failure determination unit 246 determines whether or not its own device is in a failure state.
- the failure determination unit 246 outputs information regarding whether or not its own device is in a failure state to the inheritance timing information acquisition unit 245 .
- the succession timing information acquisition unit 245 acquires the result determined by the failure determination unit 246 as the succession timing information IT.
- the internal state output unit 244 outputs the internal state information ISI when the own device is in a failure state.
- failure determination unit 246 may be a watchdog timer (WDT) or the like controlled by the calculation unit 212 .
- WDT watchdog timer
- FIG. 12 is a diagram for explaining inheritance between transmission devices according to the second embodiment. Inheritance between the transmission devices 20A will be described with reference to FIG.
- the transmitter 20A is a sensor node that constitutes a wireless sensor network.
- the transmitter 20A may be described as a sensor node.
- transmitters 20A from transmitter 20A-1 to transmitter 20A-6 are shown.
- the transmitter 20A-1 cannot be used due to its life span, and the transmitter 20A-2 cannot be used due to a failure.
- the transmitters 20A-3 and 20A-4 are in operation, and the transmitters 20A-5 and 20A-4 are in standby state (dormant state).
- the transmitting device 20A-3 inherits the internal state information ISI when the transmitting device 20A-1 cannot be used continuously due to its lifetime.
- the transmission device 20A-4 inherits the internal state information ISI when the transmission device 20A-2 stops operating due to a failure.
- the transmitters 20A-3 and 20A-4 are in the active state, and the transmitters 20A-5 and 20A-6 are in the standby state.
- the transmitters 20A-5 and 20A-6 in the standby state stand by in the dormant state and play the role of spare sensor nodes.
- That sensor node When one of the sensor nodes falls into an inoperable state, that sensor node (hereinafter sometimes referred to as a successor node) is replaced by another sensor node (hereinafter sometimes referred to as a successor node). ) inherits the function as a sensor node as internal state information ISI. At this time, due to the inheritance, the successor node becomes active, and the sensor function, communication function, etc. are enabled.
- the inheritance destination node should naturally exist in the vicinity of the inheritance source node. That is, the successor node and the successor node operate in similar communication environments.
- a similar communication environment means, for example, that the installation distance is close or that the same communication network is used.
- the timing of inheritance is not limited to these examples, and the inheritance may be performed, for example, before it is determined that the device becomes unusable. If inheritance is performed before it is determined that the device will become unusable, the latest information may be inherited by performing inheritance multiple times between the same inheritance source node and succession destination node. Inheriting multiple times is equivalent to periodically backing up the internal state information ISI. Therefore, regular backup can prevent the internal state information ISI from being lost unexpectedly.
- inheritance may also be performed.
- the inheritance node will be explained.
- the transmission device 20A-1 succeeds to the transmission device 20A-3 and the transmission device 20A-2 inherits to the transmission device 20A-4.
- the successor node is not limited to one device as in these examples, and the succession may be made to a plurality of succession nodes.
- any communication function may be used for the inheritance, and may be via the communication function of the internal state output unit 244, the communication function of the wireless communication unit 22, or any other communication function.
- Communication for inheritance may be wireless or wired communication.
- the transmission device 20A acquires the internal state information ISI from a device separate from itself by having the internal state acquisition unit 241, and the internal state information ISI acquired by having the internal state storage unit 242
- the state information ISI is stored, processing is performed based on the stored internal state information ISI by providing the calculation unit 212, and the internal state information ISI is output at a predetermined inheritance timing by providing the internal state output unit 244. Therefore, according to this embodiment, even if the transmission device 20A becomes inoperable unintentionally, the internal state information ISI can be inherited to the next generation. Therefore, according to the present embodiment, it is possible to use the result of learning by the predecessor without having to newly learn from scratch. Therefore, according to the present embodiment, even when the transmission device 20A is replaced, it is possible to immediately start using the next-generation transmission device 20A.
- the internal state information ISI is updated based on the processing performed by the calculation unit 212 .
- the computing unit 212 computes the communication parameter PM based on the internal state information ISI. That is, the internal state information ISI is updated based on the communication parameters PM. Therefore, the internal state information ISI is updated based on the signaled result according to the environment in which the device is placed. Therefore, according to this embodiment, since the internal state information ISI updated based on the result of signal communication according to the environment in which the device is placed is inherited, the learned result can be inherited from time to time. .
- the computing unit 212 includes a machine learning algorithm, and the internal state information ISI includes learned parameters learned by the machine learning algorithm. Therefore, according to this embodiment, it is possible to inherit the learned parameters updated by the algorithm using machine learning, and the learned parameters are lost when the device becomes inoperable unintentionally. can be prevented.
- the machine learning algorithm is a reinforcement learning algorithm
- the internal state information ISI includes an action-value function used by the reinforcement learning algorithm. Therefore, according to the present embodiment, the action-value function updated by the algorithm using reinforcement learning can be inherited, and the action-value function is lost when the device becomes inoperable unintentionally. can be prevented. Therefore, the transmission device 20A, which is the successor node, can restart the process in a state where the reinforcement learning has progressed.
- the calculation unit 212 calculates the communication parameter PM for information communication based on the internal state information ISI.
- 20 A of transmitters perform information communication according to the communication parameter PM calculated by the calculating part 212 by being provided with the radio
- FIG. Therefore, according to the present embodiment, even if the transmission device 20A becomes inoperable for some reason, the learning result of the transmission device 20A can be inherited by another device. Therefore, the transmission device 20A, which is the successor node, can resume processing in a state adapted to the communication environment.
- the transmission device 20A is provided with the inheritance timing information acquisition unit 245, thereby acquiring the inheritance timing information IT including information about the inheritance timing. Further, the internal state output unit 244 outputs the internal state information based on the information about the inheritance timing included in the acquired inheritance timing information IT. Therefore, the transmitting device 20A can output the internal state information ISI at suitable inheritance timing.
- the inheritance timing information acquisition unit 245 acquires information regarding the remaining amount of the battery 60, which is the power source for driving the own device, as the inheritance timing information IS. Further, the internal state output unit 244 outputs the internal state information ISI when the remaining battery level of the battery 60 falls below a predetermined threshold. Therefore, the transmitting device 20A can inherit the internal state information ISI to the next generation before the function is completely stopped. Therefore, it is possible to prevent a situation in which inheritance itself cannot be performed due to insufficient battery power, such as when the transmitting device 20A has only one battery.
- the transmission device 20A includes the failure determination unit 246 to determine whether or not the device itself is in a failure state. Further, the inheritance timing information acquisition unit 245 acquires the result determined by the failure determination unit 246 as inheritance timing information IT, and the internal state output unit 244 outputs the internal state information ISI to output Therefore, the transmission device 20A can inherit the processing when it becomes impossible to continue the processing. That is, the transmission device 20A can inherit the internal state to the next generation when the function is stopped. In other words, the transmission device 20A can inherit the processing even if it is determined that the processing cannot be continued due to a reason other than the power shutdown.
- the inheritance timing information IT includes information about a predetermined cycle
- the internal state output unit 244 outputs the internal state information ISI at the predetermined cycle included in the acquired inheritance timing information IT. Output. Therefore, by periodically outputting the internal state information ISI to the successor node, the transmission device 20A, which is the successor node, can prevent the internal state information that has already been inherited even if the inheritance is not possible. Processing can be restarted based on the ISI.
- the calculation unit 212 is in the hibernation state, and the internal state acquisition unit 241 and the internal state output unit 244 are in the hibernation state. not. Therefore, according to the present embodiment, by putting the transmitting device 20A, which is the successor node, into the dormant state, some sensor nodes constituting the sensor network can be installed as spare devices without consuming power. In addition, when the device in operation stops functioning, the function can be handed over to the standby device.
- FIG. A communication system 1B according to the third embodiment differs from the communication system 1A in that a transmission device 20B is provided instead of the transmission device 20A. Further, the communication system 1B includes a relay device 40 in addition to the transmission device 20B. The transmission device 20B inherits from the relay device 40 instead of or in addition to the communication system 1A inheriting between the transmission devices 20A. is different. In the description of the transmission device 20B, the same reference numerals may be assigned to components similar to those of the transmission device 20A, and the description thereof may be omitted.
- FIG. 13 is a diagram for explaining an example of the configuration of a communication system according to the second embodiment;
- the transmitting device 20B will be described with reference to FIG.
- a transmission device 20B according to the third embodiment is connected to the relay device 40 directly or via a predetermined network.
- the predetermined network may be a cloud system.
- the transmission device 20B transmits inheritance information II to the relay device 40 and acquires the inheritance information II from the relay device 40 .
- Inheritance information II may include internal state information ISI.
- the relay device 40 Upon obtaining the inheritance information II from the transmission device 20B, the relay device 40 stores the internal state information ISI included in the obtained inheritance information II in the storage unit. The relay device 40 outputs the succession information II to the transmission device 20B at a predetermined succession timing or when the transmission device 20B becomes inoperable. That is, the relay device 40 stores the internal state information ISI of the transmission device 20B.
- the internal state information ISI of the inheritance source node that has been inherited can be inherited to the new succession destination node. As a result, the successor node can continue the process after inheriting the internal state information ISI of the successor node, instead of starting from the complete initial state.
- the transmitting device 20B is a sensor node that constitutes a sensor network
- the sensor node may periodically transmit its internal state to other sensor nodes to replicate the internal state. For example, a configuration that periodically sends the internal state to other sensor nodes and can inherit the duplicated internal state even if inheritance becomes impossible for some reason. can be
- the copy destination sensor node may be, for example, a future successor sensor node.
- the future successor sensor node is in a dormant state, but retains only the internal state of the copy source.
- the replication source sensor node becomes inoperable, the future successor sensor node starts operating and starts operating from the time of the replicated internal state.
- Duplication may be performed via the relay device 40 .
- the relay device 40 itself may store the replicated internal state information ISI.
- the relay device 40 inherits to a future successor sensor node instead of the copy source sensor node.
- the future successor sensor node starts operating based on the internal state information ISI inherited from the relay device 40 .
- the successor node can be used immediately, and standby power consumption can be reduced.
- FIG. 14 is a diagram for explaining inheritance in the case of relaying the relay device according to the third embodiment.
- An example of inheritance relayed by the relay device 40 will be described with reference to FIG.
- the transmission device 20B-1, the transmission device 20B-2, and the transmission device 20B-3 each relay through the relay device 40 to perform inheritance.
- the transmitter 20B-1 is out of service due to its life span or other reasons.
- the transmitting device 20B-2 is in an operating state, and the transmitting device 20B-3 is in a standby state (idle state).
- the transmitting device 20B-2 inherits the internal state information ISI from the relay device 40 when the transmitting device 20B-1 becomes unable to be continuously used due to its lifetime or other reasons.
- the transmitting device 20B-3 is in the standby state, it is a successor candidate for the next time.
- FIG. 15 is a diagram for explaining proxy inheritance in the case of relaying the relay device according to the third embodiment. Proxy inheritance will be described with reference to FIG.
- the transmitter 20B is a sensor node that configures a sensor network.
- the sensor node periodically performs life confirmation communication with the relay device 40 .
- the relay device 40 can grasp the operating states of the sensor nodes that constitute the sensor network by periodically acquiring life confirmation communications from the sensor nodes.
- the communication system 1B which is a sensor network, includes transmitters 20B-1 to 20B-5 and a relay device .
- the transmitter 20B-1 cannot be used due to its life span, and the transmitter 20B-2 cannot be used due to a failure.
- the transmitting device 20B-3 is in an operating state, and the transmitting devices 20B-4 and 20B-5 are in a standby state (idle state).
- the transmitting device 20B-2 inherits the internal state information ISI by relaying the relay device 40 when the transmitting device 20B-1 cannot be used continuously due to its lifetime.
- the internal state information ISI cannot be inherited to the next generation.
- the relay device 40 instead of the transmitting device 20B-2, the relay device 40 performs proxy inheritance to the transmitting device 20B-3. By configuring in this way, it is possible to prevent the information of the internal state information ISI inherited from the transmitting device 20B-1 from being lost.
- the relay device 40 can grasp the operating state of the sensor nodes that make up the sensor network, so that the relay device 40 can take over as a proxy for the sensor node that has become inoperable due to a failure or the like. be able to. For example, when the survival confirmation communication from the sensor node is cut off, the relay device 40 determines that the sensor node has become inoperable, and takes over to another sensor node.
- FIG. 16 is a block diagram illustrating an example of a functional configuration of a relay device according to the third embodiment;
- FIG. A functional configuration of the relay device 40 will be described with reference to FIG.
- a communication system 1B according to the third embodiment includes a plurality of transmission devices 20B and a relay device 40.
- the transmitter 20B includes a transmitter 20B-1 and a transmitter 20B-2.
- the relay device 40 transmits and receives internal state information ISI to and from one or more transmission devices 20B.
- the relay device 40 acquires the internal state information ISI from the transmission device 20B-1, stores the acquired internal state information ISI, and outputs the stored internal state information ISI to the transmission device 20B-2.
- Relay device 40 includes relay information acquisition section 401 , relay information storage section 402 , and relay information output section 403 .
- Relay information acquisition section 401 acquires internal state information ISI output from transmitting device 20B as relay information.
- the relay information storage unit 402 stores relay information acquired by the relay information acquisition unit 401 .
- Relay information output section 403 outputs the relay information stored in relay information storage section 402 to transmission device 20B as internal state information ISI.
- the internal state output unit 244 provided in the transmission device 20B is based on a predetermined cycle. and outputs the internal state information ISI to the relay device 40 .
- the relay information acquisition unit 401 fails to acquire the internal state information ISI from the transmission device 20B for a predetermined period of time or longer, the relay information output unit 403 included in the relay device 40 sends the transmission device 20B, which is the successor node, relay information is output.
- FIG. 17 is a block diagram showing a modification of the functional configuration of the relay device according to the third embodiment; A modified example of the relay device 40 will be described with reference to FIG.
- the relay device 40 accumulates the internal states of a plurality of transmission devices 20B in the relay device 40 .
- the internal state accumulated in the relay device 40 is integrally processed and utilized when handing over to another transmitting device 20B.
- the relay device 40 includes a shared relay information generator 404 .
- Shared relay information generation section 404 generates shared relay information based on relay information acquired from a plurality of transmission devices 20B.
- the relay information storage unit 402 stores shared relay information as relay information.
- relay information output section 403 outputs shared relay information as relay information.
- the shared relay information generation unit 404 may generate shared relay information, for example, triggered by the fact that the relay information acquisition unit 401 has acquired the relay information. That is, the shared relay information may be generated when performing inheritance processing.
- the relay device 40 can contribute to early application of the other transmitters 20B by integrally processing the internal states of the plurality of transmitters 20B.
- the configuration of this embodiment is effective when the sensor network is spread over a wide area and the sensor nodes are scattered over a wide area.
- the transmitting device 20B outputs the self-learned content linked to the environment information and the internal state in which each sensor node is installed to the relay device 40 at the time of inheritance.
- the operating sensor node A and the newly installed sensor node B are installed in similar environments, although they are separated from each other.
- the sensor node B inherits the information learned by the sensor node A through the relay device 40 . Since the sensor node B can see that the environment is similar to that of the sensor node A from the measurement values of the installed sensors, it preferentially adopts the internal state of the sensor node A among the inherited internal states, and the sensor node B can adapt quickly to the environment in which it is placed.
- a large-scale network can be constructed with a plurality of sensor nodes, such sharing of internal states by accumulating shared relay information is an effective means.
- the communication system 1B includes multiple transmitters 20B and the relay device 40 .
- Relay device 40 acquires internal state information ISI from transmitting device 20B by having relay information acquisition section 401, stores the acquired internal state information ISI by having relay information storage section 402, and relay information output section 403. to output the stored internal state information ISI to the transmitting device 20B. Therefore, according to the communication system 1B according to the present embodiment, the transmission device 20B can take over via the relay device 40 .
- inheritance can be performed via the relay device 40. Therefore, even if the inheritance cannot be performed between the transmission devices 20B, it is possible to prevent the learning result from being lost. can.
- inheritance can be performed via the relay device 40. Therefore, the relay device 40 can monitor the remaining battery level and abnormality of each transmission device 20B, thereby ensuring appropriate inheritance. Timing can be controlled.
- the internal state output unit 244 provided in the transmission device 20B outputs the internal state information ISI to the relay device based on a predetermined cycle
- the relay information output unit 403 provided in the relay device 40 outputs the relay information when the relay information acquisition unit 401 has not acquired the internal state information ISI from the communication device 20B for a predetermined period of time or longer. Therefore, according to the present embodiment, the relay device 40 inherits the function when the power supply of the transmission device 20B is cut off, etc., so that even when the function is stopped, the relay device 40 can be used in the next generation. State information ISI can be inherited.
- the relay device 40 generates the shared relay information based on the relay information acquired from the plurality of transmitting devices 20B by sparse shared relay information generating section 404 . Therefore, according to the present embodiment, by integrating or processing the internal states obtained from a plurality of transmitting devices 20B, the newly inherited transmitting device 20B can learn early.
- the shared relay information is generated with the relay information acquisition unit 401 acquiring the relay information as a trigger. That is, the shared relay information is generated when inheritance processing is performed. Therefore, according to the present embodiment, by accumulating the internal state at the time of inheritance, the internal state can be accumulated in the relay device 40 without generating unnecessary communication processing.
- the internal state storage unit 242 may store the acquired internal state information ISI.
- the transmitting device 20 is further provided with an internal state acquisition unit, thereby acquiring information indicating the internal state of the transmitting device 20 different from itself as the internal state information ISI.
- the computation unit 212 computes the communication parameter PM based on the internal state information ISI stored in the internal state storage unit 242 .
- the transmitting device 20 according to the first embodiment can also inherit the internal state from other transmitting devices 20 . Therefore, according to the present embodiment, by preparing a backup transmission device 20, even when one transmission device 20 becomes inoperable, the function can be inherited from the backup transmission device 20. , the reliability of the communication system 1 as a whole can be improved.
- the transmission device 20 may output the internal state information ISI stored in the internal state storage unit 242 at a predetermined inheritance timing by further including an internal state output unit. That is, according to the present embodiment, by preparing the backup transmission device 20, even when one transmission device 20 falls into an inoperable state, the backup transmission device 20 can function. This can be inherited and the reliability of the communication system 1 as a whole can be improved.
- the communication system 1 may include the relay device 40 .
- the relay device 40 transmits and receives internal state information ISI to and from one or more transmission devices 20 .
- the relay device 40 includes a relay information acquisition unit 401 to acquire the internal state information ISI as relay information, a relay information storage unit 402 to store the acquired relay information, and a relay information output unit 403.
- the stored relay information is output as the internal state information ISI. Therefore, according to the present embodiment, the transmission device 20 can take over via the relay device 40 .
- the relay device 40 may include the shared relay information generation unit 404 .
- Shared relay information generation section 404 generates shared relay information based on relay information acquired from a plurality of transmission devices 20 .
- Relay information storage section 402 stores shared relay information as relay information, and relay information output section 403 outputs shared relay information as relay information. Therefore, according to the present embodiment, by integrating or processing the internal states obtained from a plurality of transmitting devices 20, the newly inherited transmitting device 20 can learn early.
- the transmission device 20A may further include a state storage unit 251 to store the state information IC.
- the internal state storage unit 242 associates the information used for calculating the communication parameter PM with the state information IC and stores them as the internal state information ISI.
- calculation unit 212 calculates communication parameter PM based on state information IC stored in state storage unit 251 and internal state information ISI stored in internal state storage unit 242 . Therefore, according to this embodiment, since the communication parameter PM is determined based on the state information IC, it is possible to quickly adapt to the communication environment.
- the state storage unit 251 stores a plurality of state information ICs acquired at a plurality of instants
- the calculation unit 212 stores a plurality of state information ICs based on the accumulated plurality of state information ICs. , determine the communication parameter PM. Therefore, according to this embodiment, not only the current state but also the past state can be stored and utilized. Therefore, according to this embodiment, a more suitable communication parameter PM can be determined.
- the transmitting device 20, the receiving device 30, and the relay device 40 may perform information communication by wired communication.
- the communication parameters may include the communication interval, the transmission power, and the channel if the communication is multiplexed. In this case, information can be transmitted with minimum power consumption while avoiding interference from other devices connected on the same line.
- wired communication one-to-many or many-to-many wired communication methods such as bus connection, star connection, and mesh connection may be used. Specifically, communication methods such as the Internet, I2C (Inter-Integrated Circuit), SPI (Serial Peripheral Interface), and CAN (Controller Area Network) may be used.
- each device provided in the communication system 1 in the above-described embodiment and all or part of the functions of each unit provided in each device may be obtained by recording a program for realizing these functions on a computer-readable recording medium. , may be realized by causing a computer system to read and execute the program recorded on this recording medium.
- the "computer system” referred to here includes hardware such as an OS and peripheral devices.
- “computer-readable recording medium” refers to portable media such as flexible discs, magneto-optical discs, ROMs, and CD-ROMs, and storage units such as hard disks built into computer systems.
- “computer-readable recording medium” means a medium that dynamically retains a program for a short period of time, like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. It may also include a device that holds a program for a certain period of time, such as a volatile memory inside a computer system that serves as a server or client in that case. Further, the program may be for realizing part of the functions described above, or may be capable of realizing the functions described above in combination with a program already recorded in the computer system.
- the transmitting device when the transmitting device is replaced by another device, the transmitting device can inherit the learning results of the other device.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
Description
本願は、2021年10月27日に日本に出願された特願2021―175223について優先権を主張し、その内容をここに援用する。
まず、図1から図7を参照しながら、第1の実施形態について説明する。
図1は、第1の実施形態に係る通信システムの装置構成の一例について説明するための図である。同図を参照しながら、通信システム1について説明する。
通信システム1は、送信装置20と、受信装置30とを備える。送信装置20と受信装置30とは、互いに情報通信を行う。通信システム1は、複数の送信装置20と、複数の受信装置30とを備えていてもよい。この場合、それぞれの送信装置20は、一以上の受信装置30との間で情報通信を行う。同図を参照しながら、通信システム1の一例として、一の送信装置20と、複数の受信装置30とを備える場合について説明する。具体的には、受信装置30の一例として、受信装置30-1と、受信装置30-2と、受信装置30-3とを備える場合について説明する。
本実施形態における近距離無線通信は、BLEの一例に限定されず、種々の通信方式を採用可能である。例えば、近距離無線通信とは、NFC(Near Field Communication)、Wi-Fi(登録商標)、IrDA(Infrared Data Association)、TransferJet(登録商標)、ZigBee(登録商標)等であってもよい。あるいは、無線通信は近距離に限定されず、LPWA(Low Power Wide Area)などであってもよい。
ペリフェラルである送信装置20は、受信装置30を特定せずに送信情報ISを送信する。送信装置20の付近に存在する受信装置30は、送信情報ISを受信した場合に、受信情報IRを送信する。
送信装置20及び受信装置30の間で行われる情報通信とは、所定の周波数帯域の中で複数の通信チャネルが定義された通信方法であってもよい。例えば、送信装置20と受信装置30とは、BLEの規格に準拠する無線通信におけるアドバタイズパケットを用いて情報のやり取りを行ってもよい。
送信装置20は、アルゴリズム231により算出された通信パラメータに基づき、送信情報ISを送信する。通信パラメータとは、例えば、通信に使用する周波数帯、信号の送信間隔や送信回数、又は送信電力等を含んでいてもよい。
無線通信部22は、制御部21から取得した通信パラメータに基づき、アンテナ221から送信する電波を制御する。また、無線通信部22は、アンテナ221により受信した電波に基づく情報を制御部21に出力する。
また、制御部21は、無線通信部22から、アンテナ221により受信した電波の情報を取得する。制御部21は、取得した電波の情報に含まれる劣化率に基づいて、指針情報232を更新する。
制御信号の他の実施形態として、BLEのアドバタイズパケットに対するスキャンレスポンス要求の有無を劣化率として用いてもよい、また、セントラル(すなわち、受信装置30)からのコネクション要求の有無を劣化率として用いてもよい。受信装置30が無線通信を介さず、異なる通信手段を用いて、正しく送信情報ISを受け取ったか否かを伝えてもよい。制御部21は、受信装置30が正しく送信情報ISを受け取った場合、劣化率を低く設定する。制御部21は、受信装置30が正しく送信情報ISを受け取った場合、劣化率を0(ゼロ)に設定してもよい。
換言すれば、出力された通信パラメータに基づいて受信装置30に送信される信号は誤り検出機能を持つ符号化方式で符号化されており、劣化率は、受信装置30から受信した信号を復号した際の誤り率に基づく。
無線通信部32は、アンテナ321を介して送信装置20から電波を受信する。制御部31は、無線通信部32から入力された、受信した電波の情報に基づいて、受信した電波の電波強度(RSSI)や、誤り率等を算出する。無線通信部32は、制御部31により算出された電波強度や、誤り率等を受信情報IRとして出力する。
図3は、第1の実施形態に係る送信装置の機能構成の一例を示すブロック図である。同図を参照しながら、送信装置20の機能構成の一例について説明する。通信システム1の説明において既に説明した構成については、同様の符号を付すことにより、説明を省略する場合がある。
送信装置20は、制御部21と、無線通信部22とを備える。送信装置20は、バスで接続された不図示のCPU(Central Processing Unit)、ROM(Read only memory)又はRAM(Random access memory)等の記憶装置等を備え、送信プログラムを実行することによって制御部21と、無線通信部22とを備える装置として機能する。
制御部21は、内部状態記憶部242と、演算部212と、出力部213と、記憶制御部215と、状態記憶部251と、状態情報取得部252とを備える。
なお、自装置の位置を示す位置情報とは、三次元空間における自装置の位置を示す位置情報であってもよいし、二次元的な座標情報における自装置の位置を示す位置情報であってもよい。二次元的な座標情報の場合、高さ(高度)の情報を要しない。
状態情報ICが位置情報である場合、例えば、測位システムを使って取得された位置座標であってもよい。当該位置座標は、送信装置20に備えられる不図示のGPS(Global Positioning System)通信部により取得される。GPS通信部は、GPS等の人工衛星から電波を受信する。受信した電波により、自装置の位置が測定される。
状態情報ICが環境情報である場合、例えば、状態記憶部251は、温度、湿度、照度、UV(紫外線)、気圧、騒音、加速度等の環境情報を記憶する。状態情報ICは、環境情報の種類に応じて、送信装置20に備えられる不図示の温度センサ、湿度センサ、照度センサ、紫外線センサ、気圧センサ、騒音センサ、加速度センサ等の環境センサ(環境情報取得部)により取得される。
なお、計時部、GPS通信部、環境センサは、送信装置20外部に備えられていてもよい。この場合、送信装置20は、外部に備えられた計時部、GPS通信部、環境センサから状態情報ICを取得する。
また、位置情報は、状態情報ICを取得するための電波とは異なる情報通信を行うための電波に基づいて推定されてもよい。すなわち、位置情報は、状態情報ICを取得するための電波、及び情報通信を行うための電波の双方またはいずれか一方に基づいて推定されてもよい。
状態情報取得部252は、状態情報ICを、状態情報取得装置50から取得してもよい。
ここで、通信履歴情報IHとは、内部状態情報ISIの一例である。通信履歴情報IHは、情報通信を行うための通信パラメータPMと、当該通信パラメータPMを用いて情報通信を行った際の劣化率Dとが対応付けられた情報である。劣化率Dとは、受信装置30に情報を送信する際に通信パラメータPMを用いて送信された電波と、受信装置30から受信した電波とに基づく値である。例えば、劣化率Dは、劣化率D=(受信した電波の電波強度/送信した電波の電波強度)により定義されてもよい。通信履歴情報記憶部211は、揮発性のRAM(Random Access Memory)を含んでいてもよいし、不揮発性のROM(Read Only Memory)を含んでいてもよい。
この場合、演算部212は、取得した画像情報に基づいて推定を行い、推定された結果に基づいて通信パラメータPMを演算する。同様に、演算部212は、取得した音声情報に基づいて推定を行い、推定された結果に基づいて通信パラメータPMを演算する。
ここで、天気を示す情報は、気温、湿度、視程、風、雲量、雨、雪、雷などの気象に関する情報を含み、不図示の各種センサによって取得される。あるいは、何らかの通信方法により外部から取得されたものであってもよい。
機械学習アルゴリズムは、通信履歴情報IHに基づき、学習される。通信履歴情報IHとは、出力部213により出力された通信パラメータPMと、当該通信パラメータPMを用いて情報通信した結果得られる劣化率Dとが対応付けられた情報である。すなわち、演算部212は、出力部213により出力された通信パラメータPMを用いて情報通信した結果得られる劣化率Dに基づき学習される。
無線通信部22は、出力部213により出力されたパラメータ情報IPに含まれる通信パラメータPMに基づいて、受信装置30との間で情報通信を行う。
演算部212は、状態記憶部251に記憶される状態情報ICと、内部状態記憶部242に記憶された内部状態情報ISIとを参照し、通信パラメータPMを決定する。
“価値関数A”及び“価値関数B”は、いずれも強化学習における行動価値関数であってもよい。
が対応付けられる(nは1以上の自然数)。
通信パラメータPMには、例えば通信チャネルと、通信強度とが含まれる。
図4に示す一例においては、環境2に応じた価値関数が選択され、選択された価値関数に基づいて、通信チャネルと、通信強度とが決定される。具体的には、通信チャネルとして、チャネル37と、チャネル38とが決定され、通信強度として-8[dBm]が決定される。
このように、演算部212は、好適な通信パラメータを学習する動作である「探索」と、探索において決定した通信パラメータPMを使用し、通信を行う動作である「活用」を繰り返しながら、情報通信を行う時点において最適な通信パラメータを導く。
“パラメータA”及び“パラメータB”は、通信パラメータPMの一例である。すなわち、同図を参照しながら説明する一例において、通信パラメータPMは、2つのパラメータを有する。それぞれのパラメータの時間変化を、横軸を時間として示す。“通信”は、アルゴリズム231が「探索」又は「活用」のいずれを行っているかについて、横軸を時間として示す。「探索」は黒塗りの矩形にて、「活用」は白抜きの矩形にて示す。
時刻t12において、アルゴリズム231は、時刻t11から時刻t12にかけて「活用」された結果、蓄積された通信履歴情報IHに基づき、より好適な通信パラメータPMを「探索」する。探索の結果、アルゴリズム231は、パラメータAの値を“A1”から“A2”に、パラメータBの値を“B1”から“B2”に決定する。時刻t12から時刻t13にかけて、送信装置20は、決定された通信パラメータPMを用いて情報通信を行う。
なお、図6に示した一例では、「探索」を行うタイミングである時刻t11、時刻t12、時刻t13、及び時刻t14、はアルゴリズム231により決定された所定のタイミングである。「探索」を行うタイミングは、この一例のように、不定期であってもよいし、定期的なタイミングであってもよい。
MABアルゴリズムを用いることにより、送信装置20は、少ない消費電力で、確実に受信装置30に向けて情報を発信することができる。
以下、MABアルゴリズムについて説明する。MABアルゴリズムは、報酬を得られる確率が明らかでないスロットマシンが複数台ある場合に、限られた試行回数の中で報酬を最大化する問題を解くために使用されるアルゴリズムである。このMABアルゴリズムを用いて好適な通信パラメータPMを決定するためには、送信に必要な電力消費と、受信装置30が正しく情報を受信したか否かのトレードオフを考慮して報酬量を設定しなければならない。
送信装置20は、所定の方法により、通信に要した電力量を取得する。送信装置20は、例えば不図示の電力測定器を備えることにより、実際に消費される電力量を測定してもよい。また、送信装置20は、通信パラメータPMと、電力消費推定量とが対応づけられた不図示の電力消費量対応表を記憶し、電力消費量対応表を参照することにより電力量を取得してもよい。
なお、通信履歴情報IHは過去に蓄積された劣化率Dに基づき算出された単一の値であってもよい。
具体的には、通信パラメータPMが、構成要素x、構成要素y及び構成要素zを有する場合について説明する。例えば、構成要素xがx1、x2及びx3の三値であり、構成要素yがy1及びy2の二値であり、構成要素zがz1、z2及びz3の三値であった場合、アルゴリズムは18(3×2×3)の組み合わせから一つを選ぶことにより通信パラメータPMを決定できる。このように構成することにより、アルゴリズム231は、容易に複数要素からなる通信パラメータPMを最適に選択することができる。
また、アルゴリズム231は、スペックが低いマイコンで動作させる必要がある場合には、より軽量なTOW(Tug Of War)アルゴリズムを用いることができる。この場合、演算部212は、TOWアルゴリズムを用いて学習される。
なお、ここでいうUCB1アルゴリズムは、UCB1アルゴリズムと、UCB1-tunedアルゴリズムとを含む。
図6は、実施形態に係る送信装置が送出するデータのタイミングの一例を示すタイミングチャートである。同図を参照しながら、通信パラメータPMの具体的な構成要素について説明する。この一例において、通信パラメータPMは、その構成要素として、「通信チャネル」、「第1の送出間隔SI1」、「第2の送出間隔SI2」、「送信回数ST」、及び「送信電力」を有する。同図に示す一例においては、「通信チャネル」として、BLEのアドバタイズに用いられるアドバタイズチャネルである37ch(2402MHz)、38ch(2426MHz)、39ch(2480MHz)の3チャンネルを用いる。同図には、それぞれのチャネルに送信されるデータの時間変化について、横軸を時間軸として示す。
具体的には、無線通信部22は、時刻t21において37chにデータAを出力し、その後、38chにデータAを出力し、その後、39chにデータAを出力する。無線通信部22は、それぞれのチャネルにデータAを出力した後、第1の送出間隔SI1を空けて、再度、それぞれのチャネルにデータAを出力する。これを、所定の送信回数STになるまで繰り返す。図7に示す一例によれば、送信回数STは4であるため、各チャネルにつき、4回ずつ同一のデータを出力する。
すなわち、通信パラメータPMは、第一の送出間隔SI1を含み、無線通信部22は、第一の送出間隔SI1に基づいて、受信装置30に信号を送出する。
なお、受信装置の受信準備が整っていない場合とは、BLEの受信側(セントラル)において、消費電力を抑えるために断続的に受信動作を行う場合等である。
演算部212は、無線通信部22により送出された情報を受信装置30が連続して安定的に受信した場合に、送出時間を減少させるように通信パラメータPMを調整してもよい。この場合、演算部212は、受信装置30から受信した受信情報IRに含まれる情報に基づいて、送出時間を減少させるように通信パラメータPMを調整してもよい。
この場合、通信パラメータPMは、第二の送出間隔SI2と、送信回数STを含む。
また、第二の送出間隔SI2は、緊急性の高いデータを送信する場合には減少させてもよい。これにより、通常のデータを送信する場合には消費電力を抑制しつつ、緊急性の高いデータを送信する場合には遅延なく受信装置30に送信することができる。
次に、通信パラメータPMの一例であるチャネルマスクについて説明する。チャネルマスクとは、使用帯域の中で複数のチャネルが定義された通信方法を用いる場合、使用するチャネルを決めるための通信パラメータである。使用帯域の中で複数のチャネルが定義された通信方法を用いる場合、通信パラメータPMとして、使用するチャネルを決めるためのチャネルマスクを含んでもよい。
演算部212は、演算した通信パラメータPMに含まれるチャネルマスクを介して特定の相手方の受信装置30に通信を行った際に、劣化率Dが減少するように通信パラメータPMを決定する。
次に、通信パラメータPMの一例である第1の送出間隔SI1、送信回数ST及び第2の送出間隔SI2について、より具体的に説明する。
第1の送出間隔SI1は、同一のデータを送信するための時間間隔である。これは情報の送信を時間的に分散(冗長化)することで干渉の確率を低減させるものである。ただし、単に劣化率に対して手続きを定義するのは現実的ではなく、たとえば、比較的長期間にわたって連続した干渉が発生するような場合には時間間隔を長くすることが望ましい。一方で、バースト的に(短時間に凝縮する形で)干渉が頻発する場合には時間間隔を短くすることが望ましい。こうした通信環境の時間に依存した干渉度合いは、事前に推測することは困難であるため、送信装置20は、「活用」と「探索」を用いて、好適な通信パラメータPMを導き出す。
第1の送出間隔SI1と、送信回数STとを合わせて考慮すると、同一データを送信完了するまでに必要な時間(必要送出時間、たとえば第1の送出間隔SI1×送信回数ST)を短縮することが電力削減において望ましい。これは、必要送出時間の間は次の送信処理のために不図示の制御部(マイクロコントローラや集積回路、その他の電子回路)が動作を継続する必要があり、必要送出時間が増加するにつれて電力を消費するためである。
ランダム値に基づいた時間間隔を用いる方法は、複数機器が通信システム1の手法を利用したときに、互いに間隔が一致することで干渉しあうことを防ぐのに有用である。例えば、装置Aの送信間隔が400[ms(ミリ秒)]であり、装置Bの送信間隔も400[ms]である場合に、タイミングが一致しているため干渉し続ける場合がある。このような場合であっても、ランダム値に基づいて時間間隔を決定すれば、干渉を避けることができる。
送信電力が通信パラメータPMに含まれる場合において、劣化率Dが増加したときには電波の強度を増加させ、劣化率Dが十分に小さいとみなせるときは、電波の強度を減少させることが望ましい。通信環境に適応して電波の強度を加減することにより、所要電力を削減するためである。
図7は、実施形態に係る通信履歴情報の変形例を示す図である。同図を参照しながら、通信履歴情報IHAについて説明する。通信履歴情報IHAは、通信履歴情報IHの変形例である。通信履歴情報IHと同様の構成については、同様の符号を付すことにより説明を省略する場合がある。通信履歴情報IHAは、パラメータ識別子PMIDを更に有し、通信パラメータPMとして、チャネルマスクCMと、第1の送出間隔SI1と、送信回数STと、第2の送出間隔SI2と、消費電力PCとを有する点において、通信履歴情報IHと異なる。
以上説明した実施形態によれば、送信装置20は、状態記憶部251を備えることにより状態情報ICを記憶し、内部状態記憶部242を備えることにより内部状態情報ISIを記憶し、演算部212を備えることにより状態情報ICと内部状態情報ISIに基づいて通信パラメータPMを演算し、出力部213を備えることにより演算された通信パラメータPMを出力する。したがって、本実施形態によれば、状態情報ICに基づいて通信パラメータPMを決定するため、早期に通信環境に適応することができる。
なお、本実施形態において、位置情報とは、絶対的な位置情報に限定されず、対象物との間における距離・位置関係などの相対的な位置情報も含む。
次に、図8から図12を参照しながら、第2の実施形態について説明する。第2の実施形態における通信システム1Aは、複数の送信装置20Aを備える。送信装置20Aは、複数の送信装置20A間において情報通信をする点において、送信装置20とは異なる。以降の説明において、送信装置20A間における情報通信を、「継承」とも記載する。
このような場合、送信装置20Aは、自装置の周辺に存在する待機中の別の送信装置20Aに、その機能を継承していく。
送信装置20Aの一例として、通信システム1Aは、送信装置20A-1と、送信装置20A-2と、送信装置20A-3とを備える。送信装置20A-1は、継承情報IIを送信装置20A-2に送信する。また、送信装置20A-2は、継承情報IIを送信装置20A-3に送信する。すなわち、送信装置20A-1は、送信装置20A-2に継承し、送信装置20A-2は、送信装置20A-3に継承する。
図9に示す一例においては、送信装置20A-1の一例について説明する。送信装置20A-1は、送信装置20A-2から内部状態情報ISIを継承し、送信装置20A-3に内部状態情報ISIを継承する。以降の説明において、送信装置20A-2を第1装置、送信装置20A-3を第2装置とも記載する。
ここで、自身とは別個の装置とは、互いに通信を行う独立した装置をいう。したがって、同一規格の別個体についても、自身とは別個の装置である。
図10は、第2の実施形態に係る送信装置の機能構成の第1の変形例を示すブロック図である。同図を参照しながら、送信装置20Aの第1の変形例について説明する。送信装置20Aの第1の変形例においては、継承タイミング情報取得部245を備える点において、上述した送信装置20Aとは異なる。
内部状態出力部は、取得した継承タイミング情報ITに含まれる電池60の電池残量が所定の閾値を下回った場合に、内部状態情報ISIを出力する。電池60の電池残量に関する情報が電源電圧であった場合、内部状態出力部は、電源電圧が所定の閾値を下回った場合に、内部状態情報ISIを出力する。
前記内部状態出力部は、取得した前記継承タイミング情報に含まれる所定の周期で前記内部状態情報を出力する。
図11は、第2の実施形態に係る送信装置の機能構成の第2の変形例を示すブロック図である。同図を参照しながら、送信装置20Aの第2の変形例について説明する。送信装置20Aの第2の変形例においては、故障判定部246を備える点において、上述した送信装置20Aの第1の変形例とは異なる。
ここで、送信装置20A-3は、送信装置20A-1が寿命により継続的な使用ができなくなった際に、内部状態情報ISIを継承している。また、送信装置20A-4は、送信装置20A-2が故障により動作が停止する際に、内部状態情報ISIを継承している。
本実施形態によれば、センサノードとして蓄積した情報を継承するため、学習した情報が失われることによる新たな学習を一から始める必要がない。すなわち、継承元ノードと継承先ノード間で学習した情報を共有することができるため、継承後即座に通信環境に適応することができる。
装置が使用できなくなると判定される前に継承を行う場合、同一の継承元ノード-継承先ノード間において複数回継承することにより、最新の情報を継承できるようにしてもよい。複数回継承することは、定期的に内部状態情報ISIのバックアップを実施することと同等である。したがって、定期的なバックアップにより、不意に内部状態情報ISIが失われることを防ぐことができる。
以上説明した実施形態によれば、送信装置20Aは、内部状態取得部241を備えることにより自身とは別個の装置から内部状態情報ISIを取得し、内部状態記憶部242を備えることにより取得した内部状態情報ISIを記憶し、演算部212を備えることにより記憶された内部状態情報ISIに基づいた処理を行い、内部状態出力部244を備えることにより所定の継承タイミングにおいて内部状態情報ISIを出力する。
したがって、本実施形態によれば、送信装置20Aが意図せず動作不能に陥った場合であっても、内部状態情報ISIを次代へ継承することができる。よって、本実施形態によれば、新たに一から学習をする必要がなく、先代が学習した結果を用いることができる。
よって、本実施形態によれば、送信装置20Aが置き換わった場合であっても、即座に次代の送信装置20Aの使用を開始することができる。
したがって、本実施形態によれば、自装置が置かれた環境に応じて信号通信された結果に基づいて更新される内部状態情報ISIを承継するため、学習した結果を時代に継承することができる。
次に、図13から図17を参照しながら、第3の実施形態について説明する。第3の実施形態における通信システム1Bは、送信装置20Aに代えて送信装置20Bを備える点において通信システム1Aとは異なる。また、通信システム1Bは、送信装置20Bに加え、中継装置40を備える。送信装置20Bは、通信システム1Aが送信装置20A間において継承を行うことに代えて、又は加えて、中継装置40に対して継承を行い、中継装置40から継承を行う点において、送信装置20Aとは異なる。送信装置20Bの説明において、送信装置20Aと同様の構成については、同様の符号を付すことにより説明を省略する場合がある。
送信装置20Bは、中継装置40に継承情報IIを送信し、中継装置40から継承情報IIを取得する。継承情報IIは、内部状態情報ISIを含んでいてもよい。
すなわち、中継装置40は、送信装置20Bの内部状態情報ISIを記憶しており、送信装置20Bが何らかの理由で動作不能になり、かつ継承を行うことができなかった場合に、中継装置40が保持していた継承元ノードの内部状態情報ISIを新たな継承先ノードに継承することができる。この結果、継承先ノードは完全な初期状態からではなく、継承元ノードの内部状態情報ISIを継承した上で処理を継続できる。
同図に示す一例では、送信装置20B-1、送信装置20B-2、送信装置20B-3が、それぞれ中継装置40を中継して継承を行う。送信装置20B-1は寿命又はその他の理由により使用ができない状態である。送信装置20B-2は稼働状態であり、送信装置20B-3は待機状態(休止状態)である。ここで、送信装置20B-2は、送信装置20B-1が寿命又はその他の理由により継続的な使用ができなくなった際に、中継装置40から内部状態情報ISIを継承している。また、送信装置20B-3は、待機状態であるが、次回継承候補であるため、中継装置40を中継して送信装置20B-2の内部状態情報ISIを継承している。
センサノードは、中継装置40に対して定期的に生存確認通信を行う。中継装置40は、センサノードから定期的な生存確認通信を取得することにより、センサネットワークを構成するセンサノードの稼働状態を把握することができる。
ここで、送信装置20B-2は、送信装置20B-1が寿命により継続的な使用ができなくなった際に、中継装置40を中継して内部状態情報ISIを継承している。しかしながら、送信装置20B-2は、継承前に、故障により動作が停止しているため、内部状態情報ISIを次代に継承することができない。
例えば、センサノードからの生存確認通信が途絶えた場合に、中継装置40は、センサノードが動作不能になったと判断し、他のセンサノードに継承を行う。
第3の実施形態に係る通信システム1Bは、複数の送信装置20Bと、中継装置40とを備える。具体的には、送信装置20Bとして、送信装置20B-1と、送信装置20B-2とを備える。
中継装置40は、一以上の送信装置20Bとの間で内部状態情報ISIの送受信を行う。具体的には、中継装置40は、送信装置20B-1から内部状態情報ISIを取得し、取得した内部状態情報ISIを記憶し、送信装置20B-2対し記憶した内部状態情報ISIを出力する。
中継情報取得部401は、送信装置20Bにより出力された内部状態情報ISIを、中継情報として取得する。中継情報記憶部402は、中継情報取得部401により取得された中継情報を記憶する。中継情報出力部403は、中継情報記憶部402に記憶された中継情報を、内部状態情報ISIとして送信装置20Bに出力する。
本実施形態において、中継装置40は、複数の送信装置20Bの内部状態を中継装置40に蓄積する。中継装置40に蓄積された内部状態は、統合処理され、他の送信装置20Bへの継承時に活用される。
共有中継情報生成部404は、複数の送信装置20Bから取得した中継情報に基づいて、共有中継情報を生成する。この場合、中継情報記憶部402は、共有中継情報を中継情報として記憶する。また、中継情報出力部403は、共有中継情報を中継情報として出力する。
なお、共有中継情報生成部404は、例えば、中継情報取得部401が中継情報を取得したことをトリガーとして、共有中継情報を生成してもよい。すなわち、共有中継情報は、継承の処理を行う際に生成されてもよい。
以上説明した実施形態によれば、通信システム1Bは、複数の送信装置20Bと、中継装置40とを備える。中継装置40は、中継情報取得部401を備えることにより送信装置20Bから内部状態情報ISIを取得し、中継情報記憶部402を備えることにより取得した内部状態情報ISIを記憶し、中継情報出力部403を備えることにより記憶した内部状態情報ISIを送信装置20Bに出力する。したがって、本実施形態に係る通信システム1Bによれば、送信装置20Bは、中継装置40を介して継承することができる。
本実施形態によれば、中継装置40を介して継承することができるため、送信装置20B間で継承を行うことができない場合であっても、学習した結果が失われてしまうことを防ぐことができる。
この場合、同一線路で接続される他の装置からの干渉を避けながら最小の電力消費で情報を送信することができる。有線通信の一例としては、バス接続、スター接続、メッシュ接続などの一体多、多対多の有線通信方式であってもよい。具体的には、インターネット、I2C(Inter-Integrated Circuit)、SPI(Serial Peripheral Interface)、CAN(Controller Area Network)等の通信方式であってもよい。
Claims (17)
- 自身とは別個の装置である第1装置から、前記第1装置の内部状態を示す内部状態情報を取得する内部状態取得部と、
取得した前記内部状態情報を記憶する内部状態記憶部と、
記憶された前記内部状態情報に基づいた処理を行う演算部と、
前記内部状態記憶部に記憶された前記内部状態情報を、所定の継承タイミングにおいて前記第1装置とは別個の装置である第2装置に出力する内部状態出力部と
を備える通信装置。 - 前記内部状態記憶部に記憶された前記内部状態情報は、前記演算部により行われた処理に基づいて更新される
請求項1に記載の通信装置。 - 前記演算部は、機械学習アルゴリズムを含み、
前記内部状態情報は、前記機械学習アルゴリズムにより学習された学習済みパラメータを含む
請求項1又は請求項2に記載の通信装置。 - 前記機械学習アルゴリズムとは、強化学習アルゴリズムであって、
前記内部状態情報は、前記強化学習アルゴリズムによって用いられる行動価値関数を含む
請求項3に記載の通信装置。 - 前記演算部は、前記内部状態記憶部に記憶された前記内部状態情報に基づいて、情報通信を行うための通信パラメータを演算し、
前記演算部により演算された通信パラメータに応じた情報通信を行う無線通信部を更に備える
請求項1から請求項4のいずれか一項に記載の通信装置。 - 前記継承タイミングに関する情報を含む継承タイミング情報を取得する継承タイミング情報取得部を更に備え、
前記内部状態出力部は、取得された前記継承タイミング情報に含まれる前記継承タイミングに関する情報に基づいて、前記内部状態情報を出力する
請求項1から請求項5のいずれか一項に記載の通信装置。 - 前記継承タイミング情報取得部は、自装置を駆動する電源の電池残量に関する情報を、前記継承タイミング情報として取得し、
前記内部状態出力部は、前記電池残量が所定の閾値を下回った場合に、前記内部状態情報を出力する
請求項6に記載の通信装置。 - 自装置が故障状態にあるか否かを判定する故障判定部を更に備え、
前記継承タイミング情報取得部は、前記故障判定部により判定された結果を、前記継承タイミング情報として取得し、
前記内部状態出力部は、自装置が故障状態にある場合に、前記内部状態情報を出力する
請求項6に記載の通信装置。 - 前記継承タイミング情報は、所定の周期に関する情報を含み、
前記内部状態出力部は、取得した前記継承タイミング情報に含まれる所定の周期で前記内部状態情報を出力する
請求項6に記載の通信装置。 - 前記内部状態取得部が前記内部状態情報を取得した時点において、前記演算部は休止状態であり、前記内部状態取得部及び前記内部状態出力部は休止状態でない
請求項1から請求項9のいずれか一項に記載の通信装置。 - 請求項1から請求項10のいずれか一項に記載の前記通信装置と、一以上の前記通信装置との間で前記内部状態情報の送受信を行う中継装置とを備え、
前記中継装置は、
前記通信装置により出力された前記内部状態情報を、中継情報として取得する中継情報取得部と、
取得した前記中継情報を記憶する中継情報記憶部と、
記憶された前記中継情報を、前記内部状態情報として前記通信装置に出力する中継情報出力部とを備え、
前記中継装置とは、前記第2装置である
通信システム。 - 前記通信装置が備える前記内部状態出力部は、所定の周期に基づいて前記中継装置に前記内部状態情報を出力し、
前記中継装置が備える前記中継情報出力部は、前記中継情報取得部が、所定期間以上前記通信装置から前記内部状態情報が取得されなかった場合に、前記中継情報を出力する
請求項11に記載の通信システム。 - 前記中継装置は、複数の前記通信装置から取得した前記中継情報に基づいて共有中継情報を生成する共有中継情報生成部を更に備え、
前記中継情報記憶部は、前記共有中継情報を前記中継情報として記憶し、
前記中継情報出力部は、前記共有中継情報を前記中継情報として出力する
請求項11又は請求項12に記載の通信システム。 - 前記共有中継情報生成部は、前記中継情報取得部が前記中継情報を取得したことをトリガーとして、前記共有中継情報を生成する
請求項13に記載の通信システム。 - 自装置の位置又は時刻の少なくとも一方に応じて変化する情報のうち、特定の瞬間に取得された情報である状態情報を記憶する状態記憶部を更に備え、
前記内部状態記憶部は、前記通信パラメータの演算に用いられる情報と、前記状態情報とを対応付けて前記内部状態情報として記憶し、
前記演算部は、状態記憶部に記憶された前記状態情報と、前記内部状態記憶部に記憶された前記内部状態情報とに基づき、前記通信パラメータを演算する
請求項5に記載の通信装置。 - 前記状態記憶部は、複数の瞬間に取得された前記状態情報を複数記憶し、
前記演算部は、蓄積された複数の前記状態情報に基づき、前記通信パラメータを決定する
請求項15に記載の通信装置。 - 自身とは別個の装置である第1装置から、前記第1装置の内部状態を示す内部状態情報を取得する内部状態取得工程と、
取得した前記内部状態情報を記憶する内部状態記憶工程と、
記憶された前記内部状態情報に基づいた処理を行う処理工程と、
記憶された前記内部状態情報を、所定の継承タイミングにおいて前記第1装置とは別個の装置である第2装置に出力する内部状態出力工程と
を有する通信方法。
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US18/701,836 US20250227569A1 (en) | 2021-10-27 | 2022-10-27 | Communication device, communication system, and communication method |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2021-175223 | 2021-10-27 | ||
| JP2021175223A JP7729549B2 (ja) | 2021-10-27 | 2021-10-27 | 通信装置、通信システム及び通信方法 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2023074792A1 true WO2023074792A1 (ja) | 2023-05-04 |
Family
ID=86159951
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/JP2022/040130 Ceased WO2023074792A1 (ja) | 2021-10-27 | 2022-10-27 | 通信装置、通信システム及び通信方法 |
Country Status (3)
| Country | Link |
|---|---|
| US (1) | US20250227569A1 (ja) |
| JP (1) | JP7729549B2 (ja) |
| WO (1) | WO2023074792A1 (ja) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN120882902A (zh) | 2023-04-12 | 2025-10-31 | 日本制铁株式会社 | 方向性电磁钢板及绝缘被膜的形成方法 |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003111127A (ja) * | 2001-09-27 | 2003-04-11 | Hitachi Kokusai Electric Inc | 無線通信装置 |
| JP2008171058A (ja) * | 2007-01-09 | 2008-07-24 | Fujitsu Ltd | システムコントローラ、プロセッサ、情報処理システムおよび情報処理プログラム |
| JP2008288940A (ja) * | 2007-05-18 | 2008-11-27 | Sumitomo Electric Ind Ltd | 路側通信装置及び通信システム |
| JP2013026980A (ja) * | 2011-07-25 | 2013-02-04 | Fujitsu Ltd | パラメータ設定装置、コンピュータプログラム及びパラメータ設定方法 |
-
2021
- 2021-10-27 JP JP2021175223A patent/JP7729549B2/ja active Active
-
2022
- 2022-10-27 WO PCT/JP2022/040130 patent/WO2023074792A1/ja not_active Ceased
- 2022-10-27 US US18/701,836 patent/US20250227569A1/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003111127A (ja) * | 2001-09-27 | 2003-04-11 | Hitachi Kokusai Electric Inc | 無線通信装置 |
| JP2008171058A (ja) * | 2007-01-09 | 2008-07-24 | Fujitsu Ltd | システムコントローラ、プロセッサ、情報処理システムおよび情報処理プログラム |
| JP2008288940A (ja) * | 2007-05-18 | 2008-11-27 | Sumitomo Electric Ind Ltd | 路側通信装置及び通信システム |
| JP2013026980A (ja) * | 2011-07-25 | 2013-02-04 | Fujitsu Ltd | パラメータ設定装置、コンピュータプログラム及びパラメータ設定方法 |
Also Published As
| Publication number | Publication date |
|---|---|
| US20250227569A1 (en) | 2025-07-10 |
| JP2023064836A (ja) | 2023-05-12 |
| JP7729549B2 (ja) | 2025-08-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10142786B2 (en) | System and method for multi-beacon interaction and management | |
| US10091748B2 (en) | Communications node, system, and synchronizing method | |
| US11163034B2 (en) | Location system | |
| KR101828726B1 (ko) | 공조기 제어 시스템, 센서 기기 제어 방법 및 프로그램 | |
| CN100466577C (zh) | 传感器网络的数据查询方法和系统以及传感器节点 | |
| KR20110069264A (ko) | 무선 센서 네트워크에서의 전력 충전장치 및 방법 | |
| US10685326B1 (en) | Systems and methods for wirelessly monitoring inventory | |
| JP2017049896A (ja) | 無線通信システム、無線通信方法、およびセンサノード | |
| US20110309977A1 (en) | Power reduction in wireless applications | |
| US20240121719A1 (en) | Managing communication with and amongst mobile units | |
| JP2014517651A (ja) | 無線通信システム | |
| US20170094579A1 (en) | Sensor network system, data transmission method and sensor node used in sensor network system | |
| WO2023074792A1 (ja) | 通信装置、通信システム及び通信方法 | |
| WO2023074801A1 (ja) | 通信装置、通信システム及び通信方法 | |
| KR20190078677A (ko) | 원격 검침 시스템, 그 시스템에 적용되는 원격검침단말장치 및 원격검침단말장치의 동작 방법 | |
| US12457557B2 (en) | Terminal device communication | |
| CN111343700A (zh) | 无线传感网络通信方法 | |
| JP7784078B2 (ja) | 送信装置、通信システム、送信方法及びプログラム | |
| WO2026048003A1 (ja) | 空間型電力伝送システム | |
| CN114009101B (zh) | 长距离无线网络管理器及延长终端设备的电池寿命的方法 | |
| US10985984B1 (en) | Systems and methods for upgrading scripts on low power devices | |
| US20150257018A1 (en) | Communication apparatus, communication system and energy management apparatus | |
| WO2025172832A1 (en) | Terminal device communication | |
| CA3092910C (en) | Selecting power consumption modes of electronic devices | |
| WO2025172835A1 (en) | Terminal device communication |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22887117 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 18701836 Country of ref document: US |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 22887117 Country of ref document: EP Kind code of ref document: A1 |
|
| WWP | Wipo information: published in national office |
Ref document number: 18701836 Country of ref document: US |