WO2020108472A1 - 编码方法、译码方法及装置 - Google Patents
编码方法、译码方法及装置 Download PDFInfo
- Publication number
- WO2020108472A1 WO2020108472A1 PCT/CN2019/120898 CN2019120898W WO2020108472A1 WO 2020108472 A1 WO2020108472 A1 WO 2020108472A1 CN 2019120898 W CN2019120898 W CN 2019120898W WO 2020108472 A1 WO2020108472 A1 WO 2020108472A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- neural network
- initial
- input information
- information
- decoding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- H—ELECTRICITY
- H03—ELECTRONIC CIRCUITRY
- H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
- H03M13/00—Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes
- H03M13/65—Purpose and implementation aspects
- H03M13/6597—Implementations using analogue techniques for coding or decoding, e.g. analogue Viterbi decoder
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
- G06F17/10—Complex mathematical operations
- G06F17/16—Matrix or vector computation, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
- G06F18/2413—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on distances to training or reference patterns
- G06F18/24133—Distances to prototypes
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
- G06N3/0455—Auto-encoder networks; Encoder-decoder networks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/0499—Feedforward networks
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/084—Backpropagation, e.g. using gradient descent
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/09—Supervised learning
-
- H—ELECTRICITY
- H03—ELECTRONIC CIRCUITRY
- H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
- H03M13/00—Coding, decoding or code conversion, for error detection or error correction; Coding theory basic assumptions; Coding bounds; Error probability evaluation methods; Channel models; Simulation or testing of codes
- H03M13/03—Error detection or forward error correction by redundancy in data representation, i.e. code words containing more digits than the source words
- H03M13/05—Error detection or forward error correction by redundancy in data representation, i.e. code words containing more digits than the source words using block codes, i.e. a predetermined number of check bits joined to a predetermined number of information bits
- H03M13/13—Linear codes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L25/00—Baseband systems
- H04L25/02—Details ; arrangements for supplying electrical power along data transmission lines
- H04L25/03—Shaping networks in transmitter or receiver, e.g. adaptive shaping networks
- H04L25/03006—Arrangements for removing intersymbol interference
- H04L25/03165—Arrangements for removing intersymbol interference using neural networks
Definitions
- Embodiments of the present application relate to the field of communications, and in particular, to an encoding method, decoding method, and device.
- the encoder/decoder needs to learn the samples of the entire codeword space, and the special length of the polarization code (Polar) leads to the code length.
- the number of spatial code sequences in the corresponding total codebook increases exponentially. Therefore, in the prior art, when the number of information bits is large, the complexity of traversing the entire codeword space increases sharply, and the implementation is difficult.
- the present application provides an encoding method, a decoding method, and a device, which can weaken the influence of code length on the traversal of codeword space to a certain extent, thereby improving the learning efficiency of encoding/decoding.
- an embodiment of the present application provides an encoding method, which may include: acquiring first input information; then, based on an encoding neural network, encode the acquired first input information to obtain first output information, and then , Output the first output information; wherein, the coding neural network contains the first neuron parameter, and the first neuron parameter can be used to indicate the mapping relationship between the first input information and the first output information; and, the coding neural network
- the initial coding neural network composed of the first neural network unit is obtained after training; wherein, the initial coding neural network contains a mapping between the second input information that can be used to indicate the input of the initial coding neural network and the output second output information
- the second neuron parameter of the relationship and, after the initial coding neural network is trained, the second neuron parameter is updated to the first neuron parameter; and, the second neuron parameter is the third nerve included in the first neural network unit
- a meta-parameter composition where the third neuron parameter is used to indicate the mapping relationship between the third input information input by the first neural network unit and the
- the step of acquiring the first neural network unit may further include: constructing a first initial neural network unit and setting a first initial neuron parameter, where the first initial neuron parameter is used to indicate The mapping relationship between the fourth input information input by the first initial neuron and the output fourth output information, where the first initial neuron parameter includes an initial weight value and an initial bias vector; and, the first initial neural network unit At least one hidden layer is included, and each hidden layer contains Q nodes, and Q is an integer greater than or equal to N, where N is the minimum value between the code length of the third input information and the code length of the third output information; Based on the first initial neuron parameters, the first initial neural network unit is trained until the error between the expected verification result of the fourth output information and the fourth input information is less than the threshold, where the expected verification of the fourth input information The result is that the fourth input information is obtained after multiplication and addition on GF(2) based on the first kernel moment; and, when training the first initial neural network unit, the first initial neural parameter is updated to obtain the first Three neural parameters;
- an initial neural network unit is generated based on the first kernel matrix, and then the initial neural network unit is trained to generate a neural network unit corresponding to the first kernel matrix.
- the first kernel matrix is Or, the first kernel matrix is
- the kernel matrix based on different structures is realized to generate the corresponding neural network unit.
- the kernel matrix based on different structures is realized to generate the corresponding neural network unit.
- the initial coding neural network is composed of a first neural network unit and a second neural network unit; wherein, the second neural network unit includes a fourth neuron parameter, and the second neural network unit is composed of the first initial
- the neural network unit is obtained after training, and after the first initial neural network unit is trained, the first initial neuron parameter is updated to obtain a fourth neuron parameter, and the fourth neural parameter is not the same as the third neural parameter.
- a neural network unit having different neuron parameters and having the same structure is formed into a coding neural network.
- the initial coding neural network is composed of a first neural network unit and a third neural network unit
- the third neural network unit includes fifth neuron parameters;
- the expected verification result of the input information is obtained by performing multiplication and addition operations on the GF(2 m ) of the fifth input information based on the second kernel matrix; where the fifth input information is training information.
- the coding neural network is composed of multiple neural network units corresponding to different kernel matrices.
- the step of acquiring the initial encoding neural network includes: acquiring an encoding network graph, wherein the encoding network graph includes at least one encoding butterfly graph, and the encoding butterfly graph is used to indicate the encoding butterfly graph.
- the check relationship between the input information and the output information of the coded butterfly diagram match the first neural network unit with at least one coded butterfly diagram; replace the first neural network unit with the coded butterfly diagram that matches successfully, And get the initial coding neural network.
- a coding neural network composed of small neural network units is realized, so that it can be generalized to the entire codeword space through small learning samples.
- an embodiment of the present application provides a decoding method.
- the method may include: acquiring first input information, and then decoding the acquired first input information based on a decoding neural network to obtain and output the first An output information; wherein, the decoding neural network includes a first neuron parameter, and the first neuron parameter is used to indicate the mapping relationship between the first input information and the first output information; and, the decoding neural network is composed of the first
- the initial decoding neural network composed of neural network units is obtained after training; wherein, the initial decoding neural network contains a mapping relationship between the second input information indicating the input of the initial decoding neural network and the output second output information
- the step of acquiring the first neural network unit may include: constructing a first initial neural network unit and setting a first initial neuron parameter, where the first initial neuron parameter is used A mapping relationship between the fourth input information input by the initial neuron and the fourth output information output, wherein the first initial neuron parameter includes an initial weight value and an initial bias vector; and, the first initial neural network unit includes At least one hidden layer, each hidden layer contains Q nodes, and Q is an integer greater than or equal to N, where N is the minimum value between the code length of the third input information and the code length of the third output information;
- the first initial neuron parameter training the first initial neural network unit until the error between the fourth output information and the expected verification result of the fourth input information is less than the threshold, where the expected verification result of the fourth input information
- the fourth input information is obtained after multiplication and addition operations on GF(2 m ) based on the first kernel moment; and, when training the first initial neural network unit, the first initial neural parameter is updated to obtain the first Three neural parameters; among them, the fourth
- the first kernel matrix is Or, the first kernel matrix is
- the initial decoding neural network is composed of a first neural network unit and a second neural network unit; wherein, the second neural network unit includes a fourth neuron parameter, and the second neural network unit is composed of The first initial neural network unit is obtained after training, and after the first initial neural network unit is trained, the first initial neuron parameter is updated to obtain the fourth neuron parameter, and the fourth and third neural parameters Not the same.
- the initial decoding neural network is composed of a first neural network unit and a third neural network unit
- the third neural network unit includes a fifth neuron parameter
- the fifth neuron parameter is used to indicate The mapping relationship between the fifth input information input by the third neural network unit and the output fifth output information; and, the error between the expected verification result of the fifth output information and the fifth input information is less than the threshold, where The expected verification result of the five-input information is obtained by performing multiplication and addition operations on the GF(2 m ) of the fifth input information based on the second kernel matrix; where the fifth input information is training information.
- the step of acquiring the initial decoding neural network includes: acquiring a decoding network graph, wherein the decoding network graph includes at least one decoding butterfly graph, and the decoding butterfly graph is used to indicate Checking relationship between the input information of the decoding butterfly diagram and the output information of the decoding butterfly diagram; matching the first neural network unit with at least one decoding butterfly diagram; matching the first neural network unit pair successfully The decoding butterfly graph is replaced and the initial decoding neural network is obtained.
- an embodiment of the present application provides an encoding/decoding method, which may include: encoding and/or decoding first input information based on an encoding/decoding neural network; wherein, encoding/decoding neural
- the network includes the coding neural network according to any one of claims 1-7 and the decoding neural network according to claims 8-14.
- the neuron parameters in the coding neural network are not the same as the neuron parameters in the decoding neural network; or, the neuron parameters in the coding neural network and the neural in the decoding neural network The meta parameters are the same.
- the encoding/decoding neural network can be composed of an encoding neural network and a decoding neural network with the same neuron parameters. It can also be composed of coding neural network and decoding neural network with different neuron parameters.
- an embodiment of the present application provides an encoding device.
- the device may include: an acquisition module for acquiring first input information, and an encoding module for encoding the first input information based on an encoding neural network to obtain And output the first output information; wherein, the coding neural network contains the first neuron parameter, and the first neuron parameter is used to indicate the mapping relationship between the first input information and the first output information; and, the coding neural network consists of An initial coding neural network composed of a neural network unit is obtained after training; wherein, the initial coding neural network includes a first relationship indicating the mapping relationship between the second input information input by the initial coding neural network and the output second output information.
- the second neuron parameter is updated to the first neuron parameter; and, the second neuron parameter is composed of the third neuron parameter included in the first neural network unit ,
- the third neuron parameter is used to indicate the mapping relationship between the third input information input by the first neural network unit and the output third output information; and, the expected verification of the third output information and the third input information
- the error between the results is less than the threshold, where the expected verification result of the third input information is obtained by multiplying and adding the third input information on the Galois Field GF(2 m ) based on the first kernel matrix;
- the first input information is information to be encoded; and, the second input information and the third input information are training information.
- the encoding module is further configured to: construct a first initial neural network unit and set the first initial neuron parameter, where the first initial neuron parameter is used to indicate the input of the first initial neuron
- the first kernel moment is obtained after multiplication and addition on GF(2 m ); and, when training the first initial neural network unit, the first initial neural parameter is updated to obtain a third neural parameter; wherein,
- the first kernel matrix is Or, the first kernel matrix is
- the initial coding neural network is composed of a first neural network unit and a second neural network unit; wherein, the second neural network unit includes fourth neuron parameters, and the second neural network unit is composed of An initial neural network unit is obtained after training, and after the first initial neural network unit is trained, the first initial neuron parameter is updated to obtain a fourth neuron parameter, and the fourth and third neural parameters are not the same.
- the initial coding neural network is composed of a first neural network unit and a third neural network unit
- the third neural network unit includes a fifth neuron parameter
- the fifth neuron parameter is used to indicate the The mapping relationship between the fifth input information input by the three neural network unit and the output fifth output information; and, the error between the expected verification result of the fifth output information and the fifth input information is less than the threshold, where the fifth The expected verification result of the input information is obtained by performing multiplication and addition operations on the GF(2 m ) of the fifth input information based on the second kernel matrix; where the fifth input information is training information.
- the encoding module is further used to: obtain an encoding network graph, where the encoding network graph includes at least one encoding butterfly graph, and the encoding butterfly graph is used to indicate input information and encoding of the encoding butterfly graph Check relationship between the output information of the butterfly diagram; match the first neural network unit with at least one coded butterfly diagram; replace the first neural network unit with the matched coded butterfly diagram, and obtain the initial code Neural Networks.
- an embodiment of the present application provides a decoding apparatus.
- the apparatus may include: an acquisition module for acquiring first input information, and a decoding module for performing first input information based on a decoding neural network Decoding, obtaining and outputting first output information; wherein, the decoding neural network contains first neuron parameters, and the first neuron parameters are used to indicate the mapping relationship between the first input information and the first output information; and,
- the decoding neural network is obtained after the initial decoding neural network composed of the first neural network unit is trained; wherein, the initial decoding neural network includes the second input information and the second output for indicating the input of the initial decoding neural network
- the third neuron parameter included in the network unit wherein the third neuron parameter is used to indicate the mapping relationship between the third input information input by the first neural network unit and the output
- the decoding module is further configured to: construct a first initial neural network unit and set a first initial neuron parameter, where the first initial neuron parameter is used to indicate the first initial neuron input Mapping relationship between the fourth input information and the output fourth output information, wherein the first initial neuron parameter includes an initial weight value and an initial bias vector; and, the first initial neural network unit includes at least one hidden layer, Each hidden layer contains Q nodes, and Q is an integer greater than or equal to N, where N is the minimum value between the code length of the third input information and the code length of the third output information; based on the first initial neuron Parameters, train the first initial neural network unit until the error between the fourth output information and the expected verification result of the fourth input information is less than the threshold, where the expected verification result of the fourth input information is the fourth input information Obtained by multiplying and adding on GF(2 m ) based on the first kernel moment; and, when training the first initial neural network unit, the first initial neural parameter is updated to obtain a third neural parameter;
- the first kernel matrix is Or, the first kernel matrix is
- the initial decoding neural network is composed of a first neural network unit and a second neural network unit; wherein, the second neural network unit includes a fourth neuron parameter, and the second neural network unit is composed of The first initial neural network unit is obtained after training, and after the first initial neural network unit is trained, the first initial neuron parameter is updated to obtain the fourth neuron parameter, and the fourth and third neural parameters Not the same.
- the initial decoding neural network is composed of a first neural network unit and a third neural network unit
- the third neural network unit includes a fifth neuron parameter
- the fifth neuron parameter is used to indicate The mapping relationship between the fifth input information input by the third neural network unit and the output fifth output information
- the expected verification result of the five-input information is obtained by performing multiplication and addition operations on the GF(2 m ) of the fifth input information based on the second kernel matrix; where the fifth input information is training information.
- the decoding module is further used to: obtain a decoding network diagram, wherein the decoding network diagram includes at least one decoding butterfly diagram, and the decoding butterfly diagram is used to indicate the decoding butterfly diagram Checking relationship between the input information of the graph and the output information of the decoding butterfly diagram; matching the first neural network unit with at least one decoding butterfly diagram; matching the first neural network unit to the decoding butterfly that successfully matches The shape graph is replaced, and the initial decoding neural network is obtained.
- an embodiment of the present application provides an encoding/decoding system for encoding and/or decoding first input information based on an encoding/decoding neural network; wherein the system is for including claim 18 The encoding neural network of any one of -24 and the decoding neural network of claims 25-31.
- the neuron parameters in the coding neural network are different from the neuron parameters in the decoding neural network.
- the neuron parameters in the coding neural network are the same as the neuron parameters in the decoding neural network.
- an embodiment of the present application provides a computer-readable storage medium that stores a computer program, where the computer program includes at least one piece of code, and the at least one piece of code can be executed by a device to control the device to execute the first Aspect of the method.
- an embodiment of the present application provides a computer-readable storage medium that stores a computer program, the computer program includes at least one piece of code, and the at least one piece of code can be executed by a device to control the device to execute Aspect of the method.
- an embodiment of the present application provides a computer-readable storage medium that stores a computer program, where the computer program includes at least one piece of code, and the at least one piece of code can be executed by a device to control the device to execute a third Aspect of the method.
- an embodiment of the present application provides a computer program, which is used to execute the method described in the first aspect when the computer program is executed by a device.
- an embodiment of the present application provides a computer program, which is used to execute the method described in the second aspect when the computer program is executed by a device.
- an embodiment of the present application provides a computer program, which is used to execute the method described in the third aspect when the computer program is executed by a device.
- an embodiment of the present application provides a chip including a processing circuit and a transceiver pin.
- the transceiver pin and the processor communicate with each other through an internal connection channel, and the processor executes the method in the first aspect or any possible implementation manner of the first aspect to control the receiving pin to receive the signal, Control sending pins to send signals.
- an embodiment of the present application provides a chip including a processing circuit and a transceiver pin.
- the transceiver pin and the processor communicate with each other through an internal connection channel, and the processor executes the method in the second aspect or any possible implementation manner of the second aspect to control the receiving pin to receive the signal, Control sending pins to send signals.
- an embodiment of the present application provides a chip including a processing circuit and a transceiver pin.
- the transceiver pin and the processor communicate with each other through an internal connection channel, and the processor executes the method in the third aspect or any possible implementation manner of the third aspect to control the receiving pin to receive the signal, Control sending pins to send signals.
- an embodiment of the present application provides an encoding device.
- the device includes a memory for storing instructions or data, and at least one processor in communication with the memory.
- the processor may be used to support the operation of the encoding device.
- the instruction executes the method in the first aspect or any possible implementation manner of the first aspect.
- an embodiment of the present application provides a decoding device.
- the device includes a memory for storing instructions or data, and at least one processor in communication with the memory.
- the processor may be used to support the encoding device in The method in the second aspect or any possible implementation manner of the second aspect is executed when the instruction is executed.
- an embodiment of the present application provides an encoding/decoding device.
- the device includes a memory for storing instructions or data, and at least one processor in communication with the memory.
- the processor may be used to support encoding
- the device executes the method in the third aspect or any possible implementation manner of the third aspect when the instruction is executed.
- an embodiment of the present application provides an encoding/decoding system, which includes the encoding device and the decoding device according to the fourth and fifth aspects.
- FIG. 1 is a schematic diagram of a communication system provided by an embodiment of the present application.
- FIG. 2a is a schematic structural diagram of a base station according to an embodiment of the present application.
- 2b is a schematic structural diagram of a terminal according to an embodiment of the present application.
- FIG. 3 is a schematic diagram of a wireless communication process provided by an embodiment of the present application.
- FIG. 6 is one of the structural schematic diagrams of the initial neural network unit provided by the embodiment of the present application.
- FIG. 10 is a schematic flowchart of generating an initial encoding neural network provided by an embodiment of the present application.
- FIG. 11 is a schematic structural diagram of an encoding network diagram provided by an embodiment of the present application.
- FIG. 12 is a schematic structural diagram of an encoding butterfly diagram provided by an embodiment of the present application.
- FIG. 13 is a schematic structural diagram of an initial encoding neural network provided by an embodiment of the present application.
- 15 is one of the structural schematic diagrams of the initial neural network unit provided by the embodiment of the present application.
- 16 is a schematic flowchart of a decoding method provided by an embodiment of the present application.
- 17 is one of the structural schematic diagrams of the initial neural network unit provided by the embodiment of the present application.
- 21 is a schematic flowchart of a training method of an encoding/decoding neural network provided by an embodiment of the present application.
- 22 is one of the structural schematic diagrams of the initial neural network unit provided by the embodiment of the present application.
- FIG. 23 is a schematic structural diagram of an encoding device provided by an embodiment of the present application.
- FIG. 24 is a schematic structural diagram of a decoding device according to an embodiment of the present application.
- 25 is a schematic block diagram of an encoding device provided by an embodiment of the present application.
- 26 is a schematic block diagram of a decoding apparatus provided by an embodiment of the present application.
- first and second in the description and claims of the embodiments of the present application are used to distinguish different objects, rather than describing a specific order of objects.
- first target object and the second target object are used to distinguish different target objects, rather than describing a specific order of the target objects.
- words such as “exemplary” or “for example” are used as examples, illustrations or explanations. Any embodiments or design solutions described as “exemplary” or “for example” in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or design solutions. Rather, the use of words such as “exemplary” or “for example” is intended to present related concepts in a specific manner.
- multiple processing units refer to two or more processing units; multiple systems refer to two or more systems.
- FIG. 1 it is a schematic diagram of a communication system provided by an embodiment of the present application.
- the communication system includes a base station 100 and a terminal 200.
- the terminal 200 may be a computer, a smart phone, a telephone, a cable TV set-top box, a digital subscriber line router, and other devices.
- the number of base stations and terminals may be one or more, and the number of base stations and terminals of the communication system shown in FIG. 1 is merely an example of adaptability, which is not limited in this application.
- the above communication system can be used to support fourth generation (4G) access technology, such as long term evolution (LTE) access technology; or, the communication system can also support fifth generation (fifth generation, 5G) ) Access technology, such as new radio (NR) access technology; or, the communication system can also be used to support third-generation (3G) access technology, such as universal mobile communication system (universal mobile telecommunications) system (UMTS) access technology; or the communication system can also be used to support second generation (2G) access technology, such as global mobile communication system (global system for mobile communications, GSM) access technology; or, the The communication system can also be used for communication systems that support multiple wireless technologies, such as LTE technology and NR technology.
- 4G fourth generation
- 5G fifth generation
- 3G third-generation
- UMTS universal mobile telecommunications
- 2G global mobile communication system
- GSM global system for mobile communications
- the communication system can also be applied to narrow-band Internet of Things (Narrow Band-Internet of Things, NB-IoT), enhanced data rate GSM evolution system (Enhanced Data Evolution for GSM Evolution, EDGE), broadband code division multiple access system (Wideband Code Division Multiple Access, WCDMA), Code Division Multiple Access 2000 system (Code Division Multiple Access, CDMA2000), Time Division Synchronization Code Division Multiple Access System (Time Division-Synchronization Code Division Multiple Access, TD-SCDMA), long-term evolution system (LongTerm Evolution, LTE) and future-oriented communication technology.
- narrow-band Internet of Things Narrow Band-Internet of Things, NB-IoT
- EDGE Enhanced Data Evolution for GSM Evolution, EDGE
- WCDMA Wideband Code Division Multiple Access
- CDMA2000 Code Division Multiple Access 2000
- Time Division Synchronization Code Division Multiple Access System Time Division-Synchronization Code Division Multiple Access
- LTE LongTerm Evolution
- the base station 100 in FIG. 1 may be used to support terminal access, for example, it may be a base transceiver station (BTS) and base station controller (BSC) in a 2G access technology communication system, Node B (node B) and radio network controller (RNC) in the 3G access technology communication system, evolved node B (eNB), 5G access technology communication in the 4G access technology communication system Next generation base station (nNB, gNB), transmission and reception point (TRP), relay node (relay node), access point (AP), etc. in the system.
- BTS base transceiver station
- BSC base station controller
- Node B node B
- RNC radio network controller
- eNB evolved node B
- eNB evolved node B
- nNB Next generation base station
- TRP transmission and reception point
- relay node relay node
- AP access point
- the terminal in FIG. 1 may be a device that provides voice or data connectivity to users, for example, it may also be called a mobile station, subscriber unit, station, and terminal equipment. TE) etc.
- the terminal may be a cellular phone (cellular), a personal digital assistant (personal digital assistant, PDA), a wireless modem (modem), a handheld device (handheld), a laptop (laptop) computer, a cordless phone (cordless phone), wireless Local loop (wireless local loop, WLL) station, tablet computer (pad), etc.
- devices that can access the communication system, communicate with the network side of the communication system, or communicate with other objects through the communication system can be terminals in the embodiments of the present application, for example, intelligent transportation Terminals in automobiles and home appliances in smart homes, power meter reading instruments in smart grids, voltage monitoring instruments, environmental monitoring instruments, video monitoring instruments in smart security networks, cash registers, etc.
- the terminal may communicate with a base station, such as the base station 10 in FIG. 1. Communication between multiple terminals is also possible.
- the terminal can be statically fixed or mobile.
- Figure 2a is a schematic structural diagram of a base station.
- Figure 2a is a schematic structural diagram of a base station.
- the base station 100 includes at least one processor 101, at least one memory 102, at least one transceiver 103, at least one network interface 104, and one or more antennas 105.
- the processor 101, the memory 102, the transceiver 103 and the network interface 104 are connected, for example, through a bus.
- the antenna 105 is connected to the transceiver 103.
- the network interface 104 is used to connect the base station to other communication devices through a communication link. In the embodiment of the present application, the connection may include various interfaces, transmission lines or buses, etc., which is not limited in this embodiment.
- the memory in the embodiment of the present application may include at least one of the following types: read-only memory (ROM) or other types of static storage devices that can store static information and instructions, and random access memory (random access memory, RAM) or other types of dynamic storage devices that can store information and instructions can also be electrically erasable programmable read-only memory (Electrically, programmable-only memory, EEPROM).
- ROM read-only memory
- RAM random access memory
- EEPROM electrically erasable programmable read-only memory
- the memory may also be a compact disc-read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compact disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.) , Disk storage media or other magnetic storage devices, or any other media that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto.
- CD-ROM compact disc-read-only memory
- optical disc storage including compact disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.
- Disk storage media or other magnetic storage devices or any other media that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto.
- the memory 102 may exist independently and be connected to the processor 101.
- the memory 102 may also be integrated with the processor 101, for example, integrated in a chip.
- the memory 102 can store program codes for executing the technical solutions of the embodiments of the present application, and the execution is controlled by the processor 101.
- Various executed computer program codes can also be regarded as the driver of the processor 101.
- the processor 101 is used to execute computer program code stored in the memory 102, so as to implement the technical solution in the embodiments of the present application.
- the transceiver 103 may be used to support the reception or transmission of radio frequency signals between the access network device and the terminal, and the transceiver 103 may be connected to the antenna 105.
- the transceiver 103 includes a transmitter Tx and a receiver Rx. Specifically, one or more antennas 105 can receive radio frequency signals, and the receiver Rx of the transceiver 103 is used to receive the radio frequency signals from the antenna, and convert the radio frequency signals into digital baseband signals or digital intermediate frequency signals, and convert the digital
- the baseband signal or digital intermediate frequency signal is provided to the processor 101, so that the processor 101 performs further processing on the digital baseband signal or digital intermediate frequency signal, such as demodulation processing and decoding processing.
- the transmitter Tx in the transceiver 103 is also used to receive the modulated digital baseband signal or digital intermediate frequency signal from the processor 101, and convert the modulated digital baseband signal or digital intermediate frequency signal into a radio frequency signal, and pass a Or multiple antennas 105 transmit the radio frequency signal.
- the receiver Rx can selectively perform one-level or multi-level down-mixing processing and analog-to-digital conversion processing on the radio frequency signal to obtain a digital baseband signal or a digital intermediate frequency signal.
- the sequence is adjustable.
- the transmitter Tx can selectively perform one-level or multi-level up-mixing processing and digital-to-analog conversion processing on the modulated digital baseband signal or digital intermediate frequency signal to obtain a radio frequency signal.
- the up-mixing processing and digital-to-analog conversion processing The sequence is adjustable.
- Digital baseband signals and digital intermediate frequency signals can be collectively referred to as digital signals.
- FIG. 2b is a schematic structural diagram of a terminal.
- Figure 2b is a schematic structural diagram of a terminal.
- the terminal 200 includes at least one processor 201, at least one transceiver 202, and at least one memory 203.
- the processor 201, the memory 203 and the transceiver 202 are connected.
- the terminal 200 may further include one or more antennas 204.
- the antenna 204 is connected to the transceiver 202.
- the transceiver 202, the memory 203, and the antenna 204 may refer to the related description in FIG. 2a to implement similar functions.
- the processor 201 may be a baseband processor or a CPU, and the baseband processor and the CPU may be integrated together or separated.
- the processor 201 may be used to implement various functions for the terminal 200, for example, to process communication protocols and communication data, or to control the entire terminal 200, execute a software program, and process data of the software program; or the processor 201 It is used to realize one or more of the above functions.
- the terminal and the base station are mutually a sending end and a receiving end, that is, when the terminal sends a signal to the base station, the terminal serves as the sending end, and the base station serves as the receiving end.
- the base station serves as the sending end
- the terminal serves as the receiving end.
- the source is sent out after source coding, channel coding, and modulation mapping.
- the sink is sequentially output through demapping demodulation, channel decoding, and source decoding.
- the coding process (source coding, channel coding, and modulation mapping steps) in FIG. 3 is performed by the terminal, and when the terminal is the receiving end, the decoding process in FIG. 3 (Steps such as mapping demodulation, channel decoding and source decoding) are executed by the terminal.
- the base station is the same.
- Current channel coding/decoding methods include but are not limited to: Hamming code and Polar code.
- the learning process of coding and decoding is mainly for the samples of the entire codeword space.
- the coding/decoding method with a long code length such as the Polar code
- an embodiment of the present application proposes an encoding/decoding method that can be generalized to the entire codeword space by sampling a small range of the codeword space.
- the method forms a coding/decoding neural network through a neural network unit generated based on coding/decoding, and then encodes and/or decodes the information to be coded according to the coding/decoding neural network.
- FIG. 4 is a schematic flowchart of an encoding method in an embodiment of the present application.
- FIG. 4 :
- Step 101 Generate a neural network unit.
- the encoding device may generate the initial neural network unit based on the kernel matrix, and then, the encoding device trains the initial neural network unit so that the output value of the initial neural network unit is close to the desired optimization target. Then, the initial neural network unit after training is the neural network unit. Among them, the initial neuron parameters included in the initial neural network unit are updated to the neuron parameters included in the neural network unit after training. And, if the output value is close to the desired optimization goal, the error between the output information output by the initial network unit and the expected verification result corresponding to the input input information is less than the threshold.
- the expected verification result of the input information is obtained after the input information is multiplied and added on the Galois Field (GF) (GF) based on the kernel matrix corresponding to the initial neural network unit.
- GF Galois Field
- the error between the output information and the expected verification result of the input information may be the difference between the output information and the expected verification result.
- the error between the output information and the expected verification result of the input information may be the mean square difference between the output information and the expected verification result.
- the operator can set the method for obtaining the error between the output information and the expected verification result according to the actual needs, which is not limited in this application.
- the threshold corresponding to the error between the output information and the expected verification result can also be set accordingly according to the way the error is obtained.
- Figure 5 is a schematic diagram of the process of generating the neural network unit.
- Step 1011 construct an initial neural network unit.
- the coding formula of the Polar code can be expressed by the following formula (1):
- x is the output information
- u is the input information
- G is the encoding matrix.
- G can also be called a generating matrix, that is, the generating matrix is one of the encoding matrices.
- both the input information and the output information contain at least one bit of information.
- n indicates that the coding neural network formed based on G may be composed of one or more neural network units corresponding to the same kernel matrix.
- the encoding device may acquire the neural network unit based on the kernel matrix. Specifically, the encoding device obtains the calibration corresponding to the expected verification result of the input information of the neural network unit (to distinguish the input information of other neural networks or neural network units, hereinafter referred to as input information 4) based on formula (1) and formula (2) Test equations.
- x 0 and x 1 are output information 4
- u 0 and u 1 are input information 4.
- x 0 , x 1 and x 2 are output information 4, and u 0 , u 1 and u 2 are input information 4.
- T can be obtained through a look-up table (for example, the value in Table (1)) or can be obtained through calculation.
- the specific obtaining method can refer to the prior art, which will not be repeated in this application.
- the initial neural network unit includes an input layer, an output layer, and at least one hidden layer.
- the initial neural network unit further includes an initial neuron parameter, which is used to indicate the mapping relationship between the input information 4 and the output information 4, wherein the initial neuron parameter may include: an initial weight value w and the initial offset vector b. It should be noted that the initial neuron parameters are generally randomly generated.
- the hidden layer in the initial neural network unit includes Q nodes.
- Q is greater than or equal to N
- N is the minimum value between the code length of the input information and the code length of the output information.
- the number of hidden layers may be one or more than one, where the more hidden layers, the greater the complexity of the neural network, but the stronger its generalization ability. Therefore, when setting the number of hidden layers of the initial neural network unit and other neural networks in the application examples, the operator can set the number based on actual requirements, combined with factors such as the processing power and computing power of the device, and this application is not limited.
- the encoding device constructs an initial neural network unit based on the kernel matrix T 2 , where the expected verification result corresponding to the initial neural network unit constructed based on T 2 is shown on the output side of the initial neural network unit of FIG. 6, and the formula ( 3).
- the number of nodes in the hidden layer is greater than the code length of the input information and output information. That is, when the code length of the input information and the input information is 2, the number of nodes in the hidden layer is an integer greater than 2.
- the initial neural network unit has one hidden layer, and the hidden layer has 3 nodes as an example for detailed description.
- Step 1012 Train the initial neural network unit to generate a neural network unit.
- the encoding device may train the initial neural network unit based on the initial neuron parameters until the error between the output information 4 and the expected verification result of the input information 4 is less than the threshold.
- the compilation device trains the initial neural network unit based on the input information 4, the expected verification result of the input information 4, and the initial neuron parameters.
- the training process is as follows:
- the input h of the next layer of neurons is the output of the neuron in the previous layer connected to it based on the initial Neuron parameters (an initial weight value w is set on each line between the two layers, and an initial bias vector b is set on each node) (the specific values of neuron parameters are not shown in Figure 6 For the setting method, please refer to the prior art, which will not be repeated in this application.) Weighted summation is performed, and then the activation function is passed.
- the input h of each neuron is shown in formula (5):
- the output y of the neural network (that is, the input information 4 output by the initial neural network in the embodiment of the present application) can be recursively expressed as:
- the input information 4: [0, 1] of the initial neural network unit is calculated based on formula (5) and formula (6), and the output information is obtained (to distinguish other training results, hereinafter referred to as training result 1) .
- the encoding device obtains the error value between the training result 1 and the expected verification result [1, 1].
- the calculation method of the error value is as described above, that is, the difference between the training result 1 and the expected verification result, or the mean square value.
- the loss function For specific details of obtaining the loss function, reference may be made to the prior art embodiments, which will not be repeated in this application.
- the encoding device can calculate the residuals of the output layer by propagating the direction of the error, and then weight-add the residuals of the nodes in each layer layer by layer. Subsequently, based on the learning rate, each The residual value of the node updates the weight of the first layer (that is, the weight between the input layer and the hidden layer), and loops the above method to update the corresponding weight layer by layer.
- the input information 4 is trained again, and the training result 2 is obtained, and the above steps are repeated, that is, the initial neuron parameters are repeatedly updated until the training result n output by the initial neural network is equal to It is expected that the error between the verification results is less than the target value (for example: the target value can be 0.0001), which can confirm the convergence of the training results.
- the target value for example: the target value can be 0.0001
- the above training method is a gradient descent method, and the encoding device may iteratively optimize the initial weight value w and the initial offset vector b through the gradient descent method, so that the loss function reaches the minimum value.
- the encoding device may iteratively optimize the initial weight value w and the initial offset vector b through the gradient descent method, so that the loss function reaches the minimum value.
- the encoding device can also train the initial neural network unit and other neural networks in the embodiments of the present application through other training methods, the purpose of which is to make the output value of the neural network close to the optimization target and update the neurons therein parameter.
- the encoding device is based on a kernel matrix Generate the initial neural network unit, then, the generated initial neural network unit is shown in FIG. 7. Among them, for the input information [u 0 , u 1 , u 2 ], the expected verification result of the input information obtained based on T 3 is:
- the encoding device is based on a kernel matrix Generate the initial neural network unit, then the generated initial neural network unit is shown in Figure 8.
- the initial neural network unit after training is the neural network unit in the embodiment of the present application.
- the initial neural network unit updates the initial neuron parameters it contains to neuron parameters (that is, the third neuron parameter in the embodiment of the present application, hereinafter referred to as neuron parameter 3).
- the neuron parameters included in the obtained neural network unit after training are also different. That is, corresponding to a kernel matrix, there may be multiple initial neural network units, and each initial neural network unit contains different neuron parameters, and the output information it outputs is the same, that is, although the above multiple initial neural network units include Different neuron parameters, however, have the same coding ability.
- Step 102 Generate an initial coding neural network.
- the encoding device may generate an initial encoding neural network based on the neural network unit generated in step 101. That is, the initial coding neural network is composed of one or more neural network units. Among them, the neuron parameter 2 is included in the initial coding nerve, and the neuron parameter 2 is composed of the neuron parameter 3 included in the neural network unit, that is, the neuron parameter included in one or more neural network units constituting the initial coding neural network 2 Make up the initial neuron parameters of the initial coding neural network. Subsequently, the encoding device trains the initial encoding neural network to update the initial neuron parameters.
- FIG. 10 it is a schematic flowchart of steps for generating an initial encoding neural network.
- FIG. 10 it is a schematic flowchart of steps for generating an initial encoding neural network.
- Step 1021 Obtain the coding network diagram.
- the encoding device may obtain the encoding network graph, where the encoding network graph includes at least one encoding butterfly graph, and the encoding butterfly graph is used to indicate the input information and encoding of the encoding butterfly graph The check relationship between the output information of the butterfly chart.
- the coding network diagram can be provided by the system.
- Figure 11 is one of the coding network diagrams.
- Step 1022 Match the neural network unit with the coded butterfly diagram.
- step 1023 the neural network unit replaces the coded butterfly graph that matches successfully.
- the neural network unit generated based on T 2 can be replaced with the coded butterfly graph in the coding network diagram in FIG. 11 that is successfully matched with the neural network unit generated based on T 2 .
- the encoding device matches the neural network unit with the encoding butterfly diagram in the encoding network diagram one by one.
- the matching method is:
- the neural network unit generated based on T 2 can refer to FIG. 6, that is, the code length of the input information and output information of neural network unit 1 are both 2, namely It can be confirmed that the neural network unit 1 is a 2 ⁇ 2 neural network unit.
- the encoding device may search for the encoding butterfly diagram with the same structure of 2 ⁇ 2 in the encoding network diagram.
- the encoding device can successfully match the neural network unit 1 with the neural unit 1 in the encoding network diagram, that is, all the encoded butterfly images with a 2 ⁇ 2 structure are replaced with the neural network unit 1, to obtain the initial encoded neural network, such as Shown in Figure 12.
- the initial coding neural network may be composed of any one or more neural network units in the set of neural network units. That is, any one or more neural network units in the set of neural network units may be replaced with the coded butterfly diagram in the coded network diagram.
- the initial coding neural network corresponding to the generator matrix G may be composed of neural network units in the set of neural network units corresponding to different kernel matrices.
- the neural network unit set 1 corresponding to the nuclear matrix T2 includes ⁇ neural network unit 1, neural network unit 2, neural network unit 3 ⁇
- the neural network unit 2 corresponding to the nuclear matrix T3 includes: ⁇ neural network unit 4,
- the coding network diagram acquired by the coding device includes at least one coding butterfly diagram with a 2 ⁇ 2 structure and at least one coding butterfly diagram with a 3 ⁇ 3 structure.
- the encoding device may match the neural network unit 1, the neural network unit 3, and the neural network unit 5 to the encoded butterfly images one by one, and replace the encoded butterfly images successfully matched to obtain an initial encoded neural network.
- Step 103 Train the initial coding neural network to obtain the coding neural network.
- the encoding device may train the initial encoding neural network based on the neuron parameter 2 (consisting of the neuron parameter 1) of the initial encoding neural network and the activation function until the initial encoding neural network outputs The error between the output information 2 and the expected verification result of the input information 2 is less than the threshold. And, after the initial coding neural network is trained, the neuron parameter 2 is updated.
- the trained initial coding neural network is the coding neural network
- the updated neuron parameter 2 is the corresponding neuron parameter 1 of the coding neural network, where the neuron parameter 1 is used to encode the nerve
- Step 104 Obtain input information.
- the encoding device may obtain information that needs to be encoded (that is, the information to be encoded in the embodiment of the present application) from other devices (for example, input devices of terminals) that are in communication with it ), that is to enter information.
- Step 105 Based on the coding neural network, encode the input information to obtain and output the output information.
- the encoding device may encode the acquired input information (to distinguish other input information, hereinafter referred to as input information 1) based on the generated encoding neural network to obtain output information 1, and output the output information 1 output.
- input information 1 to distinguish other input information
- the specific encoding process is as follows: the encoding device performs weighted summation of the input information 1 based on the neuron parameter 1, and then performs calculation based on the activation function to obtain output information 1.
- the encoding device performs weighted summation of the input information 1 based on the neuron parameter 1, and then performs calculation based on the activation function to obtain output information 1.
- the technical solutions in the embodiments of the present application can generate the corresponding neural network unit based on the kernel matrix, and then form the neural network unit into a coding network.
- a large nerve Network After connecting the small neural network unit, a large nerve Network, so that in the learning process of encoding, it can generalize to the entire codeword space through small learning samples, and weaken the information with longer codewords, such as: the effect of Polar code on the complexity of the neural network and the difficulty of learning .
- Scenario 1 mainly gives a detailed example of the process of generating the encoding network of the Polar code.
- the encoding method in the embodiment of the present application can be used as a general encoding method, that is, can be used in other encoding methods, such as Reed-Solomon (RS) code Hamming code, Bose–Chaudhuri–Hocquenghem (BCH) code, convolutional code, turbo code, low-density parity-check (LDPC) code, etc. (hereinafter referred to as Universal coding).
- RS Reed-Solomon
- BCH Bose–Chaudhuri–Hocquenghem
- convolutional code turbo code
- LDPC low-density parity-check
- FIG. 14 is a schematic flowchart of an encoding method in an embodiment of the present application.
- FIG. 14 :
- Step 201 Generate a neural network unit.
- the codeword c of the input information u with an arbitrary length k 1 can be expressed by formula (9):
- the information bit length of u is k 2 .
- the dimension of the coding matrix G is: k 1 ⁇ k 2 .
- the encoding device can generate an initial neural network unit corresponding to the kernel matrix.
- the encoding device trains the initial neural network unit until the output information is close to the expected verification result.
- the specific details of the training can refer to scene one, which will not be repeated here.
- Step 202 generate an initial coding neural network.
- the encoding device can replace the butterfly diagram obtained by the neural network unit with the acquired encoding network diagram to obtain the initial encoding network.
- scenario 1 for the Hamming code, the encoding device can replace the butterfly diagram obtained by the neural network unit with the acquired encoding network diagram to obtain the initial encoding network.
- Step 203 Train the initial coding neural network to obtain the coding neural network.
- Step 204 Obtain input information.
- Step 205 based on the coding neural network, encode the input information to obtain and output the output information.
- FIG. 16 is a schematic diagram of a decoding method in an embodiment of the present application.
- FIG. 16 :
- Step 301 Generate a neural network unit.
- the decoding device may generate the initial neural network unit based on the kernel matrix, and then, the encoding device trains the initial neural network unit so that the output value of the initial neural network unit is close to the desired optimization target. Then, the initial neural network unit after training is the neural network unit. Among them, the initial neuron parameters included in the initial neural network unit are updated to the neuron parameters included in the neural network unit after training. And, if the output value is close to the desired optimization goal, the error between the output information output by the initial network unit and the expected verification result corresponding to the input input information is less than the threshold.
- the expected verification result of the input information is obtained by performing multiplication and addition operations on the GF(2) based on the kernel matrix corresponding to the initial neural network unit.
- x is the output information of the neural network unit
- y is the input information of the neural network unit.
- the input of each neural network unit or neural network is bit information
- the encoded neural network output is encoded After the channel information is processed, the bit information is converted into a likelihood ratio. Therefore, in this scenario, the input information of the neural network unit and the neural unit is the likelihood ratio of the channel output.
- the decoding device obtains the expected verification corresponding to the input information of the initial neural network unit based on formula (10) and formula (2) (where n in formula (2) is 1) As a result, an initial neural network unit is generated based on the input information and the expected verification result of the input information.
- the initial neural network unit is shown in Figure 18.
- the expected verification result of the input information obtained based on T 3 is:
- the initial neural network unit is shown in Figure 19.
- the expected verification result of the input information obtained based on T 4 is:
- the decoding device trains the initial neural network unit to obtain the neural network unit.
- the specific training process can refer to scenario 1, which is not repeated here.
- Step 302 Generate an initial decoding neural network.
- the decoding device may generate the initial coding neural network by the neural network unit generated in step 301. That is, the initial coding neural network is composed of one or more neural network units.
- Step 303 Train the initial decoding neural network to obtain a decoding neural network.
- the decoding device may train the initial decoding neural network to make the output information of the initial decoding neural network close to the expected decoding result, and perform the neuron parameters included in the decoding device. Update.
- the initial decoding neural network after training is the decoding neural network.
- the process of the decoding device training the decoding neural network based on the training information is different from the training process of the coding neural network in scene one, in which the coding neural network is trained by After training the input information (ie, training information), the error between the output information and the expected verification result of the input information is obtained, and then, based on the error, other training steps are performed and the neuron parameters are updated.
- the training process of the decoding neural network because the training information input by the decoding neural network is a likelihood ratio, in the decoding neural network, the process of seeking the loss parameters is: based on the output information and the desired decoding The result is the loss function.
- the desired decoding result is obtained by: encoding the encoding information (the encoding information is bit information) based on any encoding device (which may be the encoding device in the embodiments of the present application or other encoding devices) And output the encoding result.
- the encoding result is also bit information.
- the encoding information is the expected decoding result in this embodiment. That is, the training information input by the decoding neural network is the likelihood ratio value generated after the encoding result is processed by the channel. Therefore, the expected output value of the decoding neural network (that is, the expected decoding result) should be the encoding information.
- Step 304 Obtain input information.
- Step 305 Decode the input information based on the decoding neural network to obtain and output the output information.
- the decoding device may decode the received input information based on the generated decoding neural network to obtain output information, and output the output information.
- the specific decoding process is: the decoding device weights and sums the input information based on the neuron parameters, and then performs an operation based on the activation function to obtain output information.
- the technical solution in the embodiments of the present application can generate the corresponding neural network unit based on the kernel matrix, and then form the neural network unit into a decoding neural network.
- a large Neural network so that in the decoding learning process, it can be generalized to the entire codeword space through small learning samples, and weaken the information with longer codewords, such as: the complexity of the Polar code to the neural network and learning The impact of difficulty.
- FIG. 20 is a schematic flowchart of an encoding/decoding method in an embodiment of the present application.
- FIG. 20 is a schematic flowchart of an encoding/decoding method in an embodiment of the present application.
- FIG. 20 :
- Step 401 Generate an initial encoding/decoding neural network.
- the encoding/decoding device may generate an initial encoding/decoding neural network based on the encoding neural network and the decoding neural network described above.
- the encoding neural network and the decoding neural network in the initial encoding/decoding neural network may have the same neuron parameters.
- the encoding neural network and the decoding neural network in the initial encoding/decoding neural network can have the same neuron parameters.
- the encoding neural network and the decoding neural network in the initial encoding/decoding neural network may have different neuron parameters.
- the encoding neural network and the decoding neural network in the initial encoding/decoding neural network may have different neuron parameters.
- the Polar code is used as a detailed description.
- the encoding/decoding device may obtain the encoding neural network generated by the encoding device, where the encoding neural network has completed the training process in scenario 1, that is, the output information of the encoding neural network is close to the expected verification result.
- the encoding/decoding device can obtain the decoding neural network generated by the decoding device, wherein the decoding neural network can be a trained decoding neural network, that is, the output information of the decoding neural network is close to the expected verification result. Alternatively, it may be an untrained initial decoding neural network, that is, a decoding neural network having only initial neuron parameters.
- the encoding/decoding device can share the parameters of the obtained encoding neural network and decoding neural network. That is, the neuron parameters in the coding neural network are replaced with the neuron parameters in the decoding neural network (or initial decoding neural network) to generate an initial coding/decoding neural network.
- the encoding/decoding device may also acquire a decoding neural network that has completed training, and an encoding neural network that has completed training, or an initial encoding neural network that has not completed training.
- the coding/decoding can replace the neuron parameters in the decoding neural network with the neuron parameters in the coding neural network (or initial coding neural network) to generate the initial coding/decoding neural network.
- Step 402 Train the initial coding/decoding neural network to obtain a coding/decoding neural network.
- the coding/decoding device trains the initial coding/decoding neural network, and the trained initial coding/decoding neural network is the coding/decoding neural network.
- Figure 21 is a schematic flowchart of the initial coding/decoding neural network training method.
- Figure 21 is a schematic flowchart of the initial coding/decoding neural network training method.
- the encoding/decoding device inputs input information on the encoding neural network side of the encoding/decoding neural network, which may also be referred to as training information.
- the code length of the training information is the same as the code length of the encoding/decoding neural network.
- the encoding neural network in the initial encoding/decoding neural network encodes the training information, and obtains and outputs the encoding result. Then, after the channel processing, the encoding result is input to the decoding neural network, wherein the encoding result on the input decoding neural network side is the likelihood ratio.
- the input training information is the expected verification result of the encoding/decoding neural network.
- the encoding/decoding device can obtain the loss function based on the training information and the training result.
- the method of obtaining the loss function can also be: mean square error, difference value and other functions.
- the encoding/decoding device judges whether the result of the loss function has converged, that is, whether the error between the training information and the training result is greater than the threshold (for the specific details of the error, please refer to the embodiment in scenario 1 above), if it is less than the threshold , Then the training is over. If it is greater than or equal to the threshold, continue to the next step.
- the encoding/decoding device may optimize the encoding/decoding neural network through an optimizer.
- the optimization methods include but are not limited to: gradient encoding, etc. / Decoding neural network to iterate, and update the neuron parameters in the coding/decoding network, and share the updated neuron parameters to the coding neural network and the decoding neural network.
- the encoding/decoding device repeats the above training steps until the error between the training result and the training information is less than the threshold, or the number of training rounds reaches the threshold of training rounds, or the duration of training reaches the threshold of training duration.
- the initial coding/decoding neural network after training is the coding/decoding neural network.
- Step 403 Encode the input information based on the coding/decoding neural network to obtain and output the output information.
- the trained coding/decoding neural network may be divided into a coding neural network part and a decoding neural network part.
- the coding/decoding neural network encodes the input information through the coding neural network part to obtain and output the coding result, and then, the decoding neural network part decodes the coding result to obtain and output the decoding result (where, the translation The code result is the output information, and the decoding result is the same as the input information).
- the coding neural network may be installed in the terminal and/or base station, and the decoding neural network may be installed in the terminal and/or base station.
- the encoding neural network in the terminal encodes the information to be encoded (ie, input information), obtains and outputs the encoding result, and transmits the channel to the base station.
- the base station decodes the coding result through a decoding neural network to obtain and output the decoding result, which is the information to be coded.
- the encoding neural network in the base station encodes the information to be encoded, obtains and outputs the encoding result, and transmits the channel to the terminal.
- the terminal decodes the encoding result through a decoding neural network to obtain and output the decoding result, which is the information to be encoded.
- a coding/decoding neural network composed of coding/decoding neural networks with different neuron parameters, such as Hamming code, it can be directly coded through the coding and decoding neural networks on both sides without training And decoding.
- the technical solutions in the embodiments of the present application share the parameters of the encoding neural network and the decoding neural network, thereby improving the performance of the encoding/decoding neural network and reducing the complexity. And, through the coding/decoding neural network composed of coding neural network and decoding neural network, the learning cost and difficulty are reduced, and the learning efficiency is effectively improved.
- the encoding/decoding method in the embodiments of the present application may also be applied to a multi-domain.
- the generator matrix of the binary Polar code is composed of two elements "0" and "1”
- the generator matrix of the multivariate Polar code can be composed of zero elements and GF(2 m ) (where m is greater than The integer of 1) is composed of non-zero elements.
- the generation matrix of the multivariate Polar code can still be expressed as the Kronecker product operation based on the kernel matrix.
- the The 1 in is replaced with a non-zero element on GF(2 m ), such as Where j, k, l are natural numbers, then, according to formula (2), the generating matrix G of the multivariate Polar code can be expressed as In the multivariate domain, corresponding to The neural network unit is shown in Figure 22.
- the expected verification result of the input information obtained based on T 2 is:
- the encoding neural network or decoding neural network generated based on it can refer to the descriptions in scenes 1 to 3, which will not be repeated here.
- the encoding device, the decoding device, and/or the encoding/decoding device in the embodiments of the present application are used in a neural network unit or neural network (referring to an encoding neural network, a decoding neural network, and / Or encoding/decoding neural network)
- a neural network unit or neural network referring to an encoding neural network, a decoding neural network, and / Or encoding/decoding neural network
- preset conditions include but are not limited to: the number of training rounds is greater than the threshold of training rounds, that is, training can be stopped when the number of training rounds reaches the threshold of training rounds; the training duration is greater than the threshold of training duration, that is, when the training duration reaches When the training duration threshold is reached, you can stop training.
- the training condition can be A: the loss function is less than the loss function threshold (that is, the error between the output information described in the embodiments of the present application and the expected verification result is less than the threshold)
- Training condition B The number of training rounds is greater than the threshold of the number of training rounds. Then, when the loss function has not yet reached the loss function threshold, but the training round number has reached the training round number threshold, the training can be stopped. Thereby reducing training time and saving resources.
- the inputs of each neural network unit and neural network are training information
- the inputs of each neural network unit and neural network are information to be encoded.
- the training information of the neural network unit or neural network with the same structure may be the same as or different from the coding information, which is not limited in this application.
- the training phase (including the training part of the neural network unit and the training part of the neural network (coding neural network, decoding neural network, and/or coding/decoding neural network)) may be online Held, that is, the training result is directly input to the encoding device as input information.
- the training phase can also be held offline, that is, before the neural network unit and the neural network in the embodiments of the present application are applied, the training of the neural network unit and the neural network is completed.
- the encoding device 300 includes a processing unit 301 and a communication unit 302.
- the encoding device 300 further includes a storage unit 303.
- the processing unit 301, the communication unit 302, and the storage unit 303 are connected through a communication bus.
- the storage unit 303 may include one or more memories, and the memory may be one or more devices or devices in a circuit for storing programs or data.
- the storage unit 303 may exist independently, and is connected to the processing unit 201 through a communication bus.
- the storage unit may also be integrated with the processing unit 301.
- the encoding device 300 may be the terminal in the embodiment of the present application, for example, the terminal 200.
- the schematic diagram of the terminal may be as shown in FIG. 2b.
- the communication unit 302 of the encoding device 300 may include an antenna and a transceiver of the terminal, such as the antenna 205 and the transceiver 202 in FIG. 2b.
- the encoding device 300 may be a chip in the terminal in the embodiment of the present application, for example, a chip in the terminal 200.
- the communication unit 302 may be an input or output interface, a pin or a circuit, or the like.
- the storage unit may store computer-executed instructions of the method on the terminal side, so that the processing unit 301 executes the encoding method in the foregoing embodiment.
- the storage unit 303 may be a register, a cache, or RAM.
- the storage unit 302 may be integrated with the processing unit 301.
- the storage unit 303 may be a ROM or other type of static storage device that can store static information and instructions.
- the storage unit 303 may be The processing unit 301 is independent.
- the transceiver may be integrated on the encoding device 300, for example, the communication unit 302 integrates the transceiver 202.
- the encoding device 300 may be a base station in the embodiment of the present application, for example, the base station 100.
- the schematic diagram of the base station 100 may be as shown in FIG. 2a.
- the communication unit 302 of the encoding device 300 may include an antenna and a transceiver of the base station, such as the antenna 205 and the transceiver 203 in FIG. 2a.
- the communication unit 302 may also include a network interface of the base station, such as the network interface 204 in FIG. 2a.
- the encoding device 300 may be a chip in the base station in the embodiment of the present application, for example, a chip in the base station 100.
- the communication unit 302 may be an input or output interface, a pin or a circuit, or the like.
- the storage unit may store computer-executed instructions of the method on the base station side, so that the processing unit 301 executes the encoding method in the foregoing embodiment.
- the storage unit 32 may be a register, a cache, or RAM.
- the storage unit 303 may be integrated with the processing unit 301; the storage unit 303 may be a ROM or other type of static storage device that can store static information and instructions.
- the storage unit 303 may be The processing unit 301 is independent.
- the transceiver may be integrated on the encoding device 300, for example, the communication unit 302 integrates the transceiver 203 and the network interface 204.
- the encoding device 300 is a base station or a chip in the base station in the embodiment of the present application, the encoding method in the foregoing embodiment may be implemented.
- the decoding device 400 includes a processing unit 401 and a communication unit 402.
- the decoding device 400 further includes a storage unit 403.
- the processing unit 401, the communication unit 402, and the storage unit 403 are connected through a communication bus.
- the storage unit 403 may include one or more memories, and the memory may be one or more devices or devices in a circuit for storing programs or data.
- the storage unit 403 may exist independently, and is connected to the processing unit 201 through a communication bus.
- the storage unit may also be integrated with the processing unit 401.
- the decoding device 400 may be the terminal in the embodiment of the present application, for example, the terminal 200.
- the schematic diagram of the terminal can be shown in Figure 2b.
- the communication unit 403 of the decoding device 400 may include an antenna and a transceiver of the terminal, such as the antenna 205 and the transceiver 202 in FIG. 2b.
- the decoding device 400 may be a chip in the terminal in the embodiment of the present application, for example, a chip in the terminal 200.
- the communication unit 402 may be an input or output interface, a pin or a circuit, or the like.
- the storage unit may store computer-executed instructions of the method on the terminal side, so that the processing unit 401 executes the decoding method in the foregoing embodiment.
- the storage unit 403 may be a register, a cache, or RAM.
- the storage unit 403 may be integrated with the processing unit 401; the storage unit 403 may be a ROM or other type of static storage device that can store static information and instructions.
- the processing unit 401 is independent.
- the transceiver may be integrated on the decoding device 400, for example, the communication unit 402 integrates the transceiver 202.
- the decoding device 400 may be a base station in the embodiment of the present application, for example, the base station 100.
- the schematic diagram of the base station 100 may be as shown in FIG. 2a.
- the communication unit 402 of the decoding device 400 may include an antenna and a transceiver of the base station, such as the antenna 205 and the transceiver 203 in FIG. 2a.
- the communication unit 402 may also include a network interface of the base station, such as the network interface 204 in FIG. 2a.
- the decoding device 400 may be a chip in the base station in the embodiment of the present application, for example, a chip in the base station 100.
- the communication unit 403 may be an input or output interface, a pin or a circuit, or the like.
- the storage unit may store computer-executed instructions of the method on the base station side, so that the processing unit 401 executes the decoding method in the foregoing embodiment.
- the storage unit 32 may be a register, a cache, or a RAM, etc.
- the storage unit 403 may be integrated with the processing unit 401; the storage unit 403 may be a ROM or other type of static storage device that can store static information and instructions, and the storage unit 403 may be The processing unit 401 is independent.
- the transceiver may be integrated on the decoding device 400, for example, the communication unit 402 integrates the transceiver 203 and the network interface 204.
- the decoding device 400 is a base station or a chip in the base station in the embodiments of the present application, the decoding method in the above embodiments may be implemented.
- the encoding device 500 includes an acquisition module 501 and an encoding module 502.
- the obtaining module 501 is used for the related steps of “obtaining input information”.
- the support encoding device 500 executes steps 104 and 204 in the above method embodiment.
- the encoding module 502 is used for the relevant steps of “obtaining an encoding neural network”.
- the support encoding apparatus 500 executes step 101, step 102, step 103, step 201, step 202, and step 203 in the above method embodiment.
- the encoding module 502 can also be used for related steps of "encoding input information".
- the encoding device 500 is supported to execute steps 105 and 205 in the above method embodiment.
- the encoding device 500 may implement other functions of the encoding device in the embodiments of the present application through the acquisition module 501 and the encoding module 502. For details, reference may be made to the related content in the foregoing embodiments.
- the decoding device 600 includes an acquisition module 601 and a decoding module 602.
- the obtaining module 601 is used for the relevant steps of “obtaining input information”.
- the support encoding apparatus 500 executes step 404 in the above method embodiment.
- the decoding module 602 is used for the relevant steps of “obtaining a decoding neural network”. For example, the support decoding device 600 executes steps 301, 302, and 303 in the above method embodiment.
- the decoding module 602 can also be used for related steps of "decoding input information to obtain and output output information".
- the supporting decoding device 600 executes step 405 in the above method embodiment.
- the decoding device 600 may implement other functions of the decoding device in the embodiments of the present application through the obtaining module 601 and the decoding module 602. For details, reference may be made to the related content in the foregoing embodiments.
- the embodiments of the present application also provide a computer-readable storage medium.
- the methods described in the above embodiments may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. If implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium.
- Computer-readable media may include computer storage media and communication media, and may also include any media that can transfer a computer program from one place to another.
- a storage medium may be any available medium that can be accessed by a computer.
- the computer-readable medium may include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or use instructions or data structures
- the required program code is stored in the form of and can be accessed by the computer.
- any connection is properly termed a computer-readable medium.
- coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technology such as infrared, radio, and microwave
- coaxial cable, fiber optic cable , Twisted pair, DSL or wireless technologies such as infrared, radio and microwave are included in the definition of medium.
- magnetic disks and optical disks include compact disks (CDs), laser disks, optical disks, digital versatile disks (DVDs), floppy disks, and blu-ray disks, where magnetic disks generally reproduce data magnetically, while optical disks reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.
- the embodiments of the present application also provide a computer program product.
- the methods described in the above embodiments may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. If implemented in software, it can be implemented in whole or in part in the form of a computer program product.
- the computer program product includes one or more computer instructions. When the above computer program instructions are loaded and executed on the computer, all or part of the processes or functions described in the above method embodiments are generated.
- the above-mentioned computer may be a general-purpose computer, a dedicated computer, a computer network, a network device, user equipment, or other programmable devices.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Mathematical Physics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Computation (AREA)
- Computing Systems (AREA)
- Software Systems (AREA)
- Biophysics (AREA)
- Molecular Biology (AREA)
- General Health & Medical Sciences (AREA)
- Computational Linguistics (AREA)
- Biomedical Technology (AREA)
- Health & Medical Sciences (AREA)
- Probability & Statistics with Applications (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Bioinformatics & Computational Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Evolutionary Biology (AREA)
- Computational Mathematics (AREA)
- Mathematical Analysis (AREA)
- Mathematical Optimization (AREA)
- Pure & Applied Mathematics (AREA)
- Algebra (AREA)
- Databases & Information Systems (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
- Error Detection And Correction (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Description
Claims (36)
- 一种编码方法,其特征在于,包括:获取第一输入信息;基于编码神经网络,对所述第一输入信息进行编码,得到并输出第一输出信息;其中,所述编码神经网络中包含第一神经元参数,所述第一神经元参数用于指示所述第一输入信息与所述第一输出信息之间的映射关系;以及,所述编码神经网络由第一神经网络单元组成的初始编码神经网络经过训练后所得;其中,所述初始编码神经网络中包含用于指示所述初始编码神经网络输入的第二输入信息与输出的第二输出信息之间的映射关系的第二神经元参数;并且,所述初始编码神经网络经过训练后,将所述第二神经元参数更新为所述第一神经元参数;以及,所述第二神经元参数由所述第一神经网络单元包含的第三神经元参数组成,其中,所述第三神经元参数用于指示所述第一神经网络单元输入的第三输入信息与输出的第三输出信息之间的映射关系;以及,所述第三输出信息与所述第三输入信息的期望校验结果之间的误差小于阈值,其中,所述第三输入信息的期望校验结果为所述第三输入信息基于第一核矩阵在伽罗华二元域GF(2)上进行乘法和加法运算后得到的;其中,所述第一输入信息为待编码信息;以及,所述第二输入信息、所述第三输入信息为训练信息。
- 根据权利要求1所述的方法,其特征在于,获取所述第一神经网络单元的步骤,包括:构造所述第一初始神经网络单元,并设置所述第一初始神经元参数,其中,所述第一初始神经元参数用于指示所述第一初始神经元输入的第四输入信息与输出的第四输出信息之间的映射关系,其中,所述第一初始神经元参数包括初始权重值与初始偏置向量;以及,所述第一初始神经网络单元包括至少一个隐藏层,每个所述隐藏层包含Q个节点,并且,Q为大于等于N的整数,其中,N为所述第三输入信息的码长与所述第三输出信息的码长之中的最小值;基于所述第一初始神经元参数,对所述第一初始神经网络单元进行训练,直至所述第四输出信息与所述第四输入信息的期望校验结果之间的误差小于所述阈值,其中,所述第四输入信息的期望校验结果为所述第四输入信息基于所述第一核矩在GF(2)上进行乘法和加法运算后得到的;以及,对所述第一初始神经网络单元进行训练时,将所述第一初始神经参数进行更新,得到所述第三神经参数;其中,所述第四输入信息为训练信息。
- 根据权利要求2至4任一项所述的方法,其特征在于,其中,所述初始编码神经网络由所述第一神经网络单元与第二神经网络单元组成;其中,所述第二神经网络单元包含第四神经元参数,所述第二神经网络单元由所述第一初始神经网络单元训练后所得,并且,所述第一初始神经网络单元经过训练后,将所述第一初始神经元参数进行更新,得到所述第四神经元参数,以及,所述第四神经参数与所述第三神经参数不相同。
- 根据权利要求2至4任一项所述的方法,其特征在于,其中,所述初始编码神经网络由所述第一神经网络单元与第三神经网络单元组成,所述第三神经网络单元包含第五神经元参数;所述第五神经元参数用于指示所述第三神经网络单元输入的第五输入信息与输出的第五输出信息之间的映射关系;以及,所述第五输出信息与所述第五输入信息的期望校验结果之间的误差小于阈值,其中,所述第五输入信息的期望校验结果为所述第五输入信息基于第二核矩阵在GF(2)上进行乘法和加法运算后得到的;其中,所述第五输入信息为训练信息。
- 根据权利要求1所述的方法,其特征在于,获取所述初始编码神经网络的步骤,包括:获取编码网络图,其中,所述编码网络图中包括至少一个编码蝶形图,所述编码蝶形图用于指示所述编码蝶形图的输入信息与所述编码蝶形图的输出信息之间的校验关系;将所述第一神经网络单元与所述至少一个编码蝶形图进行匹配;将第一神经网络单元对匹配成功的编码蝶形图进行替换,并得到所述初始编码神经网络。
- 一种译码方法,其特征在于,包括:获取第一输入信息;基于译码神经网络,对所述第一输入信息进行译码,得到并输出第一输出信息;其中,所述译码神经网络中包含第一神经元参数,所述第一神经元参数用于指示所述第一输入信息与所述第一输出信息之间的映射关系;以及,所述译码神经网络由第一神经网络单元组成的初始译码神经网络经过训练后所得;其中,所述初始译码神经网络中包含用于指示所述初始译码神经网络输入的第二输入信息与输出的第二输出信息之间的映射关系的第二神经元参数;并且,所述初始译码神经网络经过训练后,将所述第二神经元参数更新为所述第一神经元参数;以及,所述第二神经元参数由所述第一神经网络单元包含的第三神经元参数组成,其中,所述第三神经元参数用于指示所述第一神经网络单元输入的第三输入信息与输出的第三输出信息之间的映射关系;以及,所述第三输出信息与所述第三输入信息的期望校验结果之间的误差小于阈值,其中,所述第三输入信息的期望校验结果为所述第三输入信息基于第一核矩阵在GF(2)上进行乘法和加法运算后得到的;其中,所述第一输入信息为待译码信息;以及,所述第二输入信息、所述第三输入信息为训练信息。
- 根据权利要求8所述的方法,其特征在于,获取所述第一神经网络单元的步骤,包括:构造所述第一初始神经网络单元,并设置所述第一初始神经元参数,其中,所述第一初始神经元参数用于指示所述第一初始神经元输入的第四输入信息与输出的第四输出信息之间的映射关系,其中,所述第一初始神经元参数包括初始权重值与初始偏置向量;以及,所述第一初始神经网络单元包括至少一个隐藏层,每个所述隐藏层包含Q个节点,并且,Q为大于等于N的整数,其中,N为所述第三输入信息的码长与所述第三输出信息的码长之中的最小值;基于所述第一初始神经元参数,对所述第一初始神经网络单元进行训练,直至所述第四输出信息与所述第四输入信息的期望校验结果之间的误差小于所述阈值,其中,所述第四输入信息的期望校验结果为所述第四输入信息基于所述第一核矩在GF(2)上进行乘法和加法运算后得到的;以及,对所述第一初始神经网络单元进行训练时,将所述第一初始神经参数进行更新,得到所述第三神经参数;其中,所述第四输入信息为训练信息。
- 根据权利要求9至11任一项所述的方法,其特征在于,其中,所述初始译码神经网络由所述第一神经网络单元与第二神经网络单元组成;其中,所述第二神经网络单元包含第四神经元参数,所述第二神经网络单元由所述 第一初始神经网络单元训练后所得,并且,所述第一初始神经网络单元经过训练后,将所述第一初始神经元参数进行更新,得到所述第四神经元参数,以及,所述第四神经参数与所述第三神经参数不相同。
- 根据权利要求9至11任一项所述的方法,其特征在于,其中,所述初始译码神经网络由所述第一神经网络单元与第三神经网络单元组成,所述第三神经网络单元包含第五神经元参数;所述第五神经元参数用于指示所述第三神经网络单元输入的第五输入信息与输出的第五输出信息之间的映射关系;以及,所述第五输出信息与所述第五输入信息的期望校验结果之间的误差小于阈值,其中,所述第五输入信息的期望校验结果为所述第五输入信息基于第二核矩阵在GF(2)上进行乘法和加法运算后得到的;其中,所述第五输入信息为训练信息。
- 根据权利要求8所述的方法,其特征在于,获取所述初始译码神经网络的步骤,包括:获取译码网络图,其中,所述译码网络图中包括至少一个译码蝶形图,所述译码蝶形图用于指示所述译码蝶形图的输入信息与所述译码蝶形图的输出信息之间的校验关系;将所述第一神经网络单元与所述至少一个译码蝶形图进行匹配;将第一神经网络单元对匹配成功的译码蝶形图进行替换,并得到所述初始译码神经网络。
- 一种编码/译码方法,其特征在于,包括:基于编码/译码神经网络,对第一输入信息进行编码和/或译码;其中,所述编码/译码神经网络包含权利要求1-7任一项所述的编码神经网络以及权利要求8-14所述的译码神经网络。
- 根据权利要求15所述的方法,其特征在于,其中,所述编码神经网络中的神经元参数与所述译码神经网络中的神经元参数不相同;或者,所述编码神经网络中的神经元参数与所述译码神经网络中的神经元参数相同。
- 一种编码装置,其特征在于,包括:获取模块,用于获取第一输入信息;编码模块,用于基于编码神经网络,对所述第一输入信息进行编码,得到并输出第一输出信息;其中,所述编码神经网络中包含第一神经元参数,所述第一神经元参数用于指示所述第一输入信息与所述第一输出信息之间的映射关系;以及,所述编码神经网络由第一神经网络单元组成的初始编码神经网络经过训练后所得;其中,所述初始编码神经网络中包含用于指示所述初始编码神经网络输入的第二输入信息与输出的第二输出信息之间的映射关系的第二神经元参数;并且,所述初始编码神经网络经过训练后,将所述第二神经元参数更新为所述第一神经元参数;以及,所述第二神经元参数由所述第一神经网络单元包含的第三神经元参数组成,其中,所述第三神经元参数用于指示所述第一神经网络单元输入的第三输入信息与输出 的第三输出信息之间的映射关系;以及,所述第三输出信息与所述第三输入信息的期望校验结果之间的误差小于阈值,其中,所述第三输入信息的期望校验结果为所述第三输入信息基于第一核矩阵在GF(2)上进行乘法和加法运算后得到的;其中,所述第一输入信息为待编码信息;以及,所述第二输入信息、所述第三输入信息为训练信息。
- 根据权利要求17所述的装置,其特征在于,所述编码模块还用于:构造所述第一初始神经网络单元,并设置所述第一初始神经元参数,其中,所述第一初始神经元参数用于指示所述第一初始神经元输入的第四输入信息与输出的第四输出信息之间的映射关系,其中,所述第一初始神经元参数包括初始权重值与初始偏置向量;以及,所述第一初始神经网络单元包括至少一个隐藏层,每个所述隐藏层包含Q个节点,并且,Q为大于等于N的整数,其中,N为所述第三输入信息的码长与所述第三输出信息的码长之中的最小值;基于所述第一初始神经元参数,对所述第一初始神经网络单元进行训练,直至所述第四输出信息与所述第四输入信息的期望校验结果之间的误差小于所述阈值,其中,所述第四输入信息的期望校验结果为所述第四输入信息基于所述第一核矩在GF(2)上进行乘法和加法运算后得到的;以及,对所述第一初始神经网络单元进行训练时,将所述第一初始神经参数进行更新,得到所述第三神经参数;其中,所述第四输入信息为训练信息。
- 根据权利要求18至20任一项所述的装置,其特征在于,其中,所述初始编码神经网络由所述第一神经网络单元与第二神经网络单元组成;其中,所述第二神经网络单元包含第四神经元参数,所述第二神经网络单元由所述第一初始神经网络单元训练后所得,并且,所述第一初始神经网络单元经过训练后,将所述第一初始神经元参数进行更新,得到所述第四神经元参数,以及,所述第四神经参数与所述第三神经参数不相同。
- 根据权利要求18至20任一项所述的装置,其特征在于,其中,所述初始编码神经网络由所述第一神经网络单元与第三神经网络单元组成,所述第三神经网络单元包含第五神经元参数;所述第五神经元参数用于指示所述第三神经网络单元输入的第五输入信息与输出的第五输出信息之间的映射关系;以及,所述第五输出信息与所述第五输入信息的期望校验结果之间的误差小于阈值,其中,所述第五输入信息的期望校验结果为所述第五输入信息基于第二核矩阵在GF(2)上进行乘法和加法运算后得到的;其中,所述第五输入信息为训练信息。
- 根据权利要求17所述的装置,其特征在于,所述编码模块还用于:获取编码网络图,其中,所述编码网络图中包括至少一个编码蝶形图,所述编码蝶形图用于指示所述编码蝶形图的输入信息与所述编码蝶形图的输出信息之间的校验关系;将所述第一神经网络单元与所述至少一个编码蝶形图进行匹配;将第一神经网络单元对匹配成功的编码蝶形图进行替换,并得到所述初始编码神经网络。
- 一种译码装置,其特征在于,包括:获取模块,用于获取第一输入信息;译码模块,用于基于译码神经网络,对所述第一输入信息进行译码,得到并输出第一输出信息;其中,所述译码神经网络中包含第一神经元参数,所述第一神经元参数用于指示所述第一输入信息与所述第一输出信息之间的映射关系;以及,所述译码神经网络由第一神经网络单元组成的初始译码神经网络经过训练后所得;其中,所述初始译码神经网络中包含用于指示所述初始译码神经网络输入的第二输入信息与输出的第二输出信息之间的映射关系的第二神经元参数;并且,所述初始译码神经网络经过训练后,将所述第二神经元参数更新为所述第一神经元参数;以及,所述第二神经元参数由所述第一神经网络单元包含的第三神经元参数组成,其中,所述第三神经元参数用于指示所述第一神经网络单元输入的第三输入信息与输出的第三输出信息之间的映射关系;以及,所述第三输出信息与所述第三输入信息的期望校验结果之间的误差小于阈值,其中,所述第三输入信息的期望校验结果为所述第三输入信息基于第一核矩阵在GF(2)上进行乘法和加法运算后得到的;其中,所述第一输入信息为待译码信息;以及,所述第二输入信息、所述第三输入信息为训练信息。
- 根据权利要求24所述的装置,其特征在于,所述译码模块还用于:构造所述第一初始神经网络单元,并设置所述第一初始神经元参数,其中,所述第一初始神经元参数用于指示所述第一初始神经元输入的第四输入信息与输出的第四输出信息之间的映射关系,其中,所述第一初始神经元参数包括初始权重值与初始偏置向量;以及,所述第一初始神经网络单元包括至少一个隐藏层,每个所述隐藏层包含Q个节点,并且,Q为大于等于N的整数,其中,N为所述第三输入信息的码长与所述第三输出信息的码长之中的最小值;基于所述第一初始神经元参数,对所述第一初始神经网络单元进行训练,直至所述第四输出信息与所述第四输入信息的期望校验结果之间的误差小于所述阈值,其中,所述第四输入信息的期望校验结果为所述第四输入信息基于所述第一核矩在GF(2)上进行乘法和加法运算后得到的;以及,对所述第一初始神经网络单元进行训练时,将所述第一初始神经参数进行更新,得到所述第三神经参数;其中,所述第四输入信息为训练信息。
- 根据权利要求25至27任一项所述的装置,其特征在于,其中,所述初始译码神经网络由所述第一神经网络单元与第二神经网络单元组成;其中,所述第二神经网络单元包含第四神经元参数,所述第二神经网络单元由所述第一初始神经网络单元训练后所得,并且,所述第一初始神经网络单元经过训练后,将所述第一初始神经元参数进行更新,得到所述第四神经元参数,以及,所述第四神经参数与所述第三神经参数不相同。
- 根据权利要求25至27任一项所述的装置,其特征在于,其中,所述初始译码神经网络由所述第一神经网络单元与第三神经网络单元组成,所述第三神经网络单元包含第五神经元参数;所述第五神经元参数用于指示所述第三神经网络单元输入的第五输入信息与输出的第五输出信息之间的映射关系;以及,所述第五输出信息与所述第五输入信息的期望校验结果之间的误差小于阈值,其中,所述第五输入信息的期望校验结果为所述第五输入信息基于第二核矩阵在GF(2)上进行乘法和加法运算后得到的;其中,所述第五输入信息为训练信息。
- 根据权利要求24所述的装置,其特征在于,所述译码模块还用于:获取译码网络图,其中,所述译码网络图中包括至少一个译码蝶形图,所述译码蝶形图用于指示所述译码蝶形图的输入信息与所述译码蝶形图的输出信息之间的校验关系;将所述第一神经网络单元与所述至少一个译码蝶形图进行匹配;将第一神经网络单元对匹配成功的译码蝶形图进行替换,并得到所述初始译码神经网络。
- 一种编码/译码系统,其特征在于,所述系统用于基于编码/译码神经网络,对第一输入信息进行编码和/或译码;其中,所述所述系统用于包含权利要求17-23任一项所述的编码神经网络以及权利要求24-30任一项所述的译码神经网络。
- 根据权利要求31所述的系统,其特征在于,其中,所述编码神经网络中的神经元参数与所述译码神经网络中的神经元参数不相同;或者,所述编码神经网络中的神经元参数与所述译码神经网络中的神经元参数相同。
- 一种计算机可读存储介质,该计算机可读存储介质存储有计算机程序,该计算机程序包含至少一段代码,该至少一段代码可由装置执行,以控制所述装置执行权利要求1-16中任一项所述的方法。
- 一种计算机程序,当所述计算机程序被装置执行时,用于执行权利要求1-16中任一项所述的方法。
- 一种装置,其特征在于,包括:存储器,用于存储指令;以及,与所述存储器进行通信连接的至少一个处理器,其中,所述至少一个处理器用于在运行所述指令时执行权利要求1-16中任一项所述的方法。
- 一种芯片,其特征在于,包括:处理电路、收发管脚,其中,所述收发管脚和所述处理电路通过内部连接通路互相通信,所述处理电路用于在执行权利要求1-16中任一项所述的方法时控制所述收发管脚发送和/或接收信号。
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2021529778A JP7228042B2 (ja) | 2018-11-27 | 2019-11-26 | 符号化方法及び装置並びに復号化方法及び装置 |
| ES19890969T ES3053026T3 (en) | 2018-11-27 | 2019-11-26 | Channel encoding method and apparatus based on an encoding neural network |
| EP19890969.9A EP3879709B1 (en) | 2018-11-27 | 2019-11-26 | Channel encoding method and apparatus based on an encoding neural network |
| US17/330,821 US20210279584A1 (en) | 2018-11-27 | 2021-05-26 | Encoding method and apparatus, and decoding method and apparatus |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811428115.5A CN111224677B (zh) | 2018-11-27 | 2018-11-27 | 编码方法、译码方法及装置 |
| CN201811428115.5 | 2018-11-27 |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US17/330,821 Continuation US20210279584A1 (en) | 2018-11-27 | 2021-05-26 | Encoding method and apparatus, and decoding method and apparatus |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2020108472A1 true WO2020108472A1 (zh) | 2020-06-04 |
Family
ID=70827430
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2019/120898 Ceased WO2020108472A1 (zh) | 2018-11-27 | 2019-11-26 | 编码方法、译码方法及装置 |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US20210279584A1 (zh) |
| EP (1) | EP3879709B1 (zh) |
| JP (1) | JP7228042B2 (zh) |
| CN (1) | CN111224677B (zh) |
| ES (1) | ES3053026T3 (zh) |
| WO (1) | WO2020108472A1 (zh) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11468328B2 (en) * | 2020-02-24 | 2022-10-11 | Qualcomm Incorporated | Managing information transmission for wireless communication |
| US11159170B1 (en) * | 2020-10-22 | 2021-10-26 | Texas Instruments Incorporated | Differential converter with offset cancelation |
| US20240259131A1 (en) * | 2021-05-21 | 2024-08-01 | Lg Electronics Inc. | Method for transmitting/receiving signal in wireless communication system by using auto encoder, and apparatus therefor |
| CN113438049A (zh) * | 2021-05-31 | 2021-09-24 | 杭州电子科技大学 | 一种基于dnn模型分析的汉明码译码方法及系统 |
| CN115603859A (zh) * | 2021-07-09 | 2023-01-13 | 华为技术有限公司(Cn) | 模型训练方法及相关装置 |
| WO2024031502A1 (en) * | 2022-08-11 | 2024-02-15 | Qualcomm Incorporated | Determining quantization information |
| WO2025077623A1 (en) * | 2023-10-09 | 2025-04-17 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Systems and methods for obtaining neural networks for data compression |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107017892A (zh) * | 2017-04-06 | 2017-08-04 | 华中科技大学 | 一种校验级联极化码编码方法及系统 |
| US20180268595A1 (en) * | 2017-03-20 | 2018-09-20 | Google Llc | Generating cartoon images from photos |
| CN108833313A (zh) * | 2018-07-12 | 2018-11-16 | 北京邮电大学 | 一种基于卷积神经网络的无线信道估计方法及装置 |
Family Cites Families (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| FR2646575A1 (fr) * | 1989-04-26 | 1990-11-02 | Labo Electronique Physique | Procede et structure pour la compression de donnees |
| CA2040903C (en) * | 1991-04-22 | 2003-10-07 | John G. Sutherland | Neural networks |
| US5502713A (en) * | 1993-12-07 | 1996-03-26 | Telefonaktiebolaget Lm Ericsson | Soft error concealment in a TDMA radio system |
| JP3174212B2 (ja) * | 1994-02-18 | 2001-06-11 | 株式会社日立製作所 | ビタビ復号方式およびビタビ復号器ならびにデータ記録再生装置 |
| US20100161530A1 (en) * | 2002-12-18 | 2010-06-24 | Battelle Memorial Institute | Method for enhanced accuracy in predicting peptides elution time using liquid separations or chromatography |
| CN101997492A (zh) * | 2010-09-29 | 2011-03-30 | 东南大学 | 基于简化模糊神经网络的增强维纳模型的功放预失真方法 |
| FR2975251B1 (fr) * | 2011-05-12 | 2015-12-04 | Univ Pierre Et Marie Curie Paris 6 | Procede et dispositif de commande d'un dispositif d'aide a la vision |
| WO2015157643A1 (en) * | 2014-04-10 | 2015-10-15 | Vega-Avila Rolando | Solar energy forecasting |
| CN105720992B (zh) * | 2016-01-22 | 2019-07-23 | 哈尔滨工业大学深圳研究生院 | 一种极化码的简化译码方法 |
| WO2018033206A1 (en) * | 2016-08-18 | 2018-02-22 | Huawei Technologies Co., Ltd. | Communication device and communication method using polar codes |
| US10706351B2 (en) * | 2016-08-30 | 2020-07-07 | American Software Safety Reliability Company | Recurrent encoder and decoder |
| US12093813B2 (en) * | 2016-09-30 | 2024-09-17 | Intel Corporation | Dynamic neural network surgery |
| US10552738B2 (en) * | 2016-12-15 | 2020-02-04 | Google Llc | Adaptive channel coding using machine-learned models |
| CN108809506B (zh) * | 2017-05-05 | 2020-09-04 | 华为技术有限公司 | 一种编码方法及装置 |
| CN107516110B (zh) * | 2017-08-22 | 2020-02-18 | 华南理工大学 | 一种基于集成卷积编码的医疗问答语义聚类方法 |
| CN108120451A (zh) * | 2017-12-21 | 2018-06-05 | 苏州大学 | 基于改进pso优化神经网络的硅微加速度计温度补偿方法、系统 |
| CN108777584A (zh) * | 2018-07-06 | 2018-11-09 | 中国石油大学(华东) | 一种极化码译码参数的快速优化方法 |
| US10468142B1 (en) * | 2018-07-27 | 2019-11-05 | University Of Miami | Artificial intelligence-based system and methods for corneal diagnosis |
| US10804938B2 (en) * | 2018-09-25 | 2020-10-13 | Western Digital Technologies, Inc. | Decoding data using decoders and neural networks |
-
2018
- 2018-11-27 CN CN201811428115.5A patent/CN111224677B/zh active Active
-
2019
- 2019-11-26 ES ES19890969T patent/ES3053026T3/es active Active
- 2019-11-26 JP JP2021529778A patent/JP7228042B2/ja active Active
- 2019-11-26 WO PCT/CN2019/120898 patent/WO2020108472A1/zh not_active Ceased
- 2019-11-26 EP EP19890969.9A patent/EP3879709B1/en active Active
-
2021
- 2021-05-26 US US17/330,821 patent/US20210279584A1/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180268595A1 (en) * | 2017-03-20 | 2018-09-20 | Google Llc | Generating cartoon images from photos |
| CN107017892A (zh) * | 2017-04-06 | 2017-08-04 | 华中科技大学 | 一种校验级联极化码编码方法及系统 |
| CN108833313A (zh) * | 2018-07-12 | 2018-11-16 | 北京邮电大学 | 一种基于卷积神经网络的无线信道估计方法及装置 |
Non-Patent Citations (1)
| Title |
|---|
| See also references of EP3879709A4 * |
Also Published As
| Publication number | Publication date |
|---|---|
| ES3053026T3 (en) | 2026-01-16 |
| EP3879709B1 (en) | 2025-10-01 |
| CN111224677B (zh) | 2021-10-15 |
| CN111224677A (zh) | 2020-06-02 |
| US20210279584A1 (en) | 2021-09-09 |
| JP7228042B2 (ja) | 2023-02-22 |
| JP2022511771A (ja) | 2022-02-01 |
| EP3879709A1 (en) | 2021-09-15 |
| EP3879709A4 (en) | 2021-12-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111224677B (zh) | 编码方法、译码方法及装置 | |
| KR102569349B1 (ko) | 극성 코드 인코딩 방법 및 디바이스 | |
| CN107124188B (zh) | 极化码的编码方法、译码方法、编码设备和译码设备 | |
| CN116530023A (zh) | 具有外部块码和内部极化调整卷积码的串行级联码 | |
| EP3844883B1 (en) | Method and system for decoding data using compressed channel output information | |
| CN108282259B (zh) | 一种编码方法及装置 | |
| WO2018137663A1 (zh) | 一种编码方法、译码方法、编码装置及译码装置 | |
| US20230208554A1 (en) | Encoding and Decoding Method and Apparatus | |
| CN107359987A (zh) | 有限维度效应下连续变量量子密钥分发多维协商方法 | |
| CN107864029A (zh) | 一种降低多用户检测复杂度的方法 | |
| CN116886300A (zh) | 连续变量量子密钥分发多维协商方法、系统及介质 | |
| CN111490798B (zh) | 译码的方法和译码装置 | |
| CN113472360A (zh) | 极化码的译码方法和译码装置 | |
| CN117155411A (zh) | 一种编码、译码方法及装置 | |
| Yan et al. | Channel noise optimization of polar codes decoding based on a convolutional neural network | |
| CN114915376B (zh) | 译码方法、编码方法、装置、设备和存储介质 | |
| WO2018127069A1 (zh) | 一种编码方法及装置 | |
| WO2022111575A1 (zh) | 传输数据的方法以及装置 | |
| JP7769121B2 (ja) | レートマッチング方法およびレートマッチング装置 | |
| WO2024055894A1 (zh) | 一种编/译码方法及装置 | |
| US12316342B2 (en) | Product autoencoder for error-correcting via sub-stage processing | |
| US20250247168A1 (en) | Method, apparatus and computer program | |
| WO2025261320A1 (zh) | 通信方法及通信装置 | |
| CN110391868A (zh) | 一种极化Polar码的译码方法及通信设备 | |
| WO2025252074A1 (zh) | 一种译码方法及译码装置 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19890969 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 2021529778 Country of ref document: JP Kind code of ref document: A |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 2019890969 Country of ref document: EP Effective date: 20210609 |
|
| WWG | Wipo information: grant in national office |
Ref document number: 202117023353 Country of ref document: IN |
|
| WWG | Wipo information: grant in national office |
Ref document number: 2019890969 Country of ref document: EP |


























