CN111179367B - A Deterministic Weighted Coding Method - Google Patents

A Deterministic Weighted Coding Method Download PDF

Info

Publication number
CN111179367B
CN111179367B CN201911348836.XA CN201911348836A CN111179367B CN 111179367 B CN111179367 B CN 111179367B CN 201911348836 A CN201911348836 A CN 201911348836A CN 111179367 B CN111179367 B CN 111179367B
Authority
CN
China
Prior art keywords
coding
phi
sparsity
local
distribution state
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911348836.XA
Other languages
Chinese (zh)
Other versions
CN111179367A (en
Inventor
吉超
田进寿
何凯
王兴
辛丽伟
闫欣
温文龙
王俊锋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
XiAn Institute of Optics and Precision Mechanics of CAS
Original Assignee
XiAn Institute of Optics and Precision Mechanics of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by XiAn Institute of Optics and Precision Mechanics of CAS filed Critical XiAn Institute of Optics and Precision Mechanics of CAS
Priority to CN201911348836.XA priority Critical patent/CN111179367B/en
Publication of CN111179367A publication Critical patent/CN111179367A/en
Application granted granted Critical
Publication of CN111179367B publication Critical patent/CN111179367B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00Image coding
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/10Complex mathematical operations
    • G06F17/16Matrix or vector computation, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00Two-dimensional [2D] image generation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Mathematical Analysis (AREA)
  • Computational Mathematics (AREA)
  • Mathematical Optimization (AREA)
  • Multimedia (AREA)
  • Pure & Applied Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Computing Systems (AREA)
  • Signal Processing (AREA)
  • Algebra (AREA)
  • Databases & Information Systems (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

In order to solve the technical problem that the reconstruction quality of the compressed ultrafast imaging technology has uncertainty due to the uncertain state of the traditional encoding mode, the invention provides a deterministic weighting encoding method for the compressed ultrafast imaging technology, which comprises the following steps: 1) presetting encoding; 2) weighting the preset codes; 3) and manufacturing a coding board, and performing deterministic weighted coding on the information. Under the premise of adopting the same reconstruction algorithm, the peak signal-to-noise ratio and the structural similarity of the simulation reconstruction based on the coding mode of the invention are improved to a certain extent compared with the reconstruction result based on the existing (0-1) pseudo-random coding mode.

Description

一种确定性加权编码方法A Deterministic Weighted Coding Method

技术领域technical field

本发明属于信号与信息处理技术领域,涉及一种压缩超快成像技术的确定性加权编码方法。The invention belongs to the technical field of signal and information processing, and relates to a deterministic weighted coding method for compressed ultrafast imaging technology.

背景技术Background technique

压缩超快成像技术是将压缩感知理论与条纹相机相结合以实现时间分辨为皮秒到飞秒量级的二维成像技术,其二维成像实现流程如图1所示。传统的条纹相机时间分辨可以达到皮秒到分秒量级,但其狭窄的狭缝(约5mm)使其成像限制为一条线,当打开狭缝时,不同时刻的信息在CCD上会发生交叠。压缩感知理论与条纹相机相结合通过编码与压缩感知算法重构的方法便可以分离交叠二维场景,实现条纹相机单次曝光下二维成像的目的。其过程可以简单描述为:Compressed ultrafast imaging technology is a combination of compressed sensing theory and streak camera to realize two-dimensional imaging technology with time resolution ranging from picoseconds to femtoseconds. The realization process of two-dimensional imaging is shown in Figure 1. The time resolution of traditional streak cameras can reach the order of picoseconds to minutes and seconds, but its narrow slit (about 5mm) limits its imaging to a line. When the slit is opened, information at different times will intersect on the CCD. stack. The combination of compressive sensing theory and streak camera can separate overlapping two-dimensional scenes through the method of coding and compressive sensing algorithm reconstruction, and realize the purpose of two-dimensional imaging under a single exposure of streak camera. The process can be simply described as:

E(m,n)=TSCI(x,y,t) (1)E(m,n)=TSCI(x,y,t) (1)

其中:E(m,n)表示条纹相机的CCD记录下的交叠二维场景;I(x,y,t)表示原始动态场景,C表示DMD(数字微反射镜)的外部编码,S表示条纹相机扫描电压的偏转算子,T表示二维动态场景在CCD上的交叠过程。其整个过程可以用如下数学公式描述Among them: E(m,n) represents the overlapping 2D scene recorded by the CCD of the streak camera; I(x,y,t) represents the original dynamic scene, C represents the external code of DMD (Digital Micro Mirror), S represents The deflection operator of the scanning voltage of the streak camera, T represents the overlapping process of the two-dimensional dynamic scene on the CCD. The whole process can be described by the following mathematical formula

Figure BDA0002334139140000011
Figure BDA0002334139140000011

其中:d″为CCD的像素尺寸,为了重构交叠出交叠二维图像,需要使用压缩感知算法框架,其逆问题求解形式可以用如下表述:Among them: d" is the pixel size of the CCD. In order to reconstruct the overlapping two-dimensional image, the compressed sensing algorithm framework needs to be used. The inverse problem solution form can be expressed as follows:

Figure BDA0002334139140000012
Figure BDA0002334139140000012

其中:O为线性操作算子(O=TSC),β为正则项参数,

Figure BDA0002334139140000013
为正则项函数。相较于传统的压缩感知算法,该重构算法框架中的正则项采用全变差(TV)模型,同时使其形式满足三维平滑的先验条件要求,具体公式描述如下:Among them: O is the linear operator (O=TSC), β is the regular term parameter,
Figure BDA0002334139140000013
is the regular term function. Compared with the traditional compressed sensing algorithm, the regular term in the reconstruction algorithm framework adopts the Total Variation (TV) model, and at the same time its form meets the prior requirements of three-dimensional smoothness. The specific formula is described as follows:

Figure BDA0002334139140000021
Figure BDA0002334139140000021

其中:角标h表示三维信息中每个平面的水平方向,角标v表示三维信息中每个平面的竖直方向,N表示三维矩阵维度,I表示信息的强度大小,x,y,t分别表示三维信息的三个维度尺寸大小。具体描述参见文献“Single-shot compressed ultrafast photographyat one hundred billion frames per second”。Among them: the index h represents the horizontal direction of each plane in the three-dimensional information, the index v represents the vertical direction of each plane in the three-dimensional information, N represents the dimension of the three-dimensional matrix, I represents the intensity of the information, x, y, t respectively Indicates the size of the three dimensions of the three-dimensional information. For a detailed description, see the document "Single-shot compressed ultrafast photography at one hundred billion frames per second".

压缩超快成像技术的出现,极大降低了条纹相机在超快诊断领域的应用局限性,为超快光学特性研究以及激光惯性聚变等领域提供了新的诊断方式,但压缩感知理论的重构结果本身是一种概率解,现有算法的重构结果只能对20幅左右图片重构时具有理想的效果,如何有效保证解的精准性与有效性,是压缩超快成像技术面临的一大问题。其中,编码状态是影响重构质量的一个关键因素,传统编码方式是采用只含“0”,“1”元素的伪随机矩阵,“1”代表数字微反射镜的反射,“0”代表数字微反射镜不反射即丢弃信息。但是,伪随机编码的不确定状态往往导致对不同场景的重构质量具有不确定性。华东师范大学曾提出使用遗传算法的方式获得只对应特定场景的最佳编码状态来提高压缩超快成像的重构质量,但该方法较为繁冗。具体细节参见文献“Optimizing codes for compressed ultrafastphotography by the genetic algorithm”。因此,如何采用简单高效的编码设计方法还亟待进一步研究。The emergence of compressed ultrafast imaging technology has greatly reduced the application limitations of streak cameras in the field of ultrafast diagnosis, and provided a new diagnostic method for ultrafast optical characteristics research and laser inertial fusion and other fields, but the reconstruction of compressed sensing theory The result itself is a probabilistic solution. The reconstruction result of the existing algorithm can only have an ideal effect when reconstructing about 20 pictures. How to effectively ensure the accuracy and effectiveness of the solution is a challenge faced by the compressed ultrafast imaging technology. big problem. Among them, the encoding state is a key factor affecting the quality of reconstruction. The traditional encoding method uses a pseudo-random matrix containing only "0" and "1" elements, "1" represents the reflection of the digital micro-mirror, and "0" represents the digital Micromirrors discard information without reflecting. However, the uncertain state of pseudo-random coding often leads to uncertainty about the reconstruction quality of different scenes. East China Normal University once proposed to use a genetic algorithm to obtain the optimal coding state only corresponding to a specific scene to improve the reconstruction quality of compressed ultrafast imaging, but this method is cumbersome. See "Optimizing codes for compressed ultrafastphotography by the genetic algorithm" for details. Therefore, how to adopt a simple and efficient coding design method needs further research.

发明内容SUMMARY OF THE INVENTION

为了解决传统编码方式的不确定状态导致压缩超快成像技术的重构质量具有不确定性的技术问题,本发明提供了一种压缩超快成像技术的确定性加权编码方法,避免了最佳编码的不确定性,基于本发明的编码方法,可有效提高压缩超快成像技术的重构质量,改善重构图像的局部伪信息现象。In order to solve the technical problem that the reconstruction quality of the compressed ultrafast imaging technology is uncertain due to the uncertain state of the traditional encoding method, the present invention provides a deterministic weighted encoding method of the compressed ultrafast imaging technology, which avoids the optimal encoding. Based on the coding method of the present invention, the reconstruction quality of the compressed ultrafast imaging technology can be effectively improved, and the local pseudo-information phenomenon of the reconstructed image can be improved.

本发明的技术方案是:The technical scheme of the present invention is:

一种确定性加权编码方法,用于压缩超快成像系统,其特殊之处在于,包括步骤:A deterministic weighted coding method for compressing an ultrafast imaging system, which is special in that it includes the steps:

1)编码预设定1) Encoding preset

1.1)令列向量a=[1 0 1 0 0 1 0 0 0 1 0 0 0 0 1 0 0 0 0 0 1 0 0 0 0 0 01 0 0 0 0 0 1 0 0 0 0 1 0 0 0 1 0 0 1 0 1];1.1) Let the column vector a=[1 0 1 0 0 1 0 0 0 1 0 0 0 0 1 0 0 0 0 0 1 0 0 0 0 0 01 0 0 0 0 0 1 0 0 0 0 1 0 0 0 1 0 0 1 0 1];

1.2)设预编码矩阵Phi的大小为m×n,构建以列向量a为重复单元的列向量b,重复次数为d,其中d满足m≤48*d≤m+48;1.2) Set the size of the precoding matrix Phi to be m×n, and construct a column vector b with the column vector a as the repeating unit, and the number of repetitions is d, where d satisfies m≤48*d≤m+48;

1.3)令预编码矩阵Phi的第ni列(i=1,2..,n)由列向量b逆循环移位2×(i-1)个元素后的前m个元素组成的向量表示,从而构造出预编码矩阵Phi;1.3) Let the n i -th column (i=1, 2.., n) of the precoding matrix Phi be represented by a vector consisting of the first m elements after the column vector b is inversely cyclically shifted by 2×(i-1) elements , thereby constructing the precoding matrix Phi;

2)对预设编码进行加权处理2) Weighting the preset coding

2.1)通过预编码矩阵Phi与3×3的全1矩阵w做卷积,获取预编码矩阵Phi中的局部稀疏度分布状态S,S=Phi*w;2.1) Obtain the local sparsity distribution state S in the precoding matrix Phi by convolving the precoding matrix Phi with the 3×3 all-one matrix w, where S=Phi*w;

2.2)根据局部稀疏度分布状态S,计算全局平均稀疏度Sa,其中

Figure BDA0002334139140000031
2.2) According to the local sparsity distribution state S, calculate the global average sparsity S a , where
Figure BDA0002334139140000031

2.3)将局部稀疏度分布状态S与全局平均稀疏度Sa对比,对处在不同局部稀疏度的元素“1”进行相应的加权处理:2.3) Compare the local sparsity distribution state S with the global average sparsity S a , and perform corresponding weighting processing on the element "1" at different local sparsity:

对于局部稀疏度分布状态S小于全局平均稀疏度Sa的局部矩阵,即S(i,j)≤Sa的情况下相对应的元素Phi(i,j)加较小的权重;For a local matrix whose local sparsity distribution state S is less than the global average sparsity Sa, that is, when S(i,j)≤S a , the corresponding element Phi(i,j) is added with a smaller weight;

对局部稀疏度分布状态S大于全局平均稀疏度Sa的局部矩阵,即S(i,j)>Sa的情况下相对应的元素Phi(i,j)加较大的权重;A larger weight is added to the corresponding element Phi( i ,j) when the local sparsity distribution state S is greater than the global average sparsity Sa, that is, the corresponding element Phi(i,j) in the case of S( i ,j)>Sa;

3)制作编码板,对信息进行确定性加权编码3) Make a coding board and perform deterministic weighted coding on the information

3.1)根据步骤2)加权处理后的预设编码,设计不同透光率孔径的编码板,不同的透光率表示编码的不同加权状态;3.1) According to the preset coding after the weighting process in step 2), design coding plates with different light transmittance apertures, and different light transmittances represent different weighted states of the coding;

3.2)用制作好的编码板作为编码器件,设置在压缩超快成像系统前端,从而实现对信息的确定加权性编码。3.2) Use the prepared coding board as the coding device, and set it at the front end of the compression ultrafast imaging system, so as to realize the deterministic weighted coding of the information.

进一步地,步骤3.1)中所述的编码板采用光学掩模版。Further, the coding plate described in step 3.1) adopts an optical reticle.

进一步地,步骤2.3)中改变权重的原则是在元素Phi(i,j)为非零元素的情况下,元素值增加/减少0.03。Further, the principle of changing the weight in step 2.3) is that when the element Phi(i,j) is a non-zero element, the element value increases/decreases by 0.03.

与现有技术相比,本发明的有益效果是:Compared with the prior art, the beneficial effects of the present invention are:

1.本发明采用确定性加权编码方式取代了现有的(0-1)伪随机编码方式,避免了伪随机编码的随机性造成图像重构质量的随机性,同时有效的提升了压缩超快成像技术的重构精度。1. The present invention uses deterministic weighted coding to replace the existing (0-1) pseudo-random coding, which avoids the randomness of image reconstruction quality caused by the randomness of pseudo-random coding, and effectively improves the ultra-fast compression. Reconstruction accuracy of imaging techniques.

2.在采用相同的重构算法前提下,基于本发明编码方式进行模拟重构的峰值信噪比(PSNR)和结构相似度(SSIM)都比基于现有的(0-1)伪随机编码方式的重构结果有了一定的提升。2. Under the premise of using the same reconstruction algorithm, the peak signal-to-noise ratio (PSNR) and structural similarity (SSIM) of the simulation reconstruction based on the coding method of the present invention are better than those based on the existing (0-1) pseudo-random coding. The refactoring result of the method has been improved to a certain extent.

3.本发明也适用于与压缩感知理论相结合的其它技术,如单像素相机成像,基于编码孔径的高光谱成像等。3. The present invention is also applicable to other technologies combined with compressed sensing theory, such as single-pixel camera imaging, coded aperture-based hyperspectral imaging, and the like.

附图说明Description of drawings

图1为压缩超快成像系统二维成像实现过程。Figure 1 shows the realization process of 2D imaging of the compressed ultrafast imaging system.

图2为采用现有的伪随机编码与本发明确定性加权编码方式对经典图像Pepper的压缩重构结果对比,其中:(a)为Pepper原图,(b)为现有的伪随机编码重构图,(c)为本发明确定性加权编码重构图。2 is a comparison of the compression and reconstruction results of the classic image Pepper using the existing pseudo-random coding and the deterministic weighted coding method of the present invention, wherein: (a) is the original image of Pepper, and (b) is the existing pseudo-random coding re-encoding. Composition, (c) is the deterministic weighted coding reconstruction map of the present invention.

图3为采用现有不同的伪随机编码与本发明确定性加权编码方式分别对经典图片lena和Pepper压缩重构结果的PSNR以及SSIM数据对比。FIG. 3 is a comparison of PSNR and SSIM data of the compression and reconstruction results of the classic pictures lena and Pepper respectively using different existing pseudo-random coding and the deterministic weighted coding method of the present invention.

图4为本发明确定性加权编码方法的流程图。FIG. 4 is a flow chart of the deterministic weighted coding method of the present invention.

具体实施方式Detailed ways

如图4所示,本发明所提供的确定性加权编码方法包括以下步骤:As shown in Figure 4, the deterministic weighted coding method provided by the present invention comprises the following steps:

步骤1:编码预设定Step 1: Encoding Preset

为了避免伪随机编码的局部稀疏度差异过大造成权重范围过大,我们预设了一种规范的三角分布编码方式,具体如下:In order to avoid the excessive difference in local sparsity of pseudo-random coding resulting in excessive weight range, we preset a standard triangular distribution coding method, as follows:

1.1)令列向量a=[1 0 1 0 0 1 0 0 0 1 0 0 0 0 1 0 0 0 0 0 1 0 0 0 0 0 01 0 0 0 0 0 1 0 0 0 0 1 0 0 0 1 0 0 1 0 1],该列向量的特点是在保证一定编码稀疏度的情况下元素‘0’的数量呈三角分布;1.1) Let the column vector a=[1 0 1 0 0 1 0 0 0 1 0 0 0 0 1 0 0 0 0 0 1 0 0 0 0 0 01 0 0 0 0 0 1 0 0 0 0 1 0 0 0 1 0 0 1 0 1], the feature of this column vector is that the number of elements '0' is triangularly distributed under the condition of ensuring a certain coding sparsity;

1.2)设预编码矩阵Phi的大小为m×n,构建以列向量a为重复单元的列向量b,重复次数为d,其中d满足m≤48*d≤m+48;1.2) Set the size of the precoding matrix Phi to be m×n, and construct a column vector b with the column vector a as the repeating unit, and the number of repetitions is d, where d satisfies m≤48*d≤m+48;

1.3)令预编码矩阵Phi的第ni列(i=1,2..,n)由列向量b逆循环移位2×(i-1)个元素后的前m个元素组成的向量表示,从而构造出预编码矩阵Phi。例如:向量b=[1 3 5 79],对其逆循环移位操作后的前两列向量为[7 9 1 3 5;3 5 7 9 1],再取每一列的前m个元素即为所要设定矩阵的前两列。1.3) Let the n i -th column (i=1, 2.., n) of the precoding matrix Phi be represented by a vector consisting of the first m elements after the column vector b is inversely cyclically shifted by 2×(i-1) elements , thereby constructing the precoding matrix Phi. For example: vector b=[1 3 5 79], the first two columns of vectors after the reverse cyclic shift operation are [7 9 1 3 5; 3 5 7 9 1], and then take the first m elements of each column, namely The first two columns of the matrix to be set.

步骤2:对预设编码进行加权处理Step 2: Weighting the preset encoding

2.1通过预编码矩阵Phi与3×3的全1矩阵w做卷积,获取预编码矩阵Phi中的局部稀疏度分布状态S,S=Phi*w;2.1 Obtain the local sparsity distribution state S in the precoding matrix Phi by convolving the precoding matrix Phi with the 3×3 all-one matrix w, S=Phi*w;

2.2根据局部稀疏度分布状态S,计算全局平均稀疏度Sa,其中

Figure BDA0002334139140000051
2.2 According to the local sparsity distribution state S, calculate the global average sparsity S a , where
Figure BDA0002334139140000051

2.3将局部稀疏度分布状态S与全局平均稀疏度Sa对比,对处在不同局部稀疏度的元素“1”进行相应的加权处理:2.3 Compare the local sparsity distribution state S with the global average sparsity S a , and perform corresponding weighting processing on the element "1" at different local sparsity:

对于局部稀疏度分布状态S小于全局平均稀疏度Sa的局部矩阵,即S(i,j)≤Sa的情况下相对应的元素Phi(i,j)加较小的权重;For a local matrix whose local sparsity distribution state S is less than the global average sparsity Sa, that is, when S(i,j)≤S a , the corresponding element Phi(i,j) is added with a smaller weight;

对局部稀疏度分布状态S大于全局平均稀疏度Sa的局部矩阵,即S(i,j)>Sa的情况下相对应的元素Phi(i,j)加较大的权重。A larger weight is added to the corresponding element Phi( i ,j) when the local sparsity distribution state S is greater than the global average sparsity Sa, that is, when S( i ,j)>Sa.

其中,改变权重的原则是在元素Phi(i,j)为非零元素的情况下,元素值增加/减少0.03左右。Among them, the principle of changing the weight is that when the element Phi(i,j) is a non-zero element, the element value increases/decreases by about 0.03.

步骤3:制作编码板,对信息进行确定性加权编码Step 3: Make a coding board to perform deterministic weighted coding on the information

根据步骤2加权处理后的预设编码,设计不同透光率孔径的编码板,该编码板采用光学掩模版,不同的透光率表示编码的不同加权状态。According to the preset coding after the weighting process in step 2, coding plates with different light transmittance apertures are designed. The coding board adopts an optical mask, and different light transmittances represent different weighted states of the coding.

用制作好的编码板取代数字微反射镜,作为压缩超快成像系统的编码器件,设置在压缩超快成像系统前端,从而实现对信息的确定加权性编码。The digital micro-mirror is replaced by the prepared coding plate, which is used as the coding device of the compressed ultrafast imaging system, and is set at the front end of the compressed ultrafast imaging system, thereby realizing the deterministic weighted coding of the information.

本发明基本原理:The basic principle of the present invention:

压缩感知算法解决的问题为线性欠定方程,当根据编码的不同局部稀疏度添加不同的权重时,同样满足如下逆问题求解形式:The problem solved by the compressed sensing algorithm is a linear underdetermined equation. When different weights are added according to different local sparsity of the encoding, it also satisfies the following inverse problem solution form:

Figure BDA0002334139140000061
Figure BDA0002334139140000061

其中:Is为编码局部稀疏度较强(即大于全局平均稀疏度)变量的集合,τs是Is对应的加权系数矩阵;Ic为编码局部稀疏度较弱(即小于全局平均稀疏度)的变量的集合,τc是Ic对应的加权系数矩阵;具体加权方式参见上述步骤2。Among them: I s is the set of variables with relatively strong encoding local sparsity (that is, greater than the global average sparsity), τ s is the weighting coefficient matrix corresponding to Is ; I c is the encoding local sparsity is weak (that is, less than the global average sparsity) ) of the variable set, τ c is the weighting coefficient matrix corresponding to I c ; the specific weighting method refers to the above step 2.

仿真验证:Simulation:

将实例应用于Pepper,lena两幅分辨率为128×128的经典图例中,原始图像预处理方式如下:将设计好的加权编码与预设图M相点乘,得到被编码后的图像Phi′,Phi′=Phi.*M。预设图M的像素大小为128×128,将编码后的10幅相同图片相对平移一个像素值进行叠加。此建模过程相当于掩模版的编码,条纹相机扫描电压的偏转作用以及最后不同时刻二维场景在CCD上叠加的压缩超快成像过程。The example is applied to the two classic legends of Pepper and lena with a resolution of 128×128. The original image preprocessing method is as follows: multiply the designed weighted code with the preset image M to obtain the encoded image Phi′ , Phi′=Phi.*M. The pixel size of the preset image M is 128×128, and the encoded 10 identical images are relatively shifted by one pixel value and superimposed. This modeling process is equivalent to the encoding of the reticle, the deflection effect of the scanning voltage of the streak camera, and the compression ultrafast imaging process of superimposing the two-dimensional scene on the CCD at different times.

附图2是分别采用基于现有(0-1)伪随机编码方法与本发明的重构结果的比较,可以看出本发明有效降低了伪随机编码的随机性造成的局部伪信息现象。FIG. 2 is a comparison of the reconstruction results based on the existing (0-1) pseudo-random coding method and the present invention. It can be seen that the present invention effectively reduces the local pseudo-information phenomenon caused by the randomness of the pseudo-random coding.

附图3是采用随机产生的20种伪随机编码与本发明编码方式分别对Lena和Pepper两幅经典图片编码之后,再采用相同的压缩重构算法得到的结果对比,其中伪随机编码与本发明的采样率均为0.25,可以看到基于本发明编码方式重构后的峰值信噪比(peaksignal to noise ratio,PSNR)与结构相似度(structualsimiliarityindex,SSIM)指标明显优于现有方法。Accompanying drawing 3 is after adopting 20 kinds of pseudo-random codes generated at random and the coding mode of the present invention to encode two classic pictures of Lena and Pepper respectively, and then adopt the same compression and reconstruction algorithm to obtain the result comparison, wherein the pseudo-random coding and the present invention are compared. The sampling rate is 0.25. It can be seen that the peak signal to noise ratio (PSNR) and structural similarity index (SSIM) after reconstruction based on the coding method of the present invention are obviously better than the existing methods.

Claims (3)

1.一种确定性加权编码方法,用于压缩超快成像系统,其特征在于,包括步骤:1. a deterministic weighted coding method for compressing ultrafast imaging system, is characterized in that, comprises the steps: 1)编码预设定1) Encoding preset 1.1)令列向量a=[1 0 1 0 0 1 0 0 0 1 0 0 0 0 1 0 0 0 0 0 1 0 0 0 0 0 0 1 00 0 0 0 1 0 0 0 0 1 0 0 0 1 0 0 1 0 1];1.1) Let the column vector a=[1 0 1 0 0 1 0 0 0 1 0 0 0 0 1 0 0 0 0 0 1 0 0 0 0 0 0 1 00 0 0 0 1 0 0 0 0 1 0 0 0 1 0 0 1 0 1]; 1.2)设预编码矩阵Phi的大小为m×n,构建以列向量a为重复单元的列向量b,重复次数为d,其中d满足m≤48*d≤m+48;1.2) Set the size of the precoding matrix Phi to be m×n, and construct a column vector b with the column vector a as the repeating unit, and the number of repetitions is d, where d satisfies m≤48*d≤m+48; 1.3)令预编码矩阵Phi的第ni列(i=1,2..,n)由列向量b逆循环移位2×(i-1)个元素后的前m个元素组成的向量表示,从而构造出预编码矩阵Phi;1.3) Let the n i -th column (i=1, 2.., n) of the precoding matrix Phi be represented by a vector consisting of the first m elements after the column vector b is inversely cyclically shifted by 2×(i-1) elements , thereby constructing the precoding matrix Phi; 2)对预设编码进行加权处理2) Weighting the preset coding 2.1)通过预编码矩阵Phi与3×3的全1矩阵w做卷积,获取预编码矩阵Phi中的局部稀疏度分布状态S,S=Phi*w;2.1) Obtain the local sparsity distribution state S in the precoding matrix Phi by convolving the precoding matrix Phi with the 3×3 all-one matrix w, where S=Phi*w; 2.2)根据局部稀疏度分布状态S,计算全局平均稀疏度Sa,其中
Figure FDA0002334139130000011
2.2) According to the local sparsity distribution state S, calculate the global average sparsity S a , where
Figure FDA0002334139130000011
2.3)将局部稀疏度分布状态S与全局平均稀疏度Sa对比,对处在不同局部稀疏度的元素“1”进行相应的加权处理:2.3) Compare the local sparsity distribution state S with the global average sparsity S a , and perform corresponding weighting processing on the element "1" at different local sparsity: 对于局部稀疏度分布状态S小于全局平均稀疏度Sa的局部矩阵,即S(i,j)≤Sa的情况下相对应的元素Phi(i,j)加较小的权重;For a local matrix whose local sparsity distribution state S is less than the global average sparsity Sa, that is, when S(i,j)≤S a , the corresponding element Phi(i,j) is added with a smaller weight; 对局部稀疏度分布状态S大于全局平均稀疏度Sa的局部矩阵,即S(i,j)>Sa的情况下相对应的元素Phi(i,j)加较大的权重;A larger weight is added to the corresponding element Phi( i ,j) when the local sparsity distribution state S is greater than the global average sparsity Sa, that is, the corresponding element Phi(i,j) in the case of S( i ,j)>Sa; 3)制作编码板,对信息进行确定性加权编码3) Make a coding board and perform deterministic weighted coding on the information 3.1)根据步骤2)加权处理后的预设编码,设计不同透光率孔径的编码板,不同的透光率表示编码的不同加权状态;3.1) According to the preset coding after the weighting process in step 2), design coding plates with different light transmittance apertures, and different light transmittances represent different weighted states of the coding; 3.2)用制作好的编码板作为编码器件,设置在压缩超快成像系统前端,从而实现对信息的确定加权性编码。3.2) Use the prepared coding board as the coding device, and set it at the front end of the compression ultrafast imaging system, so as to realize the deterministic weighted coding of the information.
2.根据权利要求1所述的确定性加权编码方法,其特征在于:步骤3.1)中所述的编码板采用光学掩模版。2 . The deterministic weighted coding method according to claim 1 , wherein: the coding plate described in step 3.1) adopts an optical mask. 3 . 3.根据权利要求1所述的确定性加权编码方法,其特征在于:步骤2.3)中改变权重的原则是在元素Phi(i,j)为非零元素的情况下,元素值增加/减少0.03。3. deterministic weighted coding method according to claim 1, is characterized in that: in step 2.3), the principle of changing weight is that in the case that element Phi(i, j) is a non-zero element, element value increases/decreases by 0.03 .
CN201911348836.XA 2019-12-24 2019-12-24 A Deterministic Weighted Coding Method Active CN111179367B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911348836.XA CN111179367B (en) 2019-12-24 2019-12-24 A Deterministic Weighted Coding Method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911348836.XA CN111179367B (en) 2019-12-24 2019-12-24 A Deterministic Weighted Coding Method

Publications (2)

Publication Number Publication Date
CN111179367A CN111179367A (en) 2020-05-19
CN111179367B true CN111179367B (en) 2022-05-20

Family

ID=70653990

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911348836.XA Active CN111179367B (en) 2019-12-24 2019-12-24 A Deterministic Weighted Coding Method

Country Status (1)

Country Link
CN (1) CN111179367B (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1163686A (en) * 1995-06-20 1997-10-29 株式会社理光 Encoding method and system and decoding method and system
CN106709962A (en) * 2016-12-26 2017-05-24 哈尔滨工程大学 Method for compressed sensing infrared image reconstruction based on deterministic sequence encoding

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10422899B2 (en) * 2014-07-30 2019-09-24 Exxonmobil Upstream Research Company Harmonic encoding for FWI

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1163686A (en) * 1995-06-20 1997-10-29 株式会社理光 Encoding method and system and decoding method and system
CN106709962A (en) * 2016-12-26 2017-05-24 哈尔滨工程大学 Method for compressed sensing infrared image reconstruction based on deterministic sequence encoding

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
光场的稀疏编码模型及重构算法的研究;张晓帅;《中国优秀博硕士学位论文全文数据库(硕士)信息科技辑》;20180315(第03期);I138-2086 *
基于压缩感知的编码孔径光谱成像技术研究;刘铭鑫;《中国博士学位论文全文数据库基础科学辑》;20190815(第08期);A005-43 *
多值压缩编码孔径超分辨率成像方法;邵晓鹏等;《光电子·激光》;20120630;第23卷(第06期);第1189-1195页 *

Also Published As

Publication number Publication date
CN111179367A (en) 2020-05-19

Similar Documents

Publication Publication Date Title
Yuan et al. Snapshot compressive imaging: Theory, algorithms, and applications
Goldstein et al. The stone transform: Multi-resolution image enhancement and compressive video
Wang et al. Hyperreconnet: Joint coded aperture optimization and image reconstruction for compressive hyperspectral imaging
Marwah et al. Compressive light field photography using overcomplete dictionaries and optimized projections
Yeung et al. Light field spatial super-resolution using deep efficient spatial-angular separable convolution
Marcia et al. Compressive coded aperture imaging
Guo et al. Deep spatial-angular regularization for light field imaging, denoising, and super-resolution
US9225889B1 (en) Photographic image acquisition device and method
CN109255822B (en) Multi-scale coding and multi-constraint compression sensing reconstruction method for resolution ratio between times out
US10656598B2 (en) Holographic light field imaging device and method of using the same
US20140063314A1 (en) System And Method Of Video Compressive Sensing For Spatial-Multiplexing Cameras
Deng et al. Sinusoidal sampling enhanced compressive camera for high speed imaging
CN114359041A (en) Light field image space super-resolution reconstruction method
Guan et al. Srdgan: learning the noise prior for super resolution with dual generative adversarial networks
Chandramouli et al. A generative model for generic light field reconstruction
Cao et al. Oodhdr-codec: Out-of-distribution generalization for hdr image compression
Zhang et al. MEMS-based super-resolution remote sensing system using compressive sensing
CN119151831A (en) Method for restoring underwater polarized image based on Transformer
Pournaghi et al. Coded acquisition of high frame rate video
Hajisharif et al. Single sensor compressive light field video camera
Zhong et al. 3D-CNN autoencoder for plenoptic image compression
CN111179367B (en) A Deterministic Weighted Coding Method
Shi et al. Compact self-adaptive coding for spectral compressive sensing
CN119383355B (en) High-resolution remote sensing image compression method and system based on block modulation imaging
Dekel Adaptive compressed image sensing based on wavelet-trees

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant