TW201947452A

TW201947452A - Data processing method, device and processing equipment for vehicle loss assessment and client

Info

Publication number: TW201947452A
Application number: TW108105280A
Authority: TW
Inventors: 周凡
Original assignee: 香港商阿里巴巴集團服務有限公司
Priority date: 2018-05-08
Filing date: 2019-02-18
Publication date: 2019-12-16
Also published as: CN108632530B; CN113179368B; CN113179368A; WO2019214319A1; CN108632530A

Abstract

The embodiments of the present specification disclose a data processing method, device and processing equipment for vehicle loss assessment and a client. A user can automatically identify a damaged part of a vehicle on mobile equipment, an area to be shot is marked in an easy-to-identify manner in a shot picture, and the user is continuously guided to take a photo or video of the area, so that the user can complete the shooting required for loss assessment without professional knowledge, the handling efficiency of vehicle loss assessment is improved, and the loss assessment interactive experience of the user is improved.

Description

Data processing method, device, processing equipment and client for vehicle fixed loss

本說明書實施例方案屬於電腦終端保險業務資料處理的技術領域，尤其涉及一種車輛定損的資料處理方法、裝置、處理設備及客戶端。The solutions of the embodiments of the present specification belong to the technical field of computer terminal insurance business data processing, and more particularly, to a data processing method, device, processing equipment, and client for vehicle fixed loss.

機動車輛保險即汽車保險(或簡稱車險)，是指對機動車輛由於自然災害或意外事故所造成的人身傷亡或財產損失負賠償責任的一種商業保險。隨著經濟的發展，機動車輛的數量不斷增加，當前，車險已成為中國財產保險業務中最大的險種之一。
在車險行業，車主發生車輛事故提出理賠申請時，保險公司需要對車輛的損傷程度進行評估，以確定需要修復的項目清單，以及賠付金額等。目前的評估方式主要包括：藉由保險公司或第三方公估機構查勘員，對發生事故的車輛進行現場評估，或由用戶在保險公司人員的指導下，對事故車輛拍照，藉由網路傳遞給保險公司，再由定損員藉由照片進行遠端定損。目前的這種車險定損獲取定損圖像的方式中，保險公司安排車輛及人員到事故現場進行查勘，需要花費較高的成本；車主需要花費較多時間等待查勘人員到達現場，體驗較差；車主自行拍攝照片時，由於缺乏經驗，往往需要查勘人員藉由遠端電話或視頻通話等方式進行指導，費時費力。即使在查看人員遠端指導的情況下，部分案件用這種方式拍出的照片存在大量無效照片，當採集到無效的定損圖像時，車主用戶需要重新拍攝，甚至已經喪失拍攝時機，嚴重影響定損處理效率和用戶定損服務體驗。
因此，業內亟需一種可以更加簡易、便捷、快速的車輛定損處理方案。Motor vehicle insurance, or car insurance for short, refers to a type of commercial insurance that is liable for compensation for personal injury or property damage caused by a natural disaster or accident in a motor vehicle. With the development of the economy, the number of motor vehicles continues to increase. At present, auto insurance has become one of the largest types of insurance in China's property insurance business.
In the auto insurance industry, when an owner applies for a claim in a vehicle accident, the insurance company needs to evaluate the degree of damage to the vehicle to determine the list of items that need to be repaired and the amount of compensation. The current assessment methods mainly include: on-site assessment of an accident vehicle by an insurance company or a third-party public assessment agency, or taking pictures of the accident vehicle by the user under the guidance of the insurance company personnel and passing it through the Internet Give it to the insurance company, and then the loss adjuster will perform the remote loss determination through the photo. In the current method for obtaining fixed-loss images of this type of auto insurance, it is costly for insurance companies to arrange vehicles and personnel to the accident site for surveys; car owners need to spend more time waiting for surveyors to arrive at the site, and experience is poor; When the owner takes a picture by himself, due to lack of experience, surveyors often need guidance by remote telephone or video call, which is time-consuming and labor-intensive. Even with the remote guidance of the viewing staff, there are a large number of invalid photos in some cases in this way. When an invalid fixed-loss image is collected, the owner user needs to take another shot, or even lost the shooting time. Serious Affects the loss processing efficiency and user loss service experience.
Therefore, there is an urgent need in the industry for a simpler, more convenient and faster vehicle damage-determination solution.

本說明書實施例目的在於提供一種車輛定損的資料處理方法、裝置、處理設備及客戶端，用戶可以在行動設備上自動識別車輛損傷部位，並在拍攝畫面中用容易識別的方式標識出需要拍攝的區域，持續引導用戶對該區域拍攝照片或視頻，從而讓用戶可以在不需要專業知識的情況下，也能完成定損所需的符合定損處理要求拍攝，提高車輛定損的處理效率，提高用戶定損互動體驗。
本說明書實施例提供的一種車輛定損的資料處理方法、裝置、處理設備及客戶端是包括以下方式實現的：
一種車輛定損的資料處理方法，所述方法包括：
展示拍攝車輛第一受損區域的拍攝引導資訊；
若識別出當前拍攝視窗中存在第一損傷，則確定出所述第一損傷的第一損傷區域；
對所述第一損傷區域進行顯著方式呈現後，利用虛擬實境在將呈現後的第一損傷區域疊加顯示在所述當前拍攝視窗中；
展示針對於所述第一損傷區域的拍攝引導資訊。
一種車輛定損的資料處理裝置，所述裝置包括：
第一提示模組，用於展示拍攝車輛第一受損區域的拍攝引導資訊；
損傷識別結果模組，用於若識別出當前拍攝視窗中存在第一損傷，則確定出所述第一損傷的第一損傷區域；
顯著顯示模組，用於對所述第一損傷區域進行顯著方式呈現後，利用虛擬實境在將呈現後的第一損傷區域疊加顯示在所述當前拍攝視窗中；
第二提示模組，用於展示針對於所述第一損傷區域的拍攝引導資訊。
一種車輛定損的資料處理設備，包括處理器以及用於儲存處理器可執行指令的記憶體，所述處理器執行所述指令時實現：
展示拍攝車輛第一受損區域的拍攝引導資訊；
若識別出當前拍攝視窗中存在第一損傷，則確定出所述第一損傷的第一損傷區域；
對所述第一損傷區域進行顯著方式呈現後，利用虛擬實境在將呈現後的第一損傷區域疊加顯示在所述當前拍攝視窗中；
展示針對於所述第一損傷區域的拍攝引導資訊。
一種客戶端，包括處理器以及用於儲存處理器可執行指令的記憶體，所述處理器執行所述指令時實現：
展示拍攝車輛第一受損區域的拍攝引導資訊；
若識別出當前拍攝視窗中存在第一損傷，則確定出所述第一損傷的第一損傷區域；
對所述第一損傷區域進行顯著方式呈現後，利用虛擬實境在將呈現後的第一損傷區域疊加顯示在所述當前拍攝視窗中；
展示針對於所述第一損傷區域的拍攝引導資訊。
一種電子設備，包括顯示螢幕、處理器以及儲存處理器可執行指令的記憶體，所述處理器執行所述指令時實現本說明書任意一個實施例所述的方法步驟。
本說明書實施例提供的一種車輛定損的資料處理方法、裝置、處理設備及客戶端，用戶可以在行動設備上自動識別車輛損傷部位，並在拍攝畫面中用容易識別的方式標識出需要拍攝的區域，持續引導用戶對該區域拍攝照片或視頻，從而讓用戶可以在不需要專業知識的情況下，也能完成定損所需的符合定損處理要求拍攝，提高車輛定損的處理效率，提高用戶定損互動體驗。The purpose of the embodiments of this specification is to provide a data processing method, device, processing device and client for determining the damage of a vehicle. Users can automatically identify the damaged part of the vehicle on the mobile device, and identify the need to shoot in an easily recognizable manner in the shooting screen Area, continuously guide users to take photos or videos of the area, so that users can complete the shooting required by the fixed loss process without the need for professional knowledge, and improve the efficiency of vehicle fixed loss processing. Improve the user's fixed loss interactive experience.
The data processing method, device, processing equipment and client for vehicle fixed loss provided by the embodiments of this specification are implemented in the following ways:
A data processing method for vehicle damage determination, the method includes:
Display shooting guidance information for the first damaged area of the shooting vehicle;
If it is identified that a first damage exists in the current shooting window, determining a first damage area of the first damage;
After presenting the first damaged area in a prominent manner, using the virtual reality to superimpose and display the rendered first damaged area in the current shooting window;
Displaying shooting guidance information for the first damaged area.
A data processing device for determining vehicle damage, the device includes:
A first reminder module for displaying shooting guide information for shooting the first damaged area of the vehicle;
A damage recognition result module for determining a first damage region of the first damage if it is recognized that a first damage exists in the current shooting window;
A prominent display module, configured to display the first damaged area in a prominent manner, and use the virtual reality to superimpose and display the rendered first damaged area in the current shooting window;
A second prompt module is used to display shooting guide information for the first damaged area.
A data processing device for vehicle damage determination includes a processor and a memory for storing processor-executable instructions. When the processor executes the instructions, the processor implements:
Display shooting guidance information for the first damaged area of the shooting vehicle;
If it is identified that a first damage exists in the current shooting window, determining a first damage area of the first damage;
After presenting the first damaged area in a prominent manner, using the virtual reality to superimpose and display the rendered first damaged area in the current shooting window;
Displaying shooting guidance information for the first damaged area.
A client includes a processor and a memory for storing processor-executable instructions, and when the processor executes the instructions, it implements:
Display shooting guidance information for the first damaged area of the shooting vehicle;
If it is identified that a first damage exists in the current shooting window, determining a first damage area of the first damage;
After presenting the first damaged area in a prominent manner, using the virtual reality to superimpose and display the rendered first damaged area in the current shooting window;
Displaying shooting guidance information for the first damaged area.
An electronic device includes a display screen, a processor, and a memory storing instructions executable by the processor. When the processor executes the instructions, the method steps described in any one of the embodiments of the specification are implemented.
The method, device, processing device and client for vehicle fixed damage data provided in the embodiments of the present specification. The user can automatically identify the damaged part of the vehicle on the mobile device, and can easily identify the need to shoot in the shooting screen. Area, continuously guide users to take photos or videos of the area, so that users can complete the shooting required by the fixed loss process without the need for professional knowledge, improve the processing efficiency of vehicle fixed loss, improve User fixed loss interactive experience.

為了使本技術領域的人員更好地理解本說明書中的技術方案，下面將結合本說明書實施例中的圖式，對本說明書實施例中的技術方案進行清楚、完整地描述，顯然，所描述的實施例僅僅是本說明書中的一部分實施例，而不是全部的實施例。基於本說明書中的一個或多個實施例，本領域具有通常知識者在沒有作出創造性勞動前提下所獲得的所有其他實施例，都應當屬於本說明書實施例保護的範圍。
本說明書提供的一種實施方案可以應用到客戶端/伺服器的系統構架中。所述的客戶端可以包括車損現場人員(可以是事故車車主用戶，也可以是保險公司人員或進行定損處理的其他人員)使用的具有拍攝功能的終端設備，如智慧型手機、平板電腦、智慧型穿戴設備、專用定損終端等。所述的客戶端可以具有通訊模組，可以與遠端的伺服器進行通訊連接，實現與所述伺服器的資料傳輸。所述伺服器可以包括保險公司一側的伺服器或定損服務方一側的伺服器，其他的實施場景中也可以包括其他服務方的伺服器，例如與定損服務方的伺服器有通訊鏈接的配件供應商的終端、車輛維修廠的終端等。所述的伺服器可以包括單台電腦設備，也可以包括多個伺服器組成的伺服器集群，或者分散式系統的伺服器。一些應用場景中，客戶端一側可以將現場拍攝採集的圖像資料實時發送給伺服器，由伺服器一側進行損傷的識別，識別的結果可以回饋給客戶端。伺服器一側的處理的實施方案，損傷識別等處理由伺服器一側執行，處理速度通常高於客戶端一側，可以減少客戶端處理壓力，提高損傷識別速度。當然，本說明書不排除其他的實施例中上述全部或部分處理由客戶端一側實現，如客戶端一側進行損傷的實時檢測和識別。
用戶自行拍攝車損照片或視頻時，常常會面臨如下的問題：1、用戶並不完全理解哪些損傷部位需要進行拍攝(例如一條刮擦痕跡主要在前門，後門只有少量，被用戶忽略；但後門同樣需要進行噴漆，因此要對後門損傷部位進行拍攝)；2、用戶不能識別所有的損傷(例如輕微的凹陷對普通人來說難以用肉眼識別)；3、用戶很難準確掌握拍攝距離、角度、損傷部位在畫面中的比例等要素。為此，本發明提供一種可以應用在行動設備上的車輛定損的資料處理方法，可以在拍攝畫面中用容易識別的方式標識出需要拍攝的區域，持續引導用戶對該區域拍攝照片或視頻，從而讓用戶可以在不需要專業知識的情況下，也能完成定損所需的拍攝。
下面以一個具體的手機客戶端應用場景為例對本說明書實施方案進行說明。具體的，圖1是本說明書提供的所述一種車輛定損的資料處理方法實施例的流程示意圖。雖然本說明書提供了如下述實施例或圖式所示的方法操作步驟或裝置結構，但基於常規或者無需創造性的勞動在所述方法或裝置中可以包括更多或者部分合併後更少的操作步驟或模組單元。在邏輯性上不存在必要因果關係的步驟或結構中，這些步驟的執行順序或裝置的模組結構不限於本說明書實施例或圖式所示的執行順序或模組結構。所述的方法或模組結構的在實際中的裝置、伺服器或終端產品應用時，可以按照實施例或者圖式所示的方法或模組結構進行順序執行或者並行執行(例如並行處理器或者多線程處理的環境、甚至包括分散式處理、伺服器集群的實施環境)。當然，下述實施例的描述並不對基於本說明書的其他可擴展到的技術方案構成限制。例如其他的實施場景中。具體的一種實施例如圖1所示，本說明書提供的一種車輛定損的資料處理方法的一種實施例中，所述方法可以包括：
S0：展示拍攝車輛第一受損區域的拍攝引導資訊；
S2：若識別出當前拍攝視窗中存在第一損傷，則確定出所述第一損傷的第一損傷區域；
S4：對所述第一損傷區域進行顯著方式呈現後，利用虛擬實境在將呈現後的第一損傷區域疊加顯示在所述當前拍攝視窗中；
S6：展示針對於所述第一損傷區域的拍攝引導資訊。
本實施例中用戶一側的客戶端可以為智慧型手機，所述的智慧型手機可以具有拍攝功能。用戶可以在車輛事故現場打開實施了本說明書實施方案的手機應用程式對車輛事故現場進行取景拍攝。客戶端打開應用程式後，可以在客戶端顯示螢幕上展示拍攝視窗，藉由拍攝視窗獲取對車輛進行拍攝。所述的拍攝視窗可以為視頻拍攝窗口，可以用於終端對車損現場的取景(圖像採集)，藉由客戶端集成的拍攝裝置獲取的圖像資訊可以展示在所述拍攝視窗中。所述拍攝視窗具體的介面結構和展示的相關資訊可以自定義的設計。
車輛拍攝過程中可以獲取車輛的特徵資料。所述的特徵資料可以根據車輛識別、環境識別、圖像識別等資料處理需求進行具體的設置。一般的，所述的特徵資料可以包括識別出的車輛的各個部件的資料資訊，可用於構建3D坐標資訊，建立車輛的增強現實空間模型(AR空間模型，一種資料表征方式，主體的輪廓圖形)。當然，所述的特徵資料還可以包括其他的例如車輛的品牌、型號、顏色、輪廓、唯一識別碼等資料資訊。
客戶端啟用定損服務時，可以展示對受損區域進行拍攝的引導資訊。為便於描述，將當前或初始即將拍攝的受損區域稱為第一受損區域。例如一個應用實例中，用戶在啟動定損服務應用程式時，應用程式可以提示用戶在能夠看清車輛全貌的距離上，對準車輛可能受損的方位進行拍攝。如有必要可以提示用戶圍繞車身移動，如初始拍攝時未發現損傷，則提示用戶逆時針對車輛全面拍攝。當識別出當前拍攝視窗中存在損傷時(此時可以稱為第一損傷)，則可以進一步計算確定出損傷對應的損傷區域。
本說明書的一些實施例中，損傷識別的處理可以由客戶端一側實施，也可以由伺服器一側進行處理，此時的伺服器可以稱為損傷識別伺服器。在一些應用場景或計算能力允許的情況下，客戶端採集的圖像可以直接在客戶端本地進行損傷識別，或者以及其他的定損資料處理，可以減少網路傳輸開銷。當然，如前所述，通常伺服器一側的計算能力強於客戶端。因此，本說明書提供的所述方法的另一個實施例中，損傷識別的處理可以由伺服器一側進行處理。具體的，所述識別出當前拍攝視窗中存在第一損傷可以包括：
S20：將拍攝獲取的採集圖像發送至損傷識別伺服器；
S22：接收伺服器返回的損傷識別結果，所述損傷識別結果包括損傷識別伺服器利用預先訓練的深度神經網路對所述採集圖像進行損傷識別得到的處理結果。
需要說明的，本實施例中所述的識別第一損傷是針對當前次的損傷識別處理，所述的第一並不對其他損傷採集的圖像進行損傷識別處理構成限制。
上述實施例中，客戶端或伺服器一側可以利用預先或實時訓練構建的深度神經網路來識別圖像中的損傷，如損傷位置、損傷部件、損傷類型等。
深度神經網路能夠用於目標檢測及語義分割，對於輸入的圖片，找到目標在圖片中的位置。圖2是說明書所述方法實施例使用的深度神經網路模型示意圖。圖2中描述的為一種比較典型的深度神經網路Faster R-CNN，可以藉由事先標注好損傷區域的大量圖片，訓練出一個深度神經網路，對於車輛各個方位及光照條件的圖片，給出損傷區域的範圍。另外，本說明書的一些實施例中，可以使用針對行動設備定制的網路結構，如基於典型的MobileNet、SqueezeNet或其改進的網路結構，使得該模型能在行動設備較低功耗、較少記憶體、較慢處理器的環境下運行，如客戶端的行動終端運行環境。
確定出第一損傷區域後，可以對該區域進行顯著方式呈現，藉由AR技術在拍攝畫面中疊加呈現損傷所覆蓋的區域。所述的顯著方式呈現，主要是指在拍攝畫面中使用一些特點的呈現方式標出損傷區域，使得該損傷區域容易識別，或較為突出。本實施例中對具體的呈現方式不做限定，具體的可以設置達到顯著方式呈現的約束條件或滿足條件。
本說明書提供的所述方法的另一個實施例中，所述的顯著方式呈現可以包括：
S40：採用預設表徵符號標識出所述第一損傷區域，所述預設表徵符號包括下述之一：
圓點、引導線、規則圖形框、不規則圖形框、自定義的圖形。
圖3是本說明書提供一種採用小點點符號呈現來標識出損傷區域的示意圖。當然，其他的實施方式中，所述的預設表徵符號還可以包括其他形式，如引導線、規則圖形框、不規則圖形框、自定義的圖形等，其他的實施例中也可以使用文字、字符、資料等標識出損傷區域，指引用戶對損傷區域進行拍攝。呈現時可以使用一種或多種預設表徵符號。本實施例中採用預設表徵符號來標識出損傷區域，可以在拍攝視窗中更加明顯的展示出損傷所在的位置區域，輔助用戶快速定位以及引導拍攝。
本說明書提供的所述方法的另一個實施例中，還可以採用動態呈現效果來標識出損傷區域，以更加明顯的方式指引用戶對損傷區域進行拍攝。具體的，另一個實施例中，所述顯著方式呈現包括：
S400：對所述預設表徵符號進行顏色變換、大小變換、旋轉、跳動中的至少一項動畫展示。
本說明書的一些實施例中，可以集合AR疊加現實損傷的邊界，提示用戶將取景框對準變截面的部分進行拍攝。所述的增強現實AR通常是指一種實時地計算攝影機影像的位置及角度並加上相應圖像、視頻、3D模型的技術實現方案，這種方案可以在屏幕上把虛擬世界套在現實世界並進行互動。本說明書實施例中利用所述特徵資料構建的增強資訊空間模型可以為車輛的輪廓資訊，具體的可以基於獲取的車輛的型號、拍攝角度以及車輛的輪胎位置、頂棚位置、前臉位置、前大燈位置、尾燈位置、前後車窗位置等多個特徵資料構建出所述車輛的輪廓。所述的輪廓可以包括基於3D坐標建立的資料模型，所述輪廓中帶有相應的3D坐標資訊。然後可以將構建的輪廓展示在拍攝視窗中。當然，本說明書不排除其他的實施例中所述的增強現實空間模型還可以包括其他的模型形式或者在所述輪廓之上增加的其他模型資訊。
所述的AR模型可以在所述拍攝時長中與真實的車輛位置進行匹配，如將構建的3D輪廓疊加到真實車輛的輪廓位置，當兩者完全匹配或匹配程度達到閾值時可以認為完成匹配。具體的匹配處理中，可以藉由對取景方向做引導，用戶藉由引導移動拍攝方向或角度，將構建的輪廓與拍攝的真實車輛的輪廓對準。本說明書實施例結合增強現實技術，不僅展現了用戶實際客戶端拍攝的車輛真實資訊，而且將構建的所述車輛的增強現實空間模型資訊同時顯示出來，兩種資訊相互補充、疊加，可以提供更好的定損服務體驗。
結合了AR空間模型的拍攝視窗可以更加直觀的展示車輛現場情況，可以有效的進行車輛損傷位置的定損和拍攝引導。客戶端可以在AR場景下進行損傷識別引導，所述損傷識別引導具體的可以包括將展示基於從所述拍攝視窗中獲取的圖像資訊確定的拍攝引導資訊。客戶端可以獲取拍攝窗口中AR場景下獲取圖像資訊，可以對獲取的圖像資訊進行分析計算，根據分析結果確定需要在拍攝視窗中展示什麼樣的拍攝引導資訊。例如當前拍攝視窗的中車輛的位置較遠，可以在拍攝視窗中提示用戶靠近拍攝。若拍攝位置偏左，無法拍攝到車輛尾部，則可以展示拍攝引導資訊，提示用戶將拍攝角度向右平移。損傷識別引導具體處理的資料資訊以及在什麼樣的條件下展示什麼樣的拍攝引導資訊，可以預先設定相應的策略或規則，本實施例不再逐一描述。
在本實施例中，可以展示針對所述第一損傷區域的拍攝引導資訊。具體的可以根據當前的拍攝資訊和所述第一損傷區域的位置資訊來確定需要展示的拍攝引導資訊。例如，若捕捉到車輛後翼子板存在擦痕，而擦痕需要進行正面拍攝和順著擦痕方向的拍攝，但根據當前拍攝的位置和角度資訊計算得到此時用戶為斜著的45度拍攝，且距離擦痕位置較遠。則此時可以提示用戶靠近擦痕位置，提示用戶正面和順著擦痕方向進行拍攝。拍攝引導資訊可以根據當前取景實時調整，例如若用戶已經靠近擦痕位置，符合拍攝要求，則此時提示用戶靠近擦痕位置的拍攝引導資訊可以不再展示。所述的疑似損傷可以由客戶端或伺服器一側進行識別。
具體的拍攝時需要展示的拍攝引導資訊以及拍攝條件等可以根據定損互動設計或者定損處理需求進行相應的設置。本說明書提供的一個實施例中，所述拍攝引導資訊可以至少包括下述之一：
調整拍攝方向；
調整拍攝角度；
調整拍攝距離；
調整拍攝光線。
一個拍攝引導的示例如圖4所示。用戶可以藉由實時的拍攝引導資訊更加便利、高效的進行定損處理。用戶根據拍攝引導資訊進行拍攝，可以無需專業的拍攝技能或繁瑣的拍攝操作，用戶體驗更好。上述實施例描述了藉由文字展示的拍攝引導資訊，可擴展實施例中，所述的拍攝引導資訊還可以包括圖像、語音、動畫、震動等的展現方式，藉由箭頭或語音提示將當前拍攝畫面對準某個區域。因此，所述方法的另一個實施例中，所述拍攝引導資訊的在所述當前拍攝視窗展示的形式包括符號、文字、語音、動畫、視頻、震動中的至少一種。
所述方法的另一個實施例場景中，當用戶將行動設備的攝像頭對準車輛進行拍攝時，可以以一定的框速率(如15幀/s)進行拍攝，然後可以使用前述訓練的深度神經網路對圖像進行識別。若一旦檢測出損傷，可以對損傷區域啟動新的拍攝策略，如加快拍攝框速率(如30幀/s)，獲取調整其他參數實現以更快的速度、更低的功耗持續獲取該區域在當前拍攝視窗中的位置。這樣，可以根據不同的拍攝區域調整拍攝參數，使用不同的拍攝策略，可以靈活適應不同拍攝場景，加強重點區域拍攝，對應非重點區域藉由降頻還可以降低功耗。因此，本說明書提供的所述方法的另一個實施例中，在識別出當前拍攝視窗中存在損傷時，採用至少調整包括拍攝框速率的參數的拍攝策略來對損傷區域進行拍攝。
當然，還可以調整其他參數，如曝光度、亮度等。具體的拍攝策略可以自定義的根據拍攝場景進行設定。
進一步的，在第一損傷區域採集到足夠多(達到定損圖像採集要求)的照片或視頻後，可以提示引導用戶進行下一處損傷的拍攝，直至所有損傷拍攝完畢。這樣當用戶拍攝某個損傷後，可以持續引導用戶進行下一個損傷的拍攝，減少損傷拍攝遺漏，降低用戶損傷識別的參與度，提高用戶體驗。因此，所述的方法的另一個實施例中，如圖5所示，還可以包括：
S8：若確定所述第一損傷區域拍攝完成，則展示拍攝所述車輛第二受損區域的拍攝引導資訊，直至識別出的損傷拍攝完成。
客戶端應用程式可以將拍攝到的損傷畫面回傳保險公司，以便進行後續的人工或自動定損處理。還可以避免或降低用戶偽造定損圖像進行騙保的風險。因此，本說明書提供的所述方法的另一個實施例中，所述方法還包括：
S10：將拍攝的符合定損圖像採集要求的圖像傳輸至定損伺服器。
所述定損伺服器可以包括保險公司一側的伺服器，也可以包括定損服務方的伺服器。所述的傳輸至定損伺服器可以包括由客戶端直接傳輸給定損伺服器，也可以間接傳輸到定損伺服器。當然，確定的符合要求的定損圖像也可以同時發給定損伺服器和定損服務方的伺服器，如某支付應用程式提供的定損服務的伺服器端。
需要說明的，上述實施例中所描述的實時可以包括在獲取或確定某個資料資訊後即刻發送、接收或展示，本領域技術人員可以理解的是，經過快取或預期的計算、等待時間後的發送、接收或展示仍然可以屬於所述實時的定義範圍。本說明書實施例所述的圖像可以包括視頻，視頻可以視為連續的圖像集合。
另外，本說明書實施例方案中拍攝獲取的採集圖像或符合要求的定損圖像可以儲存到本地客戶端或實時上傳給遠端伺服器。本地客戶端儲存進行一些資料防篡改或上傳至伺服器儲存後，可以有效防止定損資料被篡改，或盜用其他非本次事故圖像的資料進行的保險欺詐。因此，本說明書實施例還可以提高定損處理的資料安全性和定損結果的可靠性。
上述實施例描述了用戶在手機客戶端進行車輛定損的資料處理方法實施方式。需要說明的是，本說明書實施例上述所述的方法可以在多種處理設備中，如專用定損終端，以及包括客戶端與伺服器架構的實施場景中。
本說明書中上述方法的各個實施例均採用遞進的方式描述，各個實施例之間相同相似的部分互相參見即可，每個實施例重點說明的都是與其他實施例的不同之處。相關之處參見方法實施例的部分說明即可。
本申請實施例所提供的方法實施例可以在行動終端、PC終端、專用定損終端、伺服器或者類似的運算裝置中執行。以運行在行動終端上為例，圖6是應用本發明方法或裝置實施例一種車輛定損的互動處理的客戶端的硬體結構方塊圖。如圖6所示，客戶端10可以包括一個或多個(圖中僅示出一個)處理器102(處理器102可以包括但不限於微處理器MCU或可程式邏輯裝置FPGA等的處理裝置)、用於儲存資料的記憶體104、以及用於通訊功能的傳輸模組106。本領域具有通常知識者可以理解，圖6所示的結構僅為示意，其並不對上述電子裝置的結構造成限定。例如，客戶端10還可包括比圖6中所示更多或者更少的組件，例如還可以包括其他的處理硬體，如GPU(Graphics Processing Unit，圖像處理器)，或者具有與圖8所示不同的配置。
記憶體104可用於儲存應用軟體的軟體程式以及模組，如本說明書實施例中的搜索方法對應的程式指令/模組，處理器102藉由運行儲存在記憶體104內的軟體程式以及模組，從而執行各種功能應用以及資料處理，即實現上述導航互動介面內容展示的處理方法。記憶體104可包括高速隨機記憶體，還可包括非易失性記憶體，如一個或者多個磁性儲存裝置、快閃記憶體、或者其他非易失性固態記憶體。在一些實例中，記憶體104可進一步包括相對於處理器102遠端設置的記憶體，這些遠端記憶體可以藉由網路連接至客戶端10。上述網路的實例包括但不限於網際網路、企業內部網、區域網路、行動通訊網及其組合。
傳輸模組106用於經由一個網路接收或者發送資料。上述的網路具體實例可包括電腦終端10的通訊供應商提供的無線網路。在一個實例中，傳輸模組106包括一個網路介面控制器(Network Interface Controller，NIC)，其可藉由基地台與其他網路設備相連從而可與網際網路進行通訊。在一個實例中，傳輸模組106可以為射頻(Radio Frequency，RF)模組，其用於藉由無線方式與網際網路進行通訊。
基於上述所述的圖像物體定位的方法，本說明書還提供一種車輛定損的資料處理裝置。所述的裝置可以包括使用了本說明書實施例所述方法的系統(包括分散式系統)、軟體(應用程式)、模組、組件、伺服器、客戶端等並結合必要的實施硬體的設備裝置。基於同一創新構思，本說明書提供的一種實施例中的處理裝置如下面的實施例所述。由於裝置解決問題的實現方案與方法相似，因此本說明書實施例具體的處理裝置的實施可以參見前述方法的實施，重複之處不再贅述。儘管以下實施例所描述的裝置較佳地以軟體來實現，但是硬體，或者軟體和硬體的組合的實現也是可能並被構想的。具體的，如圖7所示，圖7是本說明書提供的一種車輛定損的資料處理裝置實施例的模組結構示意圖，具體的可以包括：
第一提示模組201，可以用於展示拍攝車輛第一受損區域的拍攝引導資訊；
損傷識別結果模組202，可以用於若識別出當前拍攝視窗中存在第一損傷，則確定出所述第一損傷的第一損傷區域；
顯著顯示模組203，可以用於對所述第一損傷區域進行顯著方式呈現後，利用虛擬實境在將呈現後的第一損傷區域疊加顯示在所述當前拍攝視窗中；
第二提示模組204，可以用於展示針對於所述第一損傷區域的拍攝引導資訊。
需要說明的是，上述實施例上述所述的裝置，根據相關方法實施例的描述還可以包括其他的實施方式，如執行呈現的呈現處理模組、進行AR處理的AR顯示模組等。具體的實現方式可以參照方法實施例的描述，在此不作一一贅述。
本說明書實施例提供的設備型號識別方法可以在電腦中由處理器執行相應的程式指令來實現，如使用windows/Linux操作系統的c++/java語言在PC端/伺服器端實現，或其他例如android、iOS系統相對應的應用程式設計語言集合必要的硬體實現，或者基於量子電腦的處理邏輯實現等。具體的，本說明書提供的一種車輛定損的資料處理設備實現上述方法的實施例中，所述處理設備可以包括處理器以及用於儲存處理器可執行指令的記憶體，所述處理器執行所述指令時實現：
展示拍攝車輛第一受損區域的拍攝引導資訊；
若識別出當前拍攝視窗中存在第一損傷，則確定出所述第一損傷的第一損傷區域；
對所述第一損傷區域進行顯著方式呈現後，利用虛擬實境在將呈現後的第一損傷區域疊加顯示在所述當前拍攝視窗中；
展示針對於所述第一損傷區域的拍攝引導資訊。
基於前述方法實施例描述，所述處理設備的另一個實施例中，所述處理器還執行：
若確定所述第一損傷區域拍攝完成，則展示拍攝所述車輛第二受損區域的拍攝引導資訊，直至識別出的損傷拍攝完成。
基於前述方法實施例描述，所述處理設備的另一個實施例中，所述顯著方式呈現包括：
採用預設表徵符號標識出所述第一損傷區域，所述預設表徵符號包括下述之一：
圓點、引導線、規則圖形框、不規則圖形框、自定義的圖形。
基於前述方法實施例描述，所述處理設備的另一個實施例中，所述顯著方式呈現包括：
對所述預設表徵符號進行顏色變換、大小變換、旋轉、跳動中的至少一項動畫展示。
基於前述方法實施例描述，所述處理設備的另一個實施例中，所述拍攝引導資訊至少包括下述之一：
調整拍攝方向；
調整拍攝角度；
調整拍攝距離；
調整拍攝光線。
基於前述方法實施例描述，所述處理設備的另一個實施例中，所述拍攝引導資訊的在所述當前拍攝視窗展示的形式包括符號、文字、語音、動畫、視頻、震動中的至少一種。
基於前述方法實施例描述，所述處理設備的另一個實施例中，所述處理器識別出當前拍攝視窗中存在第一損傷包括：
將拍攝獲取的採集圖像發送至損傷識別伺服器；
接收伺服器返回的損傷識別結果，所述損傷識別結果包括損傷識別伺服器利用預先訓練的深度神經網路對所述採集圖像進行損傷識別得到的處理結果。
基於前述方法實施例描述，所述處理設備的另一個實施例中，所述處理器在識別出當前拍攝視窗中存在損傷時，執行採用至少調整包括拍攝框速率的參數的拍攝策略來對損傷區域進行拍攝。
基於前述方法實施例描述，所述處理設備的另一個實施例中，所述處理器還執行：
將拍攝的符合定損圖像採集要求的圖像傳輸至定損伺服器。
需要說明的是，上述實施例上述所述的處理設備，根據相關方法實施例的描述還可以包括其他的可擴展實施方式。具體的實現方式可以參照方法實施例的描述，在此不作一一贅述。
上述的指令可以儲存在多種電腦可讀儲存媒體中。所述電腦可讀儲存媒體可以包括用於儲存資訊的物理裝置，可以將資訊數位化後再以利用電、磁或者光學等方式的媒體加以儲存。本實施例所述的電腦可讀儲存媒體有可以包括：利用電能方式儲存資訊的裝置如，各式記憶體，如RAM、ROM等；利用磁能方式儲存資訊的裝置如，硬碟、軟碟、磁帶、磁芯記憶體、磁泡記憶體、USB隨身碟；利用光學方式儲存資訊的裝置如，CD或DVD。當然，還有其他方式的可讀儲存媒體，例如量子記憶體、石墨烯記憶體等等。本說明書實施例中所述的裝置或伺服器或客戶端或系統中的指令同上描述。
上述方法或裝置實施例可以用於用戶一側的客戶端，如智慧型手機。因此，本說明書提供一種客戶端，包括處理器以及用於儲存處理器可執行指令的記憶體，所述處理器執行所述指令時實現：
展示拍攝車輛第一受損區域的拍攝引導資訊；
若識別出當前拍攝視窗中存在第一損傷，則確定出所述第一損傷的第一損傷區域；
對所述第一損傷區域進行顯著方式呈現後，利用虛擬實境在將呈現後的第一損傷區域疊加顯示在所述當前拍攝視窗中；
展示針對於所述第一損傷區域的拍攝引導資訊。
基於前述所述，本說明書實施例還提供一種電子設備，包括顯示螢幕、處理器以及儲存處理器可執行指令的記憶體。
圖8是本說明提供的一種電子設備實施例的結構示意圖，所述處理器執行所述指令時可以實現本說明書任意一個實施例所述的方法步驟。
本說明書所述的裝置、客戶端、電子設備等的各個實施例均採用遞進的方式描述，各個實施例之間相同相似的部分互相參見即可，每個實施例重點說明的都是與其他實施例的不同之處。尤其，對於硬體加上程式類實施例而言，由於其基本相似於方法實施例，所以描述的比較簡單，相關之處參見方法實施例的部分說明即可。
上述對本說明書特定實施例進行了描述。其它實施例在所附申請專利範圍的範圍內。在一些情況下，在申請專利範圍中記載的動作或步驟可以按照不同於實施例中的順序來執行並且仍然可以實現期望的結果。另外，在圖式中描繪的過程不一定要求示出的特定順序或者連續順序才能實現期望的結果。在某些實施方式中，多任務處理和並行處理也是可以的或者可能是有利的。
雖然本申請提供了如實施例或流程圖所述的方法操作步驟，但基於常規或者無創造性的勞動可以包括更多或者更少的操作步驟。實施例中列舉的步驟順序僅僅為眾多步驟執行順序中的一種方式，不代表唯一的執行順序。在實際中的裝置或客戶端產品執行時，可以按照實施例或者圖式所示的方法順序執行或者並行執行(例如並行處理器或者多線程處理的環境)。
儘管本說明書實施例內容中提到AR技術、拍攝引導資訊展示、與用戶互動的拍攝引導、利用深度神經網路初步識別損傷位置等之類的資料獲取、位置排列、互動、計算、判斷等操作和資料描述，但是，本說明書實施例並不局限於必須是符合行業通訊標準、標準圖像資料處理協議、通訊協議和標準資料模型/模板或本說明書實施例所描述的情況。某些行業標準或者使用自定義方式或實施例描述的實施基礎上略加修改後的實施方案也可以實現上述實施例相同、等同或相近、或變形後可預料的實施效果。應用這些修改或變形後的資料獲取、儲存、判斷、處理方式等獲取的實施例，仍然可以屬於本說明書的可選實施方案範圍之內。
在20世紀90年代，對於一個技術的改進可以很明顯地區分是硬體上的改進(例如，對二極體、電晶體、開關等電路結構的改進)還是軟體上的改進(對於方法流程的改進)。然而，隨著技術的發展，當今的很多方法流程的改進已經可以視為硬體電路結構的直接改進。設計人員幾乎都藉由將改進的方法流程編程到硬體電路中來得到相應的硬體電路結構。因此，不能說一個方法流程的改進就不能用硬體實體模組來實現。例如，可程式邏輯裝置(Programmable Logic Device, PLD)(例如現場可程式閘陣列(Field Programmable Gate Array，FPGA))就是這樣一種積體電路，其邏輯功能由用戶對裝置編程來確定。由設計人員自行編程來把一個數位系統“集成”在一片PLD上，而不需要請晶片製造廠商來設計和製作專用的積體電路晶片。而且，如今，取代手工地製作積體電路晶片，這種編程也多半改用“邏輯編譯器(logic compiler)”軟體來實現，它與程式開發撰寫時所用的軟體編譯器相類似，而要編譯之前的原始碼也得用特定的編程語言來撰寫，此稱之為硬體描述語言(Hardware Description Language，HDL)，而HDL也並非僅有一種，而是有許多種，如ABEL (Advanced Boolean Expression Language)、AHDL(Altera Hardware Description Language)、Confluence、CUPL (Cornell University Programming Language)、HDCal、JHDL(Java Hardware Description Language)、Lava、Lola、MyHDL、PALASM、RHDL(Ruby Hardware Description Language)等，目前最普遍使用的是VHDL (Very-High-Speed Integrated Circuit Hardware Description Language)與Verilog。本領域技術人員也應該清楚，只需要將方法流程用上述幾種硬體描述語言稍作邏輯編程並編程到積體電路中，就可以很容易得到實現該邏輯方法流程的硬體電路。
控制器可以按任何適當的方式實現，例如，控制器可以採取例如微處理器或處理器以及儲存可由該(微)處理器執行的電腦可讀程式碼(例如軟體或韌體)的電腦可讀媒體、邏輯閘、開關、應用特定積體電路(Application Specific Integrated Circuit，ASIC)、可程式邏輯控制器和嵌入微控制器的形式，控制器的例子包括但不限於以下微控制器：ARC 625D、Atmel AT91SAM、Microchip PIC18F26K20 以及Silicone Labs C8051F320，記憶體控制器還可以被實現為記憶體的控制邏輯的一部分。本領域技術人員也知道，除了以純電腦可讀程式碼方式實現控制器以外，完全可以藉由將方法步驟進行邏輯編程來使得控制器以邏輯閘、開關、應用特定積體電路、可程式邏輯控制器和嵌入微控制器等的形式來實現相同功能。因此這種控制器可以被認為是一種硬體部件，而對其內包括的用於實現各種功能的裝置也可以視為硬體部件內的結構。或者甚至，可以將用於實現各種功能的裝置視為既可以是實現方法的軟體模組又可以是硬體部件內的結構。
上述實施例闡明的系統、裝置、模組或單元，具體可以由電腦晶片或實體實現，或者由具有某種功能的產品來實現。一種典型的實現設備為電腦。具體的，電腦例如可以為個人電腦、筆記型電腦、車載人機互動設備、蜂巢式電話、相機電話、智能電話、個人數位助理、媒體播放器、導航設備、電子郵件設備、遊戲控制台、平板電腦、可穿戴設備或者這些設備中的任何設備的組合。
雖然本說明書實施例提供了如實施例或流程圖所述的方法操作步驟，但基於常規或者無創造性的手段可以包括更多或者更少的操作步驟。實施例中列舉的步驟順序僅僅為眾多步驟執行順序中的一種方式，不代表唯一的執行順序。在實際中的裝置或終端產品執行時，可以按照實施例或者圖式所示的方法順序執行或者並行執行(例如並行處理器或者多線程處理的環境，甚至為分散式資料處理環境)。術語“包括”、“包含”或者其任何其他變體意在涵蓋非排他性的包含，從而使得包括一系列要素的過程、方法、產品或者設備不僅包括那些要素，而且還包括沒有明確列出的其他要素，或者是還包括為這種過程、方法、產品或者設備所固有的要素。在沒有更多限制的情況下，並不排除在包括所述要素的過程、方法、產品或者設備中還存在另外的相同或等同要素。
為了描述的方便，描述以上裝置時以功能分為各種模組分別描述。當然，在實施本說明書實施例時可以把各模組的功能在同一個或多個軟體和/或硬體中實現，也可以將實現同一功能的模組由多個子模組或子單元的組合實現等。以上所描述的裝置實施例僅僅是示意性的，例如，所述單元的劃分，僅僅為一種邏輯功能劃分，實際實現時可以有另外的劃分方式，例如多個單元或組件可以結合或者可以集成到另一個系統，或一些特徵可以忽略，或不執行。另一點，所顯示或討論的相互之間的耦合或直接耦合或通訊連接可以是藉由一些介面，裝置或單元的間接耦合或通訊連接，可以是電性，機械或其它的形式。
本領域技術人員也知道，除了以純電腦可讀程式碼方式實現控制器以外，完全可以藉由將方法步驟進行邏輯編程來使得控制器以邏輯閘、開關、應用特定積體電路、可程式邏輯控制器和嵌入微控制器等的形式來實現相同功能。因此這種控制器可以被認為是一種硬體部件，而對其內部包括的用於實現各種功能的裝置也可以視為硬體部件內的結構。或者甚至，可以將用於實現各種功能的裝置視為既可以是實現方法的軟體模組又可以是硬體部件內的結構。
本發明是參照根據本發明實施例的方法、設備(系統)、和電腦程式產品的流程圖和/或方塊圖來描述的。應理解可由電腦程式指令實現流程圖和/或方塊圖中的每一流程和/或方塊、以及流程圖和/或方塊圖中的流程和/或方塊的結合。可提供這些電腦程式指令到通用電腦、專用電腦、嵌入式處理機或其他可程式資料處理設備的處理器以產生一個機器，使得藉由電腦或其他可程式資料處理設備的處理器執行的指令產生用於實現在流程圖一個流程或多個流程和/或方塊圖一個方塊或多個方塊中指定的功能的裝置。
這些電腦程式指令也可儲存在能引導電腦或其他可程式資料處理設備以特定方式工作的電腦可讀記憶體中，使得儲存在該電腦可讀記憶體中的指令產生包括指令裝置的製造品，該指令裝置實現在流程圖一個流程或多個流程和/或方塊圖一個方塊或多個方塊中指定的功能。
這些電腦程式指令也可裝載到電腦或其他可程式資料處理設備上，使得在電腦或其他可程式設備上執行一系列操作步驟以產生電腦實現的處理，從而在電腦或其他可程式設備上執行的指令提供用於實現在流程圖一個流程或多個流程和/或方塊圖一個方塊或多個方塊中指定的功能的步驟。
在一個典型的配置中，計算設備包括一個或多個處理器(CPU)、輸入/輸出介面、網路介面和記憶體。
記憶體可能包括電腦可讀媒體中的非永久性記憶體，隨機存取記憶體(RAM)和/或非易失性記憶體等形式，如唯讀記憶體(ROM)或快閃記憶體(flash RAM)。記憶體是電腦可讀媒體的示例。
電腦可讀媒體包括永久性和非永久性、可移動和非可移動媒體可以由任何方法或技術來實現資訊儲存。資訊可以是電腦可讀指令、資料結構、程式的模組或其他資料。電腦的儲存媒體的例子包括，但不限於相變記憶體(PRAM)、靜態隨機存取記憶體(SRAM)、動態隨機存取記憶體(DRAM)、其他類型的隨機存取記憶體(RAM)、唯讀記憶體(ROM)、電可抹除可程式化唯讀記憶體(EEPROM)、快閃記憶體或其他記憶體技術、唯讀光碟(CD-ROM)、數位化多功能光碟(DVD)或其他光學儲存、磁盒式磁帶，磁帶磁磁碟儲存或其他磁性儲存設備或任何其他非傳輸媒體，可用於儲存可以被計算設備存取的資訊。按照本文中的界定，電腦可讀媒體不包括暫存電腦可讀媒體(transitory media)，如調變的資料信號和載波。
本領域技術人員應明白，本說明書的實施例可提供為方法、系統或電腦程式產品。因此，本說明書實施例可採用完全硬體實施例、完全軟體實施例或結合軟體和硬體方面的實施例的形式。而且，本說明書實施例可採用在一個或多個其中包含有電腦可用程式碼的電腦可用儲存媒體(包括但不限於磁碟記憶體、CD-ROM、光學記憶體等)上實施的電腦程式產品的形式。
本說明書實施例可以在由電腦執行的電腦可執行指令的一般上下文中描述，例如程式模組。一般地，程式模組包括執行特定任務或實現特定抽象資料類型的歷程、程式、物件、組件、資料結構等等。也可以在分散式計算環境中實踐本說明書實施例，在這些分散式計算環境中，由藉由通訊網路而被連接的遠端處理設備來執行任務。在分散式計算環境中，程式模組可以位於包括儲存設備在內的本地和遠端電腦儲存媒體中。
本說明書中的各個實施例均採用遞進的方式描述，各個實施例之間相同相似的部分互相參見即可，每個實施例重點說明的都是與其他實施例的不同之處。尤其，對於系統實施例而言，由於其基本相似於方法實施例，所以描述的比較簡單，相關之處參見方法實施例的部分說明即可。在本說明書的描述中，參考術語“一個實施例”、“一些實施例”、“示例”、“具體示例”、或“一些示例”等的描述意指結合該實施例或示例描述的具體特徵、結構、材料或者特點包含於本說明書實施例的至少一個實施例或示例中。在本說明書中，對上述術語的示意性表述不必須針對的是相同的實施例或示例。而且，描述的具體特徵、結構、材料或者特點可以在任一個或多個實施例或示例中以合適的方式結合。此外，在不相互矛盾的情況下，本領域的技術人員可以將本說明書中描述的不同實施例或示例以及不同實施例或示例的特徵進行結合和組合。
以上所述僅為本說明書實施例的實施例而已，並不用於限制本說明書實施例。對於本領域技術人員來說，本說明書實施例可以有各種更改和變化。凡在本說明書實施例的精神和原理之內所作的任何修改、等同替換、改進等，均應包含在本說明書實施例的申請專利範圍之內。In order to enable those skilled in the art to better understand the technical solutions in this specification, the technical solutions in the embodiments of this specification will be clearly and completely described in combination with the drawings in the embodiments of this specification. Obviously, the described The examples are only a part of examples in this specification, but not all examples. Based on one or more embodiments in this specification, all other embodiments obtained by a person having ordinary knowledge in the art without creative labor should fall within the protection scope of the embodiments of this specification.
An embodiment provided in this specification can be applied to a client / server system architecture. The client may include a terminal device with a photographing function, such as a smart phone, a tablet computer, used by a person at the scene of the car damage (may be the owner of the accident car, or an insurance company person or other person who performs the damage treatment process). , Smart wearable devices, dedicated fixed loss terminals, etc. The client may have a communication module that can communicate with a remote server to achieve data transmission with the server. The server may include a server on the insurance company side or a server on the fixed loss service side. In other implementation scenarios, the server on the other service side may also be included, for example, there is communication with the server on the fixed loss service side. Terminals of linked accessory suppliers, terminals of vehicle repair shops, etc. The server may include a single computer device, or a server cluster composed of multiple servers, or a server of a distributed system. In some application scenarios, the client side can send real-time image data collected to the server to the server, and the server side can identify the damage, and the recognition result can be returned to the client. In the implementation of the processing on the server side, processing such as damage identification is performed by the server side, and the processing speed is usually higher than that on the client side, which can reduce the processing pressure on the client side and improve the speed of damage recognition. Of course, this specification does not exclude that all or part of the processing described above is implemented on the client side in other embodiments, such as real-time detection and identification of damage on the client side.
When users take photos or videos of car damage by themselves, they often face the following problems: 1. The user does not fully understand which damage parts need to be taken (for example, a scratch mark is mainly on the front door, and the back door has only a small amount, which is ignored by the user; but the back door It also needs to be painted, so you need to shoot the damaged part of the back door.) 2. The user cannot identify all the damage (for example, a slight depression is difficult for ordinary people to recognize with the naked eye). 3. It is difficult for the user to accurately grasp the shooting distance and angle. , The proportion of the damage site in the screen and other factors. To this end, the present invention provides a data processing method for vehicle damage determination that can be applied to mobile devices, which can easily identify the area to be shot in the shooting screen, and continuously guide users to take photos or videos of the area. So that users can complete the shooting required for loss determination without requiring professional knowledge.
The following describes a specific implementation scenario of a mobile phone client as an example. Specifically, FIG. 1 is a schematic flowchart of an embodiment of a data processing method for vehicle damage determination provided in this specification. Although the present specification provides method operation steps or device structures as shown in the following embodiments or drawings, based on conventional or no creative labor, the method or device may include more or partially merged fewer operation steps. Or module unit. Among the steps or structures that do not logically have the necessary causal relationship, the execution order of these steps or the module structure of the device is not limited to the execution order or module structure shown in the embodiments or the drawings of this specification. When the described method or module structure is applied to an actual device, server, or end product, the method or module structure shown in the embodiment or the diagram may be executed sequentially or in parallel (for example, a parallel processor or Multi-threaded processing environment, even decentralized processing, server cluster implementation environment). Of course, the description of the following embodiments does not limit other technical solutions that can be extended based on this specification. For example in other implementation scenarios. A specific embodiment is shown in FIG. 1. In an embodiment of a method for processing data for determining a vehicle's damage provided in this specification, the method may include:
S0: display shooting guidance information for the first damaged area of the shooting vehicle;
S2: if it is identified that there is a first damage in the current shooting window, determine a first damage area of the first damage;
S4: After displaying the first damaged area in a prominent manner, using the virtual reality to superimpose and display the rendered first damaged area in the current shooting window;
S6: Display shooting guidance information for the first damaged area.
The client on the user side in this embodiment may be a smart phone, and the smart phone may have a shooting function. The user can open a mobile phone application that implements the implementation of this specification at the scene of the vehicle accident to take a shot of the scene of the vehicle accident. After the client opens the application, the shooting window can be displayed on the client display screen, and the vehicle can be captured through the shooting window. The shooting window may be a video shooting window, which may be used for framing (image acquisition) of a vehicle damage scene by a terminal, and image information obtained by a client-integrated shooting device may be displayed in the shooting window. The specific interface structure of the shooting window and related information displayed can be customized.
The characteristics of the vehicle can be obtained during the shooting of the vehicle. The characteristic data may be specifically set according to data processing requirements such as vehicle identification, environment identification, and image identification. In general, the characteristic data may include data information of each component of the identified vehicle, and may be used to construct 3D coordinate information and establish an augmented reality space model of the vehicle (AR space model, a data representation method, and a contour image of the subject). . Of course, the characteristic data may also include other information such as the brand, model, color, outline, and unique identification code of the vehicle.
When the client enables the fixed loss service, it can display guidance information for shooting the damaged area. For ease of description, the damaged area that is currently or initially to be photographed is referred to as the first damaged area. For example, in an application example, when a user starts a fixed loss service application, the application may prompt the user to shoot at a position where the vehicle may be damaged at a distance that can clearly see the full picture of the vehicle. If necessary, the user can be prompted to move around the body. If no damage is found during the initial shooting, the user is prompted to take a full-scale shot against the vehicle in the reverse direction. When it is identified that there is a damage in the current shooting window (which may be referred to as the first damage at this time), the damage area corresponding to the damage may be further calculated and determined.
In some embodiments of the present specification, the damage identification processing may be implemented by the client side or the server side. The server at this time may be referred to as a damage identification server. In some application scenarios or computing capabilities, the images collected by the client can be directly used to identify the damage locally on the client, or other fixed loss data processing can reduce network transmission overhead. Of course, as mentioned earlier, the computing power on the server side is usually stronger than the client. Therefore, in another embodiment of the method provided in this specification, the processing of damage identification may be processed by the server side. Specifically, the identifying that the first damage exists in the current shooting window may include:
S20: Send the acquired images obtained by shooting to the damage recognition server;
S22: Receive a damage recognition result returned by the server, where the damage recognition result includes a processing result obtained by the damage recognition server using the pre-trained deep neural network to perform damage recognition on the acquired image.
It should be noted that the identification of the first damage described in this embodiment is for the current damage recognition processing, and the first does not perform damage recognition processing on images collected from other damages.
In the above embodiment, the client or the server can use a deep neural network constructed in advance or in real time to identify the damage in the image, such as the location of the damage, the damage component, and the type of damage.
Deep neural networks can be used for target detection and semantic segmentation. For the input picture, find the position of the target in the picture. FIG. 2 is a schematic diagram of a deep neural network model used in the method embodiment described in the specification. Depicted in Figure 2 is a typical deep neural network Faster R-CNN. A deep neural network can be trained by labeling a large number of pictures of the damage area in advance. The extent of the damage area. In addition, in some embodiments of this specification, a network structure customized for mobile devices can be used, such as based on a typical MobileNet, SqueezeNet or its improved network structure, so that the model can be used in mobile devices with lower power consumption and less Memory, slower processor environment, such as the mobile terminal operating environment of the client.
After the first damage area is determined, the area can be presented in a significant manner, and the area covered by the damage is superimposed on the shooting picture by AR technology. The prominent way of presentation mainly refers to the use of some features in the shooting picture to mark the damaged area, so that the damaged area is easy to identify or more prominent. In this embodiment, a specific presentation manner is not limited, and specifically, a constraint condition or a condition that achieves a prominent presentation manner can be set.
In another embodiment of the method provided in this specification, the prominent manner presentation may include:
S40: Use a preset characterization symbol to identify the first damage area, and the preset characterization symbol includes one of the following:
Dots, guides, regular graphic boxes, irregular graphic boxes, custom graphics.
FIG. 3 is a schematic diagram provided by this specification to identify a damaged area by using a small dot symbol presentation. Of course, in other embodiments, the preset symbol may also include other forms, such as a guide line, a regular graphic frame, an irregular graphic frame, a custom graphic, etc. In other embodiments, text, Characters, materials, etc. mark the damaged area and guide the user to shoot the damaged area. You can use one or more preset characterizations when presenting. In this embodiment, a preset symbol is used to identify the damage area, and the location area of the damage can be more clearly displayed in the shooting window, which assists the user to quickly locate and guide the shooting.
In another embodiment of the method provided in this specification, a dynamic presentation effect may also be used to identify the damaged area, and guide the user to shoot the damaged area in a more obvious way. Specifically, in another embodiment, the prominent manner presentation includes:
S400: Perform at least one of animated display of the preset representative symbol in color conversion, size conversion, rotation, and beating.
In some embodiments of the present specification, AR may be used to superimpose the boundaries of the actual damage, prompting the user to align the framing frame with a section with a variable cross section for shooting. The augmented reality AR generally refers to a technical implementation solution that calculates the position and angle of the camera image in real time and adds corresponding images, videos, and 3D models. This solution can put the virtual world on the screen and place it in the real world. To interact. The enhanced information space model constructed by using the feature data in the embodiments of the present specification may be the outline information of the vehicle, and specifically may be based on the obtained vehicle model, shooting angle, and the tire position, ceiling position, front face position, front large A plurality of characteristic data such as a lamp position, a tail lamp position, and a front and rear window position construct a contour of the vehicle. The contour may include a data model based on 3D coordinates, and the contour carries corresponding 3D coordinate information. The constructed outline can then be displayed in the shooting window. Of course, this specification does not exclude that the augmented reality space model described in other embodiments may also include other model forms or other model information added on the contour.
The AR model can be matched with the actual vehicle position during the shooting time. For example, the 3D contour constructed is superimposed on the contour position of the real vehicle. When the two completely match or the degree of matching reaches a threshold, the matching can be considered complete . In the specific matching process, the framing direction can be guided, and the user can guide the moving shooting direction or angle to align the constructed contour with the contour of the real vehicle photographed. The embodiment of this specification combines augmented reality technology, which not only displays the real information of the vehicle captured by the user's actual client, but also displays the information of the augmented reality space model of the vehicle constructed, and the two types of information complement each other and superimpose, which can provide more Good fixed loss service experience.
The shooting window combined with the AR space model can more intuitively show the scene of the vehicle, and can effectively determine the damage location of the vehicle and guide the shooting. The client may perform damage identification and guidance in an AR scenario, and the damage identification and guidance may specifically include shooting guidance information determined based on image information obtained from the shooting window. The client can obtain image information in the AR scene in the shooting window, analyze and calculate the obtained image information, and determine what kind of shooting guidance information needs to be displayed in the shooting window based on the analysis result. For example, the vehicle in the current shooting window is far away, and the user can be prompted to approach the shooting in the shooting window. If the shooting position is to the left and the rear of the vehicle cannot be captured, the shooting guide information can be displayed to prompt the user to pan the shooting angle to the right. The specific information of the damage identification guide and the shooting guide information displayed under what conditions can be set in advance corresponding policies or rules, which will not be described one by one in this embodiment.
In this embodiment, shooting guide information for the first damaged area may be displayed. Specifically, the shooting guide information to be displayed may be determined according to the current shooting information and the position information of the first damage area. For example, if a scratch is detected on the rear fender of the vehicle, and the scratch needs to be shot in the front and in the direction of the scratch, the user is now inclined at 45 degrees according to the position and angle information of the current shot. Shoot, and far from the scratch position. At this time, the user may be prompted to approach the location of the scratch, and the user is prompted to shoot in the front and along the direction of the scratch. The shooting guide information can be adjusted in real time according to the current framing. For example, if the user is already close to the scratch position and meets the shooting requirements, the shooting guide information that prompts the user to approach the scratch position at this time may no longer be displayed. The suspected damage can be identified by the client or the server.
The specific shooting guide information and shooting conditions that need to be displayed during shooting can be set accordingly according to the fixed loss interactive design or fixed loss processing requirements. In an embodiment provided in this specification, the shooting guide information may include at least one of the following:
Adjust the shooting direction;
Adjust the shooting angle;
Adjust the shooting distance;
Adjust the shooting light.
An example of shooting guidance is shown in Figure 4. Users can use the real-time shooting guide information to more conveniently and efficiently perform the damage processing. Users can shoot according to the shooting guide information, which eliminates the need for professional shooting skills or tedious shooting operations, and the user experience is better. The above embodiment describes the shooting guide information displayed by text. In the expandable embodiment, the shooting guide information may further include a display manner of image, voice, animation, vibration, and the like. The shooting screen is aimed at an area. Therefore, in another embodiment of the method, the form of the shooting guide information displayed in the current shooting window includes at least one of symbols, text, voice, animation, video, and vibration.
In another embodiment of the method, when a user points a camera of a mobile device at a vehicle for shooting, the user can shoot at a certain frame rate (such as 15 frames / s), and then the aforementioned deep neural network can be used for training. Way to identify the image. Once the damage is detected, a new shooting strategy can be started for the damaged area, such as increasing the shooting frame rate (such as 30 frames / s), and adjusting other parameters to achieve continuous acquisition of the area at a faster speed and lower power consumption. Position in the current shooting window. In this way, you can adjust shooting parameters according to different shooting areas, use different shooting strategies, flexibly adapt to different shooting scenes, and enhance shooting in key areas. Corresponding to non-key areas can also reduce power consumption by reducing the frequency. Therefore, in another embodiment of the method provided in this specification, when it is recognized that there is a damage in the current shooting window, a shooting strategy that adjusts at least a parameter including a shooting frame rate is used to shoot the damaged area.
Of course, you can also adjust other parameters, such as exposure and brightness. The specific shooting strategy can be customized according to the shooting scene.
Further, after a sufficient number of photos or videos are collected in the first damage area (to meet the requirements of the fixed-loss image collection), the user may be prompted to guide the next damage shooting until all the damage shooting is completed. In this way, when the user shoots a certain damage, the user can continuously guide the user to take the next damage shot, reduce the omission of damage shooting, reduce the user's participation in damage recognition, and improve the user experience. Therefore, in another embodiment of the method, as shown in FIG. 5, the method may further include:
S8: If it is determined that the shooting of the first damaged area is completed, the shooting guide information for shooting the second damaged area of the vehicle is displayed until the recognized damage shooting is completed.
The client application can return the captured damage picture to the insurance company for subsequent manual or automatic damage determination. It can also avoid or reduce the risk of users forging a fixed-loss image for fraud protection. Therefore, in another embodiment of the method provided in this specification, the method further includes:
S10: The captured image that meets the requirements of the fixed-loss image acquisition is transmitted to the fixed-loss server.
The fixed loss server may include a server on the insurance company side, or may include a server on the fixed loss service side. The transmission to the fixed loss server may include a client directly transmitting to the fixed loss server, or indirect transmission to the fixed loss server. Of course, the fixed loss image that meets the requirements can also be sent to the fixed loss server and the server of the fixed loss service side, such as the server of the fixed loss service provided by a payment application.
It should be noted that the real-time described in the above embodiments may include sending, receiving, or displaying immediately after acquiring or determining certain material information. Those skilled in the art can understand that after caching or expected calculations and waiting time, Sending, receiving, or displaying can still belong to the real-time definition scope. The images described in the embodiments of the present specification may include videos, and the videos may be regarded as a continuous image set.
In addition, the captured images or the fixed-loss images that meet the requirements in the solutions of the embodiments of this specification can be stored on the local client or uploaded to the remote server in real time. After the local client stores some data to prevent tampering or upload it to the server for storage, it can effectively prevent the tampered data from being tampered with, or insurance fraud by misappropriating other data than the image of the accident. Therefore, the embodiments of the present specification can also improve the data security of the fixed loss processing and the reliability of the fixed loss results.
The foregoing embodiment describes the implementation of a data processing method for determining a vehicle's damage by a user on a mobile client. It should be noted that the method described in the embodiments of this specification can be used in a variety of processing equipment, such as a dedicated fixed loss terminal, and an implementation scenario including a client and server architecture.
Each embodiment of the above method in this specification is described in a progressive manner, and the same or similar parts between the various embodiments may refer to each other. Each embodiment focuses on the differences from other embodiments. For related points, refer to the description of the method embodiments.
The method embodiments provided in the embodiments of the present application may be executed in a mobile terminal, a PC terminal, a dedicated fixed loss terminal, a server, or a similar computing device. Taking running on a mobile terminal as an example, FIG. 6 is a block diagram of a hardware structure of a client to which an interactive process of vehicle damage determination is applied according to the method or device embodiment of the present invention. As shown in FIG. 6, the client 10 may include one or more (only one shown in the figure) a processor 102 (the processor 102 may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA) , A memory 104 for storing data, and a transmission module 106 for communication functions. Those skilled in the art can understand that the structure shown in FIG. 6 is only a schematic, and it does not limit the structure of the electronic device. For example, the client 10 may further include more or fewer components than those shown in FIG. 6, for example, may further include other processing hardware, such as a GPU (Graphics Processing Unit, image processor), or have the same components as those shown in FIG. 8. Different configurations shown.
The memory 104 may be used to store software programs and modules of application software, such as program instructions / modules corresponding to the search method in the embodiment of the present specification. The processor 102 runs the software programs and modules stored in the memory 104 , So as to execute various functional applications and data processing, that is, to achieve the above-mentioned processing method of navigation interactive interface content display. The memory 104 may include high-speed random access memory, and may further include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include memory remotely disposed relative to the processor 102, and these remote memories may be connected to the client 10 through a network. Examples of the above network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
The transmission module 106 is used to receive or send data through a network. The above specific examples of the network may include a wireless network provided by a communication provider of the computer terminal 10. In one example, the transmission module 106 includes a network interface controller (NIC), which can be connected to other network devices through the base station to communicate with the Internet. In one example, the transmission module 106 may be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.
Based on the image object positioning method described above, this specification also provides a data processing device for vehicle fixed damage. The device may include a system (including a decentralized system), software (application), a module, a component, a server, a client, and the like using the method described in the embodiments of the present specification, and a device incorporating necessary implementation hardware Device. Based on the same innovative concept, the processing device in one embodiment provided in this specification is as described in the following embodiments. Since the implementation solution of the device to solve the problem is similar to the method, the implementation of the specific processing device in the embodiment of this specification may refer to the implementation of the foregoing method, and the duplicated details are not described again. Although the devices described in the following embodiments are preferably implemented in software, implementation in hardware, or a combination of software and hardware is also possible and conceived. Specifically, as shown in FIG. 7, FIG. 7 is a schematic diagram of a module structure of an embodiment of a data processing device for determining a vehicle damage provided in this specification, which may specifically include:
The first reminder module 201 may be used to display shooting guide information for shooting the first damaged area of the vehicle;
The damage recognition result module 202 may be used to determine a first damage region of the first damage if it is recognized that a first damage exists in the current shooting window;
The prominent display module 203 may be configured to display the first damaged region in a prominent manner, and use the virtual reality to superimpose and display the rendered first damaged region in the current shooting window;
The second prompt module 204 may be used to display shooting guide information for the first damaged area.
It should be noted that the device described in the foregoing embodiment according to the description of the related method embodiment may further include other implementation manners, such as a rendering processing module that performs rendering, an AR display module that performs AR processing, and the like. For specific implementation manners, reference may be made to the description of the method embodiments, and details are not described herein.
The device model identification method provided in the embodiments of this specification can be implemented by a processor executing corresponding program instructions in a computer, such as using the c ++ / java language of the windows / Linux operating system on the PC / server side, or other such as android 2. The necessary hardware implementation of the application programming language corresponding to the iOS system, or the implementation of processing logic based on quantum computers. Specifically, in the embodiment of the method for realizing the above method provided by a vehicle-defective data processing device provided in this specification, the processing device may include a processor and a memory for storing processor-executable instructions, and the processor executes all Implemented when describing the instruction:
Display shooting guidance information for the first damaged area of the shooting vehicle;
If it is identified that a first damage exists in the current shooting window, determining a first damage area of the first damage;
After presenting the first damaged area in a prominent manner, using the virtual reality to superimpose and display the rendered first damaged area in the current shooting window;
Displaying shooting guidance information for the first damaged area.
Based on the foregoing method embodiment description, in another embodiment of the processing device, the processor further executes:
If it is determined that the shooting of the first damaged area is completed, the shooting guide information for shooting the second damaged area of the vehicle is displayed until the recognized damage shooting is completed.
Based on the foregoing method embodiment description, in another embodiment of the processing device, the prominent manner presentation includes:
The first damage region is identified by using a preset symbol, and the preset symbol includes one of the following:
Dots, guides, regular graphic boxes, irregular graphic boxes, custom graphics.
Based on the foregoing method embodiment description, in another embodiment of the processing device, the prominent manner presentation includes:
Performing at least one of the color transformation, size transformation, rotation, and beating animation display on the preset representative symbol.
Based on the foregoing method embodiment description, in another embodiment of the processing device, the shooting guide information includes at least one of the following:
Adjust the shooting direction;
Adjust the shooting angle;
Adjust the shooting distance;
Adjust the shooting light.
Based on the foregoing method embodiment description, in another embodiment of the processing device, the form of the shooting guide information displayed in the current shooting window includes at least one of a symbol, a text, a voice, an animation, a video, and a vibration.
Based on the foregoing method embodiment description, in another embodiment of the processing device, the processor identifying that the first damage exists in the current shooting window includes:
Send the captured images acquired by shooting to the damage recognition server;
Receiving a damage recognition result returned by the server, where the damage recognition result includes a processing result obtained by the damage recognition server performing damage recognition on the acquired image by using a pre-trained deep neural network.
Based on the description of the foregoing method embodiment, in another embodiment of the processing device, when the processor recognizes that there is a damage in the current shooting window, the processor executes a shooting strategy that uses at least a parameter including a shooting frame rate to adjust the damage area Take a shot.
Based on the foregoing method embodiment description, in another embodiment of the processing device, the processor further executes:
The captured image that meets the requirements of the fixed-loss image acquisition is transmitted to the fixed-loss server.
It should be noted that, in the processing device described in the foregoing embodiment, the description of the related method embodiment may further include other expandable implementations. For specific implementation manners, reference may be made to the description of the method embodiments, and details are not described herein.
The above instructions can be stored in a variety of computer-readable storage media. The computer-readable storage medium may include a physical device for storing information, and the information may be digitized and then stored by using a medium such as electricity, magnetism, or optics. The computer-readable storage medium described in this embodiment may include: a device for storing information using electric energy, such as various types of memory, such as RAM, ROM, etc .; a device for storing information using magnetic energy, such as hard disk, floppy disk, Magnetic tape, core memory, bubble memory, USB flash drive; devices that use optical means to store information, such as CDs or DVDs. Of course, there are other ways of readable storage media, such as quantum memory, graphene memory, and so on. The instructions in the device or server or client or system described in the embodiments of this specification are as described above.
The above method or device embodiment can be used for a client on the user side, such as a smart phone. Therefore, this specification provides a client, which includes a processor and a memory for storing processor-executable instructions. When the processor executes the instructions, it implements:
Display shooting guidance information for the first damaged area of the shooting vehicle;
If it is identified that a first damage exists in the current shooting window, determining a first damage area of the first damage;
After presenting the first damaged area in a prominent manner, using the virtual reality to superimpose and display the rendered first damaged area in the current shooting window;
Displaying shooting guidance information for the first damaged area.
Based on the foregoing, an embodiment of the present specification further provides an electronic device including a display screen, a processor, and a memory storing instructions executable by the processor.
FIG. 8 is a schematic structural diagram of an embodiment of an electronic device provided in this description. When the processor executes the instructions, the method steps described in any one of the embodiments of the present specification can be implemented.
Each embodiment of the device, client, electronic device, etc. described in this specification is described in a progressive manner. The same and similar parts between the various embodiments can refer to each other. Each embodiment focuses on explaining the other The difference between the examples. In particular, for the hardware-plus-program-type embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts may refer to the description of the method embodiment.
The specific embodiments of the present specification have been described above. Other embodiments are within the scope of the appended patent applications. In some cases, the actions or steps described in the scope of the patent application may be performed in a different order than in the embodiments and still achieve the desired result. In addition, the processes depicted in the figures do not necessarily require the particular order shown or sequential order to achieve the desired result. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
Although the present application provides method operation steps as described in the embodiments or flowcharts, more or less operation steps may be included based on conventional or non-creative labor. The sequence of steps listed in the embodiments is only one way of executing the steps, and does not represent the only sequence of execution. When the actual device or client product is executed, it may be executed sequentially or in parallel according to the method shown in the embodiment or the diagram (for example, a parallel processor or a multi-threaded processing environment).
Although the content of the embodiments of this specification mentions AR technology, shooting guidance information display, shooting guidance interacting with the user, using deep neural network to initially identify the location of the damage, etc., data acquisition, position arrangement, interaction, calculation, judgment and other operations And data description, however, the embodiments of the present specification are not limited to the situations that must conform to industry communication standards, standard image data processing protocols, communication protocols, and standard data models / templates or the embodiments described in the present specification. Certain industry standards or implementations that are slightly modified based on implementations described in custom methods or embodiments can also achieve the same, equivalent or similar, or predictable implementation effects of the above embodiments. Embodiments obtained by applying these modified or deformed data acquisition, storage, judgment, processing methods, etc., may still fall within the scope of optional implementations of this specification.
In the 1990s, for a technical improvement, it can be clearly distinguished whether it is an improvement in hardware (for example, the improvement of circuit structures such as diodes, transistors, switches, etc.) or an improvement in software (for method and process Improve). However, with the development of technology, the improvement of many methods and processes can be regarded as a direct improvement of the hardware circuit structure. Designers almost always get the corresponding hardware circuit structure by programming the improved method flow into the hardware circuit. Therefore, it cannot be said that the improvement of a method flow cannot be realized by a hardware entity module. For example, a programmable logic device (Programmable Logic Device, PLD) (such as a Field Programmable Gate Array (FPGA)) is such an integrated circuit whose logic function is determined by the user programming the device. It is programmed by the designer to "integrate" a digital system on a PLD, without having to ask a chip manufacturer to design and manufacture a dedicated integrated circuit chip. Moreover, nowadays, instead of making integrated circuit chips by hand, this programming is mostly implemented using "logic compiler" software, which is similar to the software compiler used in program development and writing, and requires compilation. The previous source code must also be written in a specific programming language. This is called the Hardware Description Language (HDL). HDL is not the only one, but there are many types, such as ABEL (Advanced Boolean Expression Language), AHDL (Altera Hardware Description Language), Confluence, CUPL (Cornell University Programming Language), HDCal, JHDL (Java Hardware Description Language), Lava, Lola, MyHDL, PALASM, RHDL (Ruby Hardware Description Language), etc. VHDL (Very-High-Speed Integrated Circuit Hardware Description Language) and Verilog are commonly used. Those skilled in the art should also be clear that the hardware circuit that implements the logic method flow can be easily obtained by simply programming the method flow into the integrated circuit with the above-mentioned several hardware description languages.
The controller may be implemented in any suitable manner, for example, the controller may take the form of a microprocessor or processor and a computer-readable storage of computer-readable code (such as software or firmware) executable by the (micro) processor. Media, logic gates, switches, application specific integrated circuits (ASICs), programmable logic controllers and embedded microcontrollers. Examples of controllers include, but are not limited to, the following microcontrollers: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20 and Silicone Labs C8051F320, the memory controller can also be implemented as part of the control logic of the memory. Those skilled in the art also know that, in addition to implementing the controller in pure computer-readable code, it is entirely possible to program the method steps to logically control the controller with logic gates, switches, application-specific integrated circuits, and programmable logic control. Controller and embedded microcontroller to achieve the same function. Therefore, the controller can be considered as a hardware component, and the device included in the controller for implementing various functions can also be considered as a structure in the hardware component. Or even, a device for implementing various functions can be regarded as a structure that can be both a software module implementing the method and a hardware component.
The system, device, module, or unit described in the foregoing embodiments may be specifically implemented by a computer chip or entity, or by a product having a certain function. A typical implementation is a computer. Specifically, the computer may be, for example, a personal computer, a notebook computer, an in-vehicle human-computer interactive device, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, or a tablet. A computer, a wearable device, or a combination of any of these devices.
Although the embodiments of the present specification provide the operation steps of the method as described in the embodiments or flowcharts, more or less operation steps may be included based on conventional or non-creative means. The sequence of steps listed in the embodiments is only one way of executing the steps, and does not represent the only sequence of execution. When the actual device or terminal product is executed, it may be executed sequentially or in parallel according to the method shown in the embodiment or the diagram (for example, a parallel processor or multi-threaded environment, or even a distributed data processing environment). The terms "including,""including," or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, product, or device that includes a series of elements includes not only those elements, but also other elements not explicitly listed Elements, or elements that are inherent to such a process, method, product, or device. Without further limitation, it does not exclude that there are other identical or equivalent elements in the process, method, product or equipment including the elements.
For the convenience of description, when describing the above device, the functions are divided into various modules and described separately. Of course, when implementing the embodiments of this specification, the functions of each module may be implemented in the same or multiple software and / or hardware, or the module that implements the same function may be composed of multiple submodules or subunits. Implementation etc. The device embodiments described above are only schematic. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner. For example, multiple units or components may be combined or integrated into Another system, or some features, can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, which may be electrical, mechanical or other forms.
Those skilled in the art also know that, in addition to implementing the controller in pure computer-readable code, it is entirely possible to program the method steps to logically control the controller with logic gates, switches, application-specific integrated circuits, and programmable logic control. Controller and embedded microcontroller to achieve the same function. Therefore, such a controller can be considered as a hardware component, and the device included in the controller for implementing various functions can also be considered as a structure within the hardware component. Or even, a device for implementing various functions can be regarded as a structure that can be both a software module implementing the method and a hardware component.
The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each flow and / or block in the flowchart and / or block diagram, and a combination of the flow and / or block in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, special purpose computer, embedded processor, or other programmable data processing device to generate a machine, so that the instructions generated by the processor of the computer or other programmable data processing device are generated Means for realizing the functions specified in one or more flowcharts and / or one or more blocks of the block diagram.
These computer program instructions may also be stored in computer readable memory that can guide a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory generate a manufactured article including a command device, The instruction device realizes a function specified in a flowchart or a plurality of processes and / or a block or a block of a block diagram.
These computer program instructions can also be loaded on a computer or other programmable data processing equipment, so that a series of operating steps can be performed on the computer or other programmable equipment to generate computer-implemented processing, which can be executed on the computer or other programmable equipment. The instructions provide steps for implementing the functions specified in one or more flowcharts and / or one or more blocks of the block diagram.
In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.
Memory may include non-permanent memory, random access memory (RAM), and / or non-volatile memory in computer-readable media, such as read-only memory (ROM) or flash memory ( flash RAM). Memory is an example of a computer-readable medium.
Computer-readable media includes permanent and non-permanent, removable and non-removable media. Information can be stored by any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), and other types of random access memory (RAM) , Read-only memory (ROM), electrically erasable and programmable read-only memory (EEPROM), flash memory or other memory technologies, read-only discs (CD-ROM), digital versatile discs (DVDs) ) Or other optical storage, magnetic tape cartridges, magnetic disk storage or other magnetic storage devices, or any other non-transmission media, may be used to store information that can be accessed by computing devices. According to the definition in this article, computer-readable media does not include temporary computer-readable media (transitory media), such as modulated data signals and carrier waves.
Those skilled in the art should understand that the embodiments of the present specification may be provided as a method, a system, or a computer program product. Therefore, the embodiments of the present specification may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Moreover, the embodiments of the present specification may use a computer program product implemented on one or more computer-usable storage media (including but not limited to disk memory, CD-ROM, optical memory, etc.) containing computer-usable code. form.
The embodiments of this specification can be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include processes, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The embodiments of the present specification can also be practiced in a decentralized computing environment. In these decentralized computing environments, tasks are performed by a remote processing device connected through a communication network. In a decentralized computing environment, program modules can be located in local and remote computer storage media, including storage devices.
Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the various embodiments can be referred to each other. Each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple. For the relevant part, refer to the description of the method embodiment. In the description of this specification, the description with reference to the terms “one embodiment”, “some embodiments”, “examples”, “specific examples”, or “some examples” and the like means specific features described in conjunction with the embodiments or examples , Structure, materials, or features are included in at least one embodiment or example of an embodiment of the present specification. In this specification, the schematic expressions of the above terms are not necessarily directed to the same embodiment or example. Moreover, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. In addition, without any contradiction, those skilled in the art may combine and combine different embodiments or examples and features of the different embodiments or examples described in this specification.
The above descriptions are merely examples of the embodiments of the present specification, and are not intended to limit the embodiments of the present specification. For those skilled in the art, the embodiments of the present specification may have various modifications and changes. Any modification, equivalent replacement, and improvement made within the spirit and principle of the embodiments of the present specification shall be included in the scope of patent application of the embodiments of the present specification.

S0~S8‧‧‧步驟S0 ~ S8‧‧‧step

10‧‧‧客戶端 10‧‧‧Client

102‧‧‧處理器 102‧‧‧ processor

104‧‧‧非易失性記憶體 104‧‧‧Non-volatile memory

106‧‧‧傳輸模組 106‧‧‧Transmission Module

201‧‧‧第一提示模組 201‧‧‧The first reminder module

202‧‧‧損傷識別結果模組 202‧‧‧ Damage Identification Results Module

203‧‧‧顯著顯示模組 203‧‧‧Significant display module

204‧‧‧第二提示模組 204‧‧‧Second Reminder Module

為了更清楚地說明本說明書實施例或現有技術中的技術方案，下面將對實施例或現有技術描述中所需要使用的圖式作簡單地介紹，顯而易見地，下面描述中的圖式僅僅是本說明書中記載的一些實施例，對於本領域具有通常知識者來講，在不付出創造性勞動性的前提下，還可以根據這些圖式獲得其他的圖式。In order to more clearly explain the embodiments of the present specification or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings in the following description are only For some people with ordinary knowledge in the field, some of the embodiments described in the specification can also obtain other drawings based on these drawings without paying creative labor.

圖1是本說明書提供的所述一種車輛定損的資料處理方法實施例的流程示意圖； FIG. 1 is a schematic flowchart of an embodiment of a data processing method for determining vehicle damage provided in this specification;

圖2是本說明書所述方法實施例使用的深度神經網路模型示意圖； 2 is a schematic diagram of a deep neural network model used in the method embodiment described in this specification;

圖3是本說明書提供一種採用小點點符號呈現來標識出損傷區域的示意圖； 3 is a schematic diagram provided by the present specification to identify a damaged area by using a small dot symbol presentation;

圖4是本說明書提供的所述方法中拍攝引導實施例的實施場景示意圖； FIG. 4 is a schematic diagram of an implementation scenario of a shooting guide embodiment in the method provided in this specification; FIG.

圖5是本說明書提供的所述方法的另一個實施例的實施場景示意圖； 5 is a schematic diagram of an implementation scenario of another embodiment of the method provided in this specification;

圖6是應用本發明方法或裝置實施例一種車輛定損的互動處理的客戶端的硬體結構方塊圖； FIG. 6 is a block diagram of a hardware structure of a client to which an interactive method of vehicle fixed damage is applied according to a method or device embodiment of the present invention; FIG.

圖7是本說明書提供的一種車輛定損的資料處理裝置實施例的模組結構示意圖； FIG. 7 is a schematic diagram of a module structure of an embodiment of a data processing device for determining vehicle damage provided in this specification; FIG.

圖8是本說明提供的一種電子設備實施例的結構示意圖。 FIG. 8 is a schematic structural diagram of an embodiment of an electronic device provided in this description.

Claims

A data processing method for vehicle fixed damage, the method includes: Display shooting guidance information for the first damaged area of the shooting vehicle; If it is identified that the first damage exists in the current shooting window, determining the first damage area of the first damage; After presenting the first damage area in a prominent manner, using the virtual reality to superimpose and display the rendered first damage area in the current shooting window; Display shooting guidance information for the first damaged area.

The method as described in claim 1 of the patent application scope, further comprising: If it is determined that the shooting of the first damaged area is completed, the shooting guide information for shooting the second damaged area of the vehicle is displayed until the recognized damage shooting is completed.

As the method described in the scope of patent application No. 1, the prominent way to present includes: The first damage region is identified by using a preset symbol, and the preset symbol includes one of the following: Dots, guides, regular graphic boxes, irregular graphic boxes, custom graphics.

As the method described in the third scope of the patent application, the prominent way of presenting includes: At least one of the color transformation, size transformation, rotation, and beating animation display is performed on the preset representative symbol.

According to the method described in the first patent application scope, the shooting guide information includes at least one of the following: Adjust the shooting direction; Adjust the shooting angle; Adjust the shooting distance; Adjust the shooting light.

According to the method described in item 1 of the scope of patent application, the form of the shooting guide information displayed in the current shooting window includes at least one of symbols, text, voice, animation, video, and vibration.

According to the method described in item 1 of the scope of patent application, when it is recognized that there is damage in the current shooting window, a shooting strategy that adjusts at least parameters including the shooting frame rate is used to shoot the damaged area.

According to the method described in item 1 of the patent application scope, the identifying that the first damage exists in the current shooting window includes: Send the captured images acquired by shooting to the damage recognition server; Receive a damage recognition result returned by the server, and the damage recognition result includes a processing result obtained by the damage recognition server performing damage recognition on the acquired image by using a pre-trained deep neural network.

The method as described in claim 1 of the patent application scope, further comprising: The captured image that meets the requirements of the fixed-loss image acquisition is transmitted to the fixed-loss server.

A data processing device for determining vehicle damage, the device includes: A first reminder module for displaying shooting guide information for shooting the first damaged area of the vehicle; A damage recognition result module for determining a first damage region of the first damage if it is recognized that a first damage exists in the current shooting window; A prominent display module, configured to display the first damaged area in a prominent manner, and use the virtual reality to superimpose and display the rendered first damaged area in the current shooting window; A second prompt module is used to display shooting guide information for the first damaged area.

A data processing device for vehicle damage determination includes a processor and a memory for storing processor-executable instructions. When the processor executes the instructions, the processor realizes: Display shooting guidance information for the first damaged area of the shooting vehicle; If it is identified that the first damage exists in the current shooting window, determining the first damage area of the first damage; After presenting the first damage area in a prominent manner, using the virtual reality to superimpose and display the rendered first damage area in the current shooting window; Display shooting guidance information for the first damaged area.

As the processing device described in item 11 of the scope of patent application, the processor also executes: If it is determined that the shooting of the first damaged area is completed, the shooting guide information for shooting the second damaged area of the vehicle is displayed until the recognized damage shooting is completed.

As for the processing equipment described in item 11 of the scope of patent application, this prominent way of presentation includes: The first damage region is identified by using a preset symbol, and the preset symbol includes one of the following: Dots, guides, regular graphic boxes, irregular graphic boxes, custom graphics.

As for the processing equipment described in item 13 of the scope of patent application, the prominent way to present includes: At least one of the color transformation, size transformation, rotation, and beating animation display is performed on the preset representative symbol.

As for the processing device described in the scope of the patent application, the shooting guidance information includes at least one of the following: Adjust the shooting direction; Adjust the shooting angle; Adjust the shooting distance; Adjust the shooting light.

According to the processing device described in item 11 of the scope of patent application, the form of the shooting guide information displayed in the current shooting window includes at least one of symbols, text, voice, animation, video, and vibration.

According to the processing device described in item 11 of the scope of patent application, the processor recognizes that the first damage in the current shooting window includes: Send the captured images acquired by shooting to the damage recognition server; Receive a damage recognition result returned by the server, and the damage recognition result includes a processing result obtained by the damage recognition server performing damage recognition on the acquired image by using a pre-trained deep neural network.

As the processing device described in item 11 of the scope of patent application, when the processor recognizes that there is damage in the current shooting window, the processor executes a shooting strategy that uses at least a parameter including a shooting frame rate to shoot the damaged area.

As the processing device described in item 11 of the scope of patent application, the processor also executes: The captured image that meets the requirements of the fixed-loss image acquisition is transmitted to the fixed-loss server.

A client includes a processor and a memory for storing processor-executable instructions. When the processor executes the instructions, it implements: Display shooting guidance information for the first damaged area of the shooting vehicle; If it is identified that the first damage exists in the current shooting window, determining the first damage area of the first damage; After presenting the first damage area in a prominent manner, using the virtual reality to superimpose and display the rendered first damage area in the current shooting window; Display shooting guidance information for the first damaged area.

An electronic device includes a display screen, a processor, and a memory storing instructions executable by the processor. When the processor executes the instructions, the method steps described in any one of claims 1-9 of the scope of patent application are implemented.