CN110977970B - Recognition method of image recognition system - Google Patents

Recognition method of image recognition system Download PDF

Info

Publication number
CN110977970B
CN110977970B CN201911220468.0A CN201911220468A CN110977970B CN 110977970 B CN110977970 B CN 110977970B CN 201911220468 A CN201911220468 A CN 201911220468A CN 110977970 B CN110977970 B CN 110977970B
Authority
CN
China
Prior art keywords
camera
arm
power output
support arm
support
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911220468.0A
Other languages
Chinese (zh)
Other versions
CN110977970A (en
Inventor
姚旭新
朱向军
陆开中
钟宇文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Kangdingli Technology Co.,Ltd.
Original Assignee
Guangdong Genius Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Genius Technology Co Ltd filed Critical Guangdong Genius Technology Co Ltd
Priority to CN201911220468.0A priority Critical patent/CN110977970B/en
Publication of CN110977970A publication Critical patent/CN110977970A/en
Application granted granted Critical
Publication of CN110977970B publication Critical patent/CN110977970B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Program-controlled manipulators
    • B25J9/16—Program controls
    • B25J9/1694—Program controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
    • B25J9/1697—Vision controlled systems
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J19/00—Accessories fitted to manipulators, e.g. for monitoring, for viewing; Safety devices combined with or specially adapted for use in connection with manipulators
    • B25J19/02—Sensing devices
    • B25J19/021—Optical sensing devices
    • B25J19/023—Optical sensing devices including video camera means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition
    • G06V30/14—Image acquisition
    • G06V30/148—Segmentation of character regions
    • G06V30/153—Segmentation of character regions using recognition of characters or words

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Manipulator (AREA)
  • Studio Devices (AREA)

Abstract

本申请提供了一种图像识别系统的识别方法,该图像识别系统包括用于获取被测物体的图像信息的摄像头、用于驱动摄像头移动的机械手臂组件和主机本体,摄像头安装于机械手臂组件上。本申请通过在机械手臂组件上设置摄像头,摄像头可获取被测物体的图像信息。当用户的指尖指在被测物体的指定内容时,摄像头拾取指尖指示的内容后,将信号传输给主机本体,此时主机本体驱动机械手臂组件以将摄像头移动至指尖所指内容的正上方,通过摄像头的自动对焦功能,能清楚地获取指尖所指内容的图像,内容识别率高,点读错误率低,可有效解决因固定的摄像头与书本成一定角度而导致内容识别率低,手指悬空导致点读错误率高的问题。

Figure 201911220468

The present application provides an identification method for an image recognition system. The image recognition system includes a camera for acquiring image information of a measured object, a robotic arm assembly for driving the camera to move, and a host body, and the camera is mounted on the robotic arm assembly. . In the present application, a camera is provided on the mechanical arm assembly, and the camera can obtain image information of the object to be measured. When the user's fingertip points to the specified content of the object to be measured, the camera picks up the content indicated by the fingertip and transmits the signal to the host body. At this time, the host body drives the mechanical arm assembly to move the camera to the location of the content pointed by the fingertip. Right above, through the automatic focus function of the camera, the image of the content pointed by the fingertip can be clearly obtained, the content recognition rate is high, and the reading error rate is low, which can effectively solve the content recognition rate caused by the fixed camera and the book at a certain angle. Low, the finger hanging in the air leads to the problem of high point reading error rate.

Figure 201911220468

Description

Recognition method of image recognition system
Technical Field
The present application relates to the field of electronic devices, and more particularly, to an identification method of an image identification system.
Background
The finger reading of the book is a technology for accurately identifying the content pointed by the finger by pointing the relevant content of the book by the finger and the machine accurately identifies the content pointed by the finger through an AI (Artificial Intelligence) algorithm, intelligent voice, intelligent image identification and fingertip positioning, thereby carrying out character identification.
The existing hand-pointing book reading machine mainly fixes a camera at a certain height, forms a certain angle with a book, and obtains an image through a single fixed-focus wide-angle high-definition camera so as to recognize characters. However, this method cannot solve the problem that the image at near point is greatly distorted; in addition, the depth information of the finger cannot be acquired, the problem of wrong touch reading caused by suspension of the finger cannot be solved, and touch reading experience is influenced.
Disclosure of Invention
An object of the embodiments of the present application is to provide an identification method for an image identification system, so as to solve the problems in the related art that a fixed camera forms a certain angle with a book, which results in a low content identification rate and a high click-to-read error rate.
In order to achieve the above purpose, the embodiment of the present application adopts the following technical solutions:
an identification method of an image identification system is provided, which adopts the image identification system, and the image identification system comprises:
the camera is used for acquiring image information of a measured object;
the mechanical arm assembly is connected with the camera and used for driving the camera to move;
the main machine body is used for driving the mechanical arm component to move the camera to be right above the specified content of the object to be measured and identify the specified content;
the camera and the manipulator arm assembly are respectively and electrically connected with the main machine body;
the identification method of the image identification system comprises the following steps:
adjusting: the main machine body controls the mechanical arm assembly, the camera is moved to the position above a measured object, and the camera acquires an integral image of the measured object;
specifying: determining specified content on the object to be measured;
identification: the host body controls the mechanical arm assembly to move the camera to the position right above the specified content, and the host body acquires and identifies the specified content through the camera.
In one embodiment, the distance between the camera and the object to be measured in the adjusting step is greater than the distance between the camera and the object to be measured in the identifying step.
In one embodiment, the distance between the camera and the object to be measured in the adjusting step is greater than the distance between the camera and the object to be measured in the identifying step.
In one embodiment, the robot arm assembly comprises a support member and a drive member for driving the support member to move; the camera is installed on the support component, the driving component is connected with the support component, and the host body is electrically connected with the driving component.
In one embodiment, the stand member includes a rotating stand and a telescopic stand mounted on the rotating stand, the camera being mounted on the telescopic stand; the driving component comprises a power part and a transmission part, the power part is used for driving the rotating support to rotate, the transmission part is used for driving the telescopic support to slide on the rotating support, the rotating support is connected with the power part, the transmission part is installed on the rotating support, the transmission part is connected with the telescopic support, and the power part and the transmission part are respectively and electrically connected with the main body.
In one embodiment, the telescopic bracket comprises an arm mounted on the rotary bracket and a connecting arm connected with the arm, the arm is connected with the transmission member, and the camera is mounted on the connecting arm; the driving component also comprises a first power output part for driving the connecting arm to rotate around the supporting arm; the first power output piece is arranged on the support arm and connected with the connecting arm, and the main machine body is electrically connected with the first power output piece.
In one embodiment, the connecting arm comprises a first supporting arm connected with the supporting arm and a second supporting arm connected with the first supporting arm, and the camera is mounted on the second supporting arm; the driving member further comprises a second power output part for driving the second supporting arm to wind the first supporting arm, the first power output part is connected with the first supporting arm, the second power output part is installed on the first supporting arm, the second power output part is connected with the second supporting arm, and the host body is electrically connected with the second power output part.
In one embodiment, the first support arm comprises a plurality of sequentially connected rotating arms, the rotating arm at one end of the first support arm is connected with the support arm, and the rotating arm at the other end of the first support arm is connected with the second support arm; the driving component further comprises third power output pieces used for driving the rotating arms to rotate, each third power output piece is installed on the first supporting arm and connected with the corresponding rotating arm, and the main body is electrically connected with each third power output piece.
In one embodiment, the driving member further comprises a fourth power output element for driving the second support arm to rotate, the fourth power output element is mounted on the first support arm, the fourth power output element is connected with the second support arm, and the main body is electrically connected with the fourth power output element.
In one embodiment, the host body includes:
a main control module;
the cloud identification module is used for uploading the specified content of the measured object acquired by the camera to a database and identifying and acquiring content information; and the number of the first and second groups,
the display module is used for playing and displaying the content information acquired by the cloud identification module;
the cloud identification module and the display module are respectively electrically connected with the main control module.
One or more technical solutions in the embodiments of the present application have at least one of the following technical effects:
the identification method of the image identification system provided by the embodiment of the application has the beneficial effects that: compared with the prior art, the camera is arranged on the mechanical arm component, and the camera can acquire the image information of the measured object. When the fingertip of a user points at the designated content of a measured object, the camera picks up the content indicated by the fingertip and transmits a signal to the host body, the host body drives the mechanical arm assembly to move the camera to the position right above the content indicated by the fingertip at the moment, an image of the content indicated by the fingertip can be clearly obtained through the automatic focusing function of the camera, the content recognition rate is high, the click-to-read error rate is low, and the problems that the content recognition rate is low due to the fact that the fixed camera and a book form a certain angle, and the click-to-read error rate is high due to the fact that the finger is suspended in the air can be effectively solved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments or exemplary technical descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a robot arm assembly and a camera provided in an embodiment of the present application;
fig. 2 is a schematic structural diagram of a manipulator arm assembly, a camera and a measured object provided in the embodiment of the present application;
fig. 3 is a schematic functional structure diagram of an image recognition system according to an embodiment of the present application;
fig. 4 is a flowchart of an identification method of an image identification system according to an embodiment of the present application.
Wherein, in the drawings, the reference numerals are mainly as follows:
1-a scaffold member; 11-a rotating bracket; 12-a telescopic bracket; 13-a support arm; 14-a linker arm; 15-a first support arm; 151-a swivel arm; 16-a second support arm;
2-a drive member; 21-a power member; 22-a transmission member; 23-a first power take off; 24-a second power take off; 25-a third power take off; 26-a fourth pto;
3-the main body of the host; 31-a master control module; 32-cloud identification module; 33-a display module;
4-a camera; 5-the object to be measured.
Detailed Description
In order to make the technical problems, technical solutions and advantageous effects to be solved by the present application clearer, the present application is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
It will be understood that when an element is referred to as being "secured to" or "disposed on" another element, it can be directly on the other element or be indirectly on the other element. When an element is referred to as being "connected to" another element, it can be directly connected to the other element or be indirectly connected to the other element.
Furthermore, the terms "first", "second", "third", "fourth" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the present application, "a plurality" means two or more unless specifically limited otherwise. The meaning of "a number" is one or more unless specifically limited otherwise.
In the description of the present application, it is to be understood that the terms "center", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", and the like, indicate orientations or positional relationships based on those shown in the drawings, and are used only for convenience in describing the present application and for simplicity in description, and do not indicate or imply that the referenced devices or elements must have a particular orientation, be constructed and operated in a particular orientation, and thus, are not to be construed as limiting the present application.
In the description of the present application, it is to be noted that, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; can be mechanically or electrically connected; either directly or indirectly through intervening media, either internally or in any other relationship. The specific meaning of the above terms in the present application can be understood by those of ordinary skill in the art as appropriate.
Reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present application. Thus, the appearances of the phrases "in one embodiment" or "in some embodiments" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
For convenience of description, three coordinate axes which are mutually vertical in space are defined as an X axis, a Y axis and a Z axis respectively, and meanwhile, the direction along the X axis is longitudinal, the direction along the Y axis is transverse, and the direction along the Z axis is vertical; the X axis and the Y axis are two coordinate axes which are vertical to each other on the same horizontal plane, and the Z axis is a coordinate axis in the vertical direction; the X axis, the Y axis and the Z axis are positioned in space and are mutually vertical, and three planes are respectively an XY plane, a YZ plane and an XZ plane, wherein the XY plane is a horizontal plane, the XZ plane and the YZ plane are vertical planes, and the XZ plane is vertical to the YZ plane. Three axes in space are an X axis, a Y axis and a Z axis, and the three-axis movement in space refers to the movement along three axes which are vertical to each other in space, in particular to the movement along the X axis, the Y axis and the Z axis in space; the planar motion is a motion in the XY plane.
Referring to fig. 1 to 3, an image recognition system provided by the present application will now be described. The image recognition system includes a camera 4 for acquiring image information of an object to be measured 5, a manipulator arm assembly (not shown) supporting the camera 4, and a host body 3. The camera 4 and the mechanical arm component are respectively electrically connected with the host body 3, image information acquired by the camera 4 can be transmitted to the host body 3, the host body 3 can determine the position of the designated content of the measured object 5 through an algorithm and send an instruction to the mechanical arm component, the camera 4 is moved to the position right above the designated content through the mechanical arm component, so that the designated content can be shot by the camera 4, the shot designated content is transmitted to the host body 3 by the camera 4, and then the pointed reading or display and the like are performed after the camera 4 is identified by the host body 3. The camera 4 may be a zoom high-definition camera, so that automatic focusing shooting is realized, and the obtained image information is clear, which is not limited uniquely here.
In the present application, the object to be measured 5 may be a book, a human face, or the like; the designated content can be information such as characters, numbers, images and the like; the image recognition system can be applied to the technical field of point-reading equipment, video calls and the like, and is not limited uniquely.
In one embodiment, referring to fig. 1, as one embodiment of the image recognition system provided by the present application, a robot arm assembly includes a support member 1 and a driving member 2 for driving the support member 1 to move; the camera 4 is mounted on the holder member 1, the driving member 2 is connected to the holder member 1, and the main body 3 is electrically connected to the driving member 2. This structure, drive member 2 can realize the control to the length of manipulator arm assembly, height and width, and under manipulator arm assembly's drive, camera 4 can realize the arbitrary removal in XYZ space to improve the variety that camera 4 position removed, and then the adaptation is located the testee 5 of different positions departments.
In one embodiment, referring to fig. 1, as a specific implementation of the image recognition system provided by the present application, the bracket member 1 includes a rotating bracket 11 and a telescopic bracket 12 mounted on the rotating bracket 11, and the camera 4 is mounted on the telescopic bracket 12; the driving member 2 comprises a power piece 21 for driving the rotating bracket 11 to rotate and a transmission piece 22 for driving the telescopic bracket 12 to slide on the rotating bracket 11, the rotating bracket 11 is connected with the power piece 21, the transmission piece 22 is installed on the rotating bracket 11, the transmission piece 22 is connected with the telescopic bracket 12, and the power piece 21 and the transmission piece 22 are respectively and electrically connected with the main body 3. With this configuration, the power unit 21 can drive the rotating bracket 11 to rotate in the horizontal plane with the Z-axis as the rotation axis, and thus the camera 4 can be driven to rotate in the horizontal plane by the telescopic bracket 12. The driving medium 22 can drive the telescopic bracket 12 to move up and down along the rotating bracket 11, so that the height of the camera 4 can be adjusted, the distance between the camera 4 and the measured object 5 can be conveniently shortened, the image acquired by the camera 4 is clear, and the identification accuracy is improved. The power member 21 and the transmission member 22 may be a stepping motor, a servo motor, etc., and are not limited herein.
In one embodiment, referring to fig. 1, as an embodiment of the image recognition system provided by the present application, the telescopic bracket 12 includes a support arm 13 mounted on the rotating bracket 11 and a connecting arm 14 connected to the support arm 13, the support arm 13 is connected to the transmission member 22, and the camera 4 is mounted on the connecting arm 14; the drive member 2 further comprises a first power take-off 23 for driving the connecting arm 14 in rotation about the arm 13; the first power output member 23 is mounted on the arm 13, the first power output member 23 is connected with the connecting arm 14, and the main body 3 is electrically connected with the first power output member 23. With the structure, the first power output part 23 can drive the connecting arm 14 to rotate around the supporting arm 13 in a vertical plane, so as to adjust the distance between the camera 4 and the object to be measured 5. The connecting arm 14 can rotate 360 degrees around the supporting arm 13, and the position of the camera 4 can be flexibly adjusted. The first power output member 23 may be a stepping motor, a servo motor, etc., and is not limited herein.
In one embodiment, referring to fig. 1, as an embodiment of the image recognition system provided by the present application, the connecting arm 14 includes a first supporting arm 15 connected to the supporting arm 13 and a second supporting arm 16 connected to the first supporting arm 15, and the camera 4 is mounted on the second supporting arm 16; the driving member 2 further comprises a second power output part 24 for driving the second support arm 16 to rotate around the first support arm 15, the first power output part 23 is connected with the first support arm 15, the second power output part 24 is mounted on the first support arm 15, the second power output part 24 is connected with the second support arm 16, and the main body 3 is electrically connected with the second power output part 24. With the structure, the first power output part 23 can drive the first support arm 15 to rotate 360 degrees in the vertical plane around the support arm 13, and the second power output part 24 can drive the second support arm 16 to rotate 360 degrees in the vertical plane around the first support arm 15, so that the photographing position of the camera 4 can be adjusted in a diversified manner. The camera 4 can be positioned at a certain coordinate of the cylindrical space whose radius is the length of the connecting arm 14 and whose height is the sum of the lengths of the rotating bracket 11 and the first support arm 15, and the positional adjustment of the camera 4 is diversified. The second power output member 24 may be a stepping motor, a servo motor, etc., and is not limited herein.
In an embodiment, referring to fig. 1, as a specific implementation of the image recognition system provided by the present application, the first support arm 15 includes a plurality of sequentially connected rotating arms 151, the rotating arm 151 located at one end of the first support arm 15 is connected to the support arm 13, and the rotating arm 151 located at the other end of the first support arm 15 is connected to the second support arm 16; the drive member 2 further comprises a third power take-off 25 for driving each of the rotary arms 151 in rotation; each third power output member 25 is mounted on the first support arm 15, each third power output member 25 is connected to the corresponding rotating arm 151, and the main body 3 is electrically connected to each third power output member 25. In this structure, the rotating arm 151 at one end is connected to the first power output member 23, and is driven by the first power output member 23 to rotate 360 degrees in a vertical plane around the support arm 23. Each third power output member 25 can drive the corresponding rotating arm 151 to rotate 360 degrees around the adjacent rotating arm 151 in the vertical plane, so that the first supporting arm 15 can be extended and retracted, and the position diversity of the camera 4 is improved. The third power output element 25 may be a stepping motor, a servo motor, etc., and is not limited herein.
In one embodiment, referring to fig. 1, the first support arm 15 includes two rotation arms 151, the two rotation arms 151 are connected end to end, the first power output member 23 drives one rotation arm 151 to rotate 360 degrees in a vertical plane around the support arm 13, a third power output member 25 is mounted on the rotation arm 151, the third power output member 25 is connected to the other rotation arm 151, and can drive the other rotation arm 151 to rotate 360 degrees in the vertical plane around the first rotation arm 151. The second power take-off 24 is mounted on a further swivel arm 151 and carries the second support arm 16 about this swivel arm 151 for 360-degree rotation in the vertical plane. In other embodiments, the number, the rotation manner, and the like of the rotation arms 151 included in the first support arm 15 can be adjusted according to actual needs, and are not limited herein.
In an embodiment, referring to fig. 1, as a specific implementation of the image recognition system provided by the present application, the driving member 2 further includes a fourth power output element 26 for driving the second support arm 16 to rotate, the fourth power output element 26 is mounted on the first support arm 15, the fourth power output element 26 is connected to the second support arm 16, and the host body 3 is electrically connected to the fourth power output element 26. With the structure, the fourth power output part 26 can drive the second support arm 16 to rotate 360 degrees in the horizontal plane around the first support arm 15, so that the position change diversity of the camera 4 is improved. The fourth power output member 26 may be a stepping motor, a servo motor, etc., and is not limited herein.
In an embodiment, referring to fig. 3, as a specific implementation manner of the image recognition system provided in the present application, the host body 3 includes a main control module 31, a cloud recognition module 32 for uploading the designated content of the object to be detected 5 acquired by the camera 4 to a database and recognizing the acquired content information, and a display module 33 for playing and displaying the content information acquired by the cloud recognition module 32; the cloud identification module 32 and the display module 33 are electrically connected to the main control module 31. With the structure, after the camera 4 acquires the specified content of the object to be measured 5, the specified content is approved and compared with the content stored in the database, so as to identify the target content of the specified content, and finally, the identified target content is subjected to voice playing or video display and the like through the display module 33. The database may be an online database or a local database, and the like, and is not limited herein.
Referring to fig. 4, the present application further provides an identification method, which adopts the image identification system, and includes the following specific steps:
adjusting S1: the main machine body 3 controls the mechanical arm component to move the camera 4 to the upper side of the measured object 5, and the camera 4 obtains the whole image of the measured object 5. This structure, after placing measured object 5 with the support table face on, start image recognition system, manipulator arm assembly moves camera 4 to the top position of measured object 5 under the drive of host computer body 3 this moment to make camera 4 can acquire the whole image of measured object 5.
Designation of S2: the specified contents are determined on the object to be measured 5. This structure is explained by taking a finger of a user as an example. The content of the finger tip of the user on the measured object 5 is the designated content. In other embodiments, the designated content may also be determined by a touch-and-talk pen, a circle, or the like, which is not limited herein.
Recognizing S3: the main body 3 controls the mechanical arm assembly to move the camera 4 to a position right above the specified content, and the main body 3 acquires and identifies the specified content through the camera 4. Can set up horizontal detection module in the host computer body 3, but through this horizontal detection module real-time supervision camera 4 whether be in the horizontal plane to can ensure to remove camera 4 to appointed content directly over.
Please refer to fig. 2, which illustrates an example of a fingertip. Before the identification, the host body 3 continuously identifies whether a finger exists in the whole image acquired by the camera 4 through a fingertip algorithm. After the finger tip designates Q on the measured object 5 as the designated content, the camera 4 acquires the whole image in which the finger exists, at this time, the host body 3 drives the mechanical arm assembly to move the camera 4 to the position right above the Q, the camera 4 acquires the complete and clear image of the Q, and transmits the image information to the host body 3 and compares the image information with the database so as to identify and determine the specific content information of the Q, and can perform voice playing or video display and the like through the display module 33.
In the step of identifying S3, the distance between the camera 4 and the object to be measured 5 is smaller than the distance between the camera 4 and the object to be measured 5 in the step of adjusting S1. With the adoption of the structure, the distance between the camera 4 and the designated content Q is shortened, so that the image shot by the camera 4 is clearer, and the identification accuracy of the designated content Q is improved.
According to the image recognition system and the recognition method thereof, the camera 4 can be moved to the position right above the designated content through the mechanical arm component, so that the designated content can be clearly shot, the problem that the image of the fixed-focus wide-angle camera 4 at a near place is distorted is solved, the problem that the spatial resolution is low, and the problem that the image of the measured object 5 shot at a far place is fuzzy and the recognition is poor is solved. Compared with a certain included angle between the camera 4 and the measured object 5, the camera 4 is not positioned right above the designated content, and the content under the tip of the misidentification finger exists, so that misidentification is caused. By moving the camera 4 to the position right above the designated content, the content pointed by the finger cannot be identified by mistake even if the finger tip is suspended, so that the problem of error identification caused by suspension of the finger can be effectively solved, and the point reading error rate is reduced.
The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims (9)

1.图像识别系统的识别方法,采用图像识别系统,所述图像识别系统包括:1. The recognition method of the image recognition system adopts the image recognition system, and the image recognition system comprises: 摄像头,用于获取被测物体的图像信息;The camera is used to obtain the image information of the measured object; 机械手臂组件,与所述摄像头相连,用于驱动所述摄像头移动;a robotic arm assembly, connected with the camera, for driving the camera to move; 主机本体,用于驱动所述机械手臂组件将所述摄像头移动至所述被测物体之指定内容的正上方并识别该指定内容;The host body is used to drive the robotic arm assembly to move the camera to just above the specified content of the measured object and identify the specified content; 其中,所述摄像头和所述机械手臂组件分别与所述主机本体电连接;Wherein, the camera and the mechanical arm assembly are respectively electrically connected to the host body; 其特征在于,所述图像识别系统的识别方法包括:It is characterized in that, the recognition method of described image recognition system comprises: 调节:所述主机本体控制所述机械手臂组件,将所述摄像头移动至被测物体的上方,所述摄像头获取所述被测物体的整体图像;Adjustment: the host body controls the mechanical arm assembly, moves the camera to the top of the measured object, and the camera obtains the overall image of the measured object; 指定:在所述被测物体上确定指定内容;Specify: determine the specified content on the measured object; 识别:所述主机本体控制所述机械手臂组件将所述摄像头移动至所述指定内容的正上方,所述主机本体通过所述摄像头获取并识别所述指定内容。Recognition: the host body controls the robotic arm assembly to move the camera to just above the specified content, and the host body acquires and recognizes the specified content through the camera. 2.如权利要求1所述的图像识别系统的识别方法,其特征在于:所述调节步骤中的所述摄像头与所述被测物体之间的距离大于所述识别步骤中该摄像头与该被测物体之间的距离。2. The recognition method of an image recognition system according to claim 1, wherein the distance between the camera and the measured object in the adjustment step is greater than the distance between the camera and the measured object in the recognition step Measure the distance between objects. 3.如权利要求1所述的图像识别系统的识别方法,其特征在于:所述机械手臂组件包括支架构件和用于驱动所述支架构件移动的驱动构件;所述摄像头安装于所述支架构件上,所述驱动构件与所述支架构件相连,所述主机本体与所述驱动构件电连接。3. The recognition method of an image recognition system according to claim 1, wherein the robotic arm assembly comprises a bracket member and a drive member for driving the bracket member to move; the camera is mounted on the bracket member Above, the driving member is connected with the bracket member, and the main body is electrically connected with the driving member. 4.如权利要求3所述的图像识别系统的识别方法,其特征在于:所述支架构件包括旋转支架和安装于所述旋转支架上的伸缩支架,所述摄像头安装于所述伸缩支架上;所述驱动构件包括用于驱动所述旋转支架旋转的动力件和用于驱动所述伸缩支架于所述旋转支架上滑动的传动件,所述旋转支架与所述动力件相连,所述传动件安装于所述旋转支架上,所述传动件与所述伸缩支架相连,所述动力件和所述传动件分别与所述主机本体电连接。4. The identification method of an image recognition system according to claim 3, wherein the support member comprises a rotating support and a telescopic support installed on the rotating support, and the camera is installed on the telescopic support; The driving member includes a power member for driving the rotating support to rotate and a transmission member for driving the telescopic support to slide on the rotating support, the rotating support is connected with the power member, and the transmission member It is installed on the rotating bracket, the transmission part is connected with the telescopic bracket, and the power part and the transmission part are respectively electrically connected with the main body. 5.如权利要求4所述的图像识别系统的识别方法,其特征在于:所述伸缩支架包括安装于所述旋转支架上的支臂和与所述支臂相连的连接臂,所述支臂与所述传动件相连,所述摄像头安装于所述连接臂上;所述驱动构件还包括用于驱动所述连接臂绕所述支臂转动的第一动力输出件;所述第一动力输出件安装于所述支臂上,所述第一动力输出件与所述连接臂相连,所述主机本体与所述第一动力输出件电连接。5. The identification method of an image recognition system according to claim 4, wherein the telescopic support comprises a support arm mounted on the rotating support and a connecting arm connected with the support arm, the support arm Connected with the transmission member, the camera is mounted on the connecting arm; the driving member further includes a first power output member for driving the connecting arm to rotate around the support arm; the first power output The first power output member is connected with the connecting arm, and the main body is electrically connected with the first power output member. 6.如权利要求5所述的图像识别系统的识别方法,其特征在于:所述连接臂包括与所述支臂相连的第一支撑臂和与所述第一支撑臂相连的第二支撑臂,所述摄像头安装于所述第二支撑臂上;所述驱动构件还包括用于驱动所述第二支撑臂绕所述第一支撑臂转动的第二动力输出件,所述第一动力输出件与所述第一支撑臂相连,所述第二动力输出件安装于所述第一支撑臂上,所述第二动力输出件与所述第二支撑臂相连,所述主机本体与所述第二动力输出件电连接。6. The identification method of an image recognition system according to claim 5, wherein the connecting arm comprises a first support arm connected with the support arm and a second support arm connected with the first support arm , the camera is mounted on the second support arm; the drive member further includes a second power output member for driving the second support arm to rotate around the first support arm, the first power output The power output member is connected to the first support arm, the second power output member is mounted on the first support arm, the second power output member is connected to the second support arm, and the main body is connected to the The second power output is electrically connected. 7.如权利要求6所述的图像识别系统的识别方法,其特征在于:所述第一支撑臂包括若干依次相连的转动臂,位于该第一支撑臂一端的所述转动臂与所述支臂相连,位于该第一支撑臂另一端的所述转动臂与所述第二支撑臂相连;所述驱动构件还包括用于驱动各所述转动臂转动的第三动力输出件,各所述第三动力输出件安装于所述第一支撑臂上,各所述第三动力输出件与对应的所述转动臂相连,所述主机本体与各所述第三动力输出件电连接。7. The identification method of an image recognition system according to claim 6, wherein the first support arm comprises a plurality of rotating arms connected in sequence, and the rotating arm at one end of the first support arm and the support arm The arms are connected to each other, and the rotating arm at the other end of the first support arm is connected to the second support arm; the driving member further includes a third power output member for driving each of the rotating arms to rotate, each of the The third power output members are mounted on the first support arms, each of the third power output members is connected to the corresponding rotating arm, and the main body is electrically connected to each of the third power output members. 8.如权利要求7所述的图像识别系统的识别方法,其特征在于:所述驱动构件还包括用于驱动所述第二支撑臂旋转的第四动力输出件,所述第四动力输出件安装于所述第一支撑臂上,所述第四动力输出件与所述第二支撑臂相连,所述主机本体与所述第四动力输出件电连接。8. The recognition method of an image recognition system according to claim 7, wherein the driving member further comprises a fourth power output member for driving the rotation of the second support arm, the fourth power output member Installed on the first support arm, the fourth power output member is connected with the second support arm, and the main body is electrically connected with the fourth power output member. 9.如权利要求1-8任一项所述的图像识别系统的识别方法,其特征在于:所述主机本体包括:9. The recognition method of an image recognition system according to any one of claims 1-8, wherein the host body comprises: 主控制模块;main control module; 云端识别模块,用于将所述摄像头获取的所述被测物体之指定内容上传至数据库、并识别获取内容信息;以及,A cloud identification module, used to upload the specified content of the measured object obtained by the camera to a database, and identify and obtain content information; and, 显示模块,用于播放及显示所述云端识别模块获取的所述内容信息;a display module for playing and displaying the content information acquired by the cloud identification module; 所述云端识别模块和所述显示模块分别与所述主控制模块电连接。The cloud identification module and the display module are respectively electrically connected with the main control module.
CN201911220468.0A 2019-12-03 2019-12-03 Recognition method of image recognition system Active CN110977970B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911220468.0A CN110977970B (en) 2019-12-03 2019-12-03 Recognition method of image recognition system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911220468.0A CN110977970B (en) 2019-12-03 2019-12-03 Recognition method of image recognition system

Publications (2)

Publication Number Publication Date
CN110977970A CN110977970A (en) 2020-04-10
CN110977970B true CN110977970B (en) 2021-06-22

Family

ID=70089534

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911220468.0A Active CN110977970B (en) 2019-12-03 2019-12-03 Recognition method of image recognition system

Country Status (1)

Country Link
CN (1) CN110977970B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113251336A (en) * 2021-05-10 2021-08-13 读书郎教育科技有限公司 Learning desk lamp with adjustable click-to-read angle and method thereof
CN114051080B (en) * 2021-11-10 2025-02-25 上海英茂信息科技有限公司 A reading system based on visual detection

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07200730A (en) * 1993-12-28 1995-08-04 Murata Mach Ltd Character reader and character label
CN2649274Y (en) * 2003-10-29 2004-10-20 中国科学院自动化研究所 Table hockey robot system
US7051935B2 (en) * 2003-07-28 2006-05-30 Imageid Ltd. Color calibration for color bar codes
CN102242857A (en) * 2011-05-30 2011-11-16 祁超 Display frame
CN105590098A (en) * 2015-12-22 2016-05-18 北京百度网讯科技有限公司 Image identification method and device
CN106125934A (en) * 2016-06-28 2016-11-16 广东欧珀移动通信有限公司 Control method, control device and electronic device
CN108037882A (en) * 2017-11-29 2018-05-15 佛山市因诺威特科技有限公司 A kind of reading method and system
CN109445588A (en) * 2018-10-23 2019-03-08 北京快乐认知科技有限公司 Point based on image recognition tracer technique is read to give directions part click judging method

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07200730A (en) * 1993-12-28 1995-08-04 Murata Mach Ltd Character reader and character label
US7051935B2 (en) * 2003-07-28 2006-05-30 Imageid Ltd. Color calibration for color bar codes
CN2649274Y (en) * 2003-10-29 2004-10-20 中国科学院自动化研究所 Table hockey robot system
CN102242857A (en) * 2011-05-30 2011-11-16 祁超 Display frame
CN105590098A (en) * 2015-12-22 2016-05-18 北京百度网讯科技有限公司 Image identification method and device
CN106125934A (en) * 2016-06-28 2016-11-16 广东欧珀移动通信有限公司 Control method, control device and electronic device
CN108037882A (en) * 2017-11-29 2018-05-15 佛山市因诺威特科技有限公司 A kind of reading method and system
CN109445588A (en) * 2018-10-23 2019-03-08 北京快乐认知科技有限公司 Point based on image recognition tracer technique is read to give directions part click judging method

Also Published As

Publication number Publication date
CN110977970A (en) 2020-04-10

Similar Documents

Publication Publication Date Title
US20250082184A1 (en) Techniques for controlling an imaging device
CN114536399B (en) Error detection method based on multiple pose identifications and robot system
CN111801198B (en) A hand-eye calibration method, system and computer storage medium
WO2019071157A4 (en) Generation of one or more edges of luminosity to form three-dimensional models of objects
CN113910219A (en) Exercise arm system and control method
CN113876433B (en) Robot system and control method
JP2009269110A (en) Assembly equipment
CN108972538B (en) Robot control device, robot, and robot system
US12144574B2 (en) System and method for assisting tool exchange
CN114523471B (en) Error detection method based on association identification and robot system
CN113814987B (en) Multi-camera robot hand-eye calibration method and device, electronic equipment and storage medium
CN115153855B (en) Positioning and aligning method and device for micro mechanical arm and electronic equipment
CN114536292B (en) Error detection method and robot system based on composite identification
CN117481823A (en) Auxiliary mirror-holding robot control method, system and medium based on binocular vision
CN110977970A (en) Image recognition system and recognition method thereof
CN113954099A (en) Power inspection robot and method for adjusting positioning device of holder camera
CN114967674A (en) Method and system for robot inspection task configuration based on panoramic perception of substation
CN117754572B (en) Truss robot hand-eye calibration method, device and system
CN118411420A (en) Method, device, equipment, and medium for calibrating a camera on an extended reality device
CN110051433B (en) Method for keeping track of target and application thereof in image-guided surgery
CN112446347A (en) Face direction determination method and device, storage medium and electronic equipment
CN115488884B (en) Calibration method, system, device and medium for ultrasonic probe of remote robot
CN115590618B (en) Interactive system, surgical robot navigation and positioning system and control method thereof
CN121104999A (en) A method, apparatus, and system for calibrating a robotic micro-pen direct writing tool based on machine learning and monocular vision.
CN114061738A (en) Wind turbine tower drum foundation ring vibration monitoring method based on calibration plate pose calculation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20251210

Address after: 100000 Beijing City Miyun District Chang'an Street No. 1 Building 3rd Floor 306 (43)

Patentee after: Beijing Kangdingli Technology Co.,Ltd.

Country or region after: China

Address before: 523860 No. 168 Dongmen Middle Road, Xiaobian Community, Chang'an Town, Dongguan City, Guangdong Province

Patentee before: Guangdong GENIUS Technology Co., Ltd.

Country or region before: China

TR01 Transfer of patent right