WO2017007492A1 - Systèmes d'affichage pour machine et de commande de machine - Google Patents

Systèmes d'affichage pour machine et de commande de machine Download PDF

Info

Publication number
WO2017007492A1
WO2017007492A1 PCT/US2015/039818 US2015039818W WO2017007492A1 WO 2017007492 A1 WO2017007492 A1 WO 2017007492A1 US 2015039818 W US2015039818 W US 2015039818W WO 2017007492 A1 WO2017007492 A1 WO 2017007492A1
Authority
WO
WIPO (PCT)
Prior art keywords
machine
operator
work piece
cnc
motions
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2015/039818
Other languages
English (en)
Inventor
Satoshi Sakai
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to PCT/US2015/039818 priority Critical patent/WO2017007492A1/fr
Publication of WO2017007492A1 publication Critical patent/WO2017007492A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Program-control systems
    • G05B19/02—Program-control systems electric
    • G05B19/18—Numerical control [NC], i.e. automatically operating machines, in particular machine tools, e.g. in a manufacturing environment, so as to execute positioning, movement or co-ordinated operations by means of program data in numerical form
    • G05B19/409—Numerical control [NC], i.e. automatically operating machines, in particular machine tools, e.g. in a manufacturing environment, so as to execute positioning, movement or co-ordinated operations by means of program data in numerical form characterised by using manual data input [MDI] or by using control panel, e.g. controlling functions with the panel; characterised by control panel details or by setting parameters
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B9/00—Safety arrangements
    • G05B9/02—Safety arrangements electric

Definitions

  • This invention relates to the field of machine operations and controls and more specifically to interactive, real time displays for the operation of machines and machine tools and handling of related work pieces.
  • Modern machine tools are complex devices used to shape a wide variety of raw materials into finished products.
  • the actions of these machines are controlled by a computer (Computer Numerical Control or CNC) to ensure precision and accuracy, but also require an operator to handle the material and ensure that the machine is working properly.
  • CNC Computer Numerical Control
  • This computer and its corresponding display, is contained in a CNC panel attached to the machine.
  • This control panel displays valuable information about the process being done, and also allows the operator to change any number of inputs, such as the program for what part is being made or which tool should be used.
  • this panel is generally not located in the same place that the operator must do the majority of his work. This creates a source of inefficiency, as the operator must walk to and from the panel during the work process, and means that the operator must look away from the part (and their hands) to see information on the panel. This creates a potentially dangerous situation, and is clearly not ideal.
  • the inefficient location of the CNC panel is one of the main reasons why production using machines has always required highly skilled workers to operate the machines in order to produce accurate results. These workers must be trained not only in how to operate each specific machine but also in how to create each specific part. The worker must either memorize the instructions for each part or continually return to the CNC panel to read the instructions which is highly inefficient. This is both expensive and time consuming, and requires high quality employees.
  • the device should clearly display the instructions required to make a specific piece directly in front of the worker. In this way the need for workers to learn how to produce each part can be eliminated. Further, the device should display this instructional information in the same location that the operator needs to be located in to perform the task. This instructional information will effectively guide the machine operator around the machine and provide instructions as to exactly what to do at each point. In this way, operators with less training and that are less skilled will be able to do the job of today's specifically trained workers, eliminating the need for training the worker for each specific part. By displaying exact instructions at a machine operating station, at the time they are needed, production errors can be minimized. The combination of these benefits permits a substantial reduction in required training and skill levels while still providing consistent, accurate results.
  • Augmented Reality is a technology that allows us to enhance the world we live in by adding images and information to the world we see around us and allowing users to interact with these images.
  • AR is a great tool for manufacturing using machine tools. Being able superimpose information (such as tooling or material handling instructions) directly onto the work area eliminates the need for the worker to step away from the work area to see information on the CNC panel and make changes to the program being executed.
  • Current AR devices use a camera to get an image of the world and then
  • Tablet devices have the drawback of requiring the user to hold the camera and aim it at the work piece. This means that the worker can either use the AR device to get information or handle the material during the process, but not do both at the same time. Headsets do not have this limitation and allow the worker to work and see the real-time information freely, but share some important drawbacks with tablet devices. Both devices have limited power supplies that must be recharged, and could be dropped, broken, or misplaced. In a machine tooling environment relying on a fragile device like a tablet or headset is not ideal.
  • This device should allow for the display of images onto objects a user wishes to interact with, just like an AR system.
  • the device should further allow for the user to interact with these images through gesture recognition.
  • gesture recognition allows the user to interact with the displayed images without needing to step away from a work area or set down a work piece.
  • the device should additionally include a safety interlock device to prevent the gesture control device from incorrectly reading the movements of a user. This safety device would require the user to make an additional step before any critical action is taken. If a gesture is misread by a machine tool this could result in a damaged work piece or even bodily harm to the user, so this is a vitally important addition to any gesture control system.
  • U.S. Patent Application No. 2014/0293039 published for Appleyard et ah, discloses an imaging and safety and method for industrial machine. This reference applies to press brakes and relates to a light beam safety system for automatically determining the status of material being worked by the industrial machine.
  • the combined imaging and safety system includes a light transmitter, one with a corresponding receiver and is intended to determine information regarding the tool and/or tool position and/or extent of work being carried out on a work piece.
  • a shadow screen may be used to form an image of a profile of the tool tip on the end of the work place for assist in determining important information about the progress of the work being accomplished as it relates to a safety application for halting a machine or tool when a light beam is interrupted.
  • U.S. Patent Application No. 2014/0272775 published for Monty, is directed to a system and method for imaging in laser dental treatment.
  • the device described in this reference includes a computation systems to compute a contour (2D) of a surface of the dental treatment area based on the image obtained by the imaging system and transforming a 3D scan to a 2D image on a computerized numerical control (CNC) milling machine that is used for generating a suitable dental restoration component such as a dental crown.
  • CNC computerized numerical control
  • U.S. Patent Application No. 2014/0081444 published for Rudberg et ah, discloses a sequencer system for an automatic tape laying and projection system. Specifically, the system is utilized for building a part using automatic fiber placement and laser projection verification utilizing a CNC control machine for placing carbon fiber tape to a surface member to produce a layered composite part.
  • the system comprises a fiber placement machine operating under CNC control that is use to place fibers relative to a surface in a fiber-laying process.
  • U.S. Patent Application No. 2014/0230026 published for Forero, is directed to a biometric -based access control system comprising a field communication link.
  • This publication relates to the "motion capture system" component of the system in which various gestures and movement by the user are utilized to control an industrial machine under control of a CNC system.
  • the invention is responsive to one or more touch gestures or a touch sensitive device such as a touch screen which detects user biometric information unique to that user and utilizes set information in carrying out a particular operation in the controlled machine.
  • the user biometric information may comprise dynamic information such as an array of coordinate values corresponding to the touch gesture as well as the pressure values corresponding to the pressure used by the operator and includes such information as keystroke dynamics, motion dynamics and patterns.
  • the system described may be utilized in both touch screen and touch pad devices.
  • U.S. Patent Application No. 2012/0290121 published for Gronbach, discloses a device for operating an automated machine for handling, assembling or machining work pieces. Specifically, this reference is intended to describe operating apparatus that is capable of inputting manual operator actions and for inputting contact-free operator actions.
  • the apparatus for contact-free operator actions includes a sensor system for detecting contact-free actions of the operator and for picking up command-triggering operating actions of the operator by means of a contact-free operator actions detected picking up operating action of the operator utilizing contact-free operator actions detected by the sensor.
  • U.S. Patent No. 8,638,984, issued to Roithmeier is directed to a display of results of a measurement of work pieces as a function of the detection of the gesture of a user. This Patent addresses "motion capture system” and provides a gesture detection device which translates the movement of the user's hands to control the action of a machine on a work piece by means of Computer Numerical Control.
  • U.S. Patent No. 5,425,237 issued to Suer, discloses a counter balance system and is an example of an industrial machine that utilizes a pressure sensitive element to detect the hydraulic pressure in the system and thus compensate or control the operation of the system depending upon the limits set for the lubricant pressure.
  • the present invention addresses all of the deficiencies of prior art machine display and related method inventions and satisfies all of the objectives described above.
  • a machine display providing all of the desired features can be fabricated from the following components.
  • a machine is provided.
  • the machine has at least one projectable surface.
  • the projectable surface is located adjacent an operator workstation and adapted to reflect a projected image.
  • a computer numerical control (CNC) computer is provided.
  • the computer includes a CNC program.
  • the program is adapted to control the machine.
  • a CNC data file is provided.
  • the data file is adapted to control performance of at least one operation by the machine.
  • the data file includes positioning information for the machine.
  • At least one calibrated projector is provided.
  • the projector is calibrated to dimensions of and integrated with the machine, the CNC program and the data file.
  • the projector projects instructional information for a machine operator at a projectable location on the projectable surface as the instructional information becomes relevant to a next machine operation.
  • the instructional information includes any of text and properly sized and positioned images.
  • the CNC program and the data file change the instructional information as operations are completed.
  • a work piece is provided.
  • the work piece is sized, shaped and located to be used with the machine.
  • the CNC data file is adapted to control performance of at least one operation by the machine upon the work piece.
  • the at least one calibrated projector projects guide information for operations of the machine directly onto any of the projectable surface, the work piece and related tooling at a time the guide information is needed for a next operation.
  • the CNC program and the data file change the guide information as operations are completed upon the work piece.
  • the instructional information further includes an animation.
  • the animation illustrates orientation of the work piece to the machine and movement of the work piece from a first work area to at least one subsequent work area.
  • the animation includes any of properly sized and positioned images of said work piece and related tooling and real time sequencing of operational steps displayed upon any of a projectable area adjacent the work area and the work piece and the tooling.
  • the animation is linked to the CNC data file and controlled by the CNC program.
  • the animation serves as a work flow guide for the machine operator.
  • the projector projecting the guide information is a laser projector.
  • the laser projector is adapted to project a properly scaled image onto any three dimensional surface.
  • the guide information provides direct verification of dimensions of the work piece.
  • a signal generating system is provided.
  • the signal generating system generates signals linked to motions by the machine operator.
  • a signal receiving system is provided.
  • the signal receiving system receives signals from the signal generating system and the signals are converted into gestures which serve as inputs to control operations of the machine. Motions by the machine operator result in operations by the machine without physical contact between the operator and any machine controls.
  • a signal generating system is provided.
  • the signal generating system generates signals linked to motions by the machine operator.
  • a signal receiving system is provided.
  • the signal receiving system receives signals from the signal generating system and the signals are converted into gestures which serve as inputs to control operations of the machine upon the work piece. Motions by the machine operator result in operations by the machine without physical contact between the operator and any machine controls.
  • the signal generating system further includes a pedestal.
  • the pedestal includes a hand sensing camera.
  • the hand sensing camera records hand motions of the machine operator and generates signals which are transmitted to the signal receiving system.
  • the signal generating system further includes a head mounted hand sensing camera.
  • the hand sensing camera records hand motions of the machine operator and generates signals which are transmitted to the signal receiving system.
  • the signal generating system includes a portable transmitter.
  • the transmitter is sized and shaped to be manually manipulated by the machine operator and provides signals indicating the position of the transmitter relative to the machine.
  • the signal receiving system includes a receiver.
  • the receiver receives the signals from the transmitter and communicates the signals to a motion capture program.
  • the motion capture program translates the signals into gestures which serve as inputs which are communicated to the CNC program to control operations of the machine.
  • the signal generating system includes a portable transmitter.
  • the transmitter is sized and shaped to be manually manipulated by the machine operator and provide signals indicating the position of the transmitter relative to the work piece and the machine.
  • the signal receiving system includes a receiver.
  • the receiver receives the signals from the transmitter and communicates the signals to a motion capture program.
  • the motion capture program translates the signals into gestures which serve as inputs which are communicated to the CNC program to control operations of the machine upon the work piece.
  • the signal generating system is adapted for the machine operator to create annotations related to operation of the machine.
  • the annotations are received by the signal receiving system and communicated to the CNC program.
  • the CNC program saves the annotations to the CNC data file for future reference.
  • the signal generating system is adapted for the machine operator to create annotations related to either of the work piece or operations upon the work piece.
  • the annotations are received by the signal receiving system and
  • the CNC program saves the annotations to the CNC data file for future reference.
  • the signal generating system includes a depth sensing camera.
  • the camera generates signals describing the motions of the machine operator.
  • the signal generating system includes a stereoscopic camera to generate signals describing the motions of the machine operator.
  • the signal generating system includes a remote device that has an embedded motion sensor, the remote device generating three dimensional signals describing the motions of the machine operator.
  • the embedded motion sensor is selected from the group that includes gyroscopes, accelerometers and compasses.
  • the signal generating system includes a light curtain projected on the projectable surface and a camera system detecting machine operator motions impinging on the light curtain, the camera system transmits signals describing the motions of the machine operator.
  • the signal generating system includes an infrared pen that contacts the projectable surface either on or adjacent to the machine and a camera system that detects machine operator motions indicated by movement of the infrared pen on the projectable surface. The camera system transmits signals describing the motions of the machine operator.
  • the signal generating system includes a track pad.
  • the track pad is located either on or adjacent to the machine and detects machine operator hand motions and transmits signals describing the hand motions of the machine operator.
  • a safety interlock device is provided.
  • the interlock device requires an operator to perform a positive activity in order for the signals generated by the signal generating system to be implemented. This positive activity prevents accidentally initiated signals from being implemented.
  • the safety interlock device includes a light curtain.
  • the light curtain must be engaged by an operator for the machine to be activated, thereby providing a safety interlock.
  • the safety interlock device includes an infrared pen.
  • a switch on the infrared pen must be engaged by an operator for the machine to be activated, thereby providing a safety interlock.
  • the safety interlock device includes a pressure sensor.
  • the pressure sensor provides a signal which controls activation of the machine.
  • the safety interlock device includes a strain gauge.
  • the strain gauge provides a signal which controls activation of the machine.
  • the safety interlock device includes a control switch.
  • the switch is manually operable by the operator.
  • a method of calibrating a machine display for guide information to a machine includes the steps of:
  • the machine has at least one projectable surface, the projectable surface is located adjacent an operator workstation and adapted to reflecting a projected image;
  • CNC computer numerical control
  • the laser projector is fixedly attached either to or adjacent to the machine;
  • the model includes three dimensional coordinates for each of the targets;
  • the calibration permits the laser projector to project guide information onto the work piece and tooling for the work piece and an image of a work piece on the projectable surface at a known location in a designated size.
  • a method of calibrating a machine display for instructional information to a machine includes the steps of:
  • each of the optical projectors is fixedly attached either at or adjacent to a machine at an identified location point wherein each of the optical projectors can project upon a projectable surface of the machine;
  • optical projectors will employ the screen alignment program, the alignment mark, the skew correction factors, and scaling factors to project properly sized and positioned images upon the projectable surface.
  • a machine control system includes a machine.
  • the machine has a computer numerical control (CNC) computer.
  • the computer includes a CNC program.
  • the program is adapted to control the machine.
  • a CNC data file is provided.
  • the data file is adapted to control performance of at least one operation by the machine.
  • the data file includes positioning information for the machine.
  • the CNC program and the data file change as operations are completed.
  • a signal generating system is provided.
  • the signal generating system generates signals linked to motions by a machine operator.
  • a signal receiving system is provided.
  • the signal receiving system receives signals from the signal generating system.
  • the signals are converted to gestures which serve as inputs to control operations of the machine. Motions by the machine operator result in operations by the machine without physical contact between the operator and any machine controls.
  • a work piece is provided.
  • the work piece is sized, shaped and located to be used with the machine.
  • the CNC data file is adapted to control performance of at least one operation by the machine upon the work piece.
  • the CNC program and the data file change as operations are completed upon the work piece.
  • the signal generating system is adapted for the machine operator to create annotations related to operation of the machine.
  • the annotations are received by the signal receiving system and communicated to the CNC program.
  • the CNC program saves the annotations to the CNC data file for future reference.
  • the signal generating system includes a depth sensing camera.
  • the camera generates data describing the motions of the machine operator.
  • the signal generating system includes a stereoscopic camera.
  • the camera generates data describing the motions of the machine operator.
  • the signal generating system includes a remote device.
  • the remote device has an embedded motion sensor. The remote device generates three dimensional data describing the motions of the machine operator.
  • the embedded motion sensor is selected from the group that includes gyroscopes, accelerometers and compasses.
  • the signal generating system includes a light curtain projected on said projectable surface and a camera system that detects machine operator motions impinging on the light curtain. The camera system transmits signals describing the motions of the machine operator.
  • the signal generating system includes an infrared pen contacting said projectable surface either on or adjacent to the machine and a camera system that detects machine operator motions indicated by movement of the infrared pen on the projectable surface. The camera system transmits data describing the motions of the machine operator.
  • the signal generating system further includes a pedestal.
  • the pedestal includes a hand sensing camera.
  • the hand sensing camera records hand motions of the machine operator and generates signals which are transmitted to the signal receiving system.
  • the signal generating system further includes a head mounted hand sensing camera.
  • the hand sensing camera records hand motions of the machine operator and generates signals which are transmitted to the signal receiving system.
  • the signal generating system includes a track pad.
  • the track pad is located either on or adjacent to the machine and detects machine operator hand motions and transmits data describing the motions of the machine operator.
  • the machine further includes a safety interlock device.
  • the interlock device requires an operator to perform a positive activity in order for the signals generated by the motion capture program to be implemented, thereby preventing accidentally initiated signals from being implemented.
  • the safety interlock device includes a light curtain.
  • the light curtain must be engaged by an operator for the machine to be activated, thereby providing a safety interlock.
  • the safety interlock device includes an infrared pen. A switch on the infrared pen must be engaged by an operator for the machine to be activated, thereby providing a safety interlock.
  • the safety interlock device includes a pressure sensor.
  • the pressure sensor provides a signal which controls activation of the machine.
  • the safety interlock device includes a strain gauge.
  • the strain gauge provides a signal which controls activation of the machine.
  • the safety interlock device includes a control switch.
  • the switch is manually operable by the operator.
  • a method of displaying instructional information for a machine includes the steps of:
  • the machine has at least one projectable surface, the projectable surface is located adjacent an operator workstation and adapted to reflecting a projected image;
  • the work piece is sized, shaped and located to be used with the machine;
  • CNC computer numerical control
  • a CNC data file adapted to control performance of at least one operation by the machine upon the work piece, the data file includes positioning information for the machine and the work piece; providing at least one calibrated projector, the projector is calibrated to dimensions of and integrated with the machine, the CNC program and the data file, the projector adapted to projecting instructional information for an operator at a projectable location on the projectable surface as the instructional information becomes relevant to a next machine operation, the instructional information including any of textual data and properly sized and positioned images;
  • a method of displaying guide information for a machine includes the steps of: providing a machine, the machine has at least one projectable surface, the projectable surface is located adjacent an operator workstation and adapted to reflecting a projected image;
  • the work piece is sized, shaped and located to be used with the machine;
  • CNC computer numerical control
  • the data file adapted to control performance of at least one operation by the machine upon the work piece, the data file includes positioning information for the machine and the work piece;
  • the projector is calibrated to dimensions of and integrated with the machine, the CNC program and the data file, the projector adapted to projecting guide information for an operator at a location where any of the work piece and related tooling is expected to be when properly positioned for a next operation, the guide information becoming visible to the machine operator when any of the work piece and related tooling is properly positioned for the next operation, the guide information includes any of textual data and properly sized and positioned images;
  • a head-mounted display system provides instructional information that includes text and properly sized and positioned images and a virtual control interface reflecting actual machine controls.
  • a work piece is provided.
  • the work piece is sized, shaped and located to be used with the machine.
  • the CNC data file is adapted to control performance of at least one operation by the machine upon the work piece.
  • the display system provides guide information that includes text and properly sized and positioned images appearing to be positioned upon either the work piece or related tooling.
  • the CNC program and the data file change as operations are completed upon the work piece.
  • the signal generating system is adapted for the machine operator to create annotations related to operation of the machine.
  • the annotations are received by the signal receiving system and communicated to the CNC program.
  • the CNC program saves the annotations to the CNC data file for future reference.
  • the signal generating system is adapted for the machine operator to create annotations related to either of the work piece or operations upon the work piece.
  • the annotations are received by the signal receiving system and communicated to the CNC program.
  • the CNC program saves the annotations to the CNC data file for future reference.
  • the signal generating system includes a depth sensing camera. The camera generates signals describing the motions of the machine operator.
  • the signal generating system includes a stereoscopic camera to generate signals describing the motions of the machine operator.
  • the signal generating system includes a remote device that has an embedded motion sensor, the remote device generating three dimensional signals describing the motions of the machine operator.
  • the embedded motion sensor is selected from the group that includes gyroscopes, accelerometers and compasses.
  • the signal generating system includes a light curtain projected on the projectable surface and a camera system detecting machine operator motions impinging on the light curtain, the camera system transmits signals describing the motions of the machine operator.
  • the signal generating system includes an infrared pen that contacts the projectable surface either on or adjacent to the machine and a camera system that detects machine operator motions indicated by movement of the infrared pen on the projectable surface.
  • the camera system transmits signals describing the motions of the machine operator.
  • the signal generating system further includes a pedestal.
  • the pedestal includes a hand sensing camera.
  • the hand sensing camera records hand motions of the machine operator and generates signals which are transmitted to the signal receiving system.
  • the signal generating system further includes a head mounted hand sensing camera.
  • the hand sensing camera records hand motions of the machine operator and generates signals which are transmitted to the signal receiving system.
  • the signal generating system includes a track pad. The track pad is located either on or adjacent to the machine and detects machine operator hand motions and transmits data describing the motions of the machine operator.
  • the machine further includes a safety interlock device.
  • the interlock device requires an operator to perform a positive activity in order for the signals generated by the motion capture program to be implemented, thereby preventing accidentally initiated signals from being implemented.
  • the safety interlock device includes a light curtain.
  • the light curtain must be engaged by an operator for the machine to be activated, thereby providing a safety interlock.
  • the safety interlock device includes an infrared pen.
  • a switch on the infrared pen must be engaged by an operator for the machine to be activated, thereby providing a safety interlock.
  • the safety interlock device includes a pressure sensor.
  • the pressure sensor provides a signal which controls activation of the machine.
  • the safety interlock device includes a strain gauge.
  • the strain gauge provides a signal which controls activation of the machine.
  • the safety interlock device includes a control switch.
  • the switch is manually operable by the operator.
  • the safety interlock device includes a switch integrally mounted with the head-mounted display system.
  • the instructional information further includes a tooling location indicator.
  • the indicator includes any of full sized images of the tooling, tooling identification, tooling size, tooling location and orientation with respect to the machine, front and side views and segmentation of the tooling at the work area at a time when the tooling is expected to be used.
  • the tooling indicator is displayed upon any of a projectable area adjacent the work area or the tooling.
  • the animation which includes any of properly sized and positioned images of the work piece and related tooling and real time sequencing of operational steps displayed upon any of a projectable area adjacent the work area, the work piece and the tooling, is adapted for each operator of the machine by at least one view angle for the operator.
  • the view angle is developed from the CNC data for three dimensional coordinates for the machine, the work piece, and an expected standing location of the operator assumed to be looking at the work piece for a present operation.
  • Figure 1 is a perspective view of a packaging machine displaying a machine operation and being controlled by an operator using hand motions;
  • Figure 2 is a perspective view of a press brake displaying instructional information for a work piece and tooling and being controlled by an operator using hand motions;
  • Figure 3 is a perspective view of the Figure 2 embodiment illustrating an animation that illustrates orientation of the work piece to the machine and movement of the work piece from a first work area to at least one subsequent work area;
  • Figure 4 is a perspective view of the Figure 2 embodiment illustrating a pedestal with hand motion sensing camera and safety interlock switch
  • Figure 5 is a perspective view of the Figure 2 embodiment illustrating a head mounted hand motion sensing camera and safety interlock switch
  • Figure 6 is a perspective view of the Figure 2 embodiment illustrating
  • Figure 6A is a close-up perspective view of the Figure 2 embodiment illustrating a projection of guide information for a work piece as the work piece is moved toward the work location;
  • Figure 6B is a close-up perspective view of the Figure 2 embodiment illustrating a projection of guide information for a work piece with the work piece moved into the work location;
  • Figure 6C is a perspective view of the Figure 2 embodiment illustrating a fold-out table used for part verification with the laser projector;
  • Figure 6D is a close-up perspective view of the Figure 6C fold-out table supporting a work piece outlined by the laser projector for part verification;
  • Figure 7 is a perspective view of the Figure 2 embodiment illustrating a ring mounted signal generating system and infrared signal receiver;
  • Figure 8 is a perspective view of the Figure 1 embodiment illustrating annotation of the instructional information using an infrared pen signal generating system
  • Figure 9 is a perspective view of the Figure 2 embodiment illustrating annotation of the instructional information using an infrared pen signal generating system
  • Figure 10 is a perspective view of the Figure 2 embodiment illustrating a depth sensing camera based signal generating system
  • Figure 11 is a perspective view of an infrared signal receiving system
  • Figure 11A is a perspective view of a hand held infrared signal generating system
  • Figure 1 IB is a perspective view of the Figure 2 embodiment illustrating projected instructional information accessed by an operator with a hand held infrared signal generating system
  • Figure 12 is a perspective view of the Figure 2 embodiment illustrating an infrared pen signal generating system and infrared signal receiving system;
  • Figure 13 is a perspective view of the Figure 2 embodiment illustrating pedestal with a hand sensing camera signal generating system and a safety interlock switch;
  • Figure 14 is a perspective view of the Figure 2 embodiment illustrating a stereoscopic camera based signal generating system
  • Figure 15 is a perspective view of the Figure 2 embodiment illustrating a head mounted hand sensing camera and safety interlock switch
  • Figure 16 is a perspective view of the Figure 1 embodiment illustrating a ring mounted signal generating system and infrared signal receiver;
  • Figure 17 is a perspective view of the Figure 1 embodiment illustrating a method of calibrating an optical projector to a machine
  • Figure 17A is a perspective view of the Figure 1 embodiment illustrating a method of calibrating a laser projector to a machine
  • Figure 18 is a perspective view of the Figure 2 embodiment illustrating a method of calibrating an optical projector to a machine
  • Figure 18A is a perspective view of the Figure 2 embodiment illustrating a method of calibrating a laser projector to a machine
  • Figure 19 is a perspective view of the Figure 1 embodiment without a projector illustrating a camera-based signal generating and signal receiving system
  • Figure 20 is a perspective view of the Figure 2 embodiment without a projector illustrating a work piece for use with the machine;
  • Figure 21 is a perspective view of the Figure 2 embodiment without a projector illustrating a depth sensing camera signal generating and signal receiving system;
  • Figure 22 is a perspective view of the Figure 2 embodiment without a projector illustrating a stereoscopic camera signal generating and signal receiving system;
  • Figure 23 is a perspective view of the Figure 2 embodiment without a projector illustrating a ring based signal generating system, infrared signal receiving system and pressure sensor safety interlock system;
  • Figure 24 is a perspective view of the Figure 2 embodiment without a projector illustrating a pedestal with hand motion sensing camera signal generating system and switch operated safety interlock system;
  • Figure 25 is a perspective view of the Figure 2 embodiment without a projector illustrating a strain gauge safety interlock device
  • Figure 26 is a perspective view of the Figure 2 embodiment with calibrated projectors illustrating a method of displaying instructional information including tooling location indicators for a machine;
  • Figure 26A is a close-up perspective view of the Figure 2 embodiment illustrating a tooling location indicator showing a horn tool;
  • Figure 26B is a perspective view of the Figure 2 embodiment illustrating an operator comparing a segmented tool to the tooling location indicator displayed on the machine;
  • Figure 26C is close-up perspective view of the tooling location indicator and the actual tooling mounted on the machine;
  • Figure 27 is a perspective view of a method of developing view angles for machine operators;
  • Figure 28 is a perspective view of the Figure 2 embodiment without a projector illustrating an infrared pen signal generating system that contacts the projectable surface of the the machine and a camera system that detects machine operator motions indicated by movement of the infrared pen on the projectable surface;
  • Figure 29 is a perspective view of the Figure 1 embodiment illustrating a track pad signal generating system
  • Figure 30 is a perspective view of the Figure 1 embodiment without a projector illustrating a track pad signal generating system a safety interlock switch;
  • Figure 31 is a perspective view of the Figure 2 embodiment illustrating a remote control with a safety interlock device
  • Figure 32 is a perspective view of the Figure 2 embodiment without a projector illustrating a remote control with a safety interlock device
  • Figure 33 is a perspective view of the Figure 2 embodiment without a projector illustrating an infrared pen signal generating system that contacts the projectable surface of the machine and a camera system that detects machine operator motions indicated by movement of the infrared pen on the projectable surface;
  • Figure 34 is a perspective view of the Figure 2 embodiment illustrating a light curtain that functions as a safety interlock device
  • Figure 35 is a perspective view of the Figure 2 embodiment illustrating head- mounted display system with integral safety interlock device. Detailed Description of the Preferred Embodiment
  • machine display 10 providing all of the desired features can be fabricated from the following components.
  • a machine 14 is provided.
  • the machine 14 has at least one projectable surface 18.
  • the projectable surface 18 is located adjacent an operator workstation 22 and adapted to reflect a projected image 26.
  • a computer numerical control (CNC) computer 30 is provided.
  • the computer 30 includes a CNC program 34.
  • the program 34 is adapted to control the machine 14.
  • a CNC data file 38 is provided.
  • the data file 38 is adapted to control performance of at least one operation 42 by the machine 14.
  • the data file 38 includes positioning information 46 for the machine 14.
  • At least one calibrated projector 50 is provided.
  • the projector 50 is calibrated to dimensions 54 of and integrated with the machine 14, the CNC program 34 and the data file 38.
  • the projector 50 projects instructional information 58 for a machine operator 62 at a projectable location 66 on the projectable surface 18 as the instructional information 58 becomes relevant to a next machine operation 70.
  • the instructional information 58 includes any of textual data 74 and properly sized and positioned images 78.
  • the CNC program 34 and the data file 38 change the instructional information 58 as operations 82 are completed.
  • a work piece 86 is provided.
  • the work piece 86 is sized, shaped and located to be used with the machine 14.
  • the CNC data file 38 is adapted to control performance of at least one operation 82 by the machine 14 upon the work piece 86.
  • the at least one calibrated projector 50 projects guide information 90 for operations 82 of the machine 14 directly onto any of the projectable surface 18, the work piece 86 and related tooling 94 at a time the guide information 90 is needed for the next operation 70.
  • the CNC program 34 and the data file 38 change the guide information 90 as operations 82 are completed upon the work piece 86.
  • the instructional information 58 further includes an animation 98.
  • the animation 98 illustrates orientation of the work piece 86 to the machine 14 and movement of the work piece 86 from a first work area 102 to at least one subsequent work area 106.
  • the animation 98 includes any of properly sized and positioned images of said work piece 86 and related tooling 94 and real time sequencing of operational steps displayed upon any of a projectable area 18 adjacent the work area 102, 106 and the work piece 86 and the tooling 94.
  • the animation 98 is linked to the CNC data file 38 and controlled by the CNC program 34.
  • the animation 98 serves as a work flow guide 110 for a machine operator 62.
  • the projector 50 projecting the guide information 90 is a laser projector 114.
  • the laser projector 114 is adapted to project a properly scaled image 118 onto any three dimensional surface 122.
  • the guide information 90 provides direct verification of dimensions 126 of the work piece 86.
  • a signal generating system 130 is provided.
  • the signal generating system 130 generates signals 134 linked to motions 138 by the machine operator 62.
  • a signal receiving system 142 is provided.
  • the signal receiving system 142 receives signals 134 from the signal generating system 130 and the signals 134 are converted into gestures 146 which serve as inputs 150 to control operations 42 of the machine 14.
  • Motions 138 by the machine operator 62 result in operations 42 by the machine 14 without physical contact between the operator 62 and any machine controls 154.
  • a signal generating system 130 is provided.
  • the signal generating system 130 generates signals 134 linked to motions 138 by a machine operator 62.
  • a signal receiving system 142 is provided.
  • the signal receiving system 142 receives signals 134 from the signal generating system 130 and the signals 134 are converted into gestures 146 which serve as inputs 150 to control operations 42 of the machine 14 upon the work piece 86. Motions 138 by the machine operator 62 result in operations 42 by the machine 14 without physical contact between the operator 62 and any machine controls 154.
  • the signal generating system 130 further includes a pedestal 158.
  • the pedestal 158 includes a hand sensing camera 162.
  • the hand sensing camera 162 records hand motions 170 of the machine operator 62 and generates signals 134 which are transmitted to the signal receiving system 142.
  • the signal generating system 130 further includes a head mounted hand sensing camera 174.
  • the hand sensing camera 174 records hand motions 170 of the machine operator 62 and generates signals 134 which are transmitted to the signal receiving system 142.
  • the signal generating system 130 includes a portable transmitter 178.
  • the transmitter 178 is sized and shaped to be manually manipulated by a machine operator 62 and provides signals 134 indicating the position of the transmitter 178 relative to the machine 14.
  • the signal receiving system 142 includes a receiver 182.
  • the receiver 182 receives the signals 134 from the transmitter 178 and communicates the signals 134 to a motion capture program 186.
  • the motion capture program 186 translates the signals 134 into gestures 146 which serve as inputs 150 which are communicated to the CNC program 34 to control operations 42 of the machine 14.
  • the signal generating system 130 includes a portable transmitter 178.
  • the transmitter 178 is sized and shaped to be manually manipulated by a machine operator 62 and provide signals 134 indicating the position of the transmitter 178 relative to the work piece 86 and the machine 14.
  • the signal receiving system 142 includes a receiver 182.
  • the receiver 182 receives the signals 134 from the transmitter 178 and communicates the signals 134 to a motion capture program 186.
  • the motion capture program 186 translates the signals 134 into gestures 146 which serve as inputs 150 which are communicated to the CNC program 34 to control operations 42 of the machine 14 upon the work piece 86.
  • the signal generating system 130 is adapted for the machine operator 62 to create annotations 190 related to operation of the machine 14.
  • the annotations 190 are received by the signal receiving system 142 and communicated to the CNC program 34.
  • the CNC program 34 saves the annotations to the CNC data file 38 for future reference.
  • the signal generating system 130 is adapted for the machine operator 62 to create annotations 190 related to either of the work piece 86 or operations 42 upon the work piece 86.
  • the annotations 190 are received by the signal receiving system 142 and communicated to the CNC program 34.
  • the CNC program 34 saves the annotations 190 to the CNC data file 38 for future reference.
  • the signal generating system 130 includes a depth sensing camera 194.
  • the camera 194 generates signals 134
  • the signal generating system 130 includes a stereoscopic camera 198 to generate signals 134 describing the motions 138 of the machine operator 62.
  • the signal generating system 130 includes a remote device 202 that has an embedded motion sensor
  • the remote device 202 generating three dimensional signals 134 describing the motions 138 of the machine operator 62.
  • the embedded motion sensor 206 is selected from the group that includes gyroscopes (not shown), accelerometers (not shown) and compasses (not shown).
  • the signal generating system 130 includes a light curtain 222 projected on the projectable surface 18 and a camera system 226 detecting machine operator 62 motions 138 impinging on the light curtain 222, the camera system 226 transmits signals 134 describing the motions 138 of the machine operator 62.
  • the signal generating system 130 includes an infrared pen 230 that contacts the projectable surface 18 either on or adjacent to the machine 14 and a camera system 234 that detects machine operator 62 motions 138 indicated by movement of the infrared pen 230 on the projectable surface 18.
  • the camera system 234 transmits signals 134 describing the motions 138 of the machine operator 62.
  • the signal generating system 130 includes a track pad 238.
  • the track pad 238 is located either on or adjacent to the machine 14 and detects machine operator 62 hand motions 170 and transmits signals 134 describing the hand motions 170 of the machine operator 62.
  • a safety interlock device 242 is provided. The interlock device 242 requires an operator 62 to perform a positive activity in order for the signals 134 generated by the signal generating system 130 to be implemented. This positive activity prevents accidentally initiated signals 134 from being implemented.
  • the safety interlock device 242 includes a light curtain 222.
  • the light curtain 222 must be engaged by an operator 62 for the machine 14 to be activated, thereby providing a safety interlock 242.
  • the safety interlock device 242 includes an infrared pen 230.
  • a switch 246 on the infrared pen 230 must be engaged by an operator 62 for the machine 14 to be activated, thereby providing a safety interlock 242.
  • the safety interlock device 242 includes a pressure sensor 250.
  • the pressure sensor provides a signal 254 which controls activation of the machine 14.
  • the safety interlock device 242 includes a strain gauge 258.
  • the strain gauge 258 provides a signal 262 which controls activation of the machine 14.
  • the safety interlock device 242 includes a control switch 266.
  • the switch 266 is manually operable by the operator 62.
  • 10 for guide information 90 to a machine 14 includes the steps of: providing a machine 14, the machine 14 has at least one projectable surface 18, the projectable surface 18 is located adjacent an operator workstation 22 and adapted to reflecting a projected image 26; providing a computer numerical control (CNC) computer 30, the computer
  • CNC computer numerical control
  • the 30 includes a CNC program 34, the program 34 adapted to control the machine 14;
  • the laser projector 114 is fixedly attached either to or adjacent to the machine 14;
  • the model 278 includes three dimensional coordinates 282 for each of the targets 270;
  • the calibration permits the laser projector 114 to project guide information 90 onto the work piece 86 and tooling 94 for the work piece 86 and an image 298 of a work piece 86 on the projectable surface 18 at a known location 302 in a designated size.
  • a method, as illustrated in Figures 17 and 18, of calibrating a machine display 10or instructional information 58 to a machine 14, includes the steps of:
  • each of the optical projectors 306 is fixedly attached either at or adjacent to a machine 14 at an identified location point 310 wherein each of the optical projectors 306 can project upon a projectable surface 18 of the machine 14; identifying a fixed reference point 314 on the projectable surface 18; projecting an alignment mark 318 on the projectable surface 18;
  • the alignment program 326 uses the alignment program 326 to determine skew correction factors 342 for each projector 306 wherein the optical projector 306 can project a properly oriented image (not shown) upon the projectable surface 18 despite a non-orthogonal orientation to the projectable surface 18; projecting horizontal 350 and vertical 354 lines upon the projectable surface 18, measuring the horizontal 350 and vertical 354 lines;
  • optical projectors 306 will employ the screen alignment
  • a machine control system 12 includes a machine 14 is provided.
  • the machine 14 has a computer numerical control (CNC) computer 30.
  • the computer includes a CNC program 34.
  • the program 34 is adapted to control the machine 14.
  • a CNC data file 38 is provided.
  • the data file 38 is adapted to control performance of at least one operation 42 by the machine 14.
  • the data file 38 includes positioning information 46 for the machine 14.
  • the CNC program 34 and the data file 38 change as operations 82 are completed.
  • a signal generating system 130 is provided.
  • the signal generating system 130 generates signals 134 linked to motions 138 by a machine operator 62.
  • a signal receiving system 142 is provided.
  • the signal receiving system 142 receives signals 134 from the signal generating system 130.
  • the signals 134 are converted to gestures 146 which serve as inputs 150 to control operations 42 of the machine 14. Motions 138 by the machine operator 62 result in operations 42 by the machine 14 without physical contact between the operator 62 and any machine controls 154.
  • a work piece 86 is provided.
  • the work piece 86 is sized, shaped and located to be used with the machine 14.
  • the CNC data file 38 is adapted to control performance of at least one operation 82 by the machine 14 upon the work piece 86.
  • the CNC program 34 and the data file 38 change as operations 82 are completed upon the work piece 86.
  • the signal generating system 130 is adapted for the machine operator 62 to create annotations 190 related to operation of the machine 14.
  • the annotations 190 are received by the signal receiving system 142 and communicated to the CNC program 34.
  • the CNC program 34 saves the annotations to the CNC data file 38 for future reference.
  • the signal generating system 130 includes a depth sensing camera 194.
  • the camera 194 generates signals 134 describing the motions 138 of the machine operator 62.
  • the signal generating system 130 includes a stereoscopic camera 198 to generate signals 134 describing the motions 138 of the machine operator 62.
  • the signal generating system 130 includes a remote device 202 that has an embedded motion sensor 206, the remote device 202 generating three dimensional signals 134 describing the motions 138 of the machine operator 62.
  • the embedded motion sensor 206 is selected from the group that includes gyroscopes (not shown), accelerometers (not shown) and compasses (not shown).
  • the signal generating system 130 includes a light curtain 222 projected on the projectable surface 18 and a camera system 226 detecting machine operator 62 motions 138 impinging on the light curtain 222, the camera system 226 transmits signals 134 describing the motions 138 of the machine operator 62.
  • the signal generating system 130 includes an infrared pen 230 that contacts the projectable surface 18 either on or adjacent to the machine 14 and a camera system 234 that detects machine operator 62 motions 138 indicated by movement of the infrared pen 230 on the projectable surface 18.
  • the camera system 234 transmits signals 134 describing the motions 138 of the machine operator 62.
  • the signal generating system 130 further includes a pedestal 158.
  • the pedestal 158 includes a hand sensing camera 162.
  • the hand sensing camera 162 records hand motions 170 of the machine operator 62 and generates signals 134 which are transmitted to the signal receiving system 142.
  • the signal generating system 130 further includes a head mounted hand sensing camera 174.
  • the hand sensing camera 174 records hand motions 170 of the machine operator 62 and generates signals 134 which are transmitted to the signal receiving system 142.
  • the signal generating system 130 includes a track pad 238.
  • the track pad 238 is located either on or adjacent to the machine 14 and detects machine operator 62 hand motions 170 and transmits signals 134 describing the hand motions 170 of the machine operator 62.
  • the machine 14 further includes a safety interlock device 242.
  • the interlock device 242 requires an operator 62 to perform a positive activity in order for the signals 134 generated by the signal generating system 130 to be implemented. This positive activity prevents accidentally initiated signals 134 from being implemented.
  • the safety interlock device 242 includes a light curtain 222.
  • the light curtain 222 must be engaged by an operator 62 for the machine 14to be activated, thereby providing a safety interlock 242.
  • the safety interlock device 242 includes an infrared pen 230.
  • a switch 246 on the infrared pen 230 must be engaged by an operator 62 for the machine 14 to be activated, thereby providing a safety interlock 242.
  • the safety interlock device 242 includes a pressure sensor 250.
  • the pressure sensor provides a signal 254 which controls activation of the machine 14.
  • the safety interlock device 242 includes a strain gauge 258.
  • the strain gauge 258 provides a signal 262 which controls activation of the machine 14.
  • the safety interlock device 242 includes a control switch 266. The switch 266 is manually operable by the operator 62.
  • instructional information 58 for a machine 14 includes the steps of:
  • the machine 14 has at least one projectable surface
  • the projectable surface 18 is located adjacent an operator workstation 22 and adapted to reflecting a projected image 26; providing a work piece 86, the work piece 86 is sized, shaped and located to be used with the machine 14;
  • CNC computer numerical control
  • the 30 includes a CNC program 34, the program 34 adapted to control the machine 14;
  • the data file 38 includes positioning information 46 for the machine 14 and the work piece 18;
  • the projector 50 is calibrated to dimensions 54 of and integrated with the machine 14, the CNC program 34 and the data file 38, the projector 50 adapted to projecting instructional information 58 for an operator 62 at a projectable location 66 on the projectable surface 18 as the instructional information 58 becomes relevant to a next machine operation 70, the instructional information 58 including any of textual data 74 and properly sized and positioned images 78;
  • a method, as illustrated in Figures 1, 2, 6, 6A, 6B and 26, of displaying guide information 90 for a machine 14 includes the steps of:
  • the machine 14 has at least one projectable surface
  • the projectable surface 18 is located adjacent an operator workstation 22 and adapted to reflecting a projected image 26; providing a work piece 86, the work piece 86 is sized, shaped and located to be used with the machine 14; providing a computer numerical control (CNC) computer 30, the computer 30 includes a CNC program 34, the program 34 adapted to control the machine 14;
  • CNC computer numerical control
  • the data file 38 includes positioning information 46 for the machine 14 and the work piece 18;
  • the projector 50 is calibrated to dimensions 54 of and integrated with the machine 14, the CNC program 34 and the data file 38, the projector 50 adapted to projecting guide information 90 for an operator 62 at a location 406 where any of the work piece 86 and related tooling 94 is expected to be when properly positioned for a next operation 410, the guide information 90 becoming visible to thejnachine operator 62 when any of the work piece 86 and related tooling 94 is properly positioned for the next operation 410, the guide information 90 includes any of textual data 74 and properly sized and positioned images 78;
  • a head-mounted display system 414 is provided.
  • the display system 414 provides instructional information 58 that includes text 74 and properly sized and positioned images 78 and a virtual control interface 418 reflecting actual machine controls 422.
  • a work piece 86 is provided.
  • the work piece 86 is sized, shaped and located to be used with the machine 14.
  • the CNC data file 38 is adapted to control performance of at least one operation 82 by the machine 14 upon the work piece 86.
  • the display system 414 provides guide information 90 that includes text 74 and properly sized and positioned images 78 appearing to be positioned upon either the work piece 86 or related tooling 94.
  • the CNC program 34 and the data file 38 change as operations 82 are completed upon the work piece 86.
  • the signal generating system 130 is adapted for the machine operator 62 to create annotations 190 related to operation of the machine 14.
  • the annotations 190 are received by the signal receiving system 142 and communicated to the CNC program 34.
  • the CNC program 34 saves the annotations to the CNC data file 38 for future reference.
  • the signal generating system 130 is adapted for the machine operator 62 to create annotations 190 related to either of the work piece 86 or operations 42 upon the work piece 86.
  • the annotations 190 are received by the signal receiving system 142 and communicated to the CNC program 34.
  • the CNC program 34 saves the annotations 190 to the CNC data file 38 for future reference.
  • the signal generating system 130 includes a depth sensing camera 194. The camera 194 generates signals 134 describing the motions 138 of the machine operator 62.
  • the signal generating system 130 includes a stereoscopic camera 198 to generate signals 134 describing the motions 138 of the machine operator 62.
  • the signal generating system 130 includes a remote device 202 that has an embedded motion sensor 206, the remote device 202 generating three dimensional signals 134 describing the motions 138 of the machine operator 62.
  • the embedded motion sensor 206 is selected from the group that includes gyroscopes (not shown), accelerometers (not shown) and compasses (not shown).
  • the signal generating system 130 includes a light curtain 222 projected on the projectable surface 18 and a camera system 226 detecting machine operator 62 motions 138 impinging on the light curtain 222, the camera system 226 transmits signals 134 describing the motions 138 of the machine operator 62.
  • the signal generating system 130 includes an infrared pen 230 that contacts the projectable surface 18 either on or adjacent to the machine 14 and a camera system 234 that detects machine operator 62 motions 138 indicated by movement of the infrared pen 230 on the projectable surface 18.
  • the camera system 234 transmits signals 134 describing the motions 138 of the machine operator 62.
  • the signal generating system 130 further includes a pedestal 158.
  • the pedestal 158 includes a hand sensing camera 162.
  • the hand sensing camera 162 records hand motions 170 of the machine operator 62 and generates signals 134 which are transmitted to the signal receiving system 142.
  • the signal generating system 130 further includes a head mounted hand sensing camera 174.
  • the hand sensing camera 174 records hand motions 170 of the machine operator 62 and generates signals 134 which are transmitted to the signal receiving system 142.
  • the signal generating system 130 includes a track pad 238.
  • the track pad 238 is located either on or adjacent to the machine
  • the machine 14 further includes a safety interlock device 242.
  • the interlock device 242 requires an operator 62 to perform a positive activity in order for the signals 134 generated by the signal generating system 130 to be implemented. This positive activity prevents accidentally initiated signals 134 from being implemented.
  • the safety interlock device 242 includes a light curtain 222.
  • the light curtain 222 must be engaged by an operator 62 for the machine 14 to be activated, thereby providing a safety interlock 242.
  • the safety interlock device 242 includes an infrared pen 230.
  • a switch 246 on the infrared pen 230 must be engaged by an operator 62 for the machine 14 to be activated, thereby providing a safety interlock 242.
  • the safety interlock device 242 includes a pressure sensor 250. The pressure sensor provides a signal 254 which controls activation of the machine 14.
  • the safety interlock device 242 includes a strain gauge 258.
  • the strain gauge 258 provides a signal 262 which controls activation of the machine 14.
  • the safety interlock device 242 includes a control switch 266.
  • the switch 266 is manually operable by the operator 62.
  • the safety interlock device 242 includes a switch 426 attached to the head-mounted display system 414.
  • the instructional information 58 further includes a tooling location indicator 430.
  • the indicator 430 includes any of properly sized and positioned images 436 of the tooling 94, tooling identification 440, tooling size 444, tooling location 448 and orientation with respect to the machine 452, front 456 and side 460 views and segmentation 464 of the tooling 94 at the work area 468 at a time when the tooling 94 is expected to be used.
  • the tooling indicator 430 is displayed upon any of a projectable area 18 adjacent the work area 468 or the tooling 94.
  • the animation 98 which includes any of properly sized and positioned images of the work piece 86 and related tooling 94 and real time sequencing of operational steps displayed upon any of a projectable area 18 adjacent the work area 102, 106, the work piece 86 and the tooling 94, is adapted for each operator 62 of the machine 14 by at least one view angle 398 for the operator 62.
  • the view angle 398 is developed from the CNC data 38 for three dimensional coordinates 386 for the machine 14, the work piece 86, and an expected standing location 390 of the operator 62 assumed to be looking at the work piece 86 for a present operation 394.

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Manufacturing & Machinery (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Numerical Control (AREA)

Abstract

L'invention concerne une machine comprenant une surface de projection adjacente à un poste de travail d'opérateur. Un ordinateur de commande numérique par calculateur (CNC) comprend un programme CNC conçu pour commander la machine. Un fichier de données CNC est conçu pour commander des opérations de la machine. Un projecteur est étalonné aux dimensions de la machine, du programme CNC et du fichier de données, et y est intégré. Le projecteur projette des informations d'instruction sur la surface de projection et des informations de guidage sur l'outillage et la pièce à usiner, à l'intention d'un opérateur, à mesure que les informations d'instruction et de guidage deviennent pertinentes pour une opération suivante de la machine. Les informations d'instruction comprennent des informations quelconques parmi des données textuelles et des images correctement dimensionnées et positionnées. Les informations de guidage comprennent des données d'achèvement de travail pour la pièce à usiner et l'outillage. Le programme CNC et le fichier de données changent les informations d'instruction et de guidage à mesure que les opérations sont achevées. Des systèmes de commande actionnés par gestes et des procédés d'étalonnage de projecteurs pour l'affichage d'informations d'instruction et de guidage pour machines sont également décrits.
PCT/US2015/039818 2015-07-09 2015-07-09 Systèmes d'affichage pour machine et de commande de machine Ceased WO2017007492A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/US2015/039818 WO2017007492A1 (fr) 2015-07-09 2015-07-09 Systèmes d'affichage pour machine et de commande de machine

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/US2015/039818 WO2017007492A1 (fr) 2015-07-09 2015-07-09 Systèmes d'affichage pour machine et de commande de machine

Publications (1)

Publication Number Publication Date
WO2017007492A1 true WO2017007492A1 (fr) 2017-01-12

Family

ID=57685958

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2015/039818 Ceased WO2017007492A1 (fr) 2015-07-09 2015-07-09 Systèmes d'affichage pour machine et de commande de machine

Country Status (1)

Country Link
WO (1) WO2017007492A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019145789A3 (fr) * 2018-01-29 2019-10-03 Datalogic Ip Tech S.R.L. Système et procédé de surveillance de processus de marquage direct de pièces (dpm) et de génération de notifications visuelles sur des pièces pour des opérateurs
CN112601621A (zh) * 2018-08-28 2021-04-02 特鲁普机械奥地利有限公司及两合公司 用于操作折弯机的方法
JP2022096643A (ja) * 2020-12-17 2022-06-29 エフ ホフマン－ラ ロッシュ アクチェン ゲゼルシャフト 実験室用分析装置

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070248937A1 (en) * 2006-04-25 2007-10-25 Frank Chen Operation training simulation system for computer numerical control (CNC) machine
US20130100277A1 (en) * 2012-08-14 2013-04-25 Eads Construcciones Aeronauticas, S.A. Workbench for manufacturing or checking electrical wiring harnesses
US20130240227A1 (en) * 2012-03-15 2013-09-19 Siemens Aktiengesellschaft Method for operating a machine tool, projection device for a machine tool and machine tool with such a projection device
US20140013291A1 (en) * 2005-11-22 2014-01-09 Faculte Polytechnique De Mons Device for and a Method of Designing a Sensor Arrangement for a Safe Automated System, An Automated System, a Program Element and a Computer-Readable Medium
US20140177909A1 (en) * 2012-12-24 2014-06-26 Industrial Technology Research Institute Three-dimensional interactive device and operation method thereof

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140013291A1 (en) * 2005-11-22 2014-01-09 Faculte Polytechnique De Mons Device for and a Method of Designing a Sensor Arrangement for a Safe Automated System, An Automated System, a Program Element and a Computer-Readable Medium
US20070248937A1 (en) * 2006-04-25 2007-10-25 Frank Chen Operation training simulation system for computer numerical control (CNC) machine
US20130240227A1 (en) * 2012-03-15 2013-09-19 Siemens Aktiengesellschaft Method for operating a machine tool, projection device for a machine tool and machine tool with such a projection device
US20130100277A1 (en) * 2012-08-14 2013-04-25 Eads Construcciones Aeronauticas, S.A. Workbench for manufacturing or checking electrical wiring harnesses
US20140177909A1 (en) * 2012-12-24 2014-06-26 Industrial Technology Research Institute Three-dimensional interactive device and operation method thereof

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019145789A3 (fr) * 2018-01-29 2019-10-03 Datalogic Ip Tech S.R.L. Système et procédé de surveillance de processus de marquage direct de pièces (dpm) et de génération de notifications visuelles sur des pièces pour des opérateurs
CN111819023A (zh) * 2018-01-29 2020-10-23 得利捷Ip科技有限公司 用于监视直接零件标识（dpm）处理并为操作员生成零件上的视觉通知的系统和方法
US11679451B2 (en) 2018-01-29 2023-06-20 Datalogic Ip Tech S.R.L. System and method for monitoring direct part marking (DPM) processes and generating visual notifications on parts for operators
CN112601621A (zh) * 2018-08-28 2021-04-02 特鲁普机械奥地利有限公司及两合公司 用于操作折弯机的方法
JP2022096643A (ja) * 2020-12-17 2022-06-29 エフ ホフマン－ラ ロッシュ アクチェン ゲゼルシャフト 実験室用分析装置
JP7303283B2 (ja) 2020-12-17 2023-07-04 エフ ホフマン－ラ ロッシュ アクチェン ゲゼルシャフト 実験室用分析装置

Similar Documents

Publication Publication Date Title
CN110977931B (zh) 使用了增强现实和混合现实的机器人控制装置及显示装置
US11563931B2 (en) System and method for calibrating a vision system with respect to a touch probe
EP1709519B1 (fr) Panneau de commande virtuel
EP1629366B1 (fr) Systeme a camera unique permettant d'effectuer une entree a base de gestes et d'indiquer une cible
JP7336184B2 (ja) 拡張現実プラットフォームにおいて、仮想コンテンツを物理環境と空間的に位置合わせするためのシステム、方法、及びツール
US10508899B2 (en) Method for generating information about a sensor chain of a coordinate measuring machine (CMM)
US9008371B2 (en) Method and system for ascertaining the position and orientation of a camera relative to a real object
US8638984B2 (en) Display of results of a measurement of workpieces as a function of the detection of the gesture of a user
US7974462B2 (en) Image capture environment calibration method and information processing apparatus
US9021344B2 (en) Off-line graphical user interface system and method for three-dimensional measurement
US11015930B2 (en) Method for 2D picture based conglomeration in 3D surveying
US20150377606A1 (en) Projection system
EP1315056A2 (fr) Appareil de simulation pour machine d'usinage
US20180374265A1 (en) Mixed reality simulation device and computer readable medium
EP4261636A1 (fr) Dispositif de traitement, système de traitement, visiocasque, procédé de traitement, programme et support de stockage
US10890430B2 (en) Augmented reality-based system with perimeter definition functionality
WO2017007492A1 (fr) Systèmes d'affichage pour machine et de commande de machine
KR20220144217A (ko) 공작물 가공 장치 및 방법
JP6966777B2 (ja) 入力システム
KR101360976B1 (ko) 용접점 자동 인식 시스템 및 인식 방법
KR100601001B1 (ko) 자이로와 초음파를 이용한 컴퓨터 입력장치
CN114465910B (zh) 一种基于增强现实技术的机械加工设备校准方法
JP7710776B1 (ja) 設計支援システムおよび設計支援プログラム
US20240378328A1 (en) Systems and methods for generating and mapping of numerically controlled tool paths in design applications
US8624929B2 (en) System for transforming and displaying coordinate datum

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15897883

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 18.05.2018)

122 Ep: pct application non-entry in european phase

Ref document number: 15897883

Country of ref document: EP

Kind code of ref document: A1