WO2019189671A1 - Système de transmission tactile de force, dispositif de transmission tactile de force, procédé de transmission tactile de force et programme - Google Patents

Système de transmission tactile de force, dispositif de transmission tactile de force, procédé de transmission tactile de force et programme Download PDF

Info

Publication number
WO2019189671A1
WO2019189671A1 PCT/JP2019/013816 JP2019013816W WO2019189671A1 WO 2019189671 A1 WO2019189671 A1 WO 2019189671A1 JP 2019013816 W JP2019013816 W JP 2019013816W WO 2019189671 A1 WO2019189671 A1 WO 2019189671A1
Authority
WO
WIPO (PCT)
Prior art keywords
force
fishing
fishing rod
robot
tactile sensation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2019/013816
Other languages
English (en)
Japanese (ja)
Inventor
貴裕 野崎
脩平 新明
大西　公平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Re-Al LLC
Original Assignee
Re-Al LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Re-Al LLC filed Critical Re-Al LLC
Priority to JP2020511040A priority Critical patent/JP7029521B2/ja
Publication of WO2019189671A1 publication Critical patent/WO2019189671A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A01—AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
    • A01K—ANIMAL HUSBANDRY; AVICULTURE; APICULTURE; PISCICULTURE; FISHING; REARING OR BREEDING ANIMALS, NOT OTHERWISE PROVIDED FOR; NEW BREEDS OF ANIMALS
    • A01K97/00—Accessories for angling
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J3/00—Manipulators of leader-follower type, i.e. both controlling unit and controlled unit perform corresponding spatial movements

Definitions

  • the present invention relates to a force / haptic transmission system, a force / haptic transmission device, a force / haptic transmission method, and a program.
  • An object of the present invention is to provide a technique that enables a more realistic experience to be realized via a robot.
  • a force / tactile sensation transmission system including a fishing robot capable of performing a fishing operation, a fishing rod type manipulator installed apart from the fishing robot, and a control device configured to be able to communicate with the fishing robot and the fishing rod type manipulator. And The controller is Based on information indicating a current or past external force input to a fishing rod provided in the fishing robot, the fishing rod-type manipulator outputs a force / tactile force due to the external force input to the fishing rod.
  • FIG. 1 is a schematic diagram showing a system configuration of a force / tactile sensation transmission system according to the present invention. It is a block diagram which shows the structure of a master side control apparatus. It is a schematic diagram which shows the structural example of the actuator used in a force-tactile transmission system. It is a flowchart which shows the flow of the force haptic transmission process which a force haptic transmission system performs. It is a flowchart which shows the flow of the remote fishing experience control process which a force-tactile transmission system performs.
  • a human physical action is configured by individual “functions” such as one joint alone or in combination. Therefore, hereinafter, in the present embodiment, “act” represents an integrated function realized by using individual “functions” of parts in the human body as components. For example, an action involving bending and stretching of the middle finger (an action of turning a screw or the like) is an integrated function having the function of each joint of the middle finger as a component.
  • the basic principle of the present invention is that any action can be mathematically expressed by three elements of force source, velocity (position) source, and transformation representing the action. Therefore, for a variable group defined by transformation and inverse transformation, By supplying control energy from the ideal force source and ideal velocity (position) source in a dual relationship to the controlled system, the extracted physical action is structured, reconstructed or expanded, and the physical action is reversible. Automatic realization (reproduction).
  • FIG. 1 is a schematic diagram showing the concept of the basic principle according to the present invention.
  • the basic principle shown in FIG. 1 represents a control law of an actuator that can be used to realize a human physical action.
  • the current position of the actuator is used as an input, and at least one of position (or velocity) or force is used.
  • the operation of the actuator is determined by performing the calculation in the region. That is, the basic principle of the present invention is that the control target system S, the function-specific force / speed allocation conversion block FT, the ideal force source block FC or the ideal speed (position) source block PC, and the inverse conversion block IFT. It is expressed as a control law including
  • the control target system S is a robot operated by an actuator (for example, an avatar or the like installed at a location remote from the user), and controls the actuator based on acceleration or the like.
  • the control target system S realizes the function of one or a plurality of parts in the human body. If a control law for realizing the function is applied, the specific configuration is as follows. It is not necessarily a form that imitates the human body.
  • the control target system S can be a robot that controls an instrument (such as a fishing rod) used by a user with an actuator.
  • the function-specific force / speed allocation conversion block FT is a block that defines conversion of control energy into a speed (position) and force area set according to the function of the control target system S.
  • coordinate conversion is defined in which the function reference value (reference value) of the control target system S and the current position of the actuator are input.
  • this coordinate conversion generally, an input vector whose elements are a reference value and a current speed (position) is converted into an output vector composed of a speed (position) for calculating a control target value of the speed (position), and a reference value
  • an input vector having the current force as an element is converted into an output vector composed of a force for calculating a force control target value.
  • the coordinate conversion in the function-specific force / speed allocation conversion block FT is generalized as in the following equations (1) and (2).
  • x ′ 1 to x ′ n are velocity vectors for deriving the speed state value
  • x ′ a to x ′ m are 1 or more
  • h 1a to h nm are elements of the transformation matrix representing the function It is.
  • f ′′ 1 to f ′′ n (n is an integer of 1 or more) is a force vector for deriving force state values
  • f ′′ a to f ′′ m ( m is an integer of 1 or more) is a vector whose elements are a force based on the reference value and the action of the actuator (the force of the moving element of the actuator or the force of the object moved by the actuator).
  • the variables of the actuator alone are converted into variable groups (virtual space in the virtual space) representing the functions to be realized.
  • Variable assigns control energy to velocity (position) control energy and force control energy. For this reason, it is possible to independently give control energy of speed (position) and control energy of force as compared with a case where control is performed with a variable of the actuator alone (variable in real space).
  • the ideal force source block FC is a block that performs calculations in the force region in accordance with the coordinate conversion defined by the function-specific force / speed allocation conversion block FT.
  • a target value related to a force for performing a calculation based on the coordinate transformation defined by the function-specific force / speed allocation transformation block FT is set.
  • This target value is set as a fixed value or a variable value depending on the function to be realized. For example, when realizing a function similar to the function indicated by the reference value, zero is set as the target value, and when scaling is performed, a value obtained by enlarging or reducing the information indicating the function to be reproduced is set. it can.
  • the ideal speed (position) source block PC is a block that performs calculations in the speed (position) area according to the coordinate conversion defined by the function-specific force / speed allocation conversion block FT.
  • a target value related to the speed (position) when performing the calculation based on the coordinate transformation defined by the function-specific force / speed assignment transformation block FT is set.
  • This target value is set as a fixed value or a variable value depending on the function to be realized. For example, when realizing a function similar to the function indicated by the reference value, zero is set as the target value, and when scaling is performed, a value obtained by enlarging or reducing the information indicating the function to be reproduced is set. it can.
  • the inverse conversion block IFT is a block that converts the value of the velocity (position) and force region into the value (for example, voltage value or current value) of the input region to the control target system S.
  • the function-specific force / speed allocation conversion block FT converts the control laws of the position and force regions corresponding to the functions. Then, in the ideal force source block FC, a force according to the function is calculated, and in the ideal speed (position) source block PC, a speed (position) according to the function is calculated, and the force and speed (position). Control energy is distributed to each.
  • the calculation results in the ideal force source block FC and the ideal speed (position) source block PC are information indicating the control target of the control target system S, and these calculation results are used as the input values of the actuator in the inverse conversion block IFT, and control is performed. Input to the target system S.
  • the actuator of the control target system S executes the operation according to the function defined by the function-specific force / speed allocation conversion block FT, and the target robot operation is realized. That is, in the present invention, it becomes possible to more appropriately realize the human physical action by the robot.
  • the force in the actuator is represented by the product of mass and acceleration
  • the velocity (position) in the actuator is represented by the integral of acceleration. Therefore, by controlling the speed (position) and force through the acceleration region, the current position of the actuator can be acquired and the intended function can be realized.
  • FIG. 2 is a schematic diagram showing the concept of control when the force / tactile transmission function is defined in the function-specific force / speed allocation conversion block FT.
  • Function (bilateral control function) can be realized.
  • the coordinate conversion in the function-specific force / speed allocation conversion block FT is expressed as the following equations (3) and (4).
  • x ′ p is a speed for deriving the state value of speed (position)
  • x ′ f is a speed related to the force state value
  • x ′ m is the speed (differential value of the current position of the master device) of the reference value (input from the master device)
  • x ′ s is the current speed (differential value of the current position) of the slave device.
  • f p is the force on the status value of the speed (position)
  • the f f is the force for deriving the state value of the force.
  • f m is a reference value (input from the master device)
  • f s is a current force of the slave device.
  • FIG. 3 is a schematic diagram showing a system configuration of the force-tactile transmission system 1 according to the present invention.
  • the force / tactile sensation transmission system 1 includes a fishing rod type manipulator 10 as a master device, a head mounted display 20, a master side control device 30, a slave side control device 40, and a fishing robot as a slave device.
  • the master side control device 30 and the slave side control device 40 are connected via a network 60 such as the Internet.
  • the fishing rod type manipulator 10 and the head mounted display 20 are configured to be able to communicate with the master-side control device 30 through a wireless communication network or a communication cable
  • the slave-side control device 40 is connected with the fishing robot 50 through a wireless communication network or a communication cable. It is configured to be able to communicate.
  • It is also possible to configure the force / tactile sensation transmission system 1 as a local system by connecting the master side control device 30 and the slave side control device 40 by wired communication such as a communication cable.
  • the force / tactile sensation transmission system 1 shown in FIG. 3 is a system that allows a remote user to experience fishing by operating a fishing robot 50 as an avatar with a fishing rod type manipulator 10. Further, in the force / tactile sensation transmission system 1, a force / tactile sensation due to an external force input to a fishing rod included in the fishing robot 50 is transmitted to the fishing rod type manipulator 10, and a force / tactile sensation by an operation performed by the user on the fishing rod type manipulator 10 is transmitted. 50.
  • the user can experience fishing remotely with the feeling of actually touching the fishing rod.
  • the force / tactile sensation transmission system 1 it is possible to provide a technology capable of realizing a more realistic experience via a robot.
  • the force / tactile sensation transmission system 1 in addition to simply transmitting the force / tactile sense, the force / tactile sense is enlarged or reduced according to the setting, or only the force / haptic sense of a specific frequency is enlarged / reduced. It is possible to communicate or add virtual force and tactile sensation.
  • a real haptics mode and a pseudo experience mode can be set as modes for the user to experience fishing.
  • the real haptics mode is a mode in which a force / tactile sensation is transmitted between the fishing rod type manipulator 10 and the fishing robot 50 in real time, and the fishing robot 50 becomes an avatar of a user who uses the fishing rod type manipulator 10.
  • the pseudo-experience mode is a mode that allows the user to experience the tactile sensation at the time of fishing by replaying data when the fish has been caught in the past.
  • the fishing rod type manipulator 10 is an operating device that imitates the whole fishing rod or the hand side, and is connected to a support base through a hinge 11 so as to be rotatable in the vertical direction.
  • the hinge 11 is provided with an actuator 12 that applies rotational torque and an encoder 13 that detects the rotational angle of the hinge 11.
  • the detection signal of the encoder 13 is output to the master-side control device 30, and the rotational torque output by the actuator 12 and the rotational position of the actuator are controlled by the master-side control device 30.
  • the fishing rod type manipulator 10 includes a reel 14 at a predetermined distance from the end portion on the hand side (that is, the position of the hinge 11).
  • the reel 14 is installed at a position corresponding to the distance between the human elbow and the hand (hereinafter referred to as “position R”) from the proximal end of the fishing rod type manipulator 10.
  • position R a position corresponding to the distance between the human elbow and the hand
  • the end of the fishing rod is adjusted to the position of the elbow, and the posture of holding the reel installation portion by hand is taken. Therefore, by installing the reel 14 of the fishing rod type manipulator 10 at the position R, the user operating the fishing rod type manipulator 10 operates the fishing rod type manipulator 10 with the same feeling as holding a fishing rod during actual fishing. can do.
  • the end of the fishing rod on the hand side is connected to the hinge, and the movement of the fishing rod around the end of the fishing rod on the hand side is detected.
  • the fishing rod type manipulator 10 may be configured not to include the reel 14.
  • the reel 14 may be provided with an actuator that applies rotational torque and an encoder that detects a rotational angle, like the hinge 11.
  • the fishing rod 50 held by the fishing robot 50 is also provided with an actuator and an encoder, so that a force / tactile sensation can be transmitted between the reel 14 and the fishing rod reel.
  • the head mounted display 20 is a display that is used by being mounted on the head so as to cover the user's field of view, and displays an image taken by a camera installed on the fishing robot 50.
  • the image displayed on the head mounted display 20 can also display the image etc. which were image
  • various display devices such as a stationary display, a projector and a screen can be used instead of the head mounted display 20.
  • the master-side control device 30 controls the entire force / tactile sensation transmission system 1 and is constituted by an information processing device such as a PC (Personal Computer) or an embedded microcomputer.
  • FIG. 4 is a block diagram illustrating a configuration of the master side control device 30.
  • the master-side control device 30 is constituted by a PC, and as shown in FIG. 4, a CPU (Central Processing Unit) 31, a RAM (Random Access Memory) 32, a storage device 33, and a communication interface ( Communication I / F) 34.
  • the master-side control device 30 includes a driver for driving the actuator 12, a battery for supplying power, an input device (for example, a keyboard and a mouse) for inputting various information, and the like.
  • a parameter storage unit 33a for storing time-series parameters handled in the force / tactile sense transmission process is formed in one area of the storage device 33.
  • the storage device 33 appropriately stores various data (such as fish images and audio data) used in the force / tactile transmission system 1.
  • the CPU 31 executes various programs for controlling the master-side control device 30, thereby realizing various target functions such as a basic force / haptic transmission function and additional functions. Specifically, when the CPU 31 executes various programs, the CPU 31 implements, as a functional configuration, a position acquisition unit 31a, a force / tactile transmission unit 31b, a management unit 31c, and a data recording unit 31d.
  • the position acquisition unit 31 a acquires a time-series detection value detected by the encoder 13 of the fishing rod manipulator 10 and a time-series detection value detected by the encoder 53 of the fishing robot 50.
  • the force / tactile sensation transmission unit 31b has functions of a function-specific force / speed allocation conversion block FT, an ideal force source block FC, an ideal speed (position) source block PC, and an inverse conversion block IFT in FIG.
  • coordinate transformation for realizing the force / tactile sense transmission function is defined. That is, the force / tactile sensation transmission unit 31b is detected by the time detection value detected by the encoder 13 of the fishing rod type manipulator 10 and the encoder 53 of the fishing robot 50 from the position detection unit 31a in the real haptics mode. A time-series detected value (reference value) is input.
  • the force / tactile sensation transmission unit 31b in the pseudo experience mode, the time-series detection values detected by the encoder 13 of the fishing rod type manipulator 10 from the position detection unit 31a and the past read from the parameter storage unit 33a. (A time-series detection value detected in the past by the encoder 53 of the fishing robot 50) (reference value) is input. These time-series detection values represent the user's operation on the fishing rod manipulator 10 (manipulation of the fishing rod when fishing) and the current or past external force on the fishing robot 50 (external force on the fishing rod by a fish or the like).
  • the force / tactile sensation transmission unit 31b applies coordinate transformation for realizing the force / tactile sensation transmission function to the velocity (position) and force information derived from the input detection value (position).
  • the force / tactile sensation transmission unit 31b performs an operation in the velocity (position) region on the velocity (position) for deriving the state value of the velocity (position) obtained by the coordinate transformation. Similarly, the force / tactile sensation transmission unit 31b performs a calculation in the force region on the force for deriving the force state value obtained by the coordinate transformation. Further, the force / tactile sensation transmission unit 31b performs a uniform dimension processing on acceleration and the like on the calculation result in the calculated velocity (position) region and the calculation result in the force region, and realizes a force / tactile transmission function.
  • the force / tactile sensation transmission unit 31b calculates the calculation result in the calculated velocity (position) region and the calculation result in the force region as the value (current value) of the input region to the actuator 12 and the actuator 52 of the fishing robot 50 described later. Etc.). Then, the force / tactile sensation transmission unit 31 b outputs a value input to the actuator 12 to the actuator 12. Further, the force / tactile sensation transmission unit 31 b transmits the value of the input area to the actuator 52 of the fishing robot 50 to the slave-side control device 40 via the network 60. In addition, the value of the area
  • the management unit 31c performs various settings in the remote fishing experience control process and manages the progress of the process. Specifically, in the remote fishing experience control process, the management unit 31c sets to either the real haptics mode or the simulated experience mode according to a preset condition, or whether or not the fish has been successfully caught. Or performing an effect display and sound output when a fish hits.
  • the real haptics mode is set immediately after the start of the process, and when the preset condition is satisfied, the pseudo experience mode is set.
  • the remote fishing experience control process only the real haptics mode or the simulated experience mode may be set.
  • the data recording unit 31d records parameters when the force / tactile sensation transmission processing is performed in the real haptics mode in the parameter storage unit 33a in time series.
  • the slave-side control device 40 is configured by an information processing device such as a PC or an embedded microcomputer.
  • the slave-side control device 40 is configured as an embedded microcomputer and is configured as a device built in the fishing robot 50.
  • the slave-side control device 40 transmits the time-series detection values detected by the encoder 53 of the fishing robot 50 to the master-side control device 30 via the network 60.
  • the slave-side control device 40 outputs the input value to the actuator 52 transmitted from the master-side control device 30 to the actuator 52 of the fishing robot 50.
  • the slave-side control device 40 is appropriately equipped with various devices necessary for the force / tactile sensation transmission system 1, such as a driver for driving the actuator 52, a battery for supplying power, and a speaker for outputting sound. Is done.
  • the fishing robot 50 is a robot that can hold a fishing rod and operates as an avatar of a user who operates the fishing rod-type manipulator 10. Therefore, the fishing robot 50 is installed at a place where fishing is performed, such as a fishing pond, a coast such as a rod and a quay, a fishing boat, a river shore, and a lake.
  • the fishing robot 50 includes an arm 50A that holds a fishing rod having a fishhook and fishing line, and a portion corresponding to an elbow of the arm 50A is connected to a support base via a hinge 51 so as to be rotatable in the vertical direction. ing.
  • the hinge 51 is provided with an actuator 52 that applies rotational torque and an encoder 53 that detects the rotational angle of the hinge 51.
  • the detection signal of the encoder 53 is output to the slave-side control device 40, and the rotational torque output by the actuator 52 and the rotational position of the actuator are controlled by the slave-side control device 40.
  • the reel provided in the fishing rod is installed at a position corresponding to the distance between the human elbow and the hand from the end on the hand side of the fishing rod. That is, the fishing rod reel is against the end of the fishing rod. It is installed at the same position as the reel 14 of the fishing rod type manipulator 10.
  • the fishing robot 50 is provided with a camera for photographing a fishing spot (such as a water surface near a fishing line).
  • the reel of the fishing rod may be provided with an actuator for applying a rotational torque and an encoder for detecting a rotational angle, similarly to the hinge 51.
  • an actuator for applying a rotational torque
  • an encoder for detecting a rotational angle
  • FIG. 5 is a schematic diagram illustrating a configuration example of the actuator 100 used in the force-tactile transmission system 1.
  • the actuator 100 shown in FIG. 5 can be used as the actuator 12 or the actuator 52, and a fishing rod-like member of the fishing rod type manipulator 10 or a fishing rod held by the fishing robot 50 can be installed.
  • the actuator 100 includes a motor 101, a gear 102, and an attachment member 103.
  • the motor 101 is configured by an electric motor such as a DC motor, for example, and outputs rotational torque to the gear 102.
  • the gear 102 amplifies the rotational torque input from the motor 101 and rotates the support member 103 with the amplified rotational torque.
  • the support member 103 is fixed to the output shaft of the gear 102 and rotates around the output shaft of the gear 102 by the rotational torque output from the gear 102. Further, the external force input to the support member 103 is input to the gear 102.
  • the actuator 100 is used as the actuator 12 of the fishing rod-type manipulator 10
  • the fishing rod-shaped member of the fishing rod-type manipulator 10 is fixed to the support member 103, and is attached to the rear end portion of the support member 103 (near the rotating shaft of the gear 102). Is touched by the user's elbow.
  • the actuator 100 is used as the actuator 52 of the fishing robot 50, a fishing rod held by the fishing robot 50 is fixed to the support member 103.
  • the elbow position of the user who uses the fishing rod type manipulator 10 is configured to match the rotation center of the actuator 12.
  • the force and position data obtained when the fish has been caught in the past are stored and reproduced at an arbitrary timing (the actuator 12 of the fishing rod type manipulator 10 is driven based on the data) to simulate the feeling of fishing.
  • the actuator 12 of the fishing rod type manipulator 10 is driven based on the data
  • the type of fish or the size of the fish is determined from the direction of pulling the fish and the strength.
  • the direction and force of pulling the fish can be detected by providing a sensor for detecting the direction and magnitude of the force applied to the fishing line at the tip of the fishing rod. Note that the direction of the force may be detected by a camera installed in the fishing robot 50.
  • the fish is discriminated by (3) and the vision system or the audio system is integrated to display the type of fish or the size of the fish on the display, and the type of fish or the size of the fish is also expressed by sound.
  • the depth of the fishing hook (or bait) and the depth of the fish that is caught are identified.
  • a pattern of force to be input to the rod is extracted from data when the fish has been caught in the past, and the force / tactile sensation is reproduced for each pattern in the fishing rod type manipulator 10.
  • the pattern to be extracted can be, for example, recorded data for each section divided by the water depth at which the fish is located and divided at a timing with small movement. In the pseudo-experience mode for experiencing a force tactile sense at the time of fishing in the past, this pattern is selected and the force tactile sense is reproduced in the fishing rod type manipulator 10.
  • the water depth in which a fish exists can be identified from the length of the fishing line drawn out from the reel 14, and the angle of a rod.
  • the fishing rod type manipulator 10 can be installed, for example, in an airport lobby or the like, and the fishing robot 50 can be installed in a famous fishing spot.
  • the user is assumed to be a boarding person who waits for the departure of the airplane. Therefore, after the user starts the remote fishing experience via the fishing robot 50, when the predetermined timing is reached, the user can reproduce the data when the fish has been caught in the past, thereby It can be controlled so that the force tactile sense at the time of fishing is simulated. Thereby, the user can actually experience remote fishing via the fishing robot 50 and can surely experience the force tactile sense when the fish is caught even if the fish does not hit. .
  • the predetermined timing includes a timing that is a predetermined time before the user's boarding time (for example, one hour before), or after the user starts a remote fishing experience in the force-tactile transmission system 1.
  • the timing at which a predetermined time (for example, 30 minutes) elapses can be set. Either remote fishing experience via the fishing robot 50 (real haptics mode) or pseudo fishing experience using data when fish were fished in the past (pseudo experience mode) is selected in advance. Then, the force / tactile sensation transmission system 1 may be operated.
  • the fishing rod type manipulator 10 has a fishing experience such as an airport, a transportation facility, a game center, an amusement facility such as an aquarium, and a training facility for learning fishing techniques. It can be installed in various places where it can be used.
  • the force / tactile sensation transmission system 1 having the above-described function can perform various operations.
  • a force / tactile sensation transmission process As a process for realizing a remote fishing experience using the fishing robot 50, a force / tactile sensation transmission process, The remote fishing experience control process is executed.
  • FIG. 6 is a flowchart showing a flow of force / tactile sensation transmission processing executed by the force / haptic transmission system 1.
  • the force / tactile sensation transmission process is started in response to activation of a function for transmitting force / tactile sensation in the master-side control device 30.
  • step S ⁇ b> 1 the position acquisition unit 31 a of the master-side control device 30 acquires information indicating the positions (rotation angles) of the hinges 11 and 51 from the encoder 13 of the fishing rod type manipulator 10 and the encoder 53 of the fishing robot 50.
  • the position acquisition unit 31 a of the master-side control device 30 acquires the position (rotation angle) of the hinge 51 detected by the encoder 53 of the fishing robot 50 via the slave-side control device 40.
  • the force / tactile sensation transmission unit 31b of the master-side control device 30 performs coordinate transformation (see FIG. 2) for force / haptic transmission.
  • the force / tactile sensation transmission unit 31b of the master-side control device 30 acquires information indicating acceleration from information indicating the position (rotation angle) of the hinges 11 and 51, and appropriately converts the information into dimensions such as speed or force. Used for conversion.
  • step S3 the force / tactile sensation transmission unit 31b of the master-side control device 30 calculates values of inputs to the actuators 12 and 52 from the control amount of speed (position) and the control amount of force based on the result of coordinate conversion. .
  • step S4 the force / tactile sensation transmission unit 31b of the master-side control device 30 transmits values of inputs to the actuators 12 and 52 to the fishing rod manipulator 10 and the fishing robot 50, respectively.
  • the fishing rod type manipulator 10 and the fishing robot 50 (slave-side control device 40) drive the actuators 12, 52 based on the input values transmitted from the master-side control device 30, and the encoders 13, 53 The position (rotation angle) of the hinges 11 and 51 is detected.
  • step S6 the management unit 31c of the master-side control device 30 determines whether or not the end of the force / tactile sensation transmission process is instructed.
  • the termination of the force / tactile sensation process is automatically instructed in response to the fact that all functions for transmitting force / tactile sensations are stopped in the master-side control device 30.
  • an operator who manages the master-side control device 30 can instruct the end of the force / tactile sensation transmission process. If the end of the force-tactile transmission process is not instructed, it is determined as NO in Step S6, and the process proceeds to Step S1.
  • YES is determined in step S6, and the force / tactile transmission process is terminated.
  • FIG. 7 is a flowchart showing the flow of remote fishing experience control processing executed by the force / tactile sensation transmission system 1.
  • the remote fishing experience control process is started in response to the master side control device 30 instructing execution of the remote fishing experience control process.
  • step S21 the management unit 31c of the master-side control device 30 sets the force / haptic transmission system 1 to the real haptics mode.
  • the real haptics mode as described above, a force / tactile sensation is transmitted in real time between the fishing rod manipulator 10 and the fishing robot 50, and the fishing robot 50 becomes an avatar of the user who uses the fishing rod manipulator 10.
  • step S22 the management unit 31c of the master-side control device 30 starts a force / tactile sensation transmission process.
  • step S ⁇ b> 23 the management unit 31 c of the master-side control device 30 determines whether or not a fish is hit in the fishing robot 50. Whether or not a fish has been hit is determined by using, for example, information such as the magnitude, acceleration, and frequency of an external force input to the fishing robot 50 as a reference threshold set based on experimental values or experience values. It can detect by comparing. If the fish is not hit in the fishing robot 50, NO is determined in step S23, and the process proceeds to step S24. On the other hand, when a fish is hit in the fishing robot 50, it is determined as YES in Step S23, and the process proceeds to Step S32.
  • step S24 the management unit 31c of the master-side control device 30 determines whether or not it is a predetermined timing after the start of the remote fishing experience control process.
  • a timing that is a predetermined time before the user's boarding time (for example, one hour before), or a remote fishing experience by the user in the force-tactile transmission system 1 The timing when a predetermined time (for example, 30 minutes) has passed can be set. If the predetermined timing is not reached after the remote fishing experience control process is started, NO is determined in step S24, and the process proceeds to step S23.
  • step S24 the management unit 31c of the master-side control device 30 sets the force / tactile sensation transmission system 1 to the pseudo experience mode.
  • the pseudo-experience mode as described above, the data when the fish has been caught in the past is reproduced, so that the user can experience the tactile sensation at the time of fishing.
  • step S26 the management unit 31c of the master-side control device 30 selects a force / tactile sensation transmission pattern.
  • the force-tactile sensation transmission pattern is, for example, recorded data for each section obtained by classifying data when a fish has been caught in the past according to the depth of water in which the fish is located and at a timing when the movement is small.
  • step S27 the management unit 31c of the master-side control device 30 reads the selected pattern data from the storage device.
  • step S28 the force / tactile sensation transmission unit 31b of the master-side control device 30 reproduces the force / tactile sensation in the fishing rod manipulator 10 by performing coordinate conversion using the read pattern data as a reference value (see FIG. 1).
  • step S ⁇ b> 29 the management unit 31 c of the master-side control device 30 displays the type of fish or the size of the fish on the head mounted display 20, and outputs the type of fish or the size of the fish from the speaker provided in the head mounted display 20. To do.
  • step S30 the management unit 31c of the master-side control device 30 determines whether or not the fish has been pulled up to a depth of 50 cm when the user operates the fishing rod manipulator 10. Here, as a reference whether or not the fish has been caught, it is determined whether or not the fish has been raised within a depth of 50 cm. If a fish is pulled up within 50 cm of water, it can usually be caught by scooping it with “Tama”.
  • “Depth of 50 cm” is an example, and can be appropriately changed according to the fishing situation (fishing place, type of fish to be aimed at, etc.). If the fish has not been pulled up to a depth of 50 cm, NO is determined in step S30, and the process proceeds to step S26. On the other hand, if the fish has been pulled up to a depth of 50 cm, YES is determined in step S30, and the process proceeds to step S31.
  • step S ⁇ b> 31 the management unit 31 c of the master-side control device 30 displays on the head-mounted display 20 that the fishing has been successful, assuming that the fish that has been hit has been successfully caught.
  • step S31 the remote fishing experience control process ends.
  • step S ⁇ b> 32 the data recording unit 31 d of the master control device 30 starts recording external force data input to the fishing robot 50. If the data recorded at this time can reproduce the force-tactile state, such as the position (rotation angle) data detected by the encoder 53, or a control parameter calculated as a result of coordinate conversion, Various formats can be used.
  • step S ⁇ b> 33 the management unit 31 c of the master-side control device 30 displays the type of fish or the size of the fish on the head mounted display 20, and outputs the type of fish or the size of the fish from the speaker provided in the head mounted display 20. To do.
  • step S ⁇ b> 34 the management unit 31 c of the master-side control device 30 determines whether or not the fish has been pulled up to a depth of 50 cm by operating the fishing rod type manipulator 10. If the fish has not been pulled up to a depth of 50 cm, NO is determined in step S34, and the process proceeds to step S26. On the other hand, if the fish has been pulled up to a depth of 50 cm, YES is determined in step S34, and the process proceeds to step S33.
  • step S ⁇ b> 35 the management unit 31 c of the master-side control device 30 displays on the head-mounted display 20 that the fishing has been successful, assuming that the fish that has been hit has been successfully caught.
  • step S ⁇ b> 36 the data recording unit 31 d of the master control device 30 ends the recording of the external force data input to the fishing robot 50. After step S36, the remote fishing control experience control process ends.
  • the user can experience fishing remotely with a sense of actually touching a fishing rod.
  • the force / tactile sensation transmission system 1 it is possible to provide a technology capable of realizing a more realistic experience via a robot.
  • FIG. 5 is shown as the actuator 100 used as the actuator 12 or the actuator 52, but the configuration is not limited thereto.
  • the output of the actuator 100 can be increased.
  • FIG. 8 is a schematic diagram illustrating another configuration example of the actuator 100 used in the force-tactile transmission system 1.
  • the actuator 100 of this modification has a configuration in which two motors 101 are connected to the configuration example shown in FIG. 5.
  • the output torque of the actuator 100 can be increased twice as compared with the configuration example shown in FIG. Note that the output torque can be doubled by doubling the reduction ratio of the gear 102, but the reduction ratio of the gear 102 is doubled.
  • FIG. 9 is a schematic diagram illustrating another configuration example of the actuator 100 used in the force-tactile transmission system 1. Since the actuator 100 includes the gear 102, the generation of friction is inevitable. Therefore, as shown in FIG. 9, it is possible to input a current for canceling the frictional force to the motor 101 and perform control for compensating the frictional force (applying compensation torque). At this time, a current is evenly input to the two motors 101 connected. As a result, it is possible to avoid a situation in which the final output torque decreases due to the current being biased to one of the motors 101.
  • a current for compensating the weight of a reel or the like installed on the fishing rod held by the fishing rod type manipulator 10 or the fishing robot 50 can be input to the motor 101 to control the gravity. Also in this case, a current is equally input to the two motors 101 connected.
  • FIG. 10 is a schematic diagram illustrating another configuration example of the actuator 100 used in the force-tactile transmission system 1.
  • a torque sensor 104 can be provided on the output shaft of the actuator 100, whereby an external force input to the actuator 100 can be measured.
  • the actuator 100 is used as the actuator 52 of the fishing robot 50, it is possible to directly measure the torque when fishing a fish. Since the difference between the torque output by the two connected motors 101 multiplied by the gear ratio of the gear 102 and the value measured by the torque sensor 104 corresponds to friction, the reaction force (torque) can be calculated with higher accuracy. It becomes possible to measure, and a sharp force-tactile transmission becomes possible.
  • FIG. 11 is a schematic diagram illustrating a configuration example of a fishing rod type manipulator 10 configured as a multi-axis mechanism.
  • FIG. 12 is a schematic diagram illustrating a configuration example of a fishing robot 50 configured as a multi-axis mechanism.
  • the fishing rod type manipulator 10 shown in FIG. 11 and the fishing robot 50 shown in FIG. 12 have the same joint mechanism, and the force / tactile sensation transmission unit 31b of the master-side control device 30 applies force between the actuators 100 provided in the corresponding joints. Tactile transmission is performed. Specifically, as shown in FIG. 11, the fishing rod type manipulator 10 rotates around the rotation axis R1, the first joint J1 rotating around the rotation axis R1, the second joint J2 rotating around the rotation axis R2, and the rotation axis R3. And a third joint J3.
  • the rotation axes R1 and R3 are set in a substantially vertical direction, and the rotation axis R2 is set in a substantially horizontal direction.
  • Each of the first joint J1 to the third joint J3 is provided with an actuator 100 for driving the joint.
  • the first joint J1 is installed as a joint corresponding to a human shoulder
  • the third joint J3 is installed as a joint corresponding to a human elbow.
  • the fishing robot 50 includes the first joint J1 to the third joint J3, similar to the fishing rod type manipulator 10, and actuators 100 are provided in these joints. Further, the fishing robot 50 is provided with a camera C for photographing the fishing spot. The camera C is installed at a position corresponding to the human viewpoint with respect to the first joint.
  • the real haptics mode is used to photograph the fishing ground from the position corresponding to the human viewpoint
  • a fishing robot 50 that performs fishing by a movement corresponding to the movement of the elbow is used as an avatar
  • external force input to the fishing robot 50 is transmitted to the fishing rod type manipulator 10 as well as an operation input by a human to the fishing rod type manipulator 10.
  • a remote fishing experience can be performed while accurately reproducing at 10.
  • the force / tactile sensation transmission system 1 by reproducing the data when the fish has been caught in the past in the pseudo experience mode, it is possible to cause the user to experience the force / tactile sense when fishing.
  • the fishing rod type manipulator 10 and the fishing robot 50 it is possible to perform fishing by movement corresponding to the movement of the human shoulder and elbow while photographing the fishing ground from the position corresponding to the human viewpoint.
  • the user can perform a remote fishing experience or a simulated fishing experience with a more natural sense.
  • the force / tactile sensation transmission system 1 configured as described above includes a fishing rod type manipulator 10, a master side control device 30, and a fishing robot 50.
  • the fishing robot 50 can execute a fishing operation, and the fishing rod type manipulator 10 is installed apart from the fishing robot 50.
  • the master side control device 30 is configured to be able to communicate with the fishing robot 50 and the fishing rod type manipulator 10.
  • the master-side control device 30 causes the fishing rod type manipulator 10 to output a force / tactile sensation due to the external force input to the fishing rod based on information indicating the current or past external force input to the fishing rod provided in the fishing robot 50. Thereby, the external force input to the fishing rod provided in the fishing robot 50 can be transmitted to the fishing rod manipulator 10. Therefore, it is possible to provide a technology capable of realizing a more realistic experience via a robot.
  • the master-side control device 30 causes the fishing robot 50 to output a force haptic by the external force input to the fishing rod type manipulator 10 based on information indicating the external force input by operating the fishing rod type manipulator 10. Thereby, the operation which the user performed with respect to the fishing rod type manipulator 10 can be accurately reproduced in the fishing robot 50, and fishing can be experienced in the position away from the fishing spot.
  • the master control device 30 obtains the operation in the first mode (real haptics mode) for transmitting the force / tactile sensation between the fishing rod type manipulator 10 and the fishing robot 50 in real time and the data when the fish has been caught in the past.
  • the fishing rod type manipulator 10 can execute the operation in the second mode (pseudo-experience mode) for artificially outputting the force / tactile sense at the time of fishing.
  • the second mode prseudo-experience mode
  • the master-side control device 30 executes switching between the first mode and the second mode in accordance with preset conditions. Thereby, depending on the situation, you can choose to experience fishing in real time at a position away from the fishing ground, and to reproduce the data when you caught fish in the past and experience fishing in a pseudo manner It becomes possible.
  • the preset condition includes the time until the departure time of the transportation facility. Thereby, it is possible to provide the user with a fishing experience with appropriate contents in accordance with the waiting time of the transportation facility.
  • the present invention can be appropriately modified and improved within the scope of the effects of the present invention, and is not limited to the above-described embodiments and modifications.
  • the present invention is implemented in the force / haptic transmission system 1 in addition to being realized as the force / haptic transmission system 1, the master side control device 30, or the slave side control device 40 (force / haptic transmission device) in the above-described embodiment. It can be realized as a force / tactile sensation transmission method constituted by each step or a program executed by a processor to realize the function of the force / tactile sensation transmission system 1.
  • the example in which the master-side control device 30 and the slave-side control device 40 are configured as different devices has been described, but it is also possible to configure them as an integrated control device.
  • the water depth of the fish is determined by the amount of fishing line wound on the reel of the fishing rod held by the fishing robot 50, or the water depth of the fish is determined by a camera installed in the fishing robot. You can do it. Further, when it is determined whether or not the fish has been caught from the water, it can be determined by the fact that when the fish is caught from the water, the buoyancy is lost and the weight applied to the fishing line increases rapidly.
  • the force / tactile sensation is bidirectionally transmitted between the fishing rod manipulator 10 and the fishing robot 50
  • the present invention is not limited thereto.
  • the force sense of the external force input to the fishing robot 50 is output from the fishing rod type manipulator 10, and the fishing rod type manipulator
  • the force / tactile sensation by the operation input to 10 may not be transmitted to the fishing robot 50 (or the operation may be transmitted in a rounded manner).
  • the fishing robot 50 When the operation by the operation input to the fishing rod manipulator 10 is rounded and transmitted to the fishing robot 50, for example, only a large operation such as lifting the fishing rod or winding up the reel 14 is transmitted to the fishing robot 50, and an accurate force / tactile sense is transmitted. Can be omitted. In this case, the fishing robot 50 may automatically perform control for fishing the fish.
  • the processing in the above-described embodiment or the like can be executed by either hardware or software. That is, it is only necessary that the force / tactile sensation transmission system 1 has a function capable of executing the above-described processing, and what functional configuration and hardware configuration are used to realize this function is not limited to the above-described example.
  • a program constituting the software is installed on a computer from a network or a storage medium.
  • the storage medium for storing the program includes a removable medium distributed separately from the apparatus main body, or a storage medium incorporated in the apparatus main body in advance.
  • the removable medium is composed of, for example, a semiconductor memory (flash memory or the like), a magnetic disk, an optical disk, a magneto-optical disk, or the like.
  • the optical disc is composed of, for example, a CD-ROM (Compact Disc-Read Only Memory), a DVD (Digital Versatile Disc), a Blu-ray Disc (registered trademark), and the like.
  • the magneto-optical disk is configured by MD (Mini-Disc) or the like.
  • the storage medium incorporated in advance in the apparatus main body is constituted by, for example, a ROM or a hard disk in which a program is stored.
  • the said embodiment has shown an example to which this invention is applied, and does not limit the technical scope of this invention. That is, the present invention can be modified in various ways such as omission and replacement without departing from the gist of the present invention, and can take various embodiments other than the above-described embodiments. Various embodiments that the present invention can take and modifications thereof are included in the invention described in the scope of claims and the equivalents thereof.
  • S Control target system FT function-specific force / speed allocation conversion block, FC ideal force source block, PC ideal speed (position) source block, IFT inverse conversion block, 1 force tactile transmission system, 10 fishing rod type manipulator, 11, 51 hinge 12, 52, 100 actuator, 13, 53 encoder, 14 reel, 20 head mounted display, 30 master side control device, 31 CPU, 31a position acquisition unit, 31b force / tactile transmission unit, 31c management unit, 31d data recording unit, 32 RAM, 33 storage device, 33a parameter storage unit, 34 communication interface, 40 slave side control device, 50 fishing robot, 50A arm, 60 network, 101 motor, 102 gear, 103 mounting member, 10 Torque sensor, R1-R3 rotation axis, J1-J3 first joint to third joint, C camera

Landscapes

  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Environmental Sciences (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Animal Husbandry (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Manipulator (AREA)

Abstract

Le problème décrit par la présente invention est de fournir une technologie permettant de réaliser une expérience avec une réalité augmentée par l'intermédiaire d'un robot. La solution selon l'invention porte sur un système de transmission tactile de force qui inclut : un robot de pêche à la ligne capable de réaliser un mouvement de pêche à la ligne et un manipulateur en forme de canne à pêche espacé du robot de pêche à la ligne ; et un dispositif de commande configuré pour pouvoir communiquer avec le robot de pêche à la ligne et le manipulateur en forme de canne à pêche, le dispositif de commande amenant, sur la base d'informations indicatives d'un courant ou d'une force externe antérieure appliquée à une canne à pêche montée sur le robot de pêche à la ligne, le manipulateur en forme de canne à pêche à délivrer en sortie une sensibilité tactile de force générée par une force externe appliquée à la canne à pêche.
PCT/JP2019/013816 2018-03-28 2019-03-28 Système de transmission tactile de force, dispositif de transmission tactile de force, procédé de transmission tactile de force et programme Ceased WO2019189671A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2020511040A JP7029521B2 (ja) 2018-03-28 2019-03-28 力触覚伝達システム、力触覚伝達装置、力触覚伝達方法及びプログラム

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2018063369 2018-03-28
JP2018-063369 2018-03-28

Publications (1)

Publication Number Publication Date
WO2019189671A1 true WO2019189671A1 (fr) 2019-10-03

Family

ID=68061901

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/013816 Ceased WO2019189671A1 (fr) 2018-03-28 2019-03-28 Système de transmission tactile de force, dispositif de transmission tactile de force, procédé de transmission tactile de force et programme

Country Status (2)

Country Link
JP (1) JP7029521B2 (fr)
WO (1) WO2019189671A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022196309A1 (fr) * 2021-03-15 2022-09-22 株式会社Re-al Système de pêche, procédé de commande pour système de pêche et programme
JPWO2022230594A1 (fr) * 2021-04-26 2022-11-03
WO2025134206A1 (fr) * 2023-12-18 2025-06-26 日本電信電話株式会社 Système de traitement d'informations

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20060017367A (ko) * 2004-08-20 2006-02-23 이미경 실시간 대리낚시 시스템 및 이를 이용한 실시간 대리낚시방법
JP2012058992A (ja) * 2010-09-08 2012-03-22 Yellow:Kk バーチャル釣りシステム、プログラム
JP2013111136A (ja) * 2011-11-26 2013-06-10 Sentaro Dosono 魚釣りリアルゲームシステム
JP2013158466A (ja) * 2012-02-04 2013-08-19 Asuka Creation Co Ltd 魚釣りリアルゲームシステム
WO2015041046A1 (fr) * 2013-09-19 2015-03-26 学校法人慶應義塾 Contrôleur de position/force, et procédé et programme de commande de position/force
WO2017155051A1 (fr) * 2016-03-09 2017-09-14 学校法人慶應義塾 Dispositif de commande de position/force

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10202558A (ja) * 1997-01-22 1998-08-04 Toshiba Corp マスタスレーブ装置
WO2012029227A1 (fr) 2010-08-31 2012-03-08 パナソニック株式会社 Unité de commande et procédé de commande pour robot maître-esclave, robot maître-esclave, programme de commande et circuit électronique intégré
KR20120048990A (ko) * 2010-11-08 2012-05-16 (주)살구넷 원격제어 낚시장치

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20060017367A (ko) * 2004-08-20 2006-02-23 이미경 실시간 대리낚시 시스템 및 이를 이용한 실시간 대리낚시방법
JP2012058992A (ja) * 2010-09-08 2012-03-22 Yellow:Kk バーチャル釣りシステム、プログラム
JP2013111136A (ja) * 2011-11-26 2013-06-10 Sentaro Dosono 魚釣りリアルゲームシステム
JP2013158466A (ja) * 2012-02-04 2013-08-19 Asuka Creation Co Ltd 魚釣りリアルゲームシステム
WO2015041046A1 (fr) * 2013-09-19 2015-03-26 学校法人慶應義塾 Contrôleur de position/force, et procédé et programme de commande de position/force
WO2017155051A1 (fr) * 2016-03-09 2017-09-14 学校法人慶應義塾 Dispositif de commande de position/force

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022196309A1 (fr) * 2021-03-15 2022-09-22 株式会社Re-al Système de pêche, procédé de commande pour système de pêche et programme
JPWO2022230594A1 (fr) * 2021-04-26 2022-11-03
WO2025134206A1 (fr) * 2023-12-18 2025-06-26 日本電信電話株式会社 Système de traitement d'informations

Also Published As

Publication number Publication date
JPWO2019189671A1 (ja) 2021-11-04
JP7029521B2 (ja) 2022-03-03

Similar Documents

Publication Publication Date Title
US12296481B2 (en) Robot control device and robot control method
JP6660102B2 (ja) ロボット教示装置およびその制御方法、ロボットシステム、プログラム
US20230305530A1 (en) Information processing apparatus, information processing method and program
JP7029521B2 (ja) 力触覚伝達システム、力触覚伝達装置、力触覚伝達方法及びプログラム
JP3882287B2 (ja) 魚釣り遊戯装置
JP6509698B2 (ja) 提示する力覚を決定する装置、方法、およびプログラム
CN115338859A (zh) 机器人操纵的深度强化学习
US20250026020A1 (en) Information processing device and information processing method
US11633863B2 (en) Condition-based robot audio techniques
JP2021065955A (ja) ロボット制御システム及びその制御方法及びプログラム
CN120921336B (zh) 机器人零力拖拽的示教方法及系统
JP2022060900A5 (fr)
WO2021172580A1 (fr) Système de commande de position/force, unité portée, unité de commande, procédé de commande de position/force, et programme
JP5536510B2 (ja) プログラム及び画像生成システム
TW201944365A (zh) 增強第一身視角體驗的方法
JP6341096B2 (ja) 触力覚提示装置、情報端末、触力覚提示方法、およびコンピュータ読み取り可能な記録媒体
JP2019213764A (ja) シミュレーションシステム
KR20220162453A (ko) 가상 릴낚시 게임 장치
Pouke et al. The plausibility paradox for scaled-down users in virtual environments
WO2022196309A1 (fr) Système de pêche, procédé de commande pour système de pêche et programme
JP2023017128A (ja) 力触覚提示システム、力触覚提示装置、力触覚提示方法及びプログラム
WO2024166661A1 (fr) Corps mobile
JP7613443B2 (ja) 機器の制御装置、機器、機器の制御方法及びプログラム
WO2014119383A1 (fr) Dispositif de présentation de force tactile, système de présentation de force tactile, procédé de présentation de force tactile et support d'enregistrement lisible par ordinateur
JP4413911B2 (ja) ゲーム装置、ゲーム処理方法、ならびに、プログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19775591

Country of ref document: EP

Kind code of ref document: A1

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
ENP Entry into the national phase

Ref document number: 2020511040

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19775591

Country of ref document: EP

Kind code of ref document: A1