JP2012123473A - Operation method and acoustic device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an operation method that allows a user to select a function by simple operation even when the number of arranged operation buttons is reduced, and an acoustic device that allows a user to select a sound source by simple operation.SOLUTION: In an operation method, a menu item in a first menu is selected and determined, so that operation corresponding to the selected menu item is performed. In the operation method, by the selection operation of the menu item (203), an upper menu item (201) corresponding to an upper layer of the menu item is displayed, and by selecting and determining the upper menu item, a second menu of a lower menu item included in a lower layer of the upper menu item is displayed to enable selection operation of the lower menu item. There is also provided an acoustic device (10).

Description

  The present invention relates to an operation method and an audio device, and is particularly suitable for an on-vehicle device operation method and an on-vehicle audio device. A specific item is selected from a display list displayed on a display device, set to the selected item, and displayed. The present invention relates to an operation method and an audio device that can be used.

  In recent years, operation buttons have been increasing with the increase in functionality of electronic devices. In particular, in the case of an in-vehicle display device, there is a limit to the area that can be secured on the front surface, and a display and operation buttons must be arranged there. For this reason, the size of the operation button is reduced and the size of the display is reduced. In addition, in-vehicle devices are required to have an “easy-to-see display” and “simple operation” in order to ensure safe driving.

  Therefore, in order to increase the size of the operation buttons, categorize the functions of the operation buttons, arrange only the upper layer buttons, and display a list that can be selected only when the lower layer buttons are selected. A technique is known (Patent Document 1).

JP 2010-152859 A

  However, in such a technique, since the operation buttons have a large size, an “easy-to-see display” can be realized, but “simple operation” cannot be realized. Specifically, in a user interface that selects a specific function from buttons having a hierarchical structure as in the prior art, first, a function category is selected from a button in an upper hierarchy, and a function list in a lower hierarchy is further selected. It is necessary to perform a multi-stage operation every time a specific function is selected, and there is a problem that a complicated operation is required from the user. Particularly in an acoustic apparatus, the types of sound sources and the number of music recording songs are increasing, and a convenient operation is desired.

  Therefore, an object of the present invention is to provide an operation method capable of selecting a function with a simple operation and a sound apparatus capable of selecting a sound source with a simple operation even when the number of operation buttons is reduced.

  An operation method according to the present invention is an operation method in which an operation corresponding to a selected menu item is performed by selecting and then confirming a menu item in a first menu, wherein the selection operation of the menu item is performed. By displaying the upper menu item corresponding to the upper layer of the menu item, selecting the upper menu item, and further performing the confirmation operation, the second lower menu item included in the lower layer of the upper menu item is displayed. A menu is displayed to enable selection operation of lower menu items.

  An audio device according to the present invention is an audio device that performs a reproduction operation of a selected sound source by selecting and confirming a sound source of an audio video reproduction system in a first menu displayed in a normal operation state. The sound source selection operation item display means for displaying the sound source selection operation item by the sound source selection operation, and the sound source selection operation item is selected and further confirmed, so that the sound source of the audio / video reproduction system is selected. Sound source menu display means for displaying a second menu and enabling a sound source selection operation is provided.

  In the operation method according to the present invention, it is possible to select a function with a simple operation even if the number of operation buttons is reduced. In particular, it has become possible to achieve an excellent effect that function selection during driving of a vehicle and selection of a sound source and music in an in-vehicle acoustic device can be realized with few operations.

It is a schematic block diagram of the vehicle-mounted apparatus 10 containing a display apparatus. It is a transition diagram of a display screen. It is a transition diagram of a display screen. It is a transition diagram of a display screen. It is an example of the processing flow for producing | generating an operation screen. It is an example of the processing flow for producing | generating an operation screen. It is an example of a display setting memory. It is an example of a rotary switch. It is a transition diagram of the shortcut registration process by an empty icon. It is a transition diagram of the shortcut registration process by an empty icon. It is an example of the shortcut registration processing flow by an empty icon. It is a transition diagram of the shortcut registration process by a registration operation icon. It is an example of the shortcut registration processing flow by a registration operation icon. It is an example of the selection path | route registered as a shortcut to a real icon.

  Hereinafter, an audio device according to the present invention will be described with reference to the drawings. However, it should be noted that the technical scope of the present invention is not limited to these embodiments, but extends to the invention described in the claims and equivalents thereof.

  FIG. 1 is a schematic configuration diagram of an in-vehicle device (audio / visual navigation integrated device) 10 having a display device.

  In FIG. 1, 100 is a control unit, 101 is a CD / MD playback unit, 102 is a radio reception unit (AM, FM), 103 is a TV reception unit, 104 is a DVD playback unit, 105 is an HD (Hard Disk) playback unit, 106 is a navigation unit, 107 is a distribution circuit, 108 is an image adjustment circuit, 110 is an audio adjustment circuit, 111 is an image output unit, 112 is a VICS information reception unit, 113 is a GPS information reception unit, 114 is a selector, and 115 is an operation unit 116 is a remote control transmission / reception unit, 117 is a remote control, 118 is a memory, 119 is an external audio / video input unit, 120 is a camera, 121 is a USB connection unit, 122 is an external connection device, 123 is a communication unit, and 124 is a USB connection. A portable digital music player capable of transferring music data (digital) or the like, for example, in this embodiment, iPod (registered trademark), 12 The sound generating circuit, 128 is a microphone.

  The control unit 100 includes a CPU that comprehensively controls each unit and each circuit in the in-vehicle device, and stores a program storage unit including a ROM that stores various programs necessary for the operation of the in-vehicle device, and various data. And a data storage unit including a RAM to be held. Note that the ROM, the RAM, and the like can be used either internally or externally provided in the CPU (external memory 118), and the ROM is an electrically rewritable nonvolatile memory such as a flash memory. Memory may be used.

  The control unit 100 receives various sources (CD / MD playback unit 101, radio reception unit 102 (AM, FM), TV reception unit 103, DVD playback unit 104, HD playback unit 105, and navigation unit 106 via a distribution circuit 107. ) Is distributed to the image adjustment unit 108, and audio data from various sources is distributed to the audio adjustment circuit 110. The image adjustment circuit 108 adjusts brightness, color tone, contrast, and the like, and causes the image output unit 111 to display the adjusted image data on the display unit 130. Further, the sound adjustment circuit 110 adjusts the distribution, volume, and sound to each speaker, and the adjusted sound is output from the speaker 140.

  As a source, iPod (registered trademark) 124, external connection device 122, or downloaded application can be used. The iPod (registered trademark) 124 is connected to the control unit via the USB connection unit.

  The TV receiving unit 103 receives an analog TV broadcast wave and a digital TV broadcast wave from the antenna via the selector 114.

  The hard disk (HD) included in the HD playback unit 105 records music data such as MP3 files, image data such as JPEG files, map data for navigation, menu screen examples for selecting various data, and the like. Is configured to be possible. The HD playback unit 105 is configured to output various data recorded on the HD to the distribution circuit 107.

  The navigation unit 106 includes a map information storage unit that stores map information used for navigation, obtains information from the VICS (registered trademark) information reception unit 112 and the GPS information reception unit 113, and performs navigation operations. An image can be created and displayed on the display unit 130.

  The user can perform control of various sources, voice input / playback, and the like through voice recognition via the touch panel 133 attached to the surface of the display unit 130, the operation unit 115 provided around the display unit 130, or the microphone 128. It can be performed by an input operation such as. In addition, the user may perform an input or selection operation with the remote control 117 via the remote control transmission / reception unit 116.

The control unit 100 is configured to display, for example, an image from the front and / or rear monitoring camera 120 connected to the external audio / image input unit 119 on the display unit 130.
In addition to the monitoring camera 120, a video camera, a game machine, or the like may be connected to the external audio / image input unit 119 and various images may be displayed on the display unit 130.

  The communication unit 123 is, for example, a connection unit for Bluetooth (registered trademark) and is used for wireless connection with a mobile phone. By setting in advance, it becomes possible to execute a hands-free function of the mobile phone (an operation for making a call and receiving a call without directly operating the mobile phone). In this case, the control unit 100 performs control so that voice input by the user is performed via the microphone 128 and voice from the caller is output from the speaker 140.

  The sound generation circuit 126 generates sound corresponding to control data recorded in advance in the internal memory, HD and / or memory 118 of the control unit 100, and outputs the sound from the speaker 140 via the sound adjustment circuit 110. It is configured.

  The display unit 130 includes a backlight 131, a liquid crystal panel 132, and a touch panel 133. The various control buttons displayed on the liquid crystal panel 132 and the touch panel 133 are interlocked so that various control inputs can be performed using the touch panel 133. Instead of the liquid crystal panel 132, a flat panel display other than the liquid crystal panel, for example, an organic EL display panel, a plasma display panel, a cold cathode flat panel display, or the like can be used.

  The in-vehicle device 10 that reproduces and displays image data and audio data shown in FIG. 1 is an example of a device having the features of the present invention, and is not limited to this. As the in-vehicle device 10 for reproducing and displaying image data and audio data, at least the control unit 100, the memory 118, various sources (CD / MD reproduction unit 101, radio reception unit 102 (AM, FM), TV reception unit) 103, DVD playback unit 104, HD playback unit 105 and navigation unit 106, iPod (registered trademark) 124, external connection device 122, etc., but not limited thereto), elements corresponding to display unit 130 and speaker 140 are included. As long as it has, other configurations are not necessarily required. Note that a USB connection cable is required to connect the iPod (registered trademark) 124. In addition, the vehicle-mounted device according to the present invention may be implemented by attaching elements corresponding to the display unit 130 and the speaker 140 to a general navigation device.

[Operation by touch panel]
First, an operation of the touch panel (TP) 133 (see FIG. 1) will be described. Note that the basic operation of touch panel input is that the operation buttons and lists are displayed on the touch panel screen according to the operation / operation state of the device, and the operation display area is pressed (contacted) with a finger etc. Will be carried out. In the normal state, the display screen has a plurality of the same hierarchy (in order to make the explanation easy to understand, this hierarchy is B hierarchy, the upper hierarchy is A hierarchy, and the lower hierarchy is sequentially represented as C, D, E,. A menu with menu items is displayed. When a menu item in the menu displayed on the display screen is pressed and selected, the menu item is selected. After that, the menu item that has been pressed is released from the menu item (Release (R)), that is, by releasing the pressed state, the pressed menu item is in a selection confirmation state, and the device is compatible. The operation is performed and a state corresponding to the user operation is obtained.

  When a menu item displayed on the display screen is pressed and selected, the menu item in the upper hierarchy (A hierarchy) including the menu item selected next to the menu item as the lower hierarchy (B hierarchy selection function) Is displayed. The B layer selection function item is displayed so as to appear by sliding from the B layer menu item. Preferably, a notation indicating that the operation is to select an item from the menu item of the B layer is given to the B layer selection function item. Accordingly, the user is recognized that the B layer selection function item shifts to an operation screen for selecting an item from the menu item in the same layer (B layer) as the menu item (B layer) in the selected state. Can provide an intuitive and easy-to-understand UI.

  Then, in a state where the menu item is pressed and selected, it is slid while touching (while pressed) in the direction of the B layer selection function item displayed next to the menu, and the pressing position is moved to the B layer selection function item. (Flick / Release (F / R)), that is, the pressed state for the B layer selection function item is released. Then, the menu item display in the first pressed menu is replaced with the B layer selection function display indicating the B layer selection function item, and the menu item list of the B layer is displayed next to the upper selection operation menu item. The menu item selection screen (B layer menu screen) is displayed. In this state, by pressing the menu item in the B layer and leaving at the desired menu item position, the selection of the menu item is confirmed and the corresponding operation is executed. In addition, the display of the menu item in the function menu pressed first is a display that suggests the menu item that has been selected and confirmed.

  Therefore, the menu item that has been selected and confirmed is displayed without adding a menu item display area, and the selection and confirmation operation can be performed immediately. It becomes operation. In addition, since a new menu item is not added and displayed, the display area can be effectively used. Note that the item selected most recently is effective because it is highly likely that the item displayed in the same menu will be selected again.

  In this embodiment, the configuration in which the display of the function menu is replaced with the display of the source is described. However, the present invention is not limited to this, and the function menu is displayed when a submenu item that appears by selecting the function menu is selected. Any configuration may be used as long as the displayed area is replaced with the display of the selected item.

  Next, the operation described above will be described using specific state transition examples for easier understanding. 2, 3 and 4 are diagrams showing screen transition states. Further, in this example, the in-vehicle device 10 is in a state where a map is displayed in the navigation operation, and audio reproduction is in a state of receiving and reproducing FM radio. Regarding the menu of the display screen, regarding the selection procedure of the function menu when the function menu is selected using the touch panel 133, the transition screen of the display screen of FIGS. 2 to 4 and the display screen after the power supply of FIG. This will be described with reference to a processing flow for generating the.

  First, in the normal operation state, the operation menu 200 is displayed on the left side of the screen. In this example, as a menu item, “current location” that moves the map so that the vehicle position is a predetermined position on the map (slightly below the center), “destination” that moves to the operation screen for setting the destination, Information function for acquiring various information using “FM” for shifting to FM broadcast reception operation screen and shifting to FM broadcast reception operation screen, “vehicle” for shifting to operation screen of various equipment (for example, air conditioner) of vehicle, Internet, etc. "Information" for moving to the operation screen, "Telephone" for performing telephone operation, various settings of the in-vehicle device 10, home position registration, communication settings, user information registration, etc. “Edit” is displayed continuously in the form of operation buttons.

  In order to make the explanation easy to understand in conformity with the drawing image, the operation area of the menu item is hereinafter referred to as a button, for example, an “FM” button. In addition, a shortcut button display area is displayed on the right side of the screen, and a plurality of shortcut buttons can be displayed in the shortcut button display area.

  In the state of this example, since it is an FM broadcast reception / playback state, an “FM” button which is the latest selected source of an audio / visual (AV) source is displayed. This area is an area where AV source buttons are arranged. For example, if the latest selected source is a DVD, “DVD” is displayed. Even in the playback stop state, the playback source before the stop is displayed. The latest selected state (operating state before stopping) and the operating state are hereinafter referred to as a last mode.

  When the map screen at the center of the screen is pressed in this state, the entire area of the screen is displayed as a map for a certain period of time, and the normal operation shown in FIG. Return to the screen.

  When the “FM” button 203 is pressed, the “FM” button 203 is selected (203-2), and the display color is inverted. Further, a “source” button 201 for shifting to a source selection screen for selecting an AV source is displayed next to the right side. When the pressed state for the “FM” button 203 is released while the “FM” button 203 is selected, the operation for the “FM” button 203 is confirmed, and an FM broadcast reception operation screen is displayed.

  If the FM broadcast is not received, FM broadcast reception is started. On the other hand, when the “FM” button 203 is kept pressed and is slid in the direction of the “source” button 201, the “source” button 201 is selected and its display color is inverted (FIG. 2C). Thereafter, when the pressing is released at the position of the “source” button 201, an operation corresponding to the “source” button 201, that is, a source selection screen is displayed here (FIG. 2D). In the source selection screen, a “source” button 201 is displayed in the selection operation area of the AV source, and next to the list of various sources, here, “AM” button, “FM” button, iPod (registration) of AM broadcast reception / playback "MAU (memory audio)" button for memory audio playback such as trademark) and "TV" button for TV broadcast playback are displayed.

  On this source selection screen, for example, when the “MAU” button is pressed, the function of the memory audio is selected (204-2), and the display color of the “MAU” button is inverted. When the pressed state is released at the position of the “MAU” button, the function of the memory audio is executed (FIG. 3E), and the playback mode of the last mode in the memory audio (song playback state before stopping) is set. When memory audio different from the previous one is connected (including when the built-in memory is replaced, etc.), the first music is played. In the display screen, the display is changed to the “MAU” button in the latest selected state at the AV source button arrangement position, and the “MAU” in the normal display is changed until the source in the latest selected state is changed. "Button display is maintained.

  In the “MAU” button display state, when an operation similar to the operation in the “FM” button display state described above is performed, the states as shown in FIGS. It becomes a transition. When the “MAU” button is released from the state in which the “MAU” button is pressed in the “MAU” button display state, the operation for the “MAU” button is confirmed and the MAU operation screen is displayed. Note that the MAU operation screen returns to the normal screen when no MAU operation continues for a predetermined time. If there is no MAU playback state, MAU playback is started in the last mode.

  The operation screen of the MAU is a screen as shown in FIG. 4 (i), and a music selection menu is displayed in the left end area of the screen. The music selection menu searches for a music based on a “play list” button for reproducing based on a list selected and registered by the user, an “artist” button for searching for and selecting music based on an artist, and an album name (disc title such as a CD). It has buttons (menu items) such as an “album” button for selecting a song and a “music” button for searching for and selecting a song based on the song name.

  For example, when a playlist is pressed on the MAU operation screen (music selection menu is displayed), a playlist name list (playlist name button) registered by the user at the lower hierarchy is displayed. When the playlist name button is further pressed, a song name list (music name button) registered in the playlist is displayed. Note that, by pressing the playlist name button, reproduction of the registered music in the playlist is started in the last mode. Furthermore, when the music name button is pressed, the music starts to be played, and then each music is played in the order stored in the playlist.

  In addition, when a flick operation in the right direction is performed in the display state of each list (moving leftward while maintaining the pressed state), the display of the lowest-level list in the display list is deleted. . Even if the lower layer list is displayed, it is possible to press the upper layer button. In this case, the operation corresponding to the operated button, for example, the display of the lower layer list corresponding to the button is displayed. An operation to become a state is performed.

  The menu 200 includes an operation button area in which operation buttons (menu items) can be changed and an operation button area in which the change is not possible. For example, an item that does not have a lower hierarchy in the item, or an item that does not have another menu in the same hierarchy (not set), for example, a “current location” button is an operation button (menu item) that cannot be changed. The "" button is a subordinate item such as "facility name" (search for destination by facility name), "address" (search for destination by address), "phone number" (search for destination by phone number), etc. This is an operation button that can be changed. These are appropriately set at the time of design, and the “destination” button can be set as an operation button that cannot be changed. Further, the user may be able to perform these settings by setting operation.

  FIG. 7 is a diagram showing an example of a display setting memory for displaying the above-described operation buttons. The display setting memory is associated with a menu item (“source”) that may display a button in a normal operation state, and its upper layer (AV system, destination) data “category”, menu item (source) Data “list position data” indicating the list display position at the time of selection, image data “button image 1” of the button display in the normal operation state, and image data “button image 2” indicating the list display image at the time of selecting the menu item (source) In addition, data “display presence / absence” indicating whether or not to perform button display in the normal operation state is stored, and data other than the fixed data is added / updated as necessary.

  For example, when button display of “MAU” is performed in the normal operation state, the presence / absence of display in the source “MAU” is updated from “0” to “1”. When button display is performed in the normal operation state, a source with “1” displayed is displayed, and an image is displayed based on the image data of “button image 1” in the “category” display area corresponding to the source. To do. Also, a selection scene of “source”, that is, a list of “source” (list display of each source button) is displayed.

  In this example, for FM, for example, the image of “FM image 1” is displayed in the “AV system” display area in the normal operation state, and “A1-2” is displayed at the display position of “A1-2” in the “source” selection scene. The image of “FM image 2” is displayed.

  Further, in the present embodiment, it is selected depending on whether the pressed state with respect to the operation button in the normal operation state is released as it is or by sliding it while maintaining the pressed state in the menu list direction (right direction) corresponding to the menu item. However, the present invention is not limited to this, and as another embodiment, the corresponding menu list appears by pressing the operation button in the normal operation state, and the pressing state for the operation button is temporarily changed. When the operation button is pressed again after being released, the function corresponding to the operation button is executed, and after pressing the operation button, the menu item (operation button) in the menu list is pressed, and the pressed state is left as it is. Release or slide in the center of the display while maintaining the pressed state By, then confirm the selection of the source selection function may be configured to display the source selection screen.

  As described above, regarding the display of the operation button in the normal operation state, for example, when it is desired to execute the function of the memory audio again by selectively displaying the menu item of the function executed immediately before, the menu item of the menu is displayed. This operation can be performed simply by selecting and operating the “MAU” operation button that is already displayed, and thus there is no need to perform complicated operations such as making a source selection screen appear and selecting each time the memory audio function is executed. Can provide simple operation.

  Next, when execution of the iPod (registered trademark) function is determined, a menu necessary for executing the iPod (registered trademark) function is displayed. Specifically, a reproduction data search screen is displayed. iPod (registered trademark) stores music data, moving image data, and the like as reproduction data in a storage medium. As items of the reproduction data search screen, for example, a playlist 211-2 in which the order of reproducing music data is registered, an artist 212 that searches music data from the artist name, an album 213 that searches music data from the album name, There are songs 214 and the like for searching music data from song names. Then, when any one of the items on the reproduction data search screen, for example, the playlist 211-2 is pressed, the playlist 211-2 is selected (active state), and a submenu is displayed next to it (on the right side). An album selection screen is displayed including a list of selectable albums (FIG. 4 (i)).

  Here, in the present embodiment, a configuration has been described in which, when any one of the items on the reproduction data search screen is pressed, the item is selected. As a form, when the execution of the function of iPod (registered trademark) is decided, any one of the items on the reproduction data search screen may be displayed in the already selected state (automatically). In this case, the item already selected (automatically) may be the item displayed at the top of the items on the reproduction data search screen, or may be the item selected in the previous execution. It may be an item frequently used by the user.

  Next, a specific operation example will be described. When one of the album lists displayed on the album selection screen, for example, the drive song 222 is pressed, the drive song 222 is selected (active state: reverse color display) (222-2) (FIG. 4 ( j)), a music selection screen of a music list that can be selected as a lower hierarchy menu is displayed next to the right side (right side) (FIG. 4 (k)). The music list displayed on the music selection screen is music included in the drive song 222-2. In the music list, the music name and artist name are displayed in association with each other (FIG. 4 (k)). Then, for example, when the song name “Romance” button and the singer name “RR” button are pressed and the pressed state is released, the music data corresponding to the song name “Romance” is reproduced, and the music being reproduced on the display unit 130 is reproduced. A still image or a moving image related to the music information included in the data is displayed (FIG. 4 (l)).

  In the present embodiment, a configuration is described in which the menu item (operation button) is pressed and the pressed state is released to select or confirm the selection and execute the function. However, the present invention is not limited to this, and the menu (selection operation button) in the lower hierarchy may be displayed by pressing the menu and sliding it in the center direction of the display unit 130 while maintaining the pressed state. Such a configuration is effective as a UI that can be operated intuitively when each menu has a hierarchical structure. For example, when transitioning from the upper hierarchy to the lower hierarchy, the slide operation is performed in the direction of expanding the menu, and when transitioning from the lower hierarchy to the upper hierarchy, the slide operation is performed in the direction of closing the menu. Become.

  Next, operation button display processing in the normal operation state will be described. FIG. 5 is a flowchart showing an example of processing for generating a display screen after turning on the power of the display device, which is one of the processing for displaying the operation button in the normal operation state. This process is a process related to AV operation buttons, and the functions of the system for displaying the same operation buttons are similarly performed.

  This process is performed when the display device is turned on by the control unit 100 using various components and various circuits of the in-vehicle device 10 according to a program stored in advance in the internal memory or the like of the control unit 100. This is executed when there is a change in the connection state of (when the connection state is constantly monitored and an interrupt is issued by the change).

  First, the control unit 100 detects a connected source (S301). For example, since the memory audio or the like is detachable, it is determined whether it is connected and reflected in the subsequent control. As an example of detecting an executable source, a command for transmitting device type data is sent to each device, and the connected device is determined based on the returned data. Each device needs to be equipped with a communication module according to a predetermined communication standard in advance. Here, as sources, there are radio (AM, FM), TV, CD / MD, DVD, memory audio, navigation, downloaded applications, etc., but this processing can be omitted for sources that are integrated and cannot be separated. Note that the memory audio is connected by, for example, a USB cable.

  Next, based on the detection result, source screen data to be stored in the display setting memory of FIG. 7 is generated and stored (S302). These necessary data (image data and the like) are stored in advance in the memory of the display device, or download application software is generated based on data included in the downloaded software, for example, image data.

  Next, it is determined whether there is a source corresponding to the AV system last mode. If there is a source, the process proceeds to step S304, and if not, the process proceeds to step S305. This is a process for the possibility that the detachable source of the memory audio may not be connected even if the source corresponds to the last mode. In step S304, a screen corresponding to the source corresponding to the last mode is formed, that is, an operation button of the source corresponding to the last mode (for example, “FM”) is generated, and the process ends as a display state. In step S305, it is determined whether or not there is a newly connected source. If there is a newly connected source, the process proceeds to step S306, and if not, the process proceeds to step S307. This is a process for preferentially displaying the operation buttons because the user is likely to select a newly connected source.

  In step S306, a screen corresponding to the newly connected source is formed, that is, an operation button of the newly connected source (for example, “FM”) is generated, and the process ends as a displayed state. In step S307, a screen corresponding to the source set as a default is formed, that is, an operation button for a preset source (for example, “FM”) is generated, and the process ends as a display state.

  Next, the source selection operation process will be described. FIG. 6 is a flowchart showing the source selection operation process, which is executed by the control unit 100 when the operation button in the AV source selection operation area is pressed.

  First, when an operation button in the AV source selection operation area, for example, the “FM” button 203 is pressed, the display color of the pressed operation button (“FM” button 203) is reversed (activated), and to the right A “source” button that is an operation button in the upper hierarchy is also displayed next to it. Next, it is determined whether the pressing is released at the pressing operation button position or the pressing is performed at the “source” button position, and if it is the pressing operation button position, the process proceeds to step S403. The process moves to S404. At this time, when the pressing position moves to the “source” button position, the “source” button becomes active. That is, the operation button at the pressed position is activated. In step S403, the operation screen is used as the operation screen in the source last mode corresponding to the pressing operation button, and the process proceeds to step S407.

  In step S404, a source list is displayed and a source selection operation is waited (steps S404 and S405). Then, the operation screen of the last mode in the selected source (for example, MAU) is displayed, and the source is set in the reproduction state in the last mode (S406). Next, the last state (immediately before the selection) (display state, reproduction state, etc.) of the source before the new selection is stored (S407). Then, waiting for the release condition of the source selection screen to be established, for example, detecting a state in which no operation continues for a predetermined period of time, for example, an operation with separation (for example, another operation button, for example, current location button operation) is performed, If the above condition is satisfied, the process proceeds to step S409. Then, a return screen, that is, a normal screen is generated, the generated normal screen is displayed, and the process ends. In the normal screen, processing is performed so that the source operation buttons in the playback state are displayed in the source selection operation area.

So far, it has been described that the menu 200 is displayed at the left end of the display screen, the lower layer menu (201 in FIG. 2B, etc.), the contents of the memory audio 204, and the like are sequentially displayed from the left end.
However, the menu 200 may be displayed at the right end of the display screen, and the lower layer menu (such as 201 in FIG. 2B), the contents of the memory audio 204, and the like may be sequentially displayed from the right end. In this case, the shortcut registration area 501 is displayed at the left end.

  Further, the display of the menu 200 is set to the upper or lower end of the display screen, and other displays are displayed sequentially in the downward direction (as in the pull-down menu) or sequentially in the upward direction (as in the pull-up menu). Also good. In that case, the shortcut registration area 501 is displayed at the end opposite to the end where the menu 200 is displayed.

[Operation by rotary switch]
The menu item displayed on the display screen of the display unit 130 can be selected using a rotary switch (RS) disposed near the handle 930 (FIG. 8) or near the display unit 130. First, the basic operation of the rotary switch (RS) will be described. The rotary switch (RS) is not limited to the operations described below.
With reference to FIGS. 2D, 3E, 3G, 4H, and 4I, transition of the display screen by operating the rotary switch will be described.

  An example of the rotary switch is shown in FIG. The rotary switch (RS) 900 has an operation portion made of resin or the like, and can be moved in the pressing direction and tilted with respect to a plane perpendicular to the pressing direction. An elastic member such as a spring can be used to return to the initial position before the operation. Restoring force is attached. In addition, push switches are arranged at the center lower part of the operation part and the lower part near the outer peripheral end of the upper, lower, left and right in the figure, and the operation part depends on the contact state of these switches and the change state (change order) of the set state. Pressing and tilting operations (eight directions depending on the combination of switches that are in the ON state, that is, tilting operation in that direction when only one switch is ON, tilting operation in the direction when two switches are ON), rotation It is possible to detect an operation (detecting that the rotation operation is performed in the order of the switch positions that are turned on by the operation of changing the pressing operation position in a rotating manner).

  When the rotary switch (RS) 900 is tilted (pressed) in any of the four arrow directions 902 in the up, down, left, and right directions, the selected state moves to the menu item (operation button) in the tilted direction. In addition, when the rotary switch (RS) is rotated while being tilted (pressed) in the clockwise direction (right rotation) 904, the selected menu item is sequentially moved down in the list, and the counterclockwise direction (left rotation) 905 is rotated. When the rotary switch (RS) is rotated while being pushed down (pressed), the selected menu item is sequentially moved up in the list. Further, when the center portion 903 of the rotary switch (RS) is depressed, selection of the selected menu item is determined, an operation corresponding to the confirmed menu item is executed, and a corresponding display screen is displayed. On the map operation screen in navigation, a map scroll operation in eight directions of tilting operation is performed.

  Furthermore, based on the duration of the ON state in the switch 906 that detects the pressing in the vertical direction, it is possible to detect a short press and a long press of the operation unit, and it is possible to vary the operation content due to this difference. For example, an operation for confirming selection of an operation button in a selected state is performed by a short press, and a menu (operation button area) to be operated by the rotary switch (RS) is sequentially changed by a long press, for example, a left menu Then, the rotary switch (RS) is sequentially switched between the center map and the shortcut on the right side, and the operation of switching the object of the tilting operation of the operation unit is performed.

  Next, the correspondence between the touch panel operation and the rotary switch operation will be described. When the touch panel operation is performed by pressing the touch panel with a finger, an operation is selected according to the pressed position, and by canceling the press, the selected state is determined and a corresponding operation is performed. For example, when the operation button part is pressed, the operation corresponding to the operation button is performed, and when the map screen (other than the part corresponding to the operation button) is pressed, the map is scrolled so that the map display is centered on the position. The operation is performed.

  On the other hand, the basic operation of the rotary switch in this embodiment is to move between the operation buttons displayed by the tilting operation of the rotary switch in the up / down / left / right directions, and to select the operation button. The operation is confirmed by the pressing operation in the direction, and the corresponding operation is executed. Note that in a tilting operation of the rotary switch in the up / down / left / right direction on a screen on which no operation buttons are displayed, a scrolling operation corresponding to the tilting operation direction of the screen, for example, a map, is performed. Further, the menu item in the menu item list is selected and changed (the display order is changed / the change direction corresponds to the rotation direction) by rotating the rotary switch.

Next, as a specific operation example, a menu selection procedure when a menu on the display screen is selected using a rotary switch (RS) will be described.
First, the procedure for selecting “MAU” as the source from the leftmost menu bar will be described with reference to FIGS.

  The navigation screen is displayed on the initial screen that is displayed when the power of the navigation device is turned on (the ignition switch of the vehicle is turned on). The menu on the left end includes “Destination”, “MAU”, “Vehicle”, “Information / G”, “phone”, and “setting / editing” buttons (menu items) are displayed. In addition, “current location” is selected as an initial state, and the display color is reversed. When the rotary switch (RS) is turned to the right, the order of the "Destination", "MAU", "Vehicle", "Information / G", "Phone", "Settings / Edit" buttons in the menu on the left is sequentially selected Changes and the display color is reversed. Note that when the rotary switch (RS) is rotated to the left, the selection state is sequentially shifted upward. When the selected item is the lowermost end, the selection state does not change even if the rotary switch (RS) is rotated to the right, and when the selected item is the uppermost end, the selection state does not change even if it is rotated to the left.

  In the state where the “MAU” button 204 is selected (see FIG. 2 (f)), when a confirmation operation (pressing operation of the rotary switch (RS)) is performed, a “source” button 201 to the right of the “MAU” button 204. Is displayed (see FIG. 3G). In this state, when the rotary switch (RS) is tilted to the right, the “source” button 201-2 is selected, and the display color is highlighted (see FIG. 3H).

  When the rotary switch (RS) is pressed (determined) while the “source” button 201-2 is selected, the “source” button is displayed at the position of the “MAU” button 204 (AV operation button area) in the leftmost menu. 201 is displayed, and on the right side of the “source” button 201, a list of sources, for example, an “AM” button 202, an “FM” button 203, a “MAU” button 204, and a “TV” button 205 are displayed side by side in the vertical direction. The “AM” button 202-2 displayed at the top is displayed in a selected state (see FIG. 2D).

  In this state, when the rotary switch (RS) is rotated to the right, the selection state sequentially shifts in the order of “FM” 203, “MAU” 204, “TV” 205 on the menu bar, and the selection state button is displayed. Displayed in reverse color. When the rotary switch (RS) is rotated to the left, the selection state is sequentially shifted upward.

  When the “MAU” 204-2 displayed in the source list is selected (see FIG. 3E), when the rotary switch (RS) is pressed (confirmation operation), the “MAU” 204-2 is selected. Is confirmed, and the memory audio is played back in the last mode. Further, a memory audio music selection operation screen is displayed in the last mode (the latest music selection operation state) on the display screen (see FIG. 4I). That is, operation buttons such as a “play list” button, an “artist” button, an “album” button, and a “song” button are displayed on the left end from the top to the bottom, and the “play list” that is the latest music selection state is displayed. "Button is displayed in a selected state (display color inverted state). Further, a list of playlists (operation button group) including, for example, a “drive song” button is displayed on the right side of a menu such as “playlist” as a lower hierarchy of “playlist” (see FIG. 4I).

  In this state, when a confirmation operation is performed by the rotary switch (RS), the “drive song” button operation is confirmed, and the music registered in the playlist “drive song” is reproduced in the last mode. In addition, a list (buttons) of songs registered in the playlist “drive song” is displayed on the right side of the “drive song” 222-2 button, and an operation button corresponding to the last mode song related to the “drive song” playback is selected. It is in a state. Then, the rotation state of the rotary switch (RS) causes the selection state to move up and down as in the above-described operation, and the operation of the music button in the selection state is confirmed by the confirmation operation, and the music is reproduced. Become. For example, when the rotary switch (RS) is pressed (determined) in a state where the “Romance” button is selected, the performance of the music “Romance” is started.

When the rotary switch (RS) is tilted to the left with the music ("Romance") selected, the selected state moves to the "Drive Song" button, and the "Drive Song" button is displayed in reverse color. (See FIG. 4 (j)).
Further, when the “play list” button 211-2 is selected and displayed (FIG. 4 (i)), when the rotary switch (RS) is tilted to the left, the upper list, that is, the source list is displayed. The last display mode, that is, a state in which the “MAU” button 204-2 is selected (see FIG. 3E).

  So far, the operation of selecting menu items (operation buttons) from the menu (list) of the upper hierarchy and lower hierarchy of the hierarchical structure using the touch panel and the rotary switch has been described. If an operation such as sequential selection in the upper and lower order in the list is substantially possible, it can be realized by using other input devices such as a mouse and a voice.

  Next, a registration method for registering a shortcut icon in the shortcut registration area on the right side of the screen will be described. As specific examples, a shortcut icon registration method using an empty icon, a shortcut icon registration method using a registration operation icon, and a shortcut icon registration method using drag and drop are sequentially described with reference to FIGS. 9 to 14. To do.

[How to register shortcut icons using empty icons]
A shortcut icon registration method using an empty icon will be described with reference to FIGS.

  The display screen includes a menu 502, a display area 500, and a shortcut registration area 501. A menu 502 including the source is displayed at the left end of the screen. In the display area 500 at the center of the screen, music and video display, navigation map display, and the like are performed, and a shortcut registration area at the right end of the screen is displayed. In 501, a shortcut icon (button) is displayed.

  Shortcut icons include empty icons 513 and 514 in which the operation state of the device is not registered, and real icons 511 and 512 in which the operation state is registered (execution of reproduction of content (music, video, etc.)). The shortcut registration area 501 is displayed in a different display form. In the following, an icon whose operation state is registered is referred to as a real icon, and an icon that is not registered is referred to as an empty icon.

  When a real icon is pressed, processing is performed so that the device state registered in the icon is obtained. For example, when a reproduction state of a certain content (music, video, etc.) is registered, the instrument is reproduced. On the other hand, when the empty icon is pressed, the device state at the time of operation, for example, the playback state of content (music, video, etc.) is registered in this icon. The details of the device state may be set as appropriate at the time of design. For example, in the case of a music playback state, the music name is the smallest unit (in this case, the actual icon is played from the beginning of the corresponding music). Alternatively, a playback position (time) unit (in this case, playback from the corresponding position of the corresponding music by operating the actual icon) may be appropriately set.

  The real icon includes a registered device state, for example, an image related to the content (for example, in the case of music playback registration, a reduced image of a music album jacket, a face photo of an artist, etc.), a title of the content, an artist name, etc. Is displayed in or near the icon. For example, icons 511 and 512 in FIG. 9A display content titles and artist names such as “AAA” and “BBB” under the icons, respectively.

  In addition, the empty icon is displayed so as to be associated with the empty icon in the icon, for example, a white triangle arrow, thereby allowing the user to recognize that the shortcut is not registered. Note that the mark indicating that the shortcut is not registered is not limited to the white triangle arrow, and the character “unknown” may be displayed or may be expressed in gray.

  If the upper limit number of icons that can be registered as shortcuts is set to 12, for example, four icons can be displayed on one screen, eight icons cannot be displayed. In this case, it is necessary to take measures such as providing a page switching button by dividing the display into three screens, or providing a scroll operation button and sequentially moving buttons displayed by the scroll operation. In this case, it is preferable that the position of the display icon can be recognized by displaying, for example, a page of the icon being displayed or an indicator 520 indicating the relative positional relationship in the shortcut registration area 501. In addition, description of the indicator 520 is abbreviate | omitted in drawings other than Fig.9 (a).

  Next, with reference to FIG. 14, a method for registering a device state in association with an icon will be described. The registration method stores the device status and reproduces the operation status of the device based on the data, and stores the operation procedure from the operation screen of the highest hierarchy and reproduces the device operation status based on the data. There are ways to do this. Here, the latter will be described with a specific example. In the latter method, for example, a “play list” in a music recorded in a memory audio is selected, a lower-level item “drive song” is selected, and a lower-level item “Romance” is selected. If you are registering a shortcut for playing a song, select “AV operation selection”, “Memory audio selection operation”, “Playlist selection operation”, “Drive song selection operation”, “Romance” The operation procedure of “selection operation” is stored. At the time of reproduction, the operation procedures of “AV operation selection”, “memory audio selection operation”, “playlist selection operation”, “drive song selection operation”, and “Romance selection operation” are read from the memory. The corresponding processing is performed assuming that the operation is performed in the procedure.

  If the upper limit number of registered icons is 12, the new shortcut cannot be registered. In order to register a new shortcut, the registration state of any real icon is canceled and an empty icon is created. Next, a method for creating this empty icon will be described.

  First, an outline of the operation / operation will be described. When canceling shortcut registration of an icon, the corresponding real icon is continuously pressed (long press) for a predetermined time (for example, 2 to 3 seconds), for example. Then, the icon is in a state where the shortcut registration can be canceled, and a display indicating that the icon is in a state where the shortcut registration can be canceled is performed (for example, “◎” is displayed on the corresponding actual icon) (see FIG. 9 (c)).

  In this process, since the icon can be released from the shortcut registration state, the registration cannot be canceled unless the icon is dragged onto the display area 500. Therefore, the shortcut registration is canceled unexpectedly due to an operation error during the shortcut operation (reproduction of the device operation). Can be prevented.

  In this state, this real icon is dragged from the shortcut registration area 501 onto the display area 500 (see FIG. 10D). Then, the icon shortcut registration is canceled (see FIG. 10E). Note that the icon whose shortcut registration has been canceled is changed to a display image of an empty icon (see FIG. 10E).

  At this time, the display area 500 displays an image that impresses the cancellation of registration, for example, meaning a trash can (see FIG. 10E). Then, after the predetermined time (1 to 2 seconds), the video display portion returns to the display before the shortcut registration cancellation operation, for example, a map image for navigation is displayed (see FIG. 10F).

  If the pressing time of the icon is short, the corresponding device state such as reproduction of content (music, moving image, etc.) registered in the shortcut is reproduced.

  Next, shortcut processing will be described with reference to the flowchart of FIG. This shortcut process is executed by a pressing operation of a shortcut icon (interrupt process by detecting a pressing operation).

  First, it is determined whether the operated icon is a real icon or an empty icon (step S601). If it is a real icon, the process proceeds to step S602, and if it is an empty icon, the process proceeds to step S610. Next, in step S602, it is determined whether or not the operation time corresponding to the operated real icon (measurement of time until pressing is released) is longer than a predetermined time (for example, about 3 seconds), and if it is longer, the process proceeds to step S620. If so, the process proceeds to step S603. In step S603, the device state data corresponding to the operated real icon is read from the memory, the operation state of the device is controlled so as to be the device state read from the memory (step S604), and the process ends.

  In step S610, the operation state of the apparatus (at the time of icon operation), for example, the name of the source being played, the name of the music, etc. are read, recorded in the memory corresponding to the operated empty icon, and the process ends. At that time, an image representing the operating state of the apparatus, for example, an image, a photograph, or a character related to the content (music, video, etc.) displayed in the display area 500, for example, a reduced image of the album jacket of the music or the face of the artist An image that fits in the icon display size is generated based on the photo, content title, artist name, etc., and displayed as an icon image (stored as icon display image data).

  In step S620, a display indicating that shortcut registration can be canceled for the corresponding real icon is performed. Next, it is determined whether or not there is a drag operation on the display area 500 of the real icon (step S621). If a drag operation is performed, the process proceeds to step S621. When there is no drag operation, the process of step S621 is repeatedly performed for a time limit (for example, 10 seconds) (step S630), and the process (step S631) for returning to the operation state before the actual icon pressing operation is performed when this time limit elapses. Execute and finish the process.

In step S622, the storage of the operation state of the device corresponding to the real icon is deleted, and the display image of the icon is rewritten to an empty icon image. And the process (step S631) which returns to the operation state before real icon press operation is performed, and a process is complete | finished.
Accordingly, if the real icon is selected and operated, the device status registered for the real icon is reproduced, and if the empty icon is selected and operated, the current device status is registered for the empty icon. In addition, since an image related to the reproduction operation at the time of icon operation is displayed on the real icon, it can be used as a guideline for selection, and it can be recognized that the shortcut registration to the empty icon 514 has been completed at the time of registration operation.
In addition, since the shortcut can be registered by pressing the blank icon, it is not necessary to display the shortcut setting registration screen to register the shortcut, and a user-friendly UI can be provided.

[Shortcut icon registration method using registration operation icon]
Next, another shortcut icon registration method, specifically, a shortcut icon registration method using the registration icon (+) will be described with reference to FIGS.

  This method is different from the above-described registration method in that a dedicated shortcut registration operation icon 704 is operated at the time of shortcut registration. Hereinafter, differences from the above registration method will be described.

  The shortcut registration operation icon 704 is displayed at the bottom of the shortcut registration area, and the registration operation icon 704 is also displayed in the shortcut registration area even when the display icon is switched to an icon that is in a non-display state by a page feed operation or a scroll operation. It is displayed at the bottom of and does not move.

  Here, when registering a shortcut to the empty icon, the registration operation icon 704 is first pressed. Thereafter, when the empty icon is pressed, the device operating state at that time is stored in association with the empty icon, and the corresponding icon image is displayed on the icon. Further, when a real icon is pressed, the stored contents of the device operation state corresponding to the real icon are erased, the device operation state at that time is newly stored in association with the real icon, and the corresponding icon image Is displayed on the icon. For example, the content being played (music, video, etc.) is registered as a shortcut for this icon, and an image such as a jacket photo is appropriately adjusted in size and displayed on the icon. Further, when the registration operation icon 704 is operated, the presence / absence (number) of empty icons is displayed so as to be a reference for selecting an icon to be registered.

Next, a shortcut process for realizing the above-described operation will be described with reference to the flowchart of FIG. This shortcut process is executed by a pressing operation of the registration operation icon 704 (interrupt processing by detecting a pressing operation).
First, it is determined whether there is an operation on a real icon or an empty icon (step S701). When there is no operation of the real icon or the empty icon, the process of step S701 is repeatedly performed for a limited time (for example, 10 seconds) (step S730). The returning process (step S731) is executed to finish the process.

  In step S701, the operating state of the apparatus (at the time of icon operation), for example, the name of the source being played, the name of the song, etc. are read and recorded in the memory corresponding to the operated empty icon or real icon (in the case of a real icon, rewriting is performed). ), The process is finished. At that time, an image representing the operating state of the apparatus, for example, an image, a photograph, or a character related to the content (music, video, etc.) displayed in the display area 500, for example, a reduced image of the album jacket of the music or the face of the artist An image that fits in the icon display size is generated based on the photo, content title, artist name, etc., and displayed as an icon image (stored as icon display image data). Next, the process (step S731) for returning to the operation state before the actual icon or empty icon pressing operation is executed to finish the process.

  Accordingly, it is possible to perform shortcut registration for an icon with an easy-to-understand operation of performing an operation on a real icon or an empty icon after a pressing operation on the registration operation icon 704.

  It is also possible to prohibit shortcut registration for a real icon, and this can be realized by stopping processing when a shortcut registration operation for a real icon is performed and displaying that registration is prohibited. If a shortcut is registered for all 12 blank buttons, a new shortcut cannot be registered for the registration button, and in order to perform a new shortcut registration, the shortcut registration of any real icon is deleted. It is necessary. In this case, the following shortcut registration deletion method is available.

First, when a shortcut is registered in all empty buttons and a new shortcut cannot be registered, when a pressing operation of the registration operation icon 704 is detected, all the real icons can be deleted (drag operation to the deletion execution area is performed). Display (for example, ◎) indicating that effect is displayed on the actual icon. Then, the dragging of the real icon in the deleteable state to the deletion execution area is detected, the device state data stored for the real icon is deleted, and the empty icon is displayed.
As a result, if there is no empty icon at the time of pressing the registration operation icon 704, the real icon that can be deleted is displayed as deleteable, and the user can easily create an empty icon after confirming that.

  Further, as another method, a method of making a deletion possible state by long-pressing a real icon to make it a blank icon by a subsequent drag operation to the deletion execution area is also possible.

[Drag and drop shortcut icon registration method]
Next, as another shortcut icon registration method, a shortcut icon registration method by drag and drop will be described with reference to FIG. Hereinafter, differences from the above registration method will be described.

  In this method, only a real icon is displayed in the shortcut registration area 501 (the empty icon itself does not exist). The registration is performed by pressing an area other than the operation button area in the display area 500 and dragging it to the shortcut registration area 501 as it is. For example, in the example of FIG. 4 (k), the song “Romance” included in the “drive song” 222 is played, and the song information and related images are displayed in the display area 500.

  In this state, by dragging the music information of “Romance” in the display area 500 and the related image part (not the operation button area) to the shortcut registration area 501, shortcut registration for realizing the reproduction operation of “Romance” is performed. In the shortcut registration area 501, a real icon for selecting and operating the reproduction operation of “Romance” is displayed. When an upper limit is set for the number of registered real icons, for example, a display indicating that registration is not possible is performed when a drag operation for shortcut registration is performed. The deletion method described above can be applied to the deletion of the real icon.

DESCRIPTION OF SYMBOLS 100 Control part 101 CD / MD reproduction part 102 Radio reception part 103 TV reception part 104 DVD reproduction part 105 HD reproduction part 106 Navigation part 107 Distribution circuit 108 Image adjustment circuit 110 Audio | voice adjustment circuit 111 Image output part 115 Operation part 118 Memory 119 External Audio / video input unit 120 Camera 130 Display unit 140 Speaker

Claims (4)

An operation method in which an operation corresponding to a selected menu item is performed by selecting and confirming a menu item in the first menu,
By selecting the menu item, the upper menu item corresponding to the upper layer of the menu item is displayed,
By selecting and then confirming the upper menu item, the second menu of the lower menu item included in the lower hierarchy of the upper menu item is displayed and the lower menu item can be selected. Characteristic operation method.   2. The operation method according to claim 1, wherein after the confirmation operation of the lower menu item, the lower menu item subjected to the confirmation operation is used as a menu item of the first menu. A sound device that performs a reproduction operation of a selected sound source by selecting and further confirming a sound source of an audio video reproduction system in a first menu displayed in a normal operation state,
Sound source selection operation item display means for displaying the sound source selection operation item by the sound source selection operation;
A sound source menu display means for displaying a second menu of a sound source of an audio / video playback system and performing a sound source selection operation by selecting and confirming the sound source selection operation item is provided. Sound device.   The sound apparatus according to claim 1, further comprising first menu display means for displaying the sound source that has been confirmed and operated as the sound source of the first menu after the sound source determining operation.

Images