WO2014145888A2 - Système de mise en place de campagnes de publicité de télévision mobile et connectée 3d - Google Patents

Système de mise en place de campagnes de publicité de télévision mobile et connectée 3d Download PDF

Info

Publication number
WO2014145888A2
WO2014145888A2 PCT/US2014/030734 US2014030734W WO2014145888A2 WO 2014145888 A2 WO2014145888 A2 WO 2014145888A2 US 2014030734 W US2014030734 W US 2014030734W WO 2014145888 A2 WO2014145888 A2 WO 2014145888A2
Authority
WO
WIPO (PCT)
Prior art keywords
gesture
recited
video
trafficker
voice command
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2014/030734
Other languages
English (en)
Other versions
WO2014145888A4 (fr
WO2014145888A3 (fr
Inventor
Zubin SINGH
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
YuMe Inc
Original Assignee
YuMe Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by YuMe Inc filed Critical YuMe Inc
Priority to CA2902123A priority Critical patent/CA2902123A1/fr
Priority to HK15111683.2A priority patent/HK1210857A1/xx
Priority to KR1020157028811A priority patent/KR20150131215A/ko
Priority to CN201480015142.3A priority patent/CN105074752A/zh
Publication of WO2014145888A2 publication Critical patent/WO2014145888A2/fr
Publication of WO2014145888A3 publication Critical patent/WO2014145888A3/fr
Publication of WO2014145888A4 publication Critical patent/WO2014145888A4/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23424—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213—Monitoring of end-user related data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/812—Monomedia components thereof involving advertisement data

Definitions

  • This invention relates generally to interactive video technology and, more particularly, with human computer 3D video interactivity.
  • Ad trafficking or "ad serving” describes the technology and service that places advertisements for viewing on personal computers and other Internet-connected systems and devices such as smartphones, tablet computers, game units and “connected TV.”
  • Ad serving technology companies provide software to serve ads, count them, choose the ads that will make the website or advertiser the most money, and monitor progress of different advertising campaigns.
  • Advertising can be very competitive and Internet advertising is no exception. It is therefore desirable to be able to serve ads to as many platforms as possible. Furthermore, it is desirable to leverage on the unique capabilities of each platform to enhance the advertising experience.
  • Connected TV (“CTV”), sometimes referred to as Smart TV or Hybrid TV, describes a trend of integration of the Internet and Web 2.0 features into television sets, as well as the technological convergence between computers and television sets. These devices have a higher focus on online interactive media, Internet TV and on-demand streaming media and less focus on traditional broadcast media than traditional television.
  • the technology that enables connected TV is also incorporated in devices such as set-top boxes, Blu-ray players, game consoles and other devices.
  • Some connected TV platforms include digital camera systems and audio inputs that can be used to control various functions of the TV.
  • Another emerging technology is that of 3D graphical displays. For example, many devices such as televisions, computer screens and even mobile phones are capable of display 3D video images.
  • M3G Mobile 3D Graphics API
  • M3G is a specification defining an API for writing Java program that produce 3D computer graphics.
  • Java ME a version of the Java platform tailored for embedded devices such as mobile phones and PDSs.
  • the object-oriented interface consists of 30 classes that can be used to draw complex animated three-dimensional scenes.
  • M3G was designed to meet the specific needs of mobile devices, which are constricted in terms of memory, and processing power.
  • the API's architecture allows it to be implemented completely inside software or take advantage of the hardware present on the device.
  • Motion control technologies are also beginning to be provided in CTVs and in set- top boxes.
  • Microsoft Kinect® provides that functionality
  • Systems and methods described herein enhance the enjoyment and engagement of users with respect to advertisements and other video content delivered over the Internet. Systems and methods described herein also provide additional information to advertisers concerning the distribution and viewing of their advertisements.
  • Figure 1 is a diagram illustrating an example system implementing features described herein;
  • Figure 2 is a block diagram of an example computerized system
  • Figure 3 is a flow diagram of an example process for uploading and processing a video advertisement
  • Figure 4 is a flow diagram of an example process for overlaying a video advertisement with gesture and/or voice command overlays
  • Figure 5 is a flow diagram of an example process for controlling a video advertisement provided with gesture and/or voice command overlays
  • Figure 6 illustrates an example gesture overlay
  • Figure 7 illustrates an example gesture and/or voice overlay
  • Figure 8 illustrates an example system provided with control of a video display with gestures and/or voice commands.
  • Fig. 1 illustrates a system 10 supporting a process for serving enhanced advertisements to publishers over the Internet in accordance with a non-limiting example.
  • the system 10 includes one or more ad trafficking servers 12, one or more advertiser computers 14 and one or more publisher server systems 16.
  • the system at 10 may further include other computers, servers or computerized systems such as proxies 18.
  • the ad trafficking servers 12, advertiser computers 14, publisher server systems 16 and proxies 18 can communicate by a wide area network such as the Internet 20 (also known as a "global network” or a "wide area network” or "WAN" operating with TCP/IP packet protocols).
  • the ad trafficking servers 12 can be
  • the term “publisher” refers to an entity or entities which publish content with which advertisements (“ads”) can be associated.
  • the term “advertiser” refers to an entity which advertises its products, services and/or brands.
  • the term “ad trafficker”, “ad agency”, and/or “ad network” refers to entities serving the middleman role of matching advertisers with publishers.
  • Fig. 2 is a simplified block diagram of a computer and/or server 22 suitable for use in system 10.
  • Such computers and/or servers are available from a number of sources including Hewlett Packard Company of Palo Alto, California, Dell, Inc. of Austin Texas, Apple, Inc. of Cupertino, California, etc.
  • computer 22 includes a microprocessor 24 coupled to a memory bus 26 and an input/output (I/O) bus 30.
  • I/O input/output
  • a number of memory and/or other high speed devices may be coupled to memory bus 26 such as the RAM 32, SRAM 34 and VRAM 36. Attached to the I/O bus 30 are various I/O devices such as mass storage 38, network interface 40, and other I/O 42.
  • RAM 32 random access memory
  • SRAM 34 volatile and non-volatile memory
  • VRAM 36 volatile and non-volatile memory
  • mass storage 38 can be of various types including hard disk drives, optical drives and flash drives, to name a few.
  • Fig. 3 illustrates a process 44, set forth by way of example and not limitation, for processing advertisements over the Internet.
  • Process 44 begins at 46 and, in an operation 48, an advertisement ("ad") is uploaded to an ad trafficker 12 from an advertiser 14.
  • the upload operation 48 may be accomplished over Internet 20 by, for example, by using the Internet's File Transfer Protocol (FTP) process.
  • FTP File Transfer Protocol
  • an operation 50 it is determined if the ad is to be digitally processed.
  • the ad which can be a video or an image file, could be converted from a flat or "2D" format into a three-dimensional or "3D” format in an operation 52, if desired.
  • the ad is placed in inventory in an operation 54 and the process 44 ends at 56.
  • Fig. 4 illustrates a process 58, set forth by way of example and not limitation, for creating an "overlay" for an advertisement.
  • the process 58 begins at 60 and, in an operation 52, and advertisement is retrieved.
  • advertisement is retrieved.
  • an operation 64 it is determined if the advertisement is to be enhanced with gesture overlay(s). If so, an operation 66 creates insertion points in the advertisement and gestures and actions are associated with those insertion points.
  • an insertion point can be upon the display of a car in a video advertisement, the gesture could be defined as a swipe or a hand-wave, and the action can be opening a website that provides additional information about the car.
  • an operation 70 creates insertion point(s) and related voice commands and actions.
  • the insertion point can be a display of a car
  • the voice command can be the spoken words "more information”
  • the action could be opening a website that provides more information about the car.
  • the process 58 is then completed at 72.
  • Fig. 5 illustrates a process 74, set forth by way of example and not limitation, for controlling a display system provided with video and audio sensors.
  • Process 74 begins at 76 and, in an operation 78, content is displayed. For example, a video advertisement may be played on the display system.
  • an operation 84 determines if the video or audio sensors have detected a command. If not, control is returned to operation 78. If an audio command has been detected by operation 84, an operation 86 performs the action related to the audio command. If a video command is detected by operation 84, an operation 88 performs the action related to the detected gesture. Control is then returned to operation 78.
  • 2D-to-3D video conversion (also called 2D to stereo 3D conversion and stereo conversion) is the process of transforming 2D ("flat") image content to a 3D format, which in almost all cases is stereo, requiring the creation of separate images for each eye from the 2D image.
  • 2D-to-3D conversion adds the binocular disparity depth cue to digital images perceived by the brain and, if done properly, greatly improves the immersive effect while viewing stereo video in comparison to 2D video.
  • the conversion should be done with sufficient accuracy and correctness: the quality of the original 2D images should not deteriorate, and the introduced disparity cue should not contradict to other cues used by the brain for depth perception. If done properly and thoroughly, the conversion produces stereo video of similar quality to "native" stereo video which is shot in stereo and accurately adjusted and aligned in post-production.
  • the 2D content is automatically converted into 3D content.
  • One method for automatic conversion is to impute depth from motion in the video using different types of motion.
  • Another method it to determine depth from focus, also called “depth from defocus” and “depth from blur.”
  • Yet another method is to impute depth from perspective which is based on the fact that parallel lines, such as railroad tracks and roadsides, appear to converge with distance, eventually reaching a vanishing point at the horizon.
  • Hand gesture recognition is to make a computerized apparatus know the meaning of a hand gesture, including the spatial information, the path information, the symbolic information, and the affective information.
  • the hand gesture interaction is to further communicate with computer interactively.
  • Vision based sensors such as the video camera, the depth-aware camera, and the stereo camera are attractive because they do not require any contact with the hand making the gestures.
  • the Microsoft Kinect® releases a player from the traditional game controller.
  • Other movements including body movements, can also convey gestures.
  • Kinect® is a motion sensing input device by Microsoft for the Xbox 360 video game console and Windows PCs. Based around a webcam-style add-on peripheral for the Xbox 360 console, it enables users to control and interact with the Xbox 360 without the need to touch a game controller, through a natural user interface using gestures and spoken commands. Kinect builds on software technology developed internally by Rare, a subsidiary of Microsoft Game Studies, and on range camera technology developed by Israeli developer PrimeSense.
  • SR speech recognition
  • ASR automatic speech recognition
  • STT speech to text
  • Some SR systems use "training” where an individual speaker reads sections of text into the SR system. These systems analyze the person's specific voice and use it to fine tune the recognition of that person's speech, resulting in more accurate transcription. Systems that do not use training are called "Speaker
  • the text can be used to control an apparatus by way of a look-up table which correlates the text to an associated action, by parsing the text for meaning and syntax, etc.
  • Fig. 6 illustrates a gesture overlay for a 3D video advertisement for a motorcycle.
  • hand gestures are used in the horizontal and vertical direction to alter the display of the video.
  • Fig. 7 illustrates a gesture overlay for a 3D video advertisement for a car.
  • the banner "Tap to learn more” overlies the advertisement, hi this example, a hand gesture can be used to "tap” the banner or a user can give the voice command "tap.” Upon the detection of either of these gestures, additional information concerning the car will be displayed and/or spoken.
  • Fig. 8 illustrates a system 90, set forth by way of example and not limitation, for gesture and voice command control of video advertisements includes a video display apparatus 92, a stereo video camera 94 and a microphone 96. Digital processors and software of the video display apparatus performs the gesture recognition and speech recognition processes described above. A user 98 is, in this example, standing in front of the video display such that his hand 100 is within the field of view of the stereo video camera 94.
  • the digital processors and software of the video display apparatus 92 convert movements of hand 100 into recognized gestures or commands.
  • the user can also provide voice commands to the video display by way of the microphone 96.
  • the stereo video camera 94 can detect if a person is in front of the video display 92 (or CTV, as another example). This feature can be embedded into the video advertisement at the time of overlaying the ad with gesture commands capability.
  • trackers can be fired to track how many viewers were exposed to the video advertisement.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Un exemple de mode de réalisation de l'invention porte sur un système de mise en place de campagnes de publicité qui comprend : un microprocesseur ; une interface réseau couplée au microprocesseur ; et une mémoire comprenant des segments de code exécutables sur le microprocesseur pour a) téléverser une publicité par l'intermédiaire de l'interface réseau ; b) déterminer si la publicité devrait être traitée ; et c) traiter la publicité s'il est déterminé que la publicité devrait être traitée. Dans un autre exemple de mode de réalisation, un procédé de commande gestuelle et vocale de publicités vidéo consiste à : a) afficher un contenu publicitaire sur un appareil d'affichage vidéo ; b) mettre fin à l'affichage du contenu publicitaire s'il est déterminé que le contenu publicitaire a été achevé ; c) effectuer une action relative à une instruction audio détectée par un microphone si une instruction audio est détectée par le microphone ; d) effectuer une action relative à un geste si un geste est détecté par une caméra vidéo stéréo ; et répéter les opérations.
PCT/US2014/030734 2013-03-15 2014-03-17 Système de mise en place de campagnes de publicité de télévision mobile et connectée 3d Ceased WO2014145888A2 (fr)

Priority Applications (4)

Application Number Priority Date Filing Date Title
CA2902123A CA2902123A1 (fr) 2013-03-15 2014-03-17 Systeme de mise en place de campagnes de publicite de television mobile et connectee 3d
HK15111683.2A HK1210857A1 (en) 2013-03-15 2014-03-17 3d mobile and connected tv ad trafficking system
KR1020157028811A KR20150131215A (ko) 2013-03-15 2014-03-17 3d 모바일 및 커넥티드 tv 광고 트래피킹 시스템
CN201480015142.3A CN105074752A (zh) 2013-03-15 2014-03-17 3d移动联网电视广告交易系统

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201361798271P 2013-03-15 2013-03-15
US61/798,271 2013-03-15
US14/214,933 2014-03-15
US14/214,933 US20140298379A1 (en) 2013-03-15 2014-03-15 3D Mobile and Connected TV Ad Trafficking System

Publications (3)

Publication Number Publication Date
WO2014145888A2 true WO2014145888A2 (fr) 2014-09-18
WO2014145888A3 WO2014145888A3 (fr) 2014-12-11
WO2014145888A4 WO2014145888A4 (fr) 2015-01-15

Family

ID=51538559

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2014/030734 Ceased WO2014145888A2 (fr) 2013-03-15 2014-03-17 Système de mise en place de campagnes de publicité de télévision mobile et connectée 3d

Country Status (6)

Country Link
US (1) US20140298379A1 (fr)
KR (1) KR20150131215A (fr)
CN (1) CN105074752A (fr)
CA (1) CA2902123A1 (fr)
HK (1) HK1210857A1 (fr)
WO (1) WO2014145888A2 (fr)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013058985A1 (fr) 2011-10-17 2013-04-25 Kimmel Zebadiah M Méthode et appareil de détection de la détérioration de l'état de santé d'un sujet
WO2013058978A1 (fr) 2011-10-17 2013-04-25 Kimmel Zebadiah M Procédé et appareil de mesurage et d'essayage d'un individu pour l'habillement, des accessoires ou la pose de prothèse
WO2013066601A1 (fr) 2011-10-17 2013-05-10 Kimmel Zebadiah M Méthode et appareil pour la surveillance des particuliers tout en protégeant leur vie privée
US10013756B2 (en) 2015-03-13 2018-07-03 Atlas5D, Inc. Methods and systems for measuring use of an assistive device for ambulation
EP3494428A4 (fr) 2016-08-02 2020-04-08 Atlas5D, Inc. Systèmes et procédés d'identification de personnes et/ou d'identification et de quantification de la douleur, la fatigue, l'humeur et l'intention avec une protection de la vie privée
CN106448475A (zh) * 2016-12-19 2017-02-22 中航华东光电（上海）有限公司 具有立体交互功能的3d广告机及其操作方法
WO2019002937A2 (fr) * 2017-06-26 2019-01-03 Inpris Innovative Products Form Israel, Ltd Systèmes utilisant une double commande tactile et sonore et leurs procédés

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
IL119948A (en) * 1996-12-31 2004-09-27 News Datacom Ltd Voice activated communication system and program guide
EP1079615A3 (fr) * 1999-08-26 2002-09-25 Matsushita Electric Industrial Co., Ltd. Système d'identification et d'adaptation du profile d'un utilisateur de télévision à l'aide de la technologie de la parole
US7665041B2 (en) * 2003-03-25 2010-02-16 Microsoft Corporation Architecture for controlling a computer using hand gestures
WO2009067560A1 (fr) * 2007-11-20 2009-05-28 Big Stage Entertainment, Inc. Systèmes et procédés de génération de modèles de tête en 3d et pour utiliser ceux-ci
WO2010071860A2 (fr) * 2008-12-18 2010-06-24 3Dfusion Corporation Système et procédé pour une conversion dynamique, évolutive et adaptative, optimisation de qualité et de traitement, amélioration, correction, matriçage et autre traitement avantageux de contenu multimédia tridimensionnel
EP2476259A1 (fr) * 2009-09-11 2012-07-18 Disney Enterprises, Inc. Insertions virtuelles dans une vidéo en 3d
MX2012010268A (es) * 2010-03-05 2012-10-05 Gen Instrument Corp Metodo y aparato para convertir contenido de video bidimensional para insercion en contenido de video tridimensional.
KR101531240B1 (ko) * 2010-07-27 2015-06-25 한국전자통신연구원 디지털 방송 시스템에서 다시점 프로그램을 송수신하는 방법 및 장치
US20120072936A1 (en) * 2010-09-20 2012-03-22 Microsoft Corporation Automatic Customized Advertisement Generation System
US9195345B2 (en) * 2010-10-28 2015-11-24 Microsoft Technology Licensing, Llc Position aware gestures with visual feedback as input method
US20120242649A1 (en) * 2011-03-22 2012-09-27 Sun Chi-Wen Method and apparatus for converting 2d images into 3d images
EP2718784A4 (fr) * 2011-06-06 2015-03-25 Webtuner Corp Système et procédé pour l'amélioration et l'extension de publicités vidéo
US9294752B2 (en) * 2011-07-13 2016-03-22 Google Technology Holdings LLC Dual mode user interface system and method for 3D video
US20130046637A1 (en) * 2011-08-19 2013-02-21 Firethorn Mobile, Inc. System and method for interactive promotion of products and services
US8645994B2 (en) * 2012-06-28 2014-02-04 Microsoft Corporation Brand detection in audiovisual media

Also Published As

Publication number Publication date
CN105074752A (zh) 2015-11-18
WO2014145888A4 (fr) 2015-01-15
WO2014145888A3 (fr) 2014-12-11
CA2902123A1 (fr) 2014-09-18
US20140298379A1 (en) 2014-10-02
HK1210857A1 (en) 2016-05-06
KR20150131215A (ko) 2015-11-24

Similar Documents

Publication Publication Date Title
CN110998505B (zh) 具有物理视频面板的同步全息显示和3d对象
US8745657B2 (en) Inserting interactive objects into video content
US11482192B2 (en) Automated object selection and placement for augmented reality
US20140298379A1 (en) 3D Mobile and Connected TV Ad Trafficking System
US8730354B2 (en) Overlay video content on a mobile device
US10575067B2 (en) Context based augmented advertisement
WO2017193576A1 (fr) Procédé et appareil d'adaptation de résolution de vidéo, et terminal de réalité virtuelle
CN104067317A (zh) 用于在真实世界视频剪辑内对合成对象进行可视化的系统和方法
JP2019536339A (ja) ビデオコンテンツの同期の方法および装置
CN105430471B (zh) 一种视频中弹幕的显示方法及装置
US11936940B2 (en) Accessibility enhanced content rendering
US20140331246A1 (en) Interactive content and player
CN107040808A (zh) 用于视频播放中弹幕图片的处理方法和装置
CN105138216A (zh) 一种在虚拟座位上显示观众互动信息的方法及装置
WO2024196938A1 (fr) Systèmes et procédés pour permettre une expérience de réalité étendue améliorée
CN105744338B (zh) 一种视频处理方法及其设备
CN113965665B (zh) 一种用于确定虚拟直播图像的方法与设备
KR101856632B1 (ko) 화자의 위치를 기반으로 한 자막 디스플레이 방법 및 이러한 방법을 수행하는 장치
CN103366392A (zh) 为图像或图像序列添加辅助可视对象的方法及设备
EP4334927B1 (fr) Rendu de contenu à accessibilité améliorée
EP4334926B1 (fr) Création de contenu amélioré d'accessibilité
WO2022235835A1 (fr) Distribution de contenu à accessibilité améliorée

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201480015142.3

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14764204

Country of ref document: EP

Kind code of ref document: A2

DPE2 Request for preliminary examination filed before expiration of 19th month from priority date (pct application filed from 20040101)
ENP Entry into the national phase

Ref document number: 2902123

Country of ref document: CA

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 20157028811

Country of ref document: KR

Kind code of ref document: A

122 Ep: pct application non-entry in european phase

Ref document number: 14764204

Country of ref document: EP

Kind code of ref document: A2