WO2023106953A1 - Système de génération automatique de clip vidéo scénarisé - Google Patents

Système de génération automatique de clip vidéo scénarisé Download PDF

Info

Publication number
WO2023106953A1
WO2023106953A1 PCT/RU2021/000560 RU2021000560W WO2023106953A1 WO 2023106953 A1 WO2023106953 A1 WO 2023106953A1 RU 2021000560 W RU2021000560 W RU 2021000560W WO 2023106953 A1 WO2023106953 A1 WO 2023106953A1
Authority
WO
WIPO (PCT)
Prior art keywords
unit
video data
data
scenario
frame
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/RU2021/000560
Other languages
English (en)
Russian (ru)
Inventor
Антон Владимирович РОЖЕНКОВ
Дмитрий Вячеславович ГУРИЧЕВ
Денис Евгеньевич КАЛИНИЧЕНКО
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Obschestvo S Ogranichennoi Otvetstvennostyu "fan Editor"
Original Assignee
Obschestvo S Ogranichennoi Otvetstvennostyu "fan Editor"
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Obschestvo S Ogranichennoi Otvetstvennostyu "fan Editor" filed Critical Obschestvo S Ogranichennoi Otvetstvennostyu "fan Editor"
Priority to PCT/RU2021/000560 priority Critical patent/WO2023106953A1/fr
Publication of WO2023106953A1 publication Critical patent/WO2023106953A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se

Definitions

  • the invention relates to systems for creating a scenario video with the presence of a given object or group of objects in the frame.
  • the system is designed to form a video filmed in places where entertainment services are provided, cultural and sports events are held, with an initially specified scenario.
  • a known system for automatically creating a scenario video with the presence in the frame of a given object or group of objects containing: a shooting unit that includes at least one primary video data recording device; an information storage module including a unit for storing raw video data; a block for identifying a given object or a group of objects in the primary video data; a block for entering information about a given object or group of objects for their identification; a block for extracting relevant video data with the presence of a given object or a group of objects in the frame, and the relevant video data means video fragments with the presence of a given object in the frame, cut according to the marks set by the identification block from the primary video data; a relevant video data processing unit; at least one scenario template, including a set of data for the operation of the capturing unit, the relevant video data extraction unit and the relevant video data processing unit, each device for recording primary video data from the capturing unit operates according to the scenario template data, in which the scenario template data in the part of the block operation shots are data
  • the relevant video data processing unit may be configured to generate scenario videos based on the relevant video data and scenario template data.
  • the identification block may include an electronic device with a unique identifier.
  • the system may additionally contain a block for transmitting scenario videos in at least one of the following ways: online broadcast, recording on a media, transmission via the Internet, in particular via social networks.
  • the information input unit can be configured to select the method of transmitting the scenario video by the transmission unit and/or to select the scenario template.
  • the survey unit may further include a telemetry system. The system can generate a scenario video in real time.
  • Such systems contain the possibility of further improvements related to adaptation to specific events, such as outdoor sports games, entertainment, competitions, for example, with the growing popularity of karting races.
  • the above system has been developed in the technical solution according to patent RU2719328C1, in particular, it additionally contains: at least one stationary shooting area with an additional identification block that fixes the time of user participation in the frame or gives a command to count the amount of time the user participated in the frame, set in the settings; at least one movable shooting area from a given movement trajectory, with an additional identification block that fixes the time of the user's participation in the frame or gives a command to count the amount of participation time user in the frame, set in the settings; at the same time, an additional identification block of the movable shooting area is associated with user identification devices located along the motion trajectory.
  • the specified technical solution was chosen as a prototype, and the proposed invention allows solving the problem of increasing the number of devices for creating content, making it more personalized, as well as providing additional data collection about the system user for subsequent analytics and generating relevant video data with additional input.
  • EFFECT replenishment of the block of primary video data and further expansion of the user's ability to influence the final result.
  • the specified task is solved by the system for automatically creating a scenario video with the presence in the frame of a given object or a group of objects, containing: a shooting unit that includes at least one primary video data recording device; an information storage module including a unit for storing primary video data; a block for identifying a given object or a group of objects in the primary video data; a block for entering information about a given object or group of objects for their identification; a block for extracting relevant video data with the presence of a given object or a group of objects in the frame, and the relevant video data means video fragments with the presence of a given object in the frame, cut according to the marks set by the identification block from the primary video data; a relevant video data processing unit; at least one scenario template, including a set of data for the operation of the capturing unit, the relevant video data extraction unit and the relevant video data processing unit, each device for recording primary video data from the capturing unit operates according to the scenario template data, in which the scenario template data in the part of the block operation shots are data specifying, in
  • the relevant video data processing unit can be configured to generate scenario videos based on the relevant video data and scenario template data.
  • the identification block may include an electronic device with a unique identifier.
  • the system may additionally contain a block for transmitting scenario videos in at least one of the following ways: online broadcast, recording on a media, transmission via the Internet, in particular via social networks.
  • the information input unit can be configured to select the method of transmitting the scenario video by the transmission unit and/or to select the scenario template.
  • the survey unit may further include a telemetry system.
  • the system can generate a scenario video in real time.
  • An RFID tag is used as an identifier (as a preferred option).
  • IR-sensors as user identification devices placed along the movement trajectory.
  • the proposed invention is illustrated by graphic material.
  • the drawing shows a general diagram of a system for automatically creating a scenario video with the presence of a given object or group of objects in the frame.
  • scenario template in this description refers to a set of data for the operation of certain blocks of the system that determine the plot and artistic style of the scenario video.
  • target object in this description means a moving object that is of interest to the consumer and the presence of which he wants to capture in the video. This may be the consumer himself, if the purpose of the scripted video, for example, is to preserve the experience of the received entertainment service. This may be a car when the territory for the provision of entertainment services is a race track. This may be a competitor, for example in the case of sporting events. These can be objects in the immediate vicinity of the moving shooting area (eg other competitors (other moving areas), spectators, scoreboards, signs, etc.).
  • the term “consumer” in this description means a person who receives in a certain way a ready-made scenario video generated by the proposed system.
  • the term “associated” means a structural relationship, a connection between two objects (a moving camera unit and a mobile camera unit) in which the working area of at least one primary video data recorder of the mobile camera unit covers at least the entire mobile camera unit and its neighborhood.
  • the proposed system for automatically creating a scenario video with the presence of a given object or group of objects in the frame contains the following blocks:
  • Shooting unit (1) including at least one device for recording primary video data.
  • primary video data devices it is possible to use standard video cameras, video cameras with different focal lengths, controlled video cameras, including those installed on remotely controlled unmanned aerial vehicles.
  • the filming unit contains a plurality of different types of video cameras that operate according to the scenario template data.
  • Scenario pattern data in terms of the operation of the capture unit includes, in particular, data specifying the frame plan, depth of field, frame geometry, lens field of view, camera movement, approach and removal of a given object in the frame, etc.
  • the capture unit may additionally include a telemetry system .
  • the composition of the telemetry system as a rule, includes sensors installed on a given object and generating data on its state.
  • the telemetry system includes sensors installed on the vehicle and the pilot, which during the race record data on the state of the vehicle (speed of movement, fuel consumption, travel time, etc.) and the pilot (for example, heart rate).
  • the state of the vehicle speed of movement, fuel consumption, travel time, etc.
  • the pilot for example, heart rate
  • the information input block contains an interface with which the user of the proposed system enters data to identify a given object.
  • it can be a person's full name, social network profile, login.
  • the information input block may be configured to select a scenario template.
  • the system includes a variety of scenario templates and the consumer has the opportunity to choose the one that is more interesting to him in terms of plot, artistic style and price.
  • the information input block can be configured to select the method of transferring the scenario video to the consumer.
  • the methods can be different, in particular, online broadcasting of a scenario video, recording a scenario video on a medium (flash card, disk), transferring a scenario video via the Internet and social networks.
  • Identification block (3) of a given object in the primary video data includes devices and software that allow you to recognize and determine the location of a given object on the primary video data and put certain marks. The operation of this block can be based on various ways of identifying a given object.
  • the identification unit may include an electronic device with a unique identifier, wireless communication with which allows you to determine the location of a given object.
  • An example of such an electronic device would be an electronic bracelet that is put on a person. In the case of motorcycle racing competitions, such an electronic device is installed on the machine.
  • Another example of such an electronic device may be a personal phone of a given person, on which a special program is installed in advance.
  • the identification block Having determined the coordinates of a given object at a certain point in time, the identification block puts marks on the primary video data taken at a given point in time by the cameras in the zone of which these coordinates were located.
  • the operation of the identification block can also be based on the identification of a person by biometric parameters in the primary video data.
  • the block for extracting relevant video data (4) with the presence of a given object in the frame includes software that allows, using the marks set by the identification block and the scenario template data, to cut video fragments with the presence of a given object in the frame from the primary video data.
  • Scenario template data in terms of generating relevant video data includes data that specifies the location of a given object in a frame, the length of a video fragment, the number of video fragments, frame synchronization, etc.
  • Relevant video data processing unit (5) includes software that allows you to create scenario videos using the relevant data generated by the extractor and the scenario template data.
  • the data of the scenario template in terms of the operation of the processing unit (5) include: data specifying the type of editing, the rhythm of editing, the duration of the editing episode, the sequence of shots and shots, color correction, focusing attention in the frame on certain shooting objects, adding graphic special effects, combination of the frame with the data of the telemetry system, etc.
  • An information storage module is one or more devices, such as servers.
  • the information storage module contains several blocks, including a primary video data storage unit (6), a relevant video data storage unit (7), a scenario template storage unit (8), a scenario video storage unit (9).
  • the proposed system may additionally contain a scenario video transmission unit (10).
  • the transfer unit is configured to transfer the finished script video to the consumer by at least one of the following methods: online broadcast, recording to a media, transmission via the Internet, in particular via social networks.
  • the system also contains a stationary survey area (or several such zones) with an additional identification unit (I), at least one movable survey area from a given movement trajectory, with an additional identification unit (12) associated with user identification devices (13), placed along the trajectory.
  • Movable filming areas mean a working area, for example, a moving attraction (carousels, browsers, etc.), a track for sports races, etc.
  • the movable camera unit 14 necessarily includes at least one camera, which is mounted on the subject from which the picture is taken, for example, a go-kart.
  • the number of cameras is not limited.
  • the camera unit 14 is connected to the control unit 15 of the movable camera unit via a cable or in any other way, for example, via wifi to issue a signal to the camera unit 14 in real time for further transfer of the footage to the primary video data storage unit 6. It is advisable to provide for the possibility of transferring video recording directly to streaming platforms (on-line).
  • Block 15 is located in the immediate vicinity of the shooting block 14, that is, in (on) the movable zone.
  • Block 15 can be assembled from standard elements: control board, battery, screen control, control buttons and connectors for connecting and charging personal electronic devices (devices), as well as a data transfer module that allows you to transfer received video files to block 6 or directly to the streaming platform.
  • the blocks included in the proposed system interact at various stages and transmit information to each other through various technologies: cable, Internet, wireless connection, etc. If necessary, at certain stages, the information is encrypted for its safety and inaccessibility to unauthorized users of the system.
  • the proposed system can be made with the ability to generate a scenario video online, which is especially important when broadcasting sports and other events.
  • the user having, for example, a bracelet with an RFID identifier (hereinafter referred to as the "wristband”), registers on the touch panel (remote control unit 15), where he enters his phone number, receives in response an identification confirmation code in the form of SMS, then, when the confirmation code is entered correctly, he applies the “bracelet” to a special reader (hereinafter referred to as the “reader”), thereby linking the “bracelet” issued to him with his personal account on the “portal” (“bracelet” is necessary only for the period of using the “karting” system "and after uploading the video to your personal account is not required. In subsequent cases of using the system, the same user may have a different "bracelet”).
  • Block 15 can be used to set the settings for the future video (shooting time, up to shutdown), viewing angle, etc., including taking into account the presence / absence of artificial intelligence in the system.
  • zones for shooting personal video fragments, from which the system will automatically create a personal video.
  • zones can be conditionally divided into two types:
  • the stationary zones include the “mirror” and “podium” zones.
  • the essence of the user's presence in these zones is that each zone has its own “reader” (identification block (11) or (12), touching it with a "bracelet” fixes the time of the user's participation in the frame and transmits it to the main identification block 3
  • the algorithm of the zone notifying the user about the action of the event, for example, displaying information content on the screen of the zone explaining the principle of interaction and its order, or turning on and off the lighting devices located in the zone, telling about the beginning and end of video recording fragment, which will later be included in the final video clip of the user.
  • This procedure lasts a fixed amount of time specified in the settings.
  • the mobile zones include the karting (car, hereinafter referred to as the “kart”), on which the user can move along the track.
  • the “card” is also equipped with a “reader” and the user also activates the reader by touching the wristband.
  • the “card reader” is equipped with sensors that receive a signal from special devices (IR sensors 13) located on the track. After activating the "reader” with the “bracelet”, the user makes a ride on the "map” along the track. At the moment of the user's movement, the "reader” "card” fixes the timestamps and generates an object of the arrival state, which is transmitted to the block (4) for analysis and calculation of video fragments after receiving a special signal.
  • Unit 14 takes pictures directly from the moving area, imitating to a large extent, the look (review) of the consumer himself, who controls the kart.
  • the system fixes the completion of the user's actions.
  • the database in the system has a complete set of information about the arrival of a specific user (a specific bracelet), associated with meta-information from the user's personal account on the portal.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

L'invention concerne des moyens pour générer des clips vidéo. Le résultat technique consiste en la possibilité de collecter des données supplémentaires sur un objet ou un groupe d'objets donné et de s'en servir pour remplir un bloc de données vidéo primaires en vue de la génération automatique de clips vidéo scénarisés en présence d'un objet ou groupe d'objets donné dans la trame. Ce système de génération automatique de clip vidéo scénarisé en présence d'un objet ou groupe d'objets donné dans la trame comprend: une unité de prise de vue; un module de stockage d'informations; une unité d'identification d'objet ou de groupe d'objets donné dans les données vidéo primaires; une unité d'entrée d'informations sur un objet ou groupe d'objets donné en vue de leur identification; une unité d'extraction de données vidéo pertinentes en présence d'un objet ou groupe d'objets donné dans la trame; une unité de traitement des données vidéo pertinentes; un modèle de scénarisation; et des zones stationnaire et mobile de prise de vue. Ce système comprend en outre une unité mobile de prise de vue, comprenant un dispositif d'enregistrement de données vidéo primaires associé à la zone mobile de prise de vue, et une unité de commande de l'unité mobile de prise de vue.
PCT/RU2021/000560 2021-12-09 2021-12-09 Système de génération automatique de clip vidéo scénarisé Ceased WO2023106953A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/RU2021/000560 WO2023106953A1 (fr) 2021-12-09 2021-12-09 Système de génération automatique de clip vidéo scénarisé

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/RU2021/000560 WO2023106953A1 (fr) 2021-12-09 2021-12-09 Système de génération automatique de clip vidéo scénarisé

Publications (1)

Publication Number Publication Date
WO2023106953A1 true WO2023106953A1 (fr) 2023-06-15

Family

ID=86730838

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/RU2021/000560 Ceased WO2023106953A1 (fr) 2021-12-09 2021-12-09 Système de génération automatique de clip vidéo scénarisé

Country Status (1)

Country Link
WO (1) WO2023106953A1 (fr)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU121637U1 (ru) * 2012-04-27 2012-10-27 Общество с ограниченной ответственностью "Бизнес Центр "Видео Интернешнл" Автоматизированная система создания и редактирования роликов в интернет-браузере для последующей доставки до рекламоносителей
US20180240500A1 (en) * 2006-07-06 2018-08-23 Sundaysky Ltd. Automatic generation of video from structured content
RU2683499C1 (ru) * 2018-03-15 2019-03-28 Антон Владимирович Роженков Система автоматического создания сценарного видеоролика с присутствием в кадре заданного объекта или группы объектов
US20200036909A1 (en) * 2018-07-27 2020-01-30 BriefCam Ltd. System and method allowing simultaneous viewing of live and recorded video content
RU2719328C1 (ru) * 2019-12-26 2020-04-17 Общество с ограниченной ответственностью "ФАН ЭДИТОР" Система автоматического создания сценарного видеоролика с присутствием в кадре заданного объекта или группы объектов
RU2761316C2 (ru) * 2014-06-16 2021-12-07 Антуан Ют Мобильная платформа для создания персонализированного фильма или серии изображений

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180240500A1 (en) * 2006-07-06 2018-08-23 Sundaysky Ltd. Automatic generation of video from structured content
RU121637U1 (ru) * 2012-04-27 2012-10-27 Общество с ограниченной ответственностью "Бизнес Центр "Видео Интернешнл" Автоматизированная система создания и редактирования роликов в интернет-браузере для последующей доставки до рекламоносителей
RU2761316C2 (ru) * 2014-06-16 2021-12-07 Антуан Ют Мобильная платформа для создания персонализированного фильма или серии изображений
RU2683499C1 (ru) * 2018-03-15 2019-03-28 Антон Владимирович Роженков Система автоматического создания сценарного видеоролика с присутствием в кадре заданного объекта или группы объектов
US20200036909A1 (en) * 2018-07-27 2020-01-30 BriefCam Ltd. System and method allowing simultaneous viewing of live and recorded video content
RU2719328C1 (ru) * 2019-12-26 2020-04-17 Общество с ограниченной ответственностью "ФАН ЭДИТОР" Система автоматического создания сценарного видеоролика с присутствием в кадре заданного объекта или группы объектов

Similar Documents

Publication Publication Date Title
RU2683499C1 (ru) Система автоматического создания сценарного видеоролика с присутствием в кадре заданного объекта или группы объектов
US12001974B2 (en) Augmented reality smartglasses for use at cultural sites
KR101748401B1 (ko) 가상현실 어트랙션 제어 방법 및 시스템
JP4100579B2 (ja) 個人客用ビデオ及びその作成システム及び方法
US20220036091A1 (en) System, method and device operable to produce a video
US20150312354A1 (en) Automatic cameraman, automatic recording system and automatic recording network
US9615015B2 (en) Systems methods for camera control using historical or predicted event data
CN112533003B (zh) 一种视频处理系统、装置、方法
CN110162667A (zh) 视频生成方法、装置及存储介质
CN109716782A (zh) 定制沉浸式媒体内容的方法和系统
US20210217245A1 (en) System and Method of Competitively Gaming in a Mixed Reality with Multiple Players
EP2515548A1 (fr) Système de suivi de la concurrence
RU2719328C1 (ru) Система автоматического создания сценарного видеоролика с присутствием в кадре заданного объекта или группы объектов
CN109126099B (zh) 远程裁判方法及其系统
CN106257528B (zh) 通过用户间的合作生成内容的方法和系统
US12010403B2 (en) Information processing apparatus, information processing method, and program
JP7524116B2 (ja) プログラム、情報処理方法、情報処理装置、及びシステム
RU2748581C1 (ru) Система автоматического создания сценарного видеоролика с присутствием в кадре заданного объекта или группы объектов
CN112969028A (zh) 智能直播方法及直播物联网系统
CN111866385A (zh) 一种用于活动策划的投屏系统及其工作方法
Kumar Mass media and communications: Theory and practice
CN109361931A (zh) 一种赛事直播中进行提示的方法及系统
JP7524115B2 (ja) プログラム、情報処理方法、情報処理装置、及びシステム
CN116017133A (zh) 一种影像数据的获取方法、装置、计算机设备及存储介质
RU2669209C1 (ru) Способ автоматического формирования персонализированного видеоролика

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21967391

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21967391

Country of ref document: EP

Kind code of ref document: A1