WO2025006588A2 - Cartes de vœux interactives - Google Patents

Cartes de vœux interactives Download PDF

Info

Publication number
WO2025006588A2
WO2025006588A2 PCT/US2024/035593 US2024035593W WO2025006588A2 WO 2025006588 A2 WO2025006588 A2 WO 2025006588A2 US 2024035593 W US2024035593 W US 2024035593W WO 2025006588 A2 WO2025006588 A2 WO 2025006588A2
Authority
WO
WIPO (PCT)
Prior art keywords
computing device
mobile computing
dimensional representations
substrate
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2024/035593
Other languages
English (en)
Other versions
WO2025006588A3 (fr
Inventor
Ta Chiun CHOU
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of WO2025006588A2 publication Critical patent/WO2025006588A2/fr
Publication of WO2025006588A3 publication Critical patent/WO2025006588A3/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0641—Electronic shopping [e-shopping] utilising user interfaces specially adapted for shopping
    • G06Q30/0643—Electronic shopping [e-shopping] utilising user interfaces specially adapted for shopping graphically representing goods, e.g. 3D product representation

Definitions

  • This disclosure relates to software facilitation augmented reality experiences, and more specifically, to systems and methods for creating greeting cards (or other tactile objects or display surfaces) that can be experienced in new ways through a display of a personal computing device being used to interact with the object.
  • QR code or other barcode can be printed on a surface, and when the QR code is scanned by the camera of a smartphone, a web browser of the smartphone will be directed to a URL encoded by the QR code. The web browser can then display content somehow related to the printed material on a webpage, or prompt a user to download software related to the printed material.
  • a novel method of creating an interactive greeting card comprises generating a series of two-dimensional representations or projections of a three-dimensional animation in a plane; printing, on a substrate, one of the two-dimensional representations and a mark that, when recognized by a mobile computing device, causes the mobile computing device to transmit a message to a given URL; receiving, at a server that is associated with the given URL, a request from the mobile computing device that was generated in response to recognizing the mark; and transmitting, to the mobile computing device, instructions to display on a screen of the mobile computing device a camera feed from the mobile computing device’s camera overlaid by additional two-dimensional representations from the series of two-dimensional representations.
  • FIG. 1 depicts an example greeting card being viewed through the camera of a smartphone or similar mobile computing device
  • FIG. 2 depicts an example set of computing devices to facilitate a change in the mobile computing device’s functionality while viewing the greeting card as depicted in FIG. 1;
  • FIG. 3 depicts, in simplified form, a method of generating an interactive experience for the mobile computing device’s user
  • FIG. 4 depicts an augmented reality interface after implementing the change in the mobile computing device’s functionality described in FIGS. 2 and 3;
  • FIGS. 5A and 5B depict one kind of augmented reality experience involving an illusion of three-dimensional objects around a viewer through a front-facing camera
  • FIGS. 6A and 6B depict an additional style of augmented reality animation with layering in planes in front of the camera.
  • FIG. 1 depicts an example greeting card being viewed through the camera of a smartphone or similar mobile computing device.
  • a greeting card or other printed matter 100 is viewed through the back-facing camera of a typical smartphone or other mobile computing device 105, the screen of the smartphone displays the card 100 itself, in addition to an illustration 110 and a QR code or other mark 115.
  • the QR code 115 is on the front of the card along with the illustration 110
  • the QR code may be located on the back of the card or on an envelope or other packaging associated with the card, so as not to risk interference with the aesthetic experience of the illustration 110.
  • the QR code could be embedded or hidden within the illustration 110 itself. The embedding could be prominent as a visual cue that the viewer should train a camera on the illustration, or more subtle, such as hiding the QR code among other visual elements in such a way that the user is unlikely to notice the QR code, or perhaps while not “hidden”, simply at the edge of the illustration to be less prominent.
  • every instance of a particular card design will have an identical QR code printed on them.
  • it may be preferable to have a unique QR code on every card which is a variant of the QR codes that are present on each other instance of the card. This variation would allow for potential customization in viewer experiences at a later time, by causing the software to react differently to each QR code, and for those differences to be configured at a time after the card is printed or after the card is purchased.
  • FIG. 1 a typical smartphone is illustrated as the mobile computing device 105, and this would be the preferred configuration.
  • a handheld gaming console, smartwatch, laptop computer, or other device might be able to perform the same functionality, so long as it has a working camera, a screen, and preferably an ability to connect to the Internet or a similar network.
  • FIG. 2 depicts an example set of computing devices to facilitate a change in the mobile computing device’s functionality while viewing the greeting card as depicted in FIG. 1.
  • a URL is resolved from the encoding of the QR code.
  • the mobile computing device then sends a request via the Internet or another network 200 to a server 205 that hosts content associated with that URL.
  • That server 205 preferably retrieves a particular set of software instructions and assets (such as image or sound files) from a database 210, the particular set being uniquely identified by the URL of the HTTP request, or in data fields that are part of the request.
  • Those software instructions and assets are then transmitted back through the network to the mobile computing device 105.
  • the mobile computing device 105 might already store instructions and assets for a variety of cards that the mobile computing device might be exposed to, and that communication over a network will be ultimately unnecessary. However, for maximum flexibility, it is preferred that there be a dynamic downloading at the time of the card’ s viewing, rather than requiring pre-installation of software before the card is viewed.
  • the existing software might be a completely native app for the mobile computing device, a progressive web app or other app that acts as a wrapper or shell for a cross-device application, or any other form of software that is executable by the mobile computing device.
  • the software and assets downloaded to the mobile computing device may be described using a syntax that Instagram already recognizes and can implement, in part or in whole, as a video filter.
  • the server 205 to which the URL points and the database 210 might be a single device (such that the server incorporates the database 210 on its local drive instead of communicating with a separate device in its vicinity) or a multitude of devices (such as an initial load balancer or content delivery network entry point, which then forwards a request to one of a number of devices, potentially very widely dispersed).
  • the exact configuration is not so important as having an automated listener that can distinguish between multiple distinct requests, retrieve appropriate instructions and assets that have been pre-stored, and transmit those instructions and assets back to the device that requested them.
  • FIG. 3 depicts, in simplified form, a method of generating an interactive experience for the mobile computing device’s user.
  • a series of two-dimensional representations or projections of a three- dimensional animation in a plane are generated (Step 300). These representations may be, depending on the particular use case, hand drawn or computer-generated, as necessary. Examples of particular use cases suitable for an interactive greeting card are included beginning with FIG. 5A and following, as discussed further below.
  • FIG. 1 is not intended to be a static image that is translated or rotated around the page to make a primitive facsimile of movement; it is intended that a conceptual model of both sides of each wing will be drawn and colored, so that the butterfly can flap its wings or turn around in an augmented reality display.
  • the rendered image at any moment may be colored, shaded, sized, skewed, etc. such that it realistically tracks how a butterfly would appear as it flew around.
  • a separate set of images may be generated for integration with the first animation, this second set being incorporated into a different camera stream.
  • an animation might be generated to appear over the face or around the head or body of a person holding the mobile computing device, when viewed through a front-facing camera of the mobile computing device.
  • one of these representations is printed onto a card, along with a mark whose purpose is to direct a mobile computing device to a source of software (Step 305).
  • this mark is preferably a QR code, but a variety of bar codes or other markings might be incorporated instead.
  • the mark might not be a traditional encoding at all, but rather text that can be picked up by optical character recognition (OCR).
  • the means by which the mark directs the mobile computing device is preferably a URL to be used in an HTTP or FTP request, but likewise, alternative methods may be used.
  • the mark might only encode a substring meant to be incorporated into a URL in a predictable manner — for example, rather than one card with a mark indicating “http://www.softwaresource.com/download/12345” and another with a mark indicating “http://www.softwaresource.com/download/abcde”, the marks on the two cards might only be “12345” and “abcde”, with software executing on the mobile computing device adding that mark’s text to the base URL before sending the HTTP request.
  • a camera of a mobile computing device is directed towards the card so that the mark is captured by the camera (Step 310).
  • the mark is interpreted as described above and resolved into a URL, which is used in an outgoing request from the mobile computing device (Step 315) using the Internet or another network connection between the mobile computing device and the server at that URL.
  • this software may include a custom-designed Instagram filter that works with the publicly available Instagram mobile application to modify images and video.
  • this software may include a different, standalone app to be installed on the mobile computing device instead, or a plugin or filter configured to work with a mobile app different from Instagram.
  • the mobile computing device When the software is executed, the mobile computing device will begin to display on its screen a video stream from the camera that had been used to capture the QR code (Step 325).
  • the video may be accompanied by music, sounds, vibration, or other experiential qualities that the mobile device is capable of conveying.
  • Rendering of the animation may require some processing and scaling, skewing/shearing, or rotation of the animation, depending on the orientation of the card with respect to the camera. For example, if the card is turned upside-down while the animation is playing, it may be desired that the animation turn upside-down, too. If the card is brought closer to or further from the camera, the animation may need to be resized accordingly.
  • the animation may need to be skewed or sheared so that it still appears to be on the surface of the card, or if the animation were intended to appear to “come out of the card” towards the viewer, the animation may need to be further modified so that it is coming out of the apparent plane of the card, even though that vector is no longer pointing at the viewer.
  • an animation might be defined with respect to particular reference points, such as the corners of the card, the QR code or other mark on the card, the original illustration, subtle targeting reticles printed on the card, or other reference points.
  • cards it is possible for cards to have a unique QR code in every instance of the card, and for the rendered animation to act as a template that can be configured in different ways before the rendering of the animation begins.
  • a birthday card might default to displaying a message of “Happy birthday!” in text appearing to float above the card surface, but if the purchaser of the card visits a website associated with the QR code before giving the card to the ultimate viewer, that website might allow the purchaser to customize the text to any other series of characters.
  • the animation when the animation is actually rendered, it might have different text from the default and tailored to the intended recipient, such as “Happy birthday, [Name]! We love you! - Mom and Dad” or “Feliz cumpleanos!”.
  • the software adding the animation over the camera stream will routinely check whether the animation has concluded (Step 330).
  • the animation tells a story or has a well defined beginning and end; if so, conclusion of the animation may cause the augmented display to end (Step 340). In other embodiments, the animation may be intended to loop smoothly and will simply return to the beginning of the loop rather than truly ending.
  • the software will check for changed circumstances with respect to the card, the camera, or other aspects of the viewing experience (Step 335). For example, if the card has been moved or rotated, future frames of the animation may need a similar transformation.
  • the software may have to determine whether to terminate the animation prematurely, or to modify it (such as by continuing to play music, but stopping the augmentation of the display until the card is returned into view). If the viewer has tapped a button to activate the front-facing camera instead of the rear-facing camera, a first animation for augmenting the card may need to be replaced by a second animation for augmenting the viewer. If the viewer taps the button to activate the rear-facing camera again, the original animation will be restored. After each moment of the experience, the appropriately updated video and other elements will be added to the video stream displaying on the mobile computing device’s screen (back to Step 325).
  • FIG. 4 depicts an augmented reality interface after implementing the change in the mobile computing device’s functionality described in FIG. 2.
  • the same card is rendered on the screen of the mobile computing device 105 with a constantly changing animation in front of it.
  • the butterfly is now in motion, and appears to flap its wings, fly up from the surface of the card, and even to move beyond the edges of the card, into the air/background.
  • the video stream of the card is modified by removing the QR code 115 and the original illustration 110 in real time by filtering them out and replacing them with the generic texture of the rest of the card.
  • the software rendering the video stream may be configured to remove, cover up, add, or modify any number of pre-determined elements at all times or if they happen to come into the line of sight of the camera. For example, as depicted in the next figures, some elements may be specifically tied to facial recognition and appear on the augmented video stream only when a face is present on camera.
  • FIGS. 5A and 5B depict one kind of augmented reality experience involving an illusion of three-dimensional objects around a viewer through a front-facing camera.
  • FIG. 5 A while viewing the card from FIGS. 1 and 4 through the rear-facing camera, the viewer chooses to tap the camera switching icon.
  • FIG. 5B the original animation of a butterfly with a specific location respective to the card disappears. Instead, the viewer sees himself through the front-facing camera, now with one or more representations of the same butterfly model fluttering around him. If there was musical accompaniment, the accompaniment continues unchanged whether the camera is front-facing or rear-facing.
  • the front-facing augmented reality need not incorporate views of the same model as the rear-facing version; there could be different butterflies, or flowers, or other complementary animations that fit the theme of the original rear-facing animation.
  • FIGS. 6A and 6B depict an additional style of augmented reality animation with layering in planes in front of the camera.
  • a card may be provided to a viewer that appears to only have a closed curtain 600 printed on the card.
  • the card does not itself in any way indicate the presence of a vanity 605 or other object behind the curtain, the curtain is intended to be part of an artistic experience involving the vanity.
  • the animation begins to play, the original illustration of the closed curtain is concealed in the video stream, and replaced with an animation of the curtain opening to reveal the vanity behind it.
  • the animation may thus include multiple layers in the Z-dimension and use changes in the X- or Y-dimensions to reveal new material that was initially concealed.
  • each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s).
  • the functions noted in the blocks may occur out of the order noted in the Figures.
  • two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.

Landscapes

  • Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Strategic Management (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Information Transfer Between Computers (AREA)
  • Processing Or Creating Images (AREA)

Abstract

Est divulguée une carte de vœux interactive et un procédé de création d'une carte de vœux interactive. Le procédé consiste à générer une série de représentations bidimensionnelles ou de projections d'une animation tridimensionnelle dans un plan et à imprimer, sur un substrat, l'une des représentations bidimensionnelles et une marque. La marque, lorsqu'elle est reconnue par un dispositif informatique mobile, amène le dispositif informatique mobile à transmettre un message à une URL donnée. Lorsqu'elles sont reçues, des instructions sont transmises au dispositif informatique mobile pour afficher sur un écran du dispositif informatique mobile un flux de caméra provenant de la caméra du dispositif informatique mobile superposé par des représentations bidimensionnelles supplémentaires à partir de la série de représentations bidimensionnelles.
PCT/US2024/035593 2023-06-28 2024-06-26 Cartes de vœux interactives Ceased WO2025006588A2 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US202363523755P 2023-06-28 2023-06-28
US63/523,755 2023-06-28

Publications (2)

Publication Number Publication Date
WO2025006588A2 true WO2025006588A2 (fr) 2025-01-02
WO2025006588A3 WO2025006588A3 (fr) 2025-02-13

Family

ID=93940170

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2024/035593 Ceased WO2025006588A2 (fr) 2023-06-28 2024-06-26 Cartes de vœux interactives

Country Status (1)

Country Link
WO (1) WO2025006588A2 (fr)

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2828752C (fr) * 2011-04-29 2020-07-28 American Greetings Corporation Systemes, procedes et appareils pour creer, editer, distribuer et visualiser des cartes de vƒux electroniques
US11249714B2 (en) * 2017-09-13 2022-02-15 Magical Technologies, Llc Systems and methods of shareable virtual objects and virtual objects as message objects to facilitate communications sessions in an augmented reality environment

Also Published As

Publication number Publication date
WO2025006588A3 (fr) 2025-02-13

Similar Documents

Publication Publication Date Title
CN114026831B (zh) 3d对象摄像头定制系统、方法和机器可读介质
Looser et al. Through the looking glass: the use of lenses as an interface tool for Augmented Reality interfaces
US9582822B2 (en) System and method for digital delivery of reveal videos for online gifting
US20190289276A1 (en) Cubic or Spherical Mapped Content for Presentation of Pre-Rendered Images Viewed from a Fixed Point of View in HTML, Javascript and/or XML for Virtual Reality Applications
CN107851299B (zh) 信息处理装置、信息处理方法以及程序
US20220254114A1 (en) Shared mixed reality and platform-agnostic format
JP2009252240A (ja) リフレクション組み込みシステム、方法及びプログラム
JP6683864B1 (ja) コンテンツ制御システム、コンテンツ制御方法、およびコンテンツ制御プログラム
CN114995924A (zh) 信息显示处理方法、装置、终端及存储介质
US9104237B1 (en) System and method for digital delivery of reveal videos for online gifting
JP2021531520A (ja) ウェアラブル制御機器、仮想・拡張現実システム及び制御方法
US10484523B2 (en) Mobile communication terminal and method therefore
Zimmer et al. Mobile Augmented Reality Illustrations that entertain and inform: Design and Implementation issues with the Hololens
KR20210076432A (ko) 텍스트 인식을 통한 실감형 학습 콘텐츠 제공 장치 및 방법
Pethő Media in the cinematic imagination: Ekphrasis and the poetics of the in-between in Jean-Luc Godard’s cinema
KR101316789B1 (ko) 증강 현실 컨텐츠 재생 시스템 및 방법
CN117011442B (zh) 材质生成方法、装置、电子设备及存储介质
JP4140333B2 (ja) Ｗｅｂ３Ｄファイル編集システム
KR101246304B1 (ko) 증강 현실 서비스 제공 시스템 및 방법
McNamara Enhancing art history education through mobile augmented reality
Đurđević et al. Development of augmented reality video application
US12530075B1 (en) Augmented reality (AR) content-sharing with AR-deprived audience
KR102622709B1 (ko) 2차원 영상에 기초하여 3차원 가상객체를 포함하는 360도 영상을 생성하는 방법 및 장치
KR101242512B1 (ko) 증강 현실 컨텐츠 재생 시스템 및 방법
Scherrer et al. Souvenirs du monde des montagnes

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE