EP4055524A4 - Arbitrary view generation - Google Patents

Arbitrary view generation Download PDF

Info

Publication number: EP4055524A4
Authority: EP; European Patent Office
Prior art keywords: view generation; arbitrary view; arbitrary; generation; view
Prior art date: 2019-11-08
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.): Pending

Application number

EP20883695.7A

Other languages

German (de)

French (fr)

Other versions

EP4055524A1 (en

Inventor

Clarence Chui

Manu Parmar

Amogh Subbakrishna Adishesha

Harshul GUPTA

Avinash Venkata Uppuluri

Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)

Outward Inc

Original Assignee

Outward Inc

Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)

2019-11-08

Filing date

2020-11-06

Publication date

2024-02-21

2020-11-05 Priority claimed from US17/090,794 external-priority patent/US11989821B2/en

2020-11-05 Priority claimed from US17/090,793 external-priority patent/US11989820B2/en

2020-11-06 Application filed by Outward Inc filed Critical Outward Inc

2022-09-14 Publication of EP4055524A1 publication Critical patent/EP4055524A1/en

2024-02-21 Publication of EP4055524A4 publication Critical patent/EP4055524A4/en

Status Pending legal-status Critical Current

Links

Classifications

- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—Three-dimensional [3D] image rendering
- G06T15/10—Geometric effects
- G06T15/20—Perspective computation
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three-dimensional [3D] modelling for computer graphics
- G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/194—Segmentation; Edge detection involving foreground-background segmentation
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/50—Depth or shape recovery
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
- G06V10/774—Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/64—Three-dimensional [3D] objects
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10028—Range image; Depth image; 3D point clouds
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20084—Artificial neural networks [ANN]

Landscapes

Engineering & Computer Science (AREA)
Theoretical Computer Science (AREA)
Physics & Mathematics (AREA)
General Physics & Mathematics (AREA)
Computer Vision & Pattern Recognition (AREA)
Multimedia (AREA)
Computing Systems (AREA)
Geometry (AREA)
Computer Graphics (AREA)
Software Systems (AREA)
Evolutionary Computation (AREA)
Artificial Intelligence (AREA)
Data Mining & Analysis (AREA)
Databases & Information Systems (AREA)
Health & Medical Sciences (AREA)
General Health & Medical Sciences (AREA)
Medical Informatics (AREA)
Bioinformatics & Cheminformatics (AREA)
Evolutionary Biology (AREA)
Life Sciences & Earth Sciences (AREA)
Bioinformatics & Computational Biology (AREA)
General Engineering & Computer Science (AREA)
Processing Or Creating Images (AREA)
Image Generation (AREA)
Image Analysis (AREA)

EP20883695.7A 2019-11-08 2020-11-06 Arbitrary view generation Pending EP4055524A4 (en)

Applications Claiming Priority (5)

Application Number	Priority Date	Filing Date	Title
US201962933261P	2019-11-08	2019-11-08
US201962933258P	2019-11-08	2019-11-08
US17/090,794 US11989821B2 (en)	2016-03-25	2020-11-05	Arbitrary view generation
US17/090,793 US11989820B2 (en)	2016-03-25	2020-11-05	Arbitrary view generation
PCT/US2020/059500 WO2021092454A1 (en)	2019-11-08	2020-11-06	Arbitrary view generation

Publications (2)

Publication Number	Publication Date
EP4055524A1 EP4055524A1 (en)	2022-09-14
EP4055524A4 true EP4055524A4 (en)	2024-02-21

Family

ID=75848702

Family Applications (2)

Application Number	Title	Priority Date	Filing Date
EP20883695.7A Pending EP4055524A4 (en)	2019-11-08	2020-11-06	Arbitrary view generation
EP20885037.0A Pending EP4055525A4 (en)	2019-11-08	2020-11-06	Arbitrary view generation

Family Applications After (1)

Application Number	Title	Priority Date	Filing Date
EP20885037.0A Pending EP4055525A4 (en)	2019-11-08	2020-11-06	Arbitrary view generation

Country Status (4)

Country	Link
EP (2)	EP4055524A4 (en)
JP (3)	JP7657214B2 (en)
KR (3)	KR102729399B1 (en)
WO (2)	WO2021092454A1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number	Priority date	Publication date	Assignee	Title
CN114820905B (en)	2022-06-24	2022-09-20	北京百度网讯科技有限公司	Virtual image generation method and device, electronic equipment and readable storage medium
KR102866676B1 (en) *	2022-07-27	2025-09-30	경북대학교 산학협력단	Method and apparatus for estimating non-uniform placement volume of powder material
IT202300015168A1 (en) *	2023-07-19	2025-01-19	Over Holding S R L	METHOD FOR GENERATING A DIGITAL TWIN OF A PHYSICAL ENVIRONMENT AS WELL AS METHOD AND SYSTEM FOR NAVIGATING WITHIN SAID DIGITAL TWIN
JP7691157B1 (en) *	2024-07-01	2025-06-11	株式会社セットジャパンコーポレーション	Procedural 3D asset generation support system

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number	Priority date	Publication date	Assignee	Title
EP1996959A4 (en) *	2006-03-03	2012-02-29	Medic Vision Brain Technologies Ltd	System and method of automatic prioritization and analysis of medical images
US8867820B2 (en) *	2009-10-07	2014-10-21	Microsoft Corporation	Systems and methods for removing a background of an image
US9177381B2 (en) *	2010-12-22	2015-11-03	Nani Holdings IP, LLC	Depth estimate determination, systems and methods
US10477189B2 (en) *	2014-04-30	2019-11-12	Intel Corporation	System and method of multi-view reconstruction with user-selectable novel views
US10726593B2 (en) *	2015-09-22	2020-07-28	Fyusion, Inc.	Artificially rendering images using viewpoint interpolation and extrapolation
GB2532075A (en) *	2014-11-10	2016-05-11	Lego As	System and method for toy recognition and detection based on convolutional neural networks
US9996914B2 (en) *	2016-03-25	2018-06-12	Outward, Inc.	Arbitrary view generation
KR101980603B1 (en) *	2016-05-20	2019-05-22	구글 엘엘씨	Relating to predicting the motion (s) of the object (s) in the robotic environment based on the image (s) capturing the object (s) and parameter (s) for future robot motion in the environment Methods and apparatus
JP6833348B2 (en) *	2016-05-25	2021-02-24	キヤノン株式会社	Information processing device, image processing system, information processing device control method, virtual viewpoint image generation method, and program
US10387765B2 (en) *	2016-06-23	2019-08-20	Siemens Healthcare Gmbh	Image correction using a deep generative machine-learning model
WO2017223560A1 (en) *	2016-06-24	2017-12-28	Rensselaer Polytechnic Institute	Tomographic image reconstruction via machine learning
US10846836B2 (en) *	2016-11-14	2020-11-24	Ricoh Company, Ltd.	View synthesis using deep convolutional neural networks
JPWO2018197984A1 (en)	2017-04-28	2020-03-19	株式会社半導体エネルギー研究所	Display system and moving object
US10469768B2 (en) *	2017-10-13	2019-11-05	Fyusion, Inc.	Skeleton-based effects and background replacement
WO2019167453A1 (en) *	2018-02-28	2019-09-06	富士フイルム株式会社	Image processing device, image processing method, and program

2020
- 2020-11-06 EP EP20883695.7A patent/EP4055524A4/en active Pending
- 2020-11-06 JP JP2022525979A patent/JP7657214B2/en active Active
- 2020-11-06 JP JP2022525978A patent/JP7410289B2/en active Active
- 2020-11-06 WO PCT/US2020/059500 patent/WO2021092454A1/en not_active Ceased
- 2020-11-06 KR KR1020227015178A patent/KR102729399B1/en active Active
- 2020-11-06 KR KR1020257002360A patent/KR20250016518A/en active Pending
- 2020-11-06 KR KR1020227015192A patent/KR20220074959A/en not_active Ceased
- 2020-11-06 EP EP20885037.0A patent/EP4055525A4/en active Pending
- 2020-11-06 WO PCT/US2020/059501 patent/WO2021092455A1/en not_active Ceased
2024
- 2024-03-26 JP JP2024048839A patent/JP2024079778A/en not_active Withdrawn

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
CHRISTIAN LEDIG ET AL: "Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network", 15 September 2016 (2016-09-15), XP055383325, Retrieved from the Internet <URL:https://arxiv.org/pdf/1609.04802.pdf> DOI: 10.1109/CVPR.2017.19 *
LEFKIMMIATIS STAMATIOS: "Non-local Color Image Denoising with Convolutional Neural Networks", IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 1 July 2017 (2017-07-01), pages 5882 - 5891, XP093089052, ISBN: 978-1-5386-0457-1, Retrieved from the Internet <URL:https://arxiv.org/pdf/1611.06757.pdf> DOI: 10.1109/CVPR.2017.623 *
See also references of WO2021092454A1 *

Also Published As

Publication number	Publication date
KR102729399B1 (en)	2024-11-14
EP4055524A1 (en)	2022-09-14
JP7657214B2 (en)	2025-04-04
JP7410289B2 (en)	2024-01-09
JP2024079778A (en)	2024-06-11
JP2022553846A (en)	2022-12-26
KR20220074959A (en)	2022-06-03
WO2021092454A1 (en)	2021-05-14
KR20250016518A (en)	2025-02-03
EP4055525A1 (en)	2022-09-14
JP2022553845A (en)	2022-12-26
WO2021092455A1 (en)	2021-05-14
KR20220078651A (en)	2022-06-10
EP4055525A4 (en)	2024-02-21

Legal Events

Date	Code	Title	Description
2021-05-14	STAA	Information on the status of an ep patent application or granted ep patent	Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE
2022-08-12	PUAI	Public reference made under article 153(3) epc to a published international application that has entered the european phase	Free format text: ORIGINAL CODE: 0009012
2022-08-12	STAA	Information on the status of an ep patent application or granted ep patent	Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE
2022-09-14	17P	Request for examination filed	Effective date: 20220427
2022-09-14	AK	Designated contracting states	Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR
2023-02-15	DAV	Request for validation of the european patent (deleted)
2023-02-15	DAX	Request for extension of the european patent (deleted)
2023-07-12	P01	Opt-out of the competence of the unified patent court (upc) registered	Effective date: 20230605
2023-10-09	REG	Reference to a national code	Ref country code: DE Ref legal event code: R079 Free format text: PREVIOUS MAIN CLASS: G06K0009360000 Ipc: G06T0005500000
2023-11-15	RIC1	Information provided on ipc code assigned before grant	Ipc: G06T 5/50 20060101AFI20231009BHEP
2024-02-21	A4	Supplementary search report drawn up and despatched	Effective date: 20240123
2024-02-21	RIC1	Information provided on ipc code assigned before grant	Ipc: G06T 5/50 20060101AFI20240117BHEP

Publication	Publication Date	Title
EP3867745A4 (en)	2022-08-03	Hyperpiler
EP3781482A4 (en)	2022-01-12	Nano-satellite
EP4044942A4 (en)	2023-11-15	Occlusion-crossing devices
EP3723593A4 (en)	2021-09-01	Reference interval generation
EP3980332A4 (en)	2023-06-14	Electroaerodynamic devices
EP4055525A4 (en)	2024-02-21	Arbitrary view generation
EP3973549A4 (en)	2023-09-13	Betavoltaic devices
EP4055567A4 (en)	2023-12-06	Arbitrary view generation
EP4003420A4 (en)	2023-11-15	Il-38-specific antiobodies
HK40076608A (en)	2023-02-17	Il-38-specific antiobodies
HK40069480A (en)	2022-10-07	Rhamnose-polysaccharides
EM79941730001S (en)	2020-06-12	Pooper-scoopers
EP3883117A4 (en)	2022-06-29	Vibration-powered generation element
EM77207920002S (en)	2020-03-31	Smartglasses
AU2019904806A0 (en)	2020-01-16	Fastcast-3
AU2019904733A0 (en)	2020-01-16	Trolleyon
AU2019904564A0 (en)	2019-12-19	WaterWords
AU2019904428A0 (en)	2019-12-05	Tapware
AU2019904116A0 (en)	2019-11-14	Oct2019ideasin3d
AU2019903707A0 (en)	2019-10-17	iWasteless
AU2019903699A0 (en)	2019-10-17	T-Brake
AU2019903571A0 (en)	2019-10-17	Shandybusta
AU2019903151A0 (en)	2019-09-12	BIzblockchain
AU2019903009A0 (en)	2019-09-05	3rdMeasure
AU2019902984A0 (en)	2019-08-29	Multimedia-arena playmakers