ISO/IEC INTERNATIONAL STANDARD 23090-2 Third edition 2023-06 Information technology Coded representation of immersive media - Part 2: Omnidirectional media format Technologies de I'information - Representation codée de média immersifs- Partie 2: Format de média omnidirectionnel Reference number IEC IS0/IEC 23090-2:2023(E) [SO @ IS0/IEC 2023 IS0/IEC23090-2:2023(E) COPYRIGHTPROTECTED DOCUMENT @IS0/IEC2023 All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting on or ISoO's member body in the country of the requester. ISO copyright office CP 40i : Ch. de Blandonnet 8 CH-1214 Vernier, Geneva Phone: +41 22 749 01 11 Email:[email protected] Website: www.iso.org Published in Switzerland ii @ IS0/IEC 2023 -All rights reserved IS0/IEC 23090-2:2023(E) @ Contents Page Foreword. vii Introduction viii Scope.. 2 Normativereferences 3 Terms, definitions, abbreviated terms and symbols... 3 3.1 Terms and definitions. 3.2 Abbreviated terms.. 3.3 Symbols.. 12 3.3.1 nathematicalfuncti 2 3.3.2 Order of operation precedence.. 13 3.3.3 Rangenotation 14 3.3.4 Variables 4 3.3.5 Processes 1.4 3.3.6 Syntaxstructures 15 3.3.7 Conventionsforindicatingthenumberofboxesintable 15 Overview 15 4.1 Overall architecture . 15 4.2 Projected omnidirectional video/images.. 18 4.2.1General... 18 4.2.2 Stitching, rotation, projection, and region-wise packing 18 4.3 Fisheye omnidirectional video/images.... 19 4.4 Meshomnidirectionalvideo.. 20 4.5 Streaming methods for omnidirectional video.. 20 4.5.1Overview... 20 4.5.2 Tile-based streaming with viewport-specific author-driven binding. 22 4.5.3 Tile-based streaming with free-viewport author-driven binding. 22 4.5.4 Tile-based streaming with late binding.. 23 4.6 Additionalfunctionalities 25 4.7 Conformance and interoperability. 25 4.7.1 General... 25 4.7.2 Media profiles 26 4.7.3 Presentation profiles. 28 4.7.4 Toolset brands... 28 4.7.5 Summary of referenceable code points 28 5 Omnidirectional video projection and region-wise packing ... 35 5.1 Coordinatesystem .35 5.2 Omnidirectional projection formats 36 5.2.1 General... 36 5.2.2 Equirectangularprojectionforonesamplelocation. .36 5.2.3 Cubemap projection for one sample location 37 5.3 Conversion from the local coordinate axes to the global coordinate axes 39 5.4 Region-wisepackingformats... .40 5.4.1 General.. 40 5.4.2 Conversion of one sample location for rectangular region-wise packing . 41 Fisheye omnidirectional video... 42 6.1 General.. 42 6.2 42 6.2.1 Syntax... .42 6.2.2 Semantics. 43 6.3 The FisheyeVideoSupplementalInfostruct () syntax structure 46 6.3.1 Syntax. 46 6.3.2 Semantics 47 IS0/IEC2023-Allrightsreserved ii IS0/IEC 23090-2:2023(E) 7 Omnidirectional media storage and metadata signalling in the ISOBMFF Generic extensions to the ISOBMFF. .52 7.1.1 Indication of a track not intended to be presented alone. ..52 7.1.2Clarificationsonthestereovideobox. .52 7.1.3 Generic sub-picture track grouping extensions.. ..53 7.1.4Mediaoffsetbox. .57 7.2 GenericextensionstoIS0/IEC14496-15 .58 7.2.1 Containing of SpatialRelationship2DDescriptionBox for HEVC tile basetrack and HEVCtiletracks... 7.3 OMAF-specific extensions to the ISOBMFF .58 7.3.1 Sync samples in timed metadata tracks . .58 7.4 OMAF-specific extensions to IS0/IEC 14496-15 .59 7.4.1 Coverage information box in an HEVC tile base track. ..59 7.5 Structures and semantics that are common for video tracks and image items. .59 7.5.1 Semantics of sample locations within a decoded picture .59 7.5.2 Projection format structure.. ..62 7.5.3 Region-wise packing structure. ..63 7.5.4 Rotation structure. .70 7.5.5 Content coverage structure.. .71 7.5.6 Sphereregionstructure.. .72 7.6 Restrictedvideoschemesforomnidirectionalvideo .76 7.6.1 Schemetypes. .76 7.6.2 Projectedomnidirectionalvideobox. .81 7.6.3 Fisheye omnidir