The Screen Fold API

W3C First Public Working Draft

This version:
https://www.w3.org/TR/2020/WD-screen-fold-20201217/
Latest published version:
https://www.w3.org/TR/screen-fold/
Latest editor's draft:
https://w3c.github.io/screen-fold/
Implementation report:
https://www.w3.org/wiki/DAS/Implementations
Editors:
Diego González (Samsung)
Kenneth Rohde Christiansen (Intel Corporation)
Participate:
GitHub w3c/screen-fold
File a bug
Commit history
Pull requests
Additional resources:
'Fold State' initial explainer & key scenarios
Polyfill

Abstract

This document specifies an API that allows web applications to request the angular value to which a device with a screen hinge is folded. Under the right conditions, and if allowed, the value representing the angle in degrees is returned.

Status of This Document

This section describes the status of this document at the time of its publication. Other documents may supersede this document. A list of current W3C publications and the latest revision of this technical report can be found in the W3C technical reports index at https://www.w3.org/TR/.

Implementors need to be aware that this specification is extremely unstable. Implementors who are not taking part in the discussions will find the specification changing out from under them in incompatible ways. Vendors interested in implementing this specification before it eventually reaches the Candidate Recommendation phase should subscribe to the repository on GitHub and take part in the discussions.

This document was published by the Devices and Sensors Working Group as a First Public Working Draft. This document is intended to become a W3C Recommendation.

GitHub Issues are preferred for discussion of this specification.

Publication as a First Public Working Draft does not imply endorsement by the W3C Membership.

This is a draft document and may be updated, replaced or obsoleted by other documents at any time. It is inappropriate to cite this document as other than work in progress.

This document was produced by a group operating under the W3C Patent Policy. W3C maintains a public list of any patent disclosures made in connection with the deliverables of the group; that page also includes instructions for disclosing a patent. An individual who has actual knowledge of a patent which the individual believes contains Essential Claim(s) must disclose the information in accordance with section 6 of the W3C Patent Policy.

This document is governed by the 15 September 2020 W3C Process Document.

1. Introduction

New types of mobile devices are appearing that have some sort of folding capabilities around the screen. Hence, when the device folds, it physically forms an angle. The main interest in knowing the fold angle is because there are opportunities in responsive design that enable new user experiences.

Among the described "folding" devices, there are mainly two different physical form factors: devices with a single flexible screen (seamless), and devices with two screens (with seam). They can both fold around a hinge, and the current specification applies to both types. It should be clarified as well that both seamless and (devices) with seam can be of different dimension ranging from mobile and tablets to laptop sizes. It should also be noted that different devices will have different default orientations (portrait or landscape), and that the fold might happen in a vertical or horizontal way.

drawing of different type of foldable devices

From enhancing the usability of a website by avoiding the area of a fold, to enabling innovative use cases for the web, knowing the fold angle can help developers tailor their content to different devices. It can also enable to detect different postures the device might be in.

Content can be consumed and browsed even when the device is not flat, in which case the developer might want to provide a different layout for it depending on the state of the angle of the fold. Additionally, developers can adapt content depending on various “postures” and potentially also animate some of these transitions. You can refer to a description of use cases.

2. Extensions to the Screen interface

The [cssom-view] specification defines the Screen interface, which this specification extends:

WebIDL[SecureContext]
partial interface Screen {
  [SameObject] readonly attribute ScreenFold fold;
};

3. The ScreenFold interface

WebIDL[SecureContext, Exposed=(Window)]
interface ScreenFold : EventTarget {
  readonly attribute unsigned short angle;
  readonly attribute ScreenFoldPosture posture;
  attribute EventHandler onchange;
};

enum ScreenFoldPosture {
  "no-fold",
  "laptop",
  "flat",
  "tent",
  "tablet",
  "book"
};

3.1 The angle attribute: Get current screen fold angle

When getting the type attribute, the user agent MUST return the responsible document's current screen fold angle.

3.2 The posture attribute: Get current screen fold posture

When getting the type attribute, the user agent MUST return the responsible document's current screen fold posture.

3.3 The onchange attribute: Handle angle/posture changes

The onchange attribute is an event handler whose corresponding event handler event type is "change".

4. Posture modes

This specification defines the following posture values:

  1. drawing of no-fold mode No-Fold is the posture of a device without a hinge. This is the expected value for devices that do not fold.
  2. drawing of laptop mode Laptop posture indicates that the device is being used as a traditional laptop, meaning one screen is placed on a more or less horizontal surface with a screen angle between 180 to 0 degrees.
  3. drawing of flat mode Flat posture indicates that one screen is being placed on a more or less horizontal surface with a screen angle around 180 degrees.
  4. drawing of tent mode Tent posture indicates that the edges of both screens are placed on a horizontal surface but with an angle > 180 degrees.
  5. drawing of tablet mode Tablet posture is when the device can turn around on its hinge all the way to have the screen back to back. The angle is considered to be around 360 degrees.
  6. drawing of book mode Book posture is when the device is used between around 50 and 160 degrees. It is generally used while being held on (not on a surface).

In the API, the posture values are represented by the ScreenFoldPosture enum values.

5. Screen Fold Media Queries

The 'screen-fold-posture' media feature

The screen-fold-posture media feature represents, via a CSS media query [MEDIAQ], the posture of the device. This media feature applies to the top-level browsing context and any child browsing contexts. Child browsing contexts reflect the posture of the top-level browsing context.

Value:
no-fold | laptop | flat | tent | tablet | book
Applies to:
visual media types
Accepts min/max prefixes:
No

A user agent MUST reflect the applied posture of the web application via a CSS media query [MEDIAQ].

The 'screen-fold-angle' media feature

The screen-fold-angle media feature represents, via a CSS media query [MEDIAQ], the <angle> of the device. This media feature applies to the top-level browsing context and any child browsing contexts. Child browsing contexts reflect the <angle> of the top-level browsing context.

Value:
<angle>
Applies to:
visual media types
Accepts min/max prefixes:
Yes

A user agent MUST reflect the applied <angle> of the web application via a CSS media query [MEDIAQ].

6. Reading the posture

All documents have a current screen fold angle and a current posture. Both of them SHOULD be initialized when the document is created, otherwise they MUST be initialized the first time they are accessed and before their value is read. The user agent MUST update the screen fold information of the document to initialize them.

For a given document, the current posture is derived from the current screen fold angle and the current screen orientation.

These tables are non-normative.

Posture values table

The values are approximations and might differ per device. For instance, a device might not yield exactly 180° when laying flat, but instead values ranging from 175° to 185°. Device makers SHOULD make sure that the physical device postures map correctly to the postures defined by this specification.

Some devices might also lack one or more of the postures due to physical constraints or device design, in which case the device SHOULD make sure that all combinations of angles and device orientation (which can be locked by [SCREEN-ORIENTATION] and host OS) maps into one of the defined postures.

An illustration on how posture values are derived from the orientation of the fold The posture values table shows how the posture values are derived depending on the orientation of the fold:

Horizontal Fold

drawing of a device with a vertical fold

Devices with a horizontal fold are the ones for which in their main form factor, the folding occurs from side to side, across the screen(s).

The posture values table for devices with a horizontal fold
Current posture Current screen orientation Current screen fold angle
Laptop "portrait-primary" | "portrait-secondary" [0° - 140°[
Flat any orientation [140° - 185°[
Tent any orientation [185° - 335°[
Tablet any orientation [335° - 360°]
Book "landscape-primary" | "landscape-secondary" [0° - 140°[

Vertical Fold

drawing of a device with a horizontal fold

Devices with a vertical fold are the ones for which in their main form factor, the folding occurs from top to bottom, across the screen(s).

The posture values table for devices with a vertical fold
Current posture Current screen orientation Current screen fold angle
Laptop "landscape-primary" | "landscape-secondary" [0° - 140°[
Flat any orientation [140° - 185°[
Tent any orientation [185° - 335°[
Tablet any orientation [335° - 360°]
Book "portrait-primary" | "portrait-secondary" [0° - 140°[

7. Algorithms

7.1 Updating the screen fold information

The steps to update the screen fold information of a document are as follows:

  1. Set the document's current screen fold angle to the angle between the screen fold in degrees (or two screens in case of a dual screen device).
  2. Update the document's current posture given the current screen fold angle and current screen orientation, according to posture values table.

7.2 Screen fold angle change

Whenever the screen(s) fold angle changes, the user agent MUST run the following steps as part of the next animation frame task:

  1. Let browsing contexts be the list of the descendant browsing contexts of the top-level browsing context's document.
  2. for each context in browsing contexts, run the following sub-steps:
    1. Let document be the context's active document.
    2. If document is not visible per [PAGE-VISIBILITY], abort these steps.
    3. Update the screen fold information of document.
    4. Fire an event named change at document's Screen.fold object.

Whenever a document becomes visible per [PAGE-VISIBILITY], in other words after the now visible algorithm is run, the user agent MUST run the following substeps as part of the next animation frame task:

  1. Let document be the document in question.
  2. Let posture and angle be respectively the document's current posture and current screen fold angle.
  3. Update the screen fold information of the document.
  4. If posture is different from the document's current posture or angle from the document's current screen fold angle, run the following sub-steps:
    1. Fire an event named change at the document's Screen.fold object.
Note

Developers need to be aware that a Screen.fold object from a document that is not visible, as per [PAGE-VISIBILITY], will not receive an orientation change event. This is to prevent unnecessary changes to layout, etc. in the non-visible web application.

Issue 1
This section could be improved if the [PAGE-VISIBILITY] specification had a hook for when the document becomes visible and hidden. PR 54.

8. Security and Privacy considerations

The Screen Fold API exposes two kinds of information:

  1. an angle value representing the hinge position
  2. A posture determined from the angle value

Typical sensor readings are sent at a constant frequency to whomever is listening to its readings. However the fold angle only communicates its value when the hinge is manipulated by the user. Variations in the angle’s readings and posture calculation, as well as event dispatching frequency offer a possibility of fingerprinting to identify users. User agents may reduce this risk by limiting or coalescing events when exposing this information to web developers. Users don’t constantly adjust the angle, so the fold angle value is changing in bursts: the events may be dispatched at a very low frequency most of the time and fire at a high frequency when the device is being opened or closed. In order for the events to be dispatched, the content must be on the foreground and visible to the user.

Minimizing the accuracy of the angle readout generally decreases the risk of fingerprinting. User agents should not provide unnecessarily verbose readouts of the hinge angle data. Posture values are not very useful values to fingerprint a user. They’re similar in concept with the orientation values. The posture change is only triggered in certain fold angle values providing a very low resolution reading. Because the changes are very sparse changes with very few predefined values, it makes it hard to precisely identify users across sites.

If the same code using the API can be used simultaneously in different window contexts on the same device it may be possible for that code to correlate the user across those two contexts, creating unanticipated tracking mechanisms.

8.1 Types of security and privacy threats

This section is non-normative.

8.1.1 Device Fingerprinting

Sensors can provide information that can uniquely identify the device using those sensors. Every concrete sensor model has minor manufacturing imperfections and differences that will be unique for this model. These manufacturing variations and imperfections can be used to fingerprint the device.

8.2 Mitigation Strategies

This section is non-normative.

This section gives a high-level presentation of some of the mitigation strategies specified in the normative sections of this specification.

8.2.1 Secure Context

Posture value and fold angle readings are explicitly flagged by the Secure Contexts specification as a high-value target for network attackers. Thus all interfaces defined by this specification or extension specifications are only available within a secure context.

8.2.2 Focused Area

Posture value and fold angle readings are only available for active documents whose origin is the same origin-domain with the currently focused area document.

This is done in order to mitigate the risk of a skimming attack against the browsing context containing an element which has gained focus, for example when the user carries out an in-game purchase using a third party payment service from within an iframe.

8.2.3 Visibility State

Posture value and fold angle readings are only available for the active documents whose visibility state is "visible".

8.3 Mitigation strategies applied on a case by case basis

8.3.1 Limit maximum sampling frequency

User agents may mitigate certain threats by limiting the maximum sampling frequency. Coalescing and aligning the fold angle readings with the animation frame would limit the fingerprinting while still allowing animations responding to the fold angle. Limiting the maximum sampling frequency prevents use cases which rely on low latency or high data density.

8.3.2 Limit number of delivered readings

An alternative to limiting the maximum sampling frequency is to limit the number of sensor readings delivered to Web application developers, regardless of what frequency the sensor is polled at. This allows use cases which have low latency requirements to increase sampling frequency without increasing the amount of data provided. Discarding intermediary readings prevents certain use cases, such as those relying on certain kinds of filters. User agent should wait before sending the angle value changes after a minimum of degrees changes to remove the noise as well as to avoid getting events while the user is just interacting with the screen. This would limit identifying users with shaky hands.

8.3.3 Reduce accuracy

Lowering the resolution of the angle MAY lead to reducing the uniqueness that the value can have. Nonetheless, if several sites are being displayed on the same device, it can be easy to identify that it is the same user, even if the value is rounded. As a solution, applying some fuzziness to the value itself MAY work.

8.3.4 Applying fuzziness to the angle value

Lowering the resolution of the returned value may not be enough, so fuzzing out the value can algo help, in order to report different values. This fuzzy offset can help differentiate returned values, minimizing the risk of fingerprinting.

9. Examples

This section is non-normative.

Example 1: screen.fold data

This is a simple use case of the posture and angle value being printed on the console.

Example 1: React to poster change
screen.fold.addEventListener("change", () => {
  const { angle, posture } = screen.fold;
  console.log(`The current screen angle is ${angle}, which means it is in ${posture} posture!`);
})

Example 2: screen-fold-posture

The device is being used for a video call web service. It can be folded into the laptop posture to enable a hands-free when placed on a surface. The UA detects the posture and the UI is enhanced. Similar examples can be drafted for content to adapt to any posture. See the explainer for other key scenarios.

An illustration of a video call web service that uses the screen-fold-posture media feature
Example 2: Adapting UI to posture
@media (screen-fold-posture: laptop) and (spanning: single-fold-horizontal){
  body {
    display: flex;
    flex-flow: column nowrap;
  }

  .videocall-area, .videocall-controls  {
    flex: 1 1 env(fold-bottom);
  }
}

Example 3: screen-fold-angle

Some scenarios might span outside of the default postures envisioned in this document. The screen-fold-angle media feature allows to define a range or threshold for the layout to change.

As an example, an experience that might require a separate viewing area by user (like a game) might find that the default 185° starting angle for the tent posture is too "open" to guarantee one user will not see the other user's screen. Using screen-fold-angle the threshold can be defined by the developer.

diagram of an example that uses an angle range to tailor content
Example 3: Defining angle ranges for content
@media (min-screen-fold-angle: 270deg) {
  /*enable custom layout for the app*/ 
}

Example 4 & 5: Animation

Opening and closing a device might include animations linked to the value of the angle of the fold. This allows the creation of content that can mimic the effect of a pop-up book.

Another example can be mapping the state of the fold of a device to transformations of a DOM element. With this approach you could rotate an element based on the value of the angle.

diagram of an img element rotating on the center of a webpage
Example 4: Element animation based on fold value (JS)
let fish = document.querySelector('.fish-circle');

ScreenFold.addEventListener('change', function(e) {
  //animation keyframes
  let rotationFish = [
    {transform: `rotate(${e.angle})`, easing: 'ease-out'}
  ];

  fish.animate(rotationFish, 100);
};
Example 5: Element animation based on fold value (CSS)
.fish-circle {
  transform: rotate(env(screen-fold-angle));
}

Example 6: Feature detection of screen-fold-posture media feature

As one of the valid screen-fold-posture values will always be true, you can use the following snippet to detect whether a user agent supports the media feature:

Example 6: Feature detect the screen-fold-posture
@media (screen-fold-posture) {
  /*The browser supports screen-fold-posture feature*/
}
For more information about media features in a boolean context please refer to Evaluating Media Features in a Boolean Context.

10. Dependencies

The following concepts and interfaces are defined in [SCREEN-ORIENTATION]: current screen orientation as represented by the OrientationType enum.

The following is defined in [MEDIAQ]: Evaluating Media Features in a Boolean Context.

The following concepts and interfaces are defined in [HTML]: list of the descendant browsing contexts.

The following is defined in [PAGE-VISIBILITY]: now visible algorithm.

The following is used but not defined in [FULLSCREEN]: animation frame task.

Issue 2
This should now be updated since the animation frame task issue is recently resolved and the timing is now defined.

11. Conformance

As well as sections marked as non-normative, all authoring guidelines, diagrams, examples, and notes in this specification are non-normative. Everything else in this specification is normative.

The key words MAY, MUST, and SHOULD in this document are to be interpreted as described in BCP 14 [RFC2119] [RFC8174] when, and only when, they appear in all capitals, as shown here.

This specification defines conformance criteria for a single product: a user agent that implements the interfaces that it contains.

A. IDL Index

WebIDL[SecureContext]
partial interface Screen {
  [SameObject] readonly attribute ScreenFold fold;
};

[SecureContext, Exposed=(Window)]
interface ScreenFold : EventTarget {
  readonly attribute unsigned short angle;
  readonly attribute ScreenFoldPosture posture;
  attribute EventHandler onchange;
};

enum ScreenFoldPosture {
  "no-fold",
  "laptop",
  "flat",
  "tent",
  "tablet",
  "book"
};

B. Acknowledgments

This section is non-normative.

We would like to offer our sincere thanks to Daniel Appelquist, Alexis Menard, Jo Balletti, and Michael Blix for their contributions to this work.

C. References

C.1 Normative references

[cssom-view]
CSSOM View Module. Simon Pieters. W3C. 17 March 2016. W3C Working Draft. URL: https://www.w3.org/TR/cssom-view-1/
[dom]
DOM Standard. Anne van Kesteren. WHATWG. Living Standard. URL: https://dom.spec.whatwg.org/
[FULLSCREEN]
Fullscreen API Standard. Philip Jägenstedt. WHATWG. Living Standard. URL: https://fullscreen.spec.whatwg.org/
[HTML]
HTML Standard. Anne van Kesteren; Domenic Denicola; Ian Hickson; Philip Jägenstedt; Simon Pieters. WHATWG. Living Standard. URL: https://html.spec.whatwg.org/multipage/
[infra]
Infra Standard. Anne van Kesteren; Domenic Denicola. WHATWG. Living Standard. URL: https://infra.spec.whatwg.org/
[MEDIAQ]
Media Queries Level 4. Florian Rivoal; Tab Atkins Jr.. W3C. 21 July 2020. W3C Candidate Recommendation. URL: https://www.w3.org/TR/mediaqueries-4/
[PAGE-VISIBILITY]
Page Visibility (Second Edition). Jatinder Mann; Arvind Jain. W3C. 29 October 2013. W3C Recommendation. URL: https://www.w3.org/TR/page-visibility/
[RFC2119]
Key words for use in RFCs to Indicate Requirement Levels. S. Bradner. IETF. March 1997. Best Current Practice. URL: https://tools.ietf.org/html/rfc2119
[RFC8174]
Ambiguity of Uppercase vs Lowercase in RFC 2119 Key Words. B. Leiba. IETF. May 2017. Best Current Practice. URL: https://tools.ietf.org/html/rfc8174
[SCREEN-ORIENTATION]
The Screen Orientation API. Mounir Lamouri; Marcos Caceres; Johanna Herman. W3C. 19 October 2020. W3C Working Draft. URL: https://www.w3.org/TR/screen-orientation/
[webidl]
Web IDL. Boris Zbarsky. W3C. 15 December 2016. W3C Editor's Draft. URL: https://heycam.github.io/webidl/