This is an archived snapshot of W3C's public bugzilla bug tracker, decommissioned in April 2019. Please see the home page for more details.

Bug 19484 - Inconsistency in regards to EOF (and EOF token)
Summary: Inconsistency in regards to EOF (and EOF token)
Status: NEW
Alias: None
Product: CSS
Classification: Unclassified
Component: Syntax (show other bugs)
Version: unspecified
Hardware: PC Linux
: P2 normal
Target Milestone: ---
Assignee: Tab Atkins Jr.
QA Contact: public-css-bugzilla
URL:
Whiteboard:
Keywords:
Depends on:
Blocks:
 
Reported: 2012-10-11 21:12 UTC by Brandon Frohs
Modified: 2012-10-11 21:12 UTC (History)
0 users

See Also:


Attachments

Description Brandon Frohs 2012-10-11 21:12:07 UTC
In the "Data state", an "end-of-file token" is emitted:

> EOF
>     Emit an end-of-file token. 


In the Tree Construction Definitions, an "EOF token" is mentioned:

> next input token
>     The token following the current input token in the list of tokens produced by the tokenizer. If there isn't a token following the current input token, the next input token is an *EOF token*.


In the "Top-level mode", "At-rule-prelude mode", "Rule-block mode", and several other modes, an "EOF token" is expected. E.g.:

> EOF token
>     Finish parsing. 


However, neither "EOF token" or "end-of-file token" is mentioned in the list of possible tokens in the Tokenization overview:

> The output of the tokenization step is a series of zero or more of the following tokens: identifier, function, at-keyword, hash, string, bad-string, url, bad-url, delim, number, percentage, dimension, unicode-range, whitespace, comment, cdo, cdc, colon, semicolon, [, ], (, ), {, }.