token = identifier
 delimiter = whitespace
 whitespace = space
 comment = ; any-character-except-record-end*
 atmosphere = whitespace
 intertoken-space = atmosphere*
Whitespace characters are spaces, record starts, record ends, and
Whitespace is used for improved readability and,
as necessary, to separate tokens from each other, a token being an
indivisible lexical unit such as an identifier or number, but is
otherwise insignificant. Whitespace may occur between any two tokens,
but not within a token. Whitespace may also occur inside a string,
where it is significant.
A semicolon (;) indicates the start of a
comment. The comment continues to the
end of the record on which the semicolon appears. Comments are invisible,
but the record end is visible as whitespace. This
prevents a comment from appearing in the middle of an identifier or
intertoken-space may occur on either side of any token, but not
within a token.
Tokens which require implicit termination (identifiers, numbers,
characters, dot, and #! constants) may be terminated by any
delimiter, but not necessarily by anything else.