• vogelheim's avatar
    Scanner::LiteralBuffer usage cleanup. · c677f813
    vogelheim authored
    1, restrict use of LiteralBuffers to the tokens that actually need it.
      - E.g., previously the Token::FUNCTION would have a literal buffer
        containing "function", which was never actually used.
      - This eliminates copies of the string data for every call to
        PeekAhead or SetBookmark.
    2, document & enforce the "secret" Scanner API contract w/ DCHECK
      - Document & check the correspondence of token value and literal buffer.
      - Document & check preconditions for calling PeekAhead, ScanRegExp*,
        ScanTemplate*.
    
    BUG=v8:4947
    
    Review-Url: https://codereview.chromium.org/2240513003
    Cr-Commit-Position: refs/heads/master@{#38677}
    c677f813
Name
Last commit
Last update
..
OWNERS Loading commit data...
expression-classifier.h Loading commit data...
func-name-inferrer.cc Loading commit data...
func-name-inferrer.h Loading commit data...
parameter-initializer-rewriter.cc Loading commit data...
parameter-initializer-rewriter.h Loading commit data...
parser-base.h Loading commit data...
parser.cc Loading commit data...
parser.h Loading commit data...
pattern-rewriter.cc Loading commit data...
preparse-data-format.h Loading commit data...
preparse-data.cc Loading commit data...
preparse-data.h Loading commit data...
preparser.cc Loading commit data...
preparser.h Loading commit data...
rewriter.cc Loading commit data...
rewriter.h Loading commit data...
scanner-character-streams.cc Loading commit data...
scanner-character-streams.h Loading commit data...
scanner.cc Loading commit data...
scanner.h Loading commit data...
token.cc Loading commit data...
token.h Loading commit data...