Changeset af21934 for t

Timestamp:
Mar 2, 2010, 9:14:44 PM (13 years ago)
Author:
David Benjamin <davidben@mit.edu>
Branches:
master, release-1.6, release-1.7, release-1.8, release-1.9
Children:
2d232ed
Parents:
ccafe64
git-author:
David Benjamin <davidben@mit.edu> (02/27/10 21:52:26)
git-committer:
David Benjamin <davidben@mit.edu> (03/02/10 21:14:44)
Message:
Fix leading whitespace in tokenizer and refactor

Should make tests pass. Leading whitespace now works. Also, we remove
the dummy '' append in tokenize() and move it as a post-processing step
in Context::new. This is so tokenize() is a little more generic.

Signed-off-by: David Benjamin <davidben@mit.edu>
(No files)

Note: See TracChangeset for help on using the changeset viewer.