diff -dur orig/tokenizerfunction.htm new/tokenizerfunction.htm
--- orig/tokenizerfunction.htm 2008-07-01 11:30:30.390625000 -0500
+++ new/tokenizerfunction.htm 2008-07-01 11:32:24.093750000 -0500
@@ -126,7 +126,7 @@
constructed.
The return value indicates whether a new token was found in the
- sequence (next,end] |
+ sequence [next,end)
If the return value is true, the new token is assigned to tok. next
is always updated to the position where parsing should start on the
|