Separate tokenizer stuff into parsing and configuration types.
authorAdam Dickmeiss <adam@indexdata.dk>
Fri, 27 Apr 2007 10:09:44 +0000 (10:09 +0000)
committerAdam Dickmeiss <adam@indexdata.dk>
Fri, 27 Apr 2007 10:09:44 +0000 (10:09 +0000)
commitaa60dbcd982a4dbd52870120ef34b91a74d63274
treed2e8f78f3fa425c7e407de7b14689cc4bd815996
parent6f95cfbbdf2f549ce23f511bc406e3d74446ea2b
Separate tokenizer stuff into parsing and configuration types.
include/yaz/tokenizer.h
src/cclqfile.c
src/tokenizer.c