Tokenizer in QB64

[aurel]

Well..and well
Mark as i already posted on BASIC4US   forum
For me is main problem null terminated string or chr$(0) or this ""
And such a thing is solved or work in other Basic dialects
so it should be fixed in QB64 to
because produce ILLEGAL FUNCTION CALL runtime error

so
ch$ = "" .....or ch$ = chr$(0)
in ASC(ch) must work !

from all what i read on Discord and ZX think that know what is problem
PaulDoe give a trick with Len() but that not work
so your solution with asc2() work properly