#
# Comments should be ignored
#
: Shell script launcher comment ignore
@ DOS script launcher comment ignore


-option key  # end of line comment
+reset   imbedded#hash   # <- not a comment, thought this is

This\ is' a 'single" token"

And\\\ \''even '\'\""more \""complex

"Backslash chars \n are returned as is"
'regardless \n of quoting'

'Single quote escapes'
\' "'"

"Double quote escapes"
\" '"' "\""

Back\ slash\ escapes
\\ '\'  "\\"       # NOTE that backslash in single quotes are literial!

'Space Character Escapes'
\  ' '  " "

'Empty Tokens, using quotes'
''   ""

"Unicode charcaters are handled"
"° ' ²  ³  ` ´"
"µ  ¶  ⨀  ⨁  ⨂"
测试用的汉字

Line__\
__Continuation

"Double_Quoted_Line__\
__Continuation"

'Single_Quoted_Line__\
__Continuation_NOT!'

"double_quoted_newlines__
__are_part_of_token"

'single_quoted_newlines__
__are_part_of_token'

"Last Token before EOF"