getTokens issue with escape charactors

[aubrijesh]

Hi,
I am unable to get correct no of tokens with escape when my string contains escape charector.
eg :

var str = 'FOO "\"hello world\""';
var items = excelFormulaUtilities.getTokens(str).items

Its giving me five tokens.
[{"value":"FOO","type":"operand","subtype":"range"},{"value":"","type":"operand","subtype":"text"},{"value":"hello","type":"operand","subtype":"range"},{"value":"world","type":"unknown","subtype":""},{"value":"","type":"operand","subtype":"text"}]

As you can see there is only two tokens "FOO" and "hello world";