Token issues found with testing framework

[pkusumaraju-rythmos]

Following are the scenarios found :
In Regression -

1 ) ? is treated as pointer for test case 10061
2) need to check for feasibility for proper tokenization of macros for test case 10063