visualise tokenised identifiers sources
@tmoldere has updated the matcher to work with tokenized identifiers sources.
In the tokenized identifiers AST sources, the identifiers were split into different tokens. For example, identifier SeverityLevelCounter was split into 3 tokens Severity, Level, Counter. And these tokens are represented in AST as follow:
<name ColNr="18" EndColNr="37" EndLineNr="58" ID="805" LineNr="58">
<SimpleName ColNr="18" EndColNr="37" EndLineNr="58" ID="1541" LineNr="58">
<identifier ColNr="18" EndColNr="37" EndLineNr="58" ID="1542" LineNr="58">
<Token ColNr="18" EndColNr="37" EndLineNr="58" ID="1542.0" LineNr="58">
<value ColNr="18" EndColNr="37" EndLineNr="58" ID="1542.0.val" LineNr="58">Severity</value>
</Token>
<Token ColNr="18" EndColNr="37" EndLineNr="58" ID="1542.1" LineNr="58">
<value ColNr="18" EndColNr="37" EndLineNr="58" ID="1542.1.val" LineNr="58">Level</value>
</Token>
<Token ColNr="18" EndColNr="37" EndLineNr="58" ID="1542.2" LineNr="58">
<value ColNr="18" EndColNr="37" EndLineNr="58" ID="1542.2.val" LineNr="58">Counter</value>
</Token>
</identifier>
<var ColNr="18" EndColNr="37" EndLineNr="58" ID="1543" LineNr="58">false</var>
</SimpleName>
</name>
I tried to visualize the patterns generated from this data, but it was not sucessful. If you have free time could you please have a look.
You can find the tokenized identifiers sources and patterns in the following zip file: