normalize()
normalize(array $tokens) : array
Makes tokens more consistent by a particular method.
This is to increase matches across what tokens are deemed equivalent but differnt
Parameters
| array | $tokens | The tokens to normalizer |
Returns
array —The array of normalized tokens