Thus, using the Tokenizer program, it is possible to very easily and without significant investment, and without engaging additional personnel or resources, produce charts in the S-101 format based on the existing collection of S-57 charts. What is important, however, is the quality of the resulting ENCs and the management of additional risks that inevitably arise due to the production of additional publications.
To assess the quality of ENCs in the S-101 format, we have developed the S-101 Inspector, which also operates in console mode, allowing for data stream verification. In addition, we have added the capability for automatic error correction to the S-57 Editor, which significantly reduced the time required for data preparation. The same functionality has been implemented in the S-101 Editor, which automatically corrects specific standard requirements. As a result, we obtained the capability to quickly and efficiently produce ENCs in the S-101 format based on official charts published in the S-57 format.
In terms of performance, the Tokenizer operates quite efficiently: a medium-sized collection of 300–500 ENCs is converted within several minutes, with each chart typically taking only a few seconds.
But is this sufficient for the release of official charts? No, it is not. The parallel publication of charts in two formats not only implies additional resources and budgets but also introduces additional risks. These risks are associated with the fact that charts in S-57 and S-101 formats, belonging to the same geographic region and the same scale band, must provide identical information to the mariner. Therefore, the question arises — how can we compare charts in two formats?
Looking ahead, we can say that we see no other way to perform such comparison except through the token mechanism. The only viable approach is to analyze the equality of meanings (semantics), rather than syntax (formats).
The point is that comparing the contents of electronic charts is practically equivalent to evaluating the quality of translation from one language to another. Letter-by-letter or word-by-word comparison does not work, even when direct and reverse translation are verified by tools from the same vendor — and even less so when translators from different suppliers are used. Meanwhile, in cartography, it is critically important to verify data quality using alternative products, which is what happens everywhere in practice.
With the use of tokens, the task of comparing charts in different formats is significantly simplified — we consider charts equal in content if the tokens they contain are identical. Taking into account that tokens are stored in open XML format, any suitable third-party software can be used for verification. In our case, we use the dKart VS program.