email copied to clipboard
info@dkart.fi
email copied to clipboard
info@dkart.fi
Copyright © 2024 GeoPhone Group International OY
All rights reserved.
dKart Publisher
DELTA
The implementation of new standards based on S-100 is a significant challenge for all hydrographic offices without exception. However, the main difficulty lies in the fact that this issue must be addressed simultaneously with other serious challenges:

  • Transition from manual production to automated production;
  • Transition from manual management to automated management.

The need to solve all of the above tasks together and simultaneously, in addition to the current production of ENCs in S-57 format, creates a rather complex situation. To address these challenges, we offer a new generation of products and technologies — dKart Evolution.

Introduction

Table of Contents:

dKart Evolution. Steps and Tools /

Tokens

S-101 is one of the most resource-demanding specifications within the entire S-100 family. However, if we compare S-57 and S-101, we can see that the differences at the semantic level are minimal. More than 90% of their content overlaps, with the main differences lying in the syntax. In simpler terms, S-101 is essentially a renamed version of S-57: what was called “A” in S-57 is now called “B” in S-101, what was “C” has become “D,” and so on. Only a very small number of new descriptors have been added, and all of this together has been presented as a revolutionary breakthrough in the description of hydrographic reality.

Given such an insignificant conceptual difference, a logical question arises: can we unify S-57 and S-101 descriptors so that data can be created, stored, and edited in one place, once and for all, thereby avoiding parallel production along with its associated additional costs and risks?

The answer is, of course, yes — and for this unification, we use Tokens as a universal repository of all linguistic parameters necessary to describe hydrographic objects in both formats. With the use of Tokens, the overall scheme for the transition from S-57 to S-101 is as presented in the diagram. At the first stage, data is transformed from S-57 into Tokens, and from Tokens we then generate S-101 data.
To implement this solution, we have developed the following tools:
  • Token Dictionary — built on the basis of merging the S-57 and S-101 formats while eliminating all duplicate parameters; in other words, each hydrographic entity is described once according to the rules of the universal S-100 data model.
  • Universal Conversion Program — Tokenizer, which performs transformations on any data described according to the rules of the universal S-100 model.
  • Conversion Rules for transforming S-57 and S-101 formats into Tokens and back.

QC and Risk Management

Thus, using the Tokenizer program, it is possible to very easily and without significant investment, and without engaging additional personnel or resources, produce charts in the S-101 format based on the existing collection of S-57 charts. What is important, however, is the quality of the resulting ENCs and the management of additional risks that inevitably arise due to the production of additional publications.

To assess the quality of ENCs in the S-101 format, we have developed the S-101 Inspector, which also operates in console mode, allowing for data stream verification. In addition, we have added the capability for automatic error correction to the S-57 Editor, which significantly reduced the time required for data preparation. The same functionality has been implemented in the S-101 Editor, which automatically corrects specific standard requirements. As a result, we obtained the capability to quickly and efficiently produce ENCs in the S-101 format based on official charts published in the S-57 format.

In terms of performance, the Tokenizer operates quite efficiently: a medium-sized collection of 300–500 ENCs is converted within several minutes, with each chart typically taking only a few seconds.

But is this sufficient for the release of official charts? No, it is not. The parallel publication of charts in two formats not only implies additional resources and budgets but also introduces additional risks. These risks are associated with the fact that charts in S-57 and S-101 formats, belonging to the same geographic region and the same scale band, must provide identical information to the mariner. Therefore, the question arises — how can we compare charts in two formats?

Looking ahead, we can say that we see no other way to perform such comparison except through the token mechanism. The only viable approach is to analyze the equality of meanings (semantics), rather than syntax (formats).

The point is that comparing the contents of electronic charts is practically equivalent to evaluating the quality of translation from one language to another. Letter-by-letter or word-by-word comparison does not work, even when direct and reverse translation are verified by tools from the same vendor — and even less so when translators from different suppliers are used. Meanwhile, in cartography, it is critically important to verify data quality using alternative products, which is what happens everywhere in practice.

With the use of tokens, the task of comparing charts in different formats is significantly simplified — we consider charts equal in content if the tokens they contain are identical. Taking into account that tokens are stored in open XML format, any suitable third-party software can be used for verification. In our case, we use the dKart VS program.
More about the improvement of the dKart Evolution technology and about error types can be found in the article “Tokenizing.”

From manual to automatic data production

After the quality control criteria for ENCs in the S-101 format have been developed and implemented, and once we have a tool that guarantees the equivalence of the two collections, we can begin the industrial production of charts in both formats.

By using tokens, we avoid the problem of expensive parallel production, since we store, edit, and correct data only once and in one place, while ENCs in S-57 and S-101 formats are obtained through automatic conversion.

For editing tokens, we have developed the dKart S-101 Editor, which can work both with tokens and with ENCs in the S-101 format. In addition, we use the dKart DELTA software module, which enables automatic data editing based on the analysis and processing of incoming information.

dKart DELTA works with text messages, data in XML format, results of queries to external databases, bathymetric and topographic survey data, and so on. The source message is analyzed and interpreted to extract meaningful information; then, for all datasets and scale bands, a search is carried out for the tokens to which the message refers, after which the found tokens are automatically edited.

Let us consider in more detail how this works.

The first example is quite simple —
In a similar way, the system finds all token sets related to this message and performs automatic data processing. The new data is generalized to the required scale and integrated with the information inside the set.

With the automated processing of bathymetric data, it is possible to significantly reduce the share of manual labor. Nevertheless, it still implies the participation of a cartographer in the production and the coordination of his work with automatic production. Thus, the next logical step is the construction of an automated management system.
The system finds all token sets to which the given message relates and automatically adds the light with the specified attributes. After that, the chart corrections in S-57 and S-101 formats are generated automatically.

Similar types of messages are processed in the same way, for example:

  Yellow pillar buoy, Fl.Y.5s ODAS, have been deployed, until further notice, in the following position: 58° 01´·30N., 23° 25´·57E.

  Change the season of the buoy to seasonal according to the NMA: 2247.5 Right side of chine 5 marker at 59°32.2'N - 24°46.4'E. Season: 01.06-31.12

  Add yellow special purpose Fl Y 5s buoys with yellow light to the locations: 1. 57.957178°N - 023.946460°E 2. 57.966157°N - 023.946447°E 3. 57.948191°N - 023.929587°E 4. 57.948181°N - 023.912701°E 5. 58.011145°N - 024.098586°E 6. 58.020124°N - 024.098611°E 7. 58.002179°N - 024.081649°E 8. 58.002189°N - 024.064737°E

The system also processes message lists and information in tabular form.
Examples of work on automatic processing of input messages are available at the link https://pd.bgeo.fi/
login: demo
password: demo

The second example is more complex and concerns the processing of bathymetric information –
a navigational light is established at coordinates...
new hydrographic survey data has appeared.

Automatic resource management

dKart ERM (Enterprise Resource Management) allows for efficient management of data production through automatic monitoring of production processes, their coordination, timely initiation of tasks, and optimal resource allocation. The program automatically monitors changes in the data production system and carries out the formation of tasks in manual and automatic modes.
In a short example, it is difficult to present all the variants of the system's operation; the main thing is the thorough formalization of business processes on the current technological basis, taking into account the use of new tools and new management algorithms. Gradually, manual management will be replaced by automatic.
ERM Messages:
Operator Response:
System Actions
To launch
dKart Patrol
auto check every 5 min
new S-57 data
To launch
dKart S-57 Editor
with auto fix - ON
new S-57 data

To Launch Tokenizer
To launch
S-101 Inspector
To launch
dKart DELTA
To launch
S-101 Editor
with auto fix - ON
To inform
cartographers
to analyze the issue
New S-57 charts have appeared
in the system.
Convert them to S-101?
YES
Should we QC&Validate
new S-101 ENC?
YES
New messages have appeared –
process them?
YES
...
Check the equality
S-57 vs S-101 portfolio?
YES
Bugs found
In new S-101 ENC
Should we fix it automatically?
YES
Two S-101 charts are not equal to S-57.
Should we inform
cartographers?
YES
To launch
dKart VS

Conclusions

Modern requirements for marine electronic cartography are constantly increasing and becoming more complex, while at the level of national maritime administrations, problems with budget cuts and a shortage of qualified cartographers are widespread and constant. Under these conditions, the transition to a higher level of automation in the production of cartographic data is the only answer to modern challenges.

dKart Evolution offers a gradual, economical transition to automated production based on modern data processing technologies, a critical understanding of new requirements, and a scalable approach. We offer for use both the entire system as a whole and its individual components. It is important to note that dKart Evolution is built on an open architecture and works with data in an open format. This ensures the use of third-party resources for supporting and improving the system, does not create bottlenecks, and guarantees continuous development.