In December, 2009 the New South Wales Office of Water (NOW) in Australia contracted with KISTERS Australia to implement a new organization-wide advanced sampling data management system. The new system would retire their 15-year-old, in-house water quality system with upgrade it with a modern commercial package.
KISTERS' water quality module (KiWQM) is designed for the efficient and effective management, analysis, and reporting of sampling data, which comprises water quality, ecological analysis and air quality.
Capabilities enable a wide range of functions and calculations for analysis, interpretation and comparison of sampling data. Furthermore, implementation of ESRI's ArcGIS Engine empowers users to manage, access and analyze data with a spatial perspective.
KiWQM is based on KISTERS' advanced WISKI technology and functionality. The technology comprises a three-tier architecture with a database layer, which is MS SQL at NOW; the KiTSM business logic layer; and the KiWQM application layer.
Through the application of KiTSM, sample data is processed as soon as data have entered the system. Data validation and correction, in addition to analysis, can be automated. Examples include calculation of annual percentiles, long-term statistics, or specific routines such as ionization balancing. In terms of standard functionality KiWQM comprises the flexible WISKI metadata framework, the agent and operation frameworks, the KiScript scripting language and user administration.
The water quality data system installed at NOW also comprises the distributed service manager (KiDSM) and the alarm manager (KiAM). KiDSM allows lab results, which are automatically imported into the system - on a predefined schedule or on-demand. KiAM informs project managers about potential water quality or algae issues by email or text message as soon as they are reported.
A main focus of the implementation of the new system for managing water quality samples was the seamless integration with existing systems, in particular Hydstra, which handles all time series data. Users can now work on water quality metadata and sample data and time series data in the same platform.
In addition export KiWQM data directly to the Hydstra WQ warehouse, where it can be treated as any other data sources and exposed to Hydstra functionality. It can potentially be published to Hydstra/Web or exported to the Australian Bureau of Meteorology (BOM) in WDTF format.
A major part of the implementation of the new system was the migration of legacy data into the KiWQM database. This included information from more than 20,000 sampling stations, 500,000 samples, and 3.5 million lab results. The newly-built KiWQM batch import framework, a flexible tool to import bulk data seamlessly into the data structure, spared data managers from unnecessary headache and frustration.
Following the complete migration of data, KiWQM became available to staff from a variety of stakeholders from different New South Wales departments that require water quality data.