Exportiert Zeitreihen aus WISKI

Der Exporter führt Zeitreihenexporte aus WISKI (mittels WiskiPlotMap) durch und wird über eine INI-Datei mit der Sektion EXPORTER ausgeführt.

Aus einer WISKI-Gruppe (groups) werden Dateien im Exportintervall (days oder interval) exportiert und in einer Datei (filename) geschrieben.

python prozessing.pyz export_xxxx.ini

perl exporter.pl -iniFile [file]

perl exporter.pl -iniFile [file] -logLevel [DEBUG|INFO|WARN|ERROR] -logDir [logs]

INI-Datei: exporter

[EXPORTER]
groupPurpose =          # Group purpose name in WISKI
group =                 # Group name in WISKI (use `*` to export all groups of the group purpose)
filename =              # Pattern for path/filename, Default: {ts.path}.zrxp
days =                  # A number of days between back then and now
fullDays =              # A number of days between back then and end of current day
format =                # Export timeseries in the specified format, Default: ZRXP
interval =              # An interval of the format 'datetime/datetime', 'datetime/period' or 'period/datetime'
dateTimeFormatter =     # Formatter for timestamp
timezone =              # timezone for the exported timestamp, Default: +01:00
numberPattern =         # Pattern to format numbers (cf. java.text.DecimalFormat)
dataLinePattern =       # A pattern string which defines the data line in the export, e.g., "{name};{number};{datetime};{value};{unit}"
decimalSeparator =      # Character used as decimal separator
fieldSeparator =        # Characters used to separate timestamp from value
no_header =             # Whether to export the ZRXP header
headerOncePerFile =     # Whether to export the ZRXP header only for the first timeseries per file
headerTemplate =        # A template file which defines the file header in the export
transformation =        # Apply WISKI transformation, e.g. Mean(day)
missingValue =          # Characters used to replace missing values
lastEntry =             # Export last non-null entry only
skipRemainingMissingValues = # Skip all null entries at the end of the export period
path = # Timeseries paths pattern, [site number]/[station number]/[parameter number]/[timeseriesshortname]
config = # WiskiPlotMap properties file, Default: [wiski.properties]
configOverride = # Override config entries

Unicode escape characters are evaluated. For instance, use \u0020 for a space.

Variablen für header, dataLinePattern oder filename

VariableBeschreibung
WTO_OBJECTGewässername
GAUGE_DATUMPegelnullpunkt der Stations
GWREF_DATUMMesspunkthöhe der Station
altitudeStationshöhe
numberStationsnummer
station.numberStationsnummer
nameStationsname
station.nameStationsname
parameterParametername
timeseriesZeitreihenname
datetimeZeitstempel
valueWert
value.statusStatus des Werts
absvalueWert der Absolutspalte
absvalue.statusStatus der Absolutwertspalte
WISKI-StammdatenKurzname des Stammdatenfelds in WISKI (HYDAMS_Nummer, STA_ATTR_OWNER, …)

INI-Beispiele

Export aus Zeitreihengruppen

[EXPORTER]
groupPurpose = Datenlieferungen
group        = export-HD-oesterreich
filename     = ftp://YYYYYY:DDDDDDDDDDDD@ftp.server.at/HD-HD/Bundesland/Pegel/Export.zrx
fullDays     = 2
#ZRXPCREATORWiskiPlotMap|*|
#SNAMESalzburg (Nonntaler Brücke)|*|
#SANR204180|*|
#RINVAL-777|*|
#CUNITm³/s|*|
#CNAMEQ|*|
#TSPATH/177531/204180/Q/15m.Cmd.RunOff|*|
#REXCHANGE204180_Q|*|
#SWATERSalzach|*|
20200303000000 120.75
20200303001500 116.75
20200303003000 108.75
...
20200304234500 -777
20200305000000 -777

#ZRXPCREATORWiskiPlotMap|*|
#SNAMESalzburg (Nonntaler Brücke)|*|
#SANR204180|*|
#RINVAL-777|*|
#CUNITcm|*|
#CNAMEW|*|
#TSPATH/177531/204180/W/15m.Cmd.WiskiWeb|*|
#REXCHANGE204180_W|*|
#SWATERSalzach|*|
20200303000000 205
20200303001500 204

HyDaMs-Export mit headerTemplate

[EXPORTER]
groupPurpose = Datenlieferungen
group        = export-HyDaMS-NLV-LT
filename     = //servername/o/Hydro_Importdaten/NLV/LT.ascii
fullDays     = 38
missingValue = \u0020
headerTemplate = J:/Data/wiski/ini/HyDaMS_NLV_LT.tmpl.txt
dateTimeFormatter = dd.MM.yyyy HH:mm:ss
numberPattern = 0.00
# headerTemplate
BEGIN
Parameter: Temperatur
Ort: {WISKIZA_DBMS_Nr}
DefArt: K
Herkunft: O
Quelle:
Reihenart: Z
Version: 0
X: 0
Y: 0
Einheit: {unit}
Messgenau:
FToleranz:
NWGrenze:
Kommentar: {station.number}-Datensammlerwerte
Hoehe: 0
Werte:
BEGIN
Parameter: Temperatur
Ort: 5002171
DefArt: K
Herkunft: O
Quelle:
Reihenart: Z
Version: 0
X: 0
Y: 0
Einheit: °C
Messgenau:
FToleranz:
NWGrenze:
Kommentar: 104240-Datensammlerwerte
Hoehe: 0
Werte:
27.01.2020 00:00:00 1.00
27.01.2020 00:15:00 1.20
27.01.2020 00:30:00 0.50
27.01.2020 00:45:00 0.60

BEGIN
Parameter: Temperatur
Ort: 5002169
DefArt: K
Herkunft: O
Quelle:
Reihenart: Z
Version: 0
X: 0
Y: 0
Einheit: °C
Messgenau:
FToleranz:
NWGrenze:
Kommentar: 104224-Datensammlerwerte
Hoehe: 0
Werte:
27.01.2020 00:00:00 -0.10
27.01.2020 00:15:00 -0.10
27.01.2020 00:30:00 0.10

OGD-Export

[EXPORTER]
groupPurpose = Datenlieferungen
group        = export-OGD-Seen
filename     = //servername/n/ordner/data/Hydrografie.txt
fullDays     = 1
missingValue = --
no_header    = 1
dateTimeFormatter = yyyy.MM.dd HH:mm
dataLinePattern   = {name};{WTO_OBJECT};{GAUGE_DATUM};{GWREF_DATUM};{datetime};{value}{unit};{WISKIZA_Koord_RW};{WISKIZA_Koord_HW}
numberPattern = 0.0
Zell am See (Seepegel);Zeller See;2020.03.04 00:00;189.0cm;409750;242790
Zell am See (Seepegel);Zeller See;2020.03.04 00:15;189.0cm;409750;242790
...
Obertrum (Seepegel);Obertrumer See;2020.03.04 00:00;4.5°C;430370;311630
Obertrum (Seepegel);Obertrumer See;2020.03.04 06:00;4.3°C;430370;311630
...

Export von Absolutwertspalte und Status des Absolutwerts mit Rundung

[EXPORTER]
path = CH/HG2060/W/15m.Cmd.RelAbs.O
interval = P1Y/now
dateTimeFormatter = yyyy.MM.dd HH:mm
dataLinePattern   = {datetime} {absvalue} {absvalue.status}
numberPattern = 0.0

Export im SMET-Format for SNOWPACK

[EXPORTER]
groupPurpose = Export
group = Export-Infra.Wetter-Snowpack
filename = F:/Datenmanagement/export/oebb_infra_wetter_smet/{LWD-Nummer:-number}.smet.gz
interval = 2019-09-01/now
config = F:/Datenmanagement/ini/export_oebb_smet.properties
numberPattern = 0.###
missingValue = -999
format = SMET

Benötigt eine SMET-Konfiguration.

SMET 1.1 ASCII
[HEADER]
station_id = SOBP1
station_name = Schoberpass Windstation
latitude = 47.4421
longitude = 14.6375
altitude = 1893.0
source =
nodata = -999
creation = 2020-03-04T14:11:34.771285Z
fields = timestamp RH TA VW VW_MAX DW
#parameters = timestamp LF LT WG WG.Boe WR
#units = ISO8601 1 K m/s m/s °
[DATA]
2019-08-31T22:00:00Z 0.829 286.15 9.01 11.72 195
2019-08-31T22:10:00Z 0.832 286.25 6.63 8.53 200
2019-08-31T22:20:00Z 0.829 286.25 5.3 7.56 197
2019-08-31T22:30:00Z 0.836 286.15 4.26 5.44 204
...