Forecast Accuracy Comparisons - for Beaumaris Weather Station


Beaumaris Weather ( Upper East Coast Tasmania ) provides forecasts that are generated every 3 hours daily using ( WxSim ). Below are Tables and Graphs comparing our ( WxSim ) Forecast to our Actual Observations, also includes our ( WxSim ) forecast ahead.

Forecast Accuracy Comparisons - by GFS Runs  ( 00z - 06z - 12z - 18z )


WxSim vs Actual ( Min and Max ) Temperature Comparison by Day Actual Observed (Act), WxSim Generated (WS)
All WxSim latest.csv data is injected into MySql Tables for each GFSz Run
( Minimum and Maximum Temps are Daily Min/Max from WxSim Temperature field )
( High Range and Low Range Temps are Daily Min/Max from WxSim ( HiTemp and LowTemp ) fields )
      Min Date :   Fri 19 Mar 2021              Max Date :   Wed 20 Nov 2024    ( on Record )
Select Dates :                         
            Total Days Selected :               Total Days on Record : 1343

Early Morning - GFS 12z Run - ( 5:15 AEDT )

( If ± 2.0° C          ) or ( if ± 5.0° C          ) or ( if between   +/-   )

Goal Min Temp Compare Max Temp Compare
± 2.0° C Minimum Low Range Maximum High Range
Date Act WS Delta WS Delta Act WS Delta WS Delta
2024-11-209.39.90.69.40.119.019.00.020.11.1
2024-11-195.45.70.35.2-0.217.120.23.120.83.7
2024-11-188.410.92.510.92.520.119.7-0.420.70.6
2024-11-1713.612.8-0.812.5-1.121.419.0-2.420.3-1.1
2024-11-1612.112.80.712.50.421.119.5-1.620.4-0.7
2024-11-159.79.80.19.5-0.215.215.1-0.116.21.0
2024-11-1411.812.00.211.7-0.117.716.0-1.717.0-0.7
2024-11-1313.413.70.313.40.027.020.3-6.721.5-5.5
2024-11-127.89.01.28.40.622.322.70.423.81.5
2024-11-119.29.60.48.9-0.325.222.8-2.423.2-2.0

( If > 80 %          ) or ( if < 45 %          ) or ( if between          )

Min Temp Success Max Temp Success
Minimum Low Range Maximum High Range
Success % Avg Error ° C Success % Avg Error ° C Success % Avg Error ° C Success % Avg Error ° C
90.00.790.00.660.01.980.01.8

Late Morning - GFS 18z Run - ( 11:15 AEDT )

( If ± 2.0° C          ) or ( if ± 5.0° C          ) or ( if between   +/-   )

Goal Min Temp Compare Max Temp Compare
± 2.0° C Minimum Low Range Maximum High Range
Date Act WS Delta WS Delta Act WS Delta WS Delta
2024-11-209.310.51.210.20.919.018.9-0.120.01.0
2024-11-195.47.01.66.71.317.119.52.420.33.2
2024-11-188.410.52.110.42.020.119.8-0.320.80.7
2024-11-1713.613.3-0.313.0-0.621.420.9-0.521.60.2
2024-11-1612.113.21.112.90.821.119.4-1.720.5-0.6
2024-11-159.710.30.610.00.315.215.60.416.81.6
2024-11-1411.811.7-0.111.4-0.417.717.70.018.71.0
2024-11-1313.414.00.613.70.327.025.2-1.825.9-1.1
2024-11-127.87.80.07.2-0.622.321.5-0.822.50.2
2024-11-119.28.3-0.98.1-1.125.223.8-1.424.2-1.0

( If > 80 %          ) or ( if < 45 %          ) or ( if between          )

Min Temp Success Max Temp Success
Minimum Low Range Maximum High Range
Success % Avg Error ° C Success % Avg Error ° C Success % Avg Error ° C Success % Avg Error ° C
90.00.9100.00.890.00.990.01.1

Afternoon - GFS 00z Run - ( 17:15 AEDT )

( If ± 2.0° C          ) or ( if ± 5.0° C          ) or ( if between   +/-   )

Goal Min Temp Compare Max Temp Compare
± 2.0° C Minimum Low Range Maximum High Range
Date Act WS Delta WS Delta Act WS Delta WS Delta
2024-11-209.310.81.510.51.219.019.40.420.51.5
2024-11-195.47.01.66.71.317.119.62.520.33.2
2024-11-188.410.11.710.01.620.119.9-0.220.80.7
2024-11-1713.612.6-1.012.4-1.221.420.0-1.421.40.0
2024-11-1612.113.11.012.90.821.118.9-2.219.6-1.5
2024-11-159.710.81.110.60.915.214.7-0.515.40.2
2024-11-1411.811.0-0.810.7-1.117.716.2-1.517.0-0.7
2024-11-1313.412.5-0.912.2-1.227.022.2-4.823.3-3.7
2024-11-127.88.50.78.10.322.322.80.523.91.6
2024-11-119.28.7-0.58.5-0.725.223.8-1.423.8-1.4

( If > 80 %          ) or ( if < 45 %          ) or ( if between          )

Min Temp Success Max Temp Success
Minimum Low Range Maximum High Range
Success % Avg Error ° C Success % Avg Error ° C Success % Avg Error ° C Success % Avg Error ° C
100.01.1100.01.070.01.580.01.5

Late Evening - GFS 06z Run - ( 23:15 AEDT )

( If ± 2.0° C          ) or ( if ± 5.0° C          ) or ( if between   +/-   )

Goal Min Temp Compare Max Temp Compare
± 2.0° C Minimum Low Range Maximum High Range
Date Act WS Delta WS Delta Act WS Delta WS Delta
2024-11-209.39.40.19.0-0.319.018.8-0.219.90.9
2024-11-195.46.61.26.00.617.119.92.820.53.4
2024-11-188.410.21.89.71.320.119.8-0.320.80.7
2024-11-1713.613.60.013.2-0.421.418.8-2.620.1-1.3
2024-11-1612.112.10.011.8-0.321.118.3-2.819.6-1.5
2024-11-159.710.91.210.60.915.214.8-0.415.70.5
2024-11-1411.811.80.011.5-0.317.716.2-1.517.2-0.5
2024-11-1313.414.00.613.60.227.021.2-5.822.3-4.7
2024-11-127.87.3-0.56.8-1.022.323.61.324.42.1
2024-11-119.29.1-0.18.6-0.625.222.7-2.523.1-2.1

( If > 80 %          ) or ( if < 45 %          ) or ( if between          )

Min Temp Success Max Temp Success
Minimum Low Range Maximum High Range
Success % Avg Error ° C Success % Avg Error ° C Success % Avg Error ° C Success % Avg Error ° C
100.00.6100.00.650.02.060.01.8


The 4 selectable Graphs below reflect ( Max / Min ) and ( High / Low Range ) Temp Delta data from the above Tables

Note: Although GFS Runs are only made available every 6 Hours, we elect to ( re-forecast, using WxSim ) every 3 Hours in order to adjust and predict the next 3 hours based on our onsite ( recent / current ) conditions. The Graph below contains a greyed out series called ( WxSim Fcst Temp ), clicking it will display the current ( 3 Hourly - re-forecast ) in order to compare against the original GFS Runs.



Forecast Temperature Comparison - ( Realtime Rolling 7 Days (+) Forecast Ahead )

 


Forecast - Mean Absolute Error - Check ( MAE )


This Graph compares the Mean Absolute Error (MAE) from the forecasts generated each day since 09 Dec 2019. MAE is the mean absolute temperature error for the data analyzed, during the forecast process in ( WXSIM / Wret ) and is displayed in degree °C and °F. Also compares the Mix Percentage of WxSim-Lite ( bias corrections ) used in our final WxSim Modelling for the forecasts generated each day since 09 Dec 2019. The Current Target is set to 55% influence on temperature and dew point from WXSIM-Lite data, changed from 46% to 55% on Sunday 29th August 2021.

Current Records as of  Thu 21 Nov 2024  |  MAE : 1.31 °C | 2.36 °F  |  WXSIMLite MIX Percent : 50.4 %
MAE is ( 0.04 °C | 0.07 °F ) Higher than Yesterday. 0.04 °C  /  0.07 °F Higher than Yesterday.
Min MAE  WAS  0.75 °C | 1.35 °F  ON  Tue 21 Nov 2023
Max MAE  WAS  2.43 °C | 4.37 °F  ON  Wed 09 Oct 2024
Max MIX Percent  WAS  63.0 %  ON  Fri 25 Sep 2020
Note : Drag Mouse over an area on charts to zoom into more detail.

WXSIM - Learning Routine Runs from WRET
Note: The Charts below display the Daily Difference between ( MAE - pred ), ( MAE - raw ) and ( MAE, pred, raw ).
The goal is for the ( MAE ) to get smaller than the ( raw ), and hopefully almost as small as the ( pred ).
  MAE  is the mean absolute temperature error for the data analyzed.
  pred  is the approximate MAE the run would have had with the new bias corrections (and likely value for subsequent runs).
  raw  is the approximate MAE the analyzed data would have had with no bias corrections (and = MAE if none were in effect).
  Some Stats since Records began on the 09th of Dec 2019
  MAE  has been equal to  pred  ( 158 )  Times.
  Select Series ( MAE (=) Pred ) below Chart to view when they occurred.  ( Value set as 0.5 in order to highlight time of occurrence )

  MAE  has never been less than  pred.




WxSim ErrDate & ErrDep (Autolearn - Error Correction Graphs) Run at 01:15(AEST) each day.

WXSIM - ErrDate - Graph
WXSIM - ErrDate - Graph
Last Uploaded on : 21 November 2024 17:13:31.
WXSIM - ErrDep - Graph
WXSIM - ErrDep - Graph
Last Uploaded on : 21 November 2024 17:13:31.

WXSIM Forecast WRET Image

WXSIM Forecast Analysis Display (WRET Image)
WxSim Auto Generated Image above ( ./data/latest.png ) Last Uploaded on : 21 November 2024 17:13:31.

WXSIM Onsite Forecast - GFS Data Check ( Forecasts run 3 Hrly and GFS runs are 6 Hrly )

Next 3hr ( 00z ) Beaumaris Onsite WxSim Re-Forecast due on ( Thu 21 at 20:15 AEDT )
 GFS Runs ( 00z - 06z - 12z - 18z ) 3 Hrly Check ( WxSim Data )
  1  All Good - Bohler WXSIM-Lite - Last was ( 2024-11-21-00 z ) and Last Should Be ( 2024-11-21-00 z )
 GFS Runs ( 00z - 06z - 12z - 18z ) 6 Hrly Check ( Bohler Data )
  0  Bohler GFS-Data ( 00 z ) - Available    0  Bohler GFS-Adv ( 00 z ) - Available
Please Note : Admin is automatically emailed in the event a GFS Run is not available for injection into our onsite WxSim Forecast.