Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements.  See the NOTICE file distributed with
this work for additional information regarding copyright ownership.
The ASF licenses this file to You under the Apache License, Version 2.0
(the "License"); you may not use this file except in compliance with
the License.  You may obtain a copy of the License at

    http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.

Model: chardetect.bin (28 classes, post-stride-2 retrain, 2026-04-17)
Devtest corpus: 33 classes = 28 TODAY_SBCS_INCLUDE + EUC-KR (CharsetSupersets test) + UTF-16-LE/BE + UTF-32-LE/BE
Columns: Stat=model only | +ISO=+STRUCTURAL_GATES+C1-correction | +CJK=+grammar | All=ML+rules
Metrics:  R%=strict  S%=soft  T3%=top-3  D%=decode-match  A%=alpha-match
Baselines: ICU4J, juniversalchardet
Note: results are Mojibuster ablations only — no CharSoup arbitration (see charset-20260417-plan.md TODO).

=== Probe length: 20B ===
                            N  | --- ML ablation --------------------------------------------------- | --- Baselines --------------------------------- |
Charset                        | Stat R%   S%  T3%  D%   A%  | +ISO R%   S%  T3%  D%   A%  | +CJK R%   S%  T3%  D%   A%  | All  R%   S%  T3%  D%   A%  | ICU4J R%   S%  T3%  D%   A%  | juniv R%   S%  T3%  D%   A%  |
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Big5-HKSCS              30334  |  79.7  79.7  80.5  83.8  83.8  |  80.6  80.6  81.6  84.7  84.7  |  80.6  80.6  81.6  84.7  84.7  |  80.6  80.6  81.6  84.7  84.7  |   0.0  14.5  71.8  16.8  17.1  |   0.0  44.7  44.7  47.2  47.5  |
EUC-JP                  37043  |  79.9  79.9  81.2  87.2  87.6  |  79.6  79.6  80.9  86.9  87.3  |  79.6  79.6  80.9  86.9  87.3  |  79.6  79.6  80.9  86.9  87.3  |   0.0   0.0  14.8   6.8   7.8  |  64.6  64.6  64.6  71.9  72.9  |
EUC-KR                  36883  |   0.0  89.8  90.2  89.8  89.9  |   0.0  87.4  87.8  90.3  90.4  |   0.0  87.4  87.8  90.3  90.4  |   0.0  87.4  87.8  90.3  90.4  |   0.0   0.0  28.6   2.8   3.0  |  83.9  83.9  83.9  86.7  87.0  |
GB18030                 36862  |  76.4  76.4  77.1  82.4  82.6  |  76.8  76.8  77.5  83.0  83.1  |  76.8  76.8  77.5  83.0  83.1  |  76.8  76.8  77.5  83.0  83.1  |   0.1   0.1   7.8   6.0   6.6  |  46.1  46.1  46.1  52.1  52.8  |
IBM500                  31455  |  95.8  95.8  95.8  95.8  95.8  |  62.0  62.0  62.0  62.0  62.0  |  62.0  62.0  62.0  62.0  62.0  |  62.0  62.0  62.0  62.0  62.0  |  92.1  92.1  98.3  92.1  92.1  |   0.0   0.0   0.0   0.0   0.0  |
IBM850                  30539  |  36.0  36.0  41.9  96.2  96.3  |  36.2  36.2  41.9  96.4  96.4  |  36.2  36.2  41.9  96.4  96.4  |  36.2  36.2  41.9  96.4  96.4  |   0.0   0.0   0.0  56.5  57.3  |   0.0   0.0   0.0  57.4  58.3  |
IBM852                  35403  |  50.4  50.4  58.3  96.8  96.8  |  50.5  50.5  58.0  96.8  96.8  |  50.5  50.5  58.0  96.8  96.8  |  50.5  50.5  58.0  96.8  96.8  |   0.0   0.0   0.0  39.2  39.4  |   0.0   0.0   0.0  40.8  41.1  |
IBM855                  36702  |  89.5  89.5  89.7  91.3  91.3  |  89.6  89.6  89.9  91.4  91.4  |  89.6  89.6  89.9  91.4  91.4  |  89.6  89.6  89.9  91.4  91.4  |   0.0   0.0   0.0   1.7   1.7  |  93.1  93.1  93.1  94.8  94.9  |
IBM866                  36985  |  93.4  93.4  93.9  95.6  95.6  |  94.1  94.1  94.6  96.3  96.3  |  94.1  94.1  94.6  96.3  96.3  |  94.1  94.1  94.6  96.3  96.3  |  52.3  52.3  79.1  54.4  54.4  |  94.9  94.9  94.9  97.0  97.0  |
ISO-8859-16             32899  |  50.1  50.1  99.8  99.0  99.0  |  48.9  48.9  49.7  97.7  97.7  |  48.9  48.9  49.7  97.7  97.7  |  17.6  17.6  17.8  97.7  97.7  |   0.0   0.0   0.0  84.2  84.6  |   0.0   0.0   0.0  82.1  82.8  |
ISO-8859-3              35648  |  46.3  46.3  47.7  98.7  98.7  |  46.0  46.0  47.2  98.4  98.4  |  46.0  46.0  47.2  98.4  98.4  |  45.3  45.3  46.5  98.4  98.4  |   0.0   0.0   0.0  50.9  50.9  |   0.0   0.0   0.0  53.2  53.2  |
KOI8-R                  36850  |  79.0  93.5  93.8  95.7  95.7  |  79.0  93.5  93.8  95.7  95.7  |  79.0  93.5  93.8  95.7  95.7  |  79.0  93.5  93.8  95.7  95.7  |  66.6  66.6  77.7  68.6  68.6  |  96.1  96.1  96.1  98.3  98.3  |
KOI8-U                  36846  |  84.2  96.3  96.4  96.8  96.8  |  84.2  96.2  96.4  96.8  96.8  |  84.2  96.2  96.4  96.8  96.8  |  84.2  96.2  96.4  96.8  96.8  |   0.0  59.5  73.2  19.3  19.4  |   0.0  97.1  97.1  33.2  33.2  |
Shift_JIS               36917  |  83.4  83.4  84.7  90.6  90.8  |  79.4  79.4  81.3  86.6  86.7  |  79.4  79.4  81.3  86.6  86.7  |  79.4  79.4  81.3  86.6  86.7  |   0.0   0.0   2.9   6.9   7.3  |  67.2  67.2  67.2  74.4  75.0  |
UTF-16-BE               36799  |   0.0   0.0   0.0   0.0   0.0  |  92.2  92.2  92.2  92.2  92.2  |  92.2  92.2  92.2  92.2  92.2  |  92.2  92.2  92.2  92.2  92.2  |  36.5  36.5  38.6  36.5  36.5  |   0.0   0.0   0.0   0.0   0.0  |
UTF-16-LE               36736  |   0.0   0.0   0.0   0.0   0.0  |  92.4  92.4  92.4  92.4  92.4  |  92.4  92.4  92.4  92.4  92.4  |  92.4  92.4  92.4  92.4  92.4  |  36.8  36.8  39.0  36.8  36.8  |   0.0   0.0   0.0   0.0   0.0  |
UTF-32-BE               36757  |   0.0   0.0   0.0   0.0   0.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  |   0.0   0.0   0.0   0.0   0.0  |
UTF-32-LE               37011  |   0.0   0.0   0.0   0.0   0.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  |   0.0   0.0   0.0   0.0   0.0  |
UTF-8                   36254  |  75.3  75.3  93.3  92.4  92.4  |  78.9  78.9  78.9  96.1  96.1  |  78.9  78.9  78.9  96.1  96.1  |  78.9  78.9  78.9  96.1  96.1  |  82.0  82.0  91.4  97.9  97.9  |  81.9  81.9  81.9  99.0  99.0  |
windows-1250            34499  |  33.9  33.9  51.1  89.2  89.5  |  33.9  33.9  50.7  88.7  89.0  |  33.9  33.9  50.7  88.7  89.0  |  20.7  20.7  34.3  88.7  89.0  |  11.2  54.0  88.8  83.5  83.5  |   0.0   0.0   0.0  58.5  62.2  |
windows-1251            36852  |  93.0  93.0  93.2  94.9  94.9  |  93.0  93.0  93.2  94.9  94.9  |  93.0  93.0  93.2  94.9  94.9  |  93.0  93.0  93.2  94.9  94.9  |  60.2  60.4  76.0  62.2  62.2  |  74.4  74.5  74.5  76.3  76.5  |
windows-1252            25874  |  22.1  22.1  29.3  88.3  88.4  |  73.8  73.8  80.9  87.9  88.0  |  73.8  73.8  81.0  87.9  88.0  |  87.9  87.9  94.7  87.9  88.0  |   3.8  65.8  94.7  88.4  88.4  |   0.0  98.6  98.6  92.8  98.6  |
windows-1253            36845  |  87.4  87.4  87.7  90.7  90.8  |  87.4  87.4  87.7  90.8  90.8  |  87.4  87.4  87.7  90.8  90.8  |  87.4  87.4  87.7  90.8  90.8  |   2.0  72.2  87.0  74.7  74.8  |   0.1  89.9  89.9  89.6  92.4  |
windows-1254            36705  |  60.8  60.8  70.4  86.9  87.0  |  60.8  60.8  70.3  86.7  86.8  |  60.8  60.8  70.3  86.7  86.8  |  50.8  50.8  57.0  86.7  86.8  |   5.3  58.2  84.0  79.6  79.6  |   0.0   0.0   0.0  39.2  43.5  |
windows-1255            31252  |  89.8  89.8  90.1  91.3  91.3  |  89.8  89.8  90.1  91.3  91.3  |  89.8  89.8  90.1  91.3  91.3  |  89.8  89.8  90.1  91.3  91.3  |   6.7  34.0  48.1  34.5  35.5  |  93.9  95.6  95.6  96.6  97.2  |
windows-1256            41912  |  94.0  94.0  94.2  95.4  95.4  |  94.0  94.0  94.2  95.4  95.4  |  94.0  94.0  94.2  95.4  95.4  |  94.0  94.0  94.2  95.4  95.4  |  36.0  59.9  79.6  37.4  37.4  |   0.0   0.0   0.0   1.3   1.4  |
windows-1257            30789  |  30.8  30.8  50.6  67.5  67.6  |  30.9  30.9  50.5  67.4  67.4  |  30.9  30.9  50.5  67.4  67.4  |  23.4  23.4  38.8  67.4  67.4  |   0.0   0.0   0.0  47.3  47.4  |   0.0   0.0   0.0  43.5  49.3  |
windows-1258            36885  |  80.1  80.1  87.5  85.7  85.7  |  80.1  80.1  87.5  85.7  86.1  |  80.1  80.1  87.5  85.7  86.1  |  80.1  80.1  87.5  85.7  86.1  |   0.0   0.0   0.0   5.5   5.6  |   0.0   0.0   0.0   5.3   5.7  |
windows-874             31440  |  76.8  76.8  78.0  85.8  85.8  |  78.2  78.2  79.6  87.2  87.2  |  78.2  78.2  79.7  87.2  87.2  |  78.2  78.2  79.7  87.2  87.2  |   0.0   0.0   0.0   8.9   8.9  |   0.0   0.0   0.0  83.8  94.6  |
x-EUC-TW                26788  |  87.9  87.9  88.3  92.1  92.2  |  88.0  88.0  88.3  92.3  92.3  |  87.9  87.9  88.3  92.3  92.3  |  87.9  87.9  88.3  92.3  92.3  |   0.0   0.0   0.0   4.2   4.4  |  43.9  43.9  43.9  48.2  48.5  |
x-MacRoman               1994  |  15.3  15.3  30.1  70.7  70.8  |  15.6  15.6  30.0  71.0  71.6  |  15.6  15.6  30.0  71.0  71.6  |  15.6  15.6  30.0  71.0  71.6  |   0.0   0.0   0.0  54.6  55.3  |   0.0   0.0   0.0  55.5  56.2  |
x-mac-cyrillic           1773  |  45.4  45.4  45.6  45.4  45.4  |  45.5  45.5  45.7  45.5  45.5  |  45.5  45.5  45.7  45.5  45.5  |  45.5  45.5  45.7  45.5  45.5  |   0.0   0.0   0.0   0.0   0.0  |  51.0  51.0  51.0  51.0  51.0  |
x-windows-949           36719  |  89.9  89.9  90.2  89.9  90.0  |  87.7  87.7  88.0  90.3  90.4  |  87.7  87.7  88.0  90.3  90.4  |  87.7  87.7  88.0  90.3  90.4  |   0.0   0.0  29.0   2.5   2.7  |   0.0  84.2  84.2  86.7  87.0  |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
OVERALL                 1085250  |  60.3  64.2  69.0  78.4  78.5  |  73.5  77.4  80.1  90.6  90.6  |  73.5  77.4  80.1  90.6  90.6  |  71.9  75.8  78.1  90.6  90.6  |  23.1  34.2  45.9  45.1  45.2  |  27.7  40.5  40.5  54.5  55.7  |
  Stat=model only | +ISO=+C1-correction | +CJK=+grammar | All=ML+rules | R%=strict | S%=soft | T3%=top-3 hit | D%=decode-match | A%=alpha-match
  µs/sample                    |                       20.5  |                       15.4  |                       15.0  |                       15.1  |                       23.5  |                        6.7  |

=== Probe length: 50B ===
                            N  | --- ML ablation --------------------------------------------------- | --- Baselines --------------------------------- |
Charset                        | Stat R%   S%  T3%  D%   A%  | +ISO R%   S%  T3%  D%   A%  | +CJK R%   S%  T3%  D%   A%  | All  R%   S%  T3%  D%   A%  | ICU4J R%   S%  T3%  D%   A%  | juniv R%   S%  T3%  D%   A%  |
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Big5-HKSCS              30334  |  96.2  96.2  96.3  97.6  97.7  |  96.4  96.4  96.5  97.8  97.9  |  96.4  96.4  96.5  97.8  97.9  |  96.4  96.4  96.5  97.8  97.9  |   0.0  92.2  95.0  69.8  69.9  |   0.0  79.9  79.9  70.2  70.3  |
EUC-JP                  37043  |  95.2  95.2  95.4  97.1  97.2  |  95.1  95.1  95.3  97.1  97.1  |  95.1  95.1  95.3  97.1  97.1  |  95.1  95.1  95.3  97.1  97.1  |  85.1  85.1  87.2  87.0  87.3  |  89.3  89.3  89.3  91.2  91.4  |
EUC-KR                  36883  |   0.0  96.0  96.1  96.0  96.0  |   0.0  95.5  95.6  96.1  96.1  |   0.0  95.5  95.6  96.1  96.1  |   0.0  95.5  95.6  96.1  96.1  |  93.8  93.8  94.7  94.3  94.4  |  97.5  97.5  97.5  98.1  98.2  |
GB18030                 36862  |  93.8  93.8  93.9  95.7  95.8  |  93.9  93.9  94.1  95.9  95.9  |  93.9  93.9  94.1  95.9  95.9  |  93.9  93.9  94.1  95.9  95.9  |  81.1  81.1  85.6  83.0  83.3  |  87.3  87.3  87.3  89.2  89.5  |
IBM500                  31455  |  99.7  99.7  99.7  99.7  99.7  |  69.9  69.9  69.9  69.9  69.9  |  69.9  69.9  69.9  69.9  69.9  |  69.9  69.9  69.9  69.9  69.9  |  85.4  85.4  99.8  85.4  85.4  |   0.0   0.0   0.0   0.0   0.0  |
IBM850                  30539  |  64.3  64.3  68.4  97.1  97.1  |  64.4  64.4  68.4  97.2  97.2  |  64.4  64.4  68.4  97.2  97.2  |  64.4  64.4  68.4  97.2  97.2  |   0.0   0.0   0.0  30.7  31.4  |   0.0   0.0   0.0  30.8  31.5  |
IBM852                  35403  |  78.1  78.1  84.0  97.1  97.1  |  78.1  78.1  83.9  97.1  97.1  |  78.1  78.1  83.9  97.1  97.1  |  78.1  78.1  83.9  97.1  97.1  |   0.0   0.0   0.0  15.1  15.3  |   0.0   0.0   0.0  15.3  15.6  |
IBM855                  36702  |  99.0  99.0  99.0  99.3  99.3  |  99.0  99.0  99.0  99.3  99.3  |  99.0  99.0  99.0  99.3  99.3  |  99.0  99.0  99.0  99.3  99.3  |   0.0   0.0   0.0   0.3   0.3  |  98.9  98.9  98.9  99.1  99.2  |
IBM866                  36985  |  99.2  99.2  99.3  99.5  99.5  |  99.3  99.3  99.3  99.6  99.6  |  99.3  99.3  99.3  99.6  99.6  |  99.3  99.3  99.3  99.6  99.6  |  75.5  75.5  94.7  75.8  75.8  |  99.0  99.0  99.0  99.3  99.3  |
ISO-8859-16             32899  |  76.0  76.0  99.8  99.3  99.3  |  75.7  75.7  76.2  99.0  99.0  |  75.7  75.7  76.2  99.0  99.0  |  42.1  42.1  42.3  99.0  99.0  |   0.0   0.0   0.0  76.1  76.4  |   0.0   0.0   0.0  68.0  68.5  |
ISO-8859-3              35648  |  79.0  79.0  80.0  99.2  99.2  |  78.9  78.9  79.8  99.0  99.0  |  78.9  78.9  79.8  99.0  99.0  |  78.1  78.1  78.9  99.0  99.0  |   0.0   0.0   0.0  20.9  20.9  |   0.0   0.0   0.0  21.1  21.1  |
KOI8-R                  36850  |  93.9  99.3  99.3  99.6  99.6  |  93.9  99.3  99.3  99.6  99.6  |  93.9  99.3  99.3  99.6  99.6  |  93.9  99.3  99.3  99.6  99.6  |  86.4  86.4  94.8  86.7  86.7  |  99.2  99.2  99.2  99.5  99.5  |
KOI8-U                  36846  |  96.6  99.6  99.6  99.3  99.3  |  96.6  99.6  99.6  99.3  99.3  |  96.6  99.6  99.6  99.3  99.3  |  96.6  99.6  99.6  99.3  99.3  |   0.0  79.4  91.7   5.1   5.1  |   0.0  99.1  99.1   7.1   7.1  |
Shift_JIS               36917  |  95.9  95.9  96.1  97.8  97.8  |  92.9  92.9  93.1  94.7  94.7  |  92.9  92.9  93.1  94.7  94.7  |  92.9  92.9  93.1  94.7  94.7  |  86.9  86.9  87.1  88.7  88.8  |  93.9  93.9  93.9  95.8  95.9  |
UTF-16-BE               36799  |   0.0   0.0   0.0   0.0   0.0  |  96.4  96.4  96.4  96.4  96.4  |  96.4  96.4  96.4  96.4  96.4  |  96.4  96.4  96.4  96.4  96.4  |  69.8  69.8  93.2  69.8  69.8  |   0.0   0.0   0.0   0.0   0.0  |
UTF-16-LE               36736  |   0.0   0.0   0.0   0.0   0.0  |  96.5  96.5  96.5  96.5  96.5  |  96.5  96.5  96.5  96.5  96.5  |  96.5  96.5  96.5  96.5  96.5  |  70.2  70.2  93.3  70.2  70.2  |   0.0   0.0   0.0   0.0   0.0  |
UTF-32-BE               36757  |   0.0   0.0   0.0   0.0   0.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  |   0.0   0.0   0.0   0.0   0.0  |
UTF-32-LE               37011  |   0.0   0.0   0.0   0.0   0.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  |   0.0   0.0   0.0   0.0   0.0  |
UTF-8                   36254  |  85.7  85.7  94.8  93.8  93.8  |  91.6  91.6  91.6  99.7  99.7  |  91.6  91.6  91.6  99.7  99.7  |  91.6  91.6  91.6  99.7  99.7  |  90.4  90.4  95.0  98.4  98.4  |  91.3  91.3  91.3  99.4  99.4  |
windows-1250            34499  |  62.6  62.6  76.8  91.5  92.0  |  62.5  62.5  76.7  91.3  91.9  |  62.6  62.6  76.7  91.3  91.9  |  48.6  48.6  60.5  91.3  91.9  |  25.5  64.7  96.4  81.8  81.8  |   0.0   0.0   0.0  31.9  35.8  |
windows-1251            36852  |  98.9  98.9  99.0  99.3  99.3  |  98.9  98.9  99.0  99.3  99.3  |  98.9  98.9  99.0  99.3  99.3  |  98.9  98.9  99.0  99.3  99.3  |  82.1  82.1  90.8  82.5  82.5  |  83.7  83.7  83.7  84.1  84.1  |
windows-1252            25874  |  43.2  43.2  50.4  89.1  89.2  |  75.2  75.2  82.4  89.0  89.1  |  75.2  75.2  82.4  89.0  89.1  |  88.9  88.9  95.7  89.0  89.1  |   8.2  80.5  98.4  91.1  91.1  |   0.0  98.8  98.8  89.0  98.8  |
windows-1253            36845  |  96.6  96.6  96.6  97.1  97.1  |  96.6  96.6  96.6  97.1  97.1  |  96.6  96.6  96.6  97.1  97.1  |  96.6  96.6  96.6  97.1  97.1  |   5.3  92.7  96.9  91.7  91.7  |   0.2  96.3  96.3  89.7  95.3  |
windows-1254            36705  |  90.7  90.7  94.8  94.9  94.9  |  90.7  90.7  94.8  94.9  94.9  |  90.7  90.7  94.8  94.9  94.9  |  86.0  86.0  88.6  94.9  94.9  |  13.5  80.8  97.0  85.4  85.4  |   0.0   0.0   0.0  10.2  12.3  |
windows-1255            31252  |  98.3  98.3  98.3  98.7  98.7  |  98.3  98.3  98.3  98.7  98.7  |  98.3  98.3  98.3  98.7  98.7  |  98.3  98.3  98.3  98.7  98.7  |  16.1  52.8  63.7  50.9  53.2  |  97.8  98.7  98.7  98.7  99.1  |
windows-1256            41912  |  98.1  98.1  98.1  98.5  98.5  |  98.1  98.1  98.1  98.5  98.5  |  98.1  98.1  98.1  98.5  98.5  |  98.1  98.1  98.1  98.5  98.5  |  42.4  71.9  90.8  42.8  42.8  |   0.0   0.0   0.0   0.4   0.4  |
windows-1257            30789  |  62.5  62.5  80.1  74.9  74.9  |  62.5  62.5  80.0  74.9  74.9  |  62.5  62.5  80.0  74.9  74.9  |  52.7  52.7  65.1  74.9  74.9  |   0.0   0.0   0.0  28.2  28.2  |   0.0   0.0   0.0  25.6  30.3  |
windows-1258            36885  |  98.0  98.0  98.6  98.7  98.7  |  98.0  98.0  98.6  98.7  98.8  |  98.0  98.0  98.6  98.7  98.8  |  98.0  98.0  98.6  98.7  98.8  |   0.0   0.0   0.0   0.8   0.8  |   0.0   0.0   0.0   0.7   0.8  |
windows-874             31440  |  94.2  94.2  94.4  97.1  97.1  |  94.5  94.5  94.7  97.3  97.3  |  94.5  94.5  94.7  97.3  97.3  |  94.5  94.5  94.7  97.3  97.3  |   0.0   0.0   0.0   3.0   3.0  |   0.0   0.0   0.0  80.0  98.9  |
x-EUC-TW                26788  |  97.1  97.1  97.1  98.5  98.6  |  97.1  97.1  97.1  98.6  98.6  |  97.1  97.1  97.1  98.6  98.6  |  97.1  97.1  97.1  98.6  98.6  |   0.0   0.0   0.0   1.5   1.5  |  77.1  77.1  77.1  78.6  78.6  |
x-MacRoman               1994  |  34.9  34.9  57.1  62.2  62.2  |  35.8  35.8  57.5  63.1  63.1  |  35.8  35.8  57.5  63.1  63.1  |  35.8  35.8  57.5  63.1  63.1  |   0.0   0.0   0.0  27.3  27.6  |   0.0   0.0   0.0  27.3  27.7  |
x-mac-cyrillic           1773  |  58.9  58.9  59.0  58.9  58.9  |  58.9  58.9  59.0  58.9  58.9  |  58.9  58.9  59.0  58.9  58.9  |  58.9  58.9  59.0  58.9  58.9  |   0.0   0.0   0.0   0.0   0.0  |  66.9  66.9  66.9  66.9  66.9  |
x-windows-949           36719  |  96.1  96.1  96.1  96.1  96.2  |  95.6  95.6  95.6  96.2  96.2  |  95.6  95.6  95.6  96.2  96.2  |  95.6  95.6  95.6  96.2  96.2  |   0.0  93.9  94.8  94.3  94.4  |   0.0  97.5  97.5  98.0  98.1  |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
OVERALL                 1085250  |  73.6  77.1  79.8  83.3  83.4  |  86.9  90.4  92.1  95.9  95.9  |  86.9  90.4  92.1  95.9  95.9  |  85.3  88.8  90.2  95.9  95.9  |  40.9  59.7  67.1  62.2  62.3  |  33.3  47.9  47.9  53.2  54.6  |
  Stat=model only | +ISO=+C1-correction | +CJK=+grammar | All=ML+rules | R%=strict | S%=soft | T3%=top-3 hit | D%=decode-match | A%=alpha-match
  µs/sample                    |                       25.5  |                       21.5  |                       21.0  |                       21.0  |                       42.4  |                        8.6  |

=== Probe length: 100B ===
                            N  | --- ML ablation --------------------------------------------------- | --- Baselines --------------------------------- |
Charset                        | Stat R%   S%  T3%  D%   A%  | +ISO R%   S%  T3%  D%   A%  | +CJK R%   S%  T3%  D%   A%  | All  R%   S%  T3%  D%   A%  | ICU4J R%   S%  T3%  D%   A%  | juniv R%   S%  T3%  D%   A%  |
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Big5-HKSCS              30334  |  99.6  99.6  99.6  99.7  99.7  |  99.7  99.7  99.7  99.8  99.8  |  99.7  99.7  99.7  99.8  99.8  |  99.7  99.7  99.7  99.8  99.8  |   0.0  99.2  99.4  62.6  62.6  |   0.0  84.3  84.3  62.4  62.4  |
EUC-JP                  37043  |  98.8  98.8  98.8  99.3  99.3  |  98.8  98.8  98.8  99.3  99.3  |  98.8  98.8  98.8  99.3  99.3  |  98.8  98.8  98.8  99.3  99.3  |  97.5  97.5  97.9  98.0  98.0  |  96.4  96.4  96.4  96.8  96.9  |
EUC-KR                  36883  |   0.0  99.0  99.0  99.0  99.0  |   0.0  98.9  98.9  99.0  99.0  |   0.0  98.9  98.9  99.0  99.0  |   0.0  98.9  98.9  99.0  99.0  |  99.4  99.4  99.5  99.5  99.5  |  99.6  99.6  99.6  99.7  99.7  |
GB18030                 36862  |  98.2  98.2  98.3  98.9  98.9  |  98.3  98.3  98.3  99.0  99.0  |  98.3  98.3  98.3  99.0  99.0  |  98.3  98.3  98.3  99.0  99.0  |  95.5  95.5  97.3  96.2  96.3  |  97.4  97.4  97.4  98.0  98.2  |
IBM500                  31455  | 100.0 100.0 100.0 100.0 100.0  |  83.5  83.5  83.5  83.5  83.5  |  83.5  83.5  83.5  83.5  83.5  |  83.5  83.5  83.5  83.5  83.5  |  88.3  88.3  99.9  88.3  88.3  |   0.0   0.0   0.0   0.0   0.0  |
IBM850                  30539  |  82.5  82.5  86.4  96.6  96.7  |  82.7  82.7  86.5  96.9  96.9  |  82.7  82.7  86.6  96.9  97.0  |  82.7  82.7  86.6  96.9  97.0  |   0.0   0.0   0.0  12.3  12.7  |   0.0   0.0   0.0  12.3  12.7  |
IBM852                  35403  |  91.5  91.5  94.4  97.6  97.6  |  91.5  91.5  94.5  97.6  97.6  |  91.6  91.6  94.6  97.7  97.7  |  91.6  91.6  94.6  97.7  97.7  |   0.0   0.0   0.0   4.5   4.6  |   0.0   0.0   0.0   4.5   4.6  |
IBM855                  36702  |  99.9  99.9  99.9  99.9  99.9  |  99.9  99.9  99.9  99.9  99.9  |  99.9  99.9  99.9  99.9  99.9  |  99.9  99.9  99.9  99.9  99.9  |   0.0   0.0   0.0   0.1   0.1  |  99.8  99.8  99.8  99.8  99.8  |
IBM866                  36985  |  99.9  99.9  99.9 100.0 100.0  |  99.9  99.9  99.9 100.0 100.0  |  99.9  99.9  99.9 100.0 100.0  |  99.9  99.9  99.9 100.0 100.0  |  91.2  91.2  99.0  91.3  91.3  |  99.7  99.7  99.7  99.8  99.8  |
ISO-8859-16             32899  |  88.0  88.0  99.6  99.0  99.1  |  87.9  87.9  88.7  98.9  99.0  |  88.1  88.1  88.7  99.0  99.1  |  75.2  75.2  75.4  99.0  99.1  |   0.0   0.0   0.0  63.1  63.4  |   0.0   0.0   0.0  54.5  54.9  |
ISO-8859-3              35648  |  93.6  93.6  95.3  98.1  98.1  |  93.6  93.6  95.3  98.1  98.1  |  93.6  93.6  95.3  98.1  98.2  |  93.6  93.6  95.0  98.1  98.2  |   0.0   0.0   0.0   5.1   5.1  |   0.0   0.0   0.0   5.0   5.0  |
KOI8-R                  36850  |  98.7  99.9  99.9 100.0 100.0  |  98.7  99.9  99.9 100.0 100.0  |  98.7  99.9  99.9 100.0 100.0  |  98.7  99.9  99.9 100.0 100.0  |  95.9  95.9  99.1  96.0  96.0  |  99.7  99.7  99.7  99.8  99.8  |
KOI8-U                  36846  |  99.4  99.9  99.9  99.8  99.8  |  99.4  99.9  99.9  99.8  99.8  |  99.4  99.9  99.9  99.8  99.8  |  99.4  99.9  99.9  99.8  99.8  |   0.0  92.0  98.0   0.7   0.7  |   0.0  99.6  99.6   0.9   0.9  |
Shift_JIS               36917  |  99.1  99.1  99.2  99.6  99.6  |  96.7  96.7  96.8  97.2  97.2  |  96.7  96.7  96.8  97.2  97.2  |  96.7  96.7  96.8  97.2  97.2  |  98.0  98.0  98.1  98.5  98.5  |  98.6  98.6  98.6  99.1  99.2  |
UTF-16-BE               36799  |   0.0   0.0   0.0   0.0   0.0  |  96.3  96.3  96.3  96.3  96.3  |  96.3  96.3  96.3  96.3  96.3  |  96.3  96.3  96.3  96.3  96.3  |  68.8  68.8  94.1  68.8  68.8  |   0.0   0.0   0.0   0.0   0.0  |
UTF-16-LE               36736  |   0.0   0.0   0.0   0.0   0.0  |  96.4  96.4  96.4  96.4  96.4  |  96.4  96.4  96.4  96.4  96.4  |  96.4  96.4  96.4  96.4  96.4  |  69.6  69.6  94.1  69.6  69.6  |   0.0   0.0   0.0   0.0   0.0  |
UTF-32-BE               36757  |   0.0   0.0   0.0   0.0   0.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  |   0.0   0.0   0.0   0.0   0.0  |
UTF-32-LE               37011  |   0.0   0.0   0.0   0.0   0.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  |   0.0   0.0   0.0   0.0   0.0  |
UTF-8                   36254  |  93.1  93.1  97.4  96.7  96.7  |  96.5  96.5  96.5 100.0 100.0  |  96.5  96.5  96.5 100.0 100.0  |  96.5  96.5  96.5 100.0 100.0  |  95.5  95.5  97.3  99.0  99.0  |  95.8  95.8  95.8  99.3  99.3  |
windows-1250            34499  |  80.9  80.9  87.3  94.4  94.9  |  81.1  81.1  87.4  94.6  95.1  |  81.1  81.1  87.4  94.6  95.1  |  74.1  74.1  79.6  94.6  95.1  |  43.1  72.0  98.5  80.5  80.5  |   0.0   0.0   0.0  14.8  18.0  |
windows-1251            36852  |  99.8  99.8  99.8  99.9  99.9  |  99.8  99.8  99.8  99.9  99.9  |  99.8  99.8  99.8  99.9  99.9  |  99.8  99.8  99.8  99.9  99.9  |  92.2  92.2  96.6  92.3  92.3  |  87.3  87.3  87.3  87.4  87.5  |
windows-1252            25874  |  62.2  62.2  67.1  90.0  90.2  |  80.0  80.0  84.9  90.0  90.2  |  80.0  80.0  84.9  90.1  90.2  |  89.8  89.8  94.7  90.1  90.2  |  13.6  86.5  99.1  93.1  93.1  |   0.0  99.1  99.1  83.9  99.0  |
windows-1253            36845  |  99.2  99.2  99.2  99.3  99.3  |  99.2  99.2  99.2  99.3  99.3  |  99.2  99.2  99.2  99.3  99.3  |  99.2  99.2  99.2  99.3  99.3  |   9.8  98.3  99.4  95.8  95.9  |   0.3  98.5  98.5  86.4  96.0  |
windows-1254            36705  |  99.0  99.0  99.4  99.4  99.4  |  99.0  99.0  99.4  99.4  99.4  |  99.0  99.0  99.4  99.4  99.4  |  98.2  98.2  98.4  99.4  99.4  |  24.4  93.8  99.6  94.4  94.4  |   0.0   0.0   0.0   1.4   1.8  |
windows-1255            31252  |  99.6  99.6  99.6  99.7  99.7  |  99.6  99.6  99.6  99.7  99.7  |  99.6  99.6  99.6  99.7  99.7  |  99.6  99.6  99.6  99.7  99.7  |  26.7  63.6  77.7  59.6  63.8  |  99.2  99.4  99.4  99.4  99.6  |
windows-1256            41912  |  99.2  99.2  99.2  99.3  99.3  |  99.2  99.2  99.2  99.3  99.3  |  99.2  99.2  99.2  99.3  99.3  |  99.2  99.2  99.2  99.3  99.3  |  46.9  80.1  96.4  47.1  47.1  |   0.0   0.0   0.0   0.1   0.1  |
windows-1257            30789  |  85.3  85.3  94.9  88.8  88.8  |  85.3  85.3  94.9  88.8  88.8  |  85.3  85.3  94.9  88.8  88.8  |  77.3  77.3  82.5  88.8  88.8  |   0.0   0.0   0.0  17.8  17.8  |   0.0   0.0   0.0  16.0  19.7  |
windows-1258            36885  |  99.7  99.7  99.8  99.9  99.9  |  99.7  99.7  99.8  99.9  99.9  |  99.7  99.7  99.8  99.9  99.9  |  99.7  99.7  99.8  99.9  99.9  |   0.0   0.0   0.0   0.2   0.2  |   0.0   0.0   0.0   0.2   0.2  |
windows-874             31440  |  98.8  98.8  98.8  99.5  99.5  |  98.8  98.8  98.9  99.5  99.5  |  98.8  98.8  98.9  99.5  99.5  |  98.8  98.8  98.9  99.5  99.5  |   0.0   0.0   0.0   0.7   0.7  |   0.0   0.0   0.0  69.6  99.7  |
x-EUC-TW                26788  |  99.7  99.7  99.7  99.8  99.8  |  99.7  99.7  99.7  99.8  99.8  |  99.7  99.7  99.7  99.8  99.8  |  99.7  99.7  99.7  99.8  99.8  |   0.0   0.0   0.0   0.1   0.1  |  81.0  81.0  81.0  81.1  81.1  |
x-MacRoman               1994  |  63.0  63.0  81.0  73.6  73.7  |  63.4  63.4  81.5  74.0  74.2  |  63.5  63.5  81.7  74.1  74.2  |  63.5  63.5  81.7  74.1  74.2  |   0.0   0.0   0.0  10.6  10.8  |   0.0   0.0   0.0  10.6  10.8  |
x-mac-cyrillic           1773  |  70.8  70.8  70.8  70.8  70.8  |  70.8  70.8  70.8  70.8  70.8  |  70.8  70.8  70.8  70.8  70.8  |  70.8  70.8  70.8  70.8  70.8  |   0.0   0.0   0.0   0.0   0.0  |  78.1  78.1  78.1  78.1  78.1  |
x-windows-949           36719  |  99.1  99.1  99.1  99.1  99.1  |  98.9  98.9  98.9  99.1  99.1  |  98.9  98.9  98.9  99.1  99.1  |  98.9  98.9  98.9  99.1  99.1  |   0.0  99.4  99.5  99.4  99.4  |   0.0  99.5  99.5  99.6  99.6  |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
OVERALL                 1085250  |  79.0  82.4  83.8  85.0  85.0  |  92.3  95.7  96.7  97.9  97.9  |  92.3  95.7  96.7  97.9  97.9  |  91.7  95.1  95.9  97.9  97.9  |  45.5  65.1  70.4  63.2  63.4  |  34.7  49.5  49.5  50.3  52.1  |
  Stat=model only | +ISO=+C1-correction | +CJK=+grammar | All=ML+rules | R%=strict | S%=soft | T3%=top-3 hit | D%=decode-match | A%=alpha-match
  µs/sample                    |                       32.3  |                       28.5  |                       27.9  |                       27.7  |                       65.8  |                       11.1  |

=== Probe length: 200B ===
                            N  | --- ML ablation --------------------------------------------------- | --- Baselines --------------------------------- |
Charset                        | Stat R%   S%  T3%  D%   A%  | +ISO R%   S%  T3%  D%   A%  | +CJK R%   S%  T3%  D%   A%  | All  R%   S%  T3%  D%   A%  | ICU4J R%   S%  T3%  D%   A%  | juniv R%   S%  T3%  D%   A%  |
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Big5-HKSCS              30334  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  |   0.0  99.9  99.9  51.5  51.6  |   0.0  84.5  84.5  51.3  51.3  |
EUC-JP                  37043  |  99.7  99.7  99.7  99.8  99.8  |  99.7  99.7  99.7  99.8  99.8  |  99.7  99.7  99.7  99.8  99.8  |  99.7  99.7  99.7  99.8  99.8  |  99.4  99.4  99.5  99.6  99.6  |  98.8  98.8  98.8  98.9  98.9  |
EUC-KR                  36883  |   0.0  99.5  99.5  99.5  99.5  |   0.0  99.5  99.5  99.5  99.5  |   0.0  99.5  99.5  99.5  99.5  |   0.0  99.5  99.5  99.5  99.5  |  99.9  99.9  99.9  99.9  99.9  |  99.9  99.9  99.9  99.9  99.9  |
GB18030                 36862  |  99.5  99.5  99.5  99.7  99.7  |  99.5  99.5  99.5  99.7  99.7  |  99.5  99.5  99.5  99.7  99.7  |  99.5  99.5  99.5  99.7  99.7  |  98.5  98.5  99.3  98.7  98.7  |  99.3  99.3  99.3  99.4  99.4  |
IBM500                  31455  | 100.0 100.0 100.0 100.0 100.0  |  86.1  86.1  86.1  86.1  86.1  |  86.1  86.1  86.1  86.1  86.1  |  86.1  86.1  86.1  86.1  86.1  |  88.5  88.5 100.0  88.5  88.5  |   0.0   0.0   0.0   0.0   0.0  |
IBM850                  30539  |  94.3  94.3  96.0  98.4  98.4  |  94.5  94.5  96.1  98.6  98.6  |  94.5  94.5  96.1  98.6  98.6  |  94.5  94.5  96.1  98.6  98.6  |   0.0   0.0   0.0   3.3   3.4  |   0.0   0.0   0.0   3.3   3.4  |
IBM852                  35403  |  97.9  97.9  98.5  99.3  99.3  |  98.0  98.0  98.5  99.3  99.3  |  98.0  98.0  98.5  99.3  99.3  |  98.0  98.0  98.5  99.3  99.3  |   0.0   0.0   0.0   1.1   1.1  |   0.0   0.0   0.0   1.1   1.1  |
IBM855                  36702  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  |   0.0   0.0   0.0   0.0   0.0  |  99.9  99.9  99.9  99.9  99.9  |
IBM866                  36985  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  |  97.4  97.4  99.7  97.5  97.5  |  99.9  99.9  99.9  99.9  99.9  |
ISO-8859-16             32899  |  94.8  94.8  99.7  99.5  99.5  |  94.7  94.7  95.0  99.4  99.5  |  94.8  94.8  95.0  99.5  99.6  |  91.6  91.6  91.7  99.5  99.6  |   0.0   0.0   0.0  47.3  47.6  |   0.0   0.0   0.0  40.5  40.7  |
ISO-8859-3              35648  |  99.1  99.1  99.4  99.6  99.6  |  99.1  99.1  99.4  99.6  99.6  |  99.1  99.1  99.4  99.6  99.6  |  99.1  99.1  99.4  99.6  99.6  |   0.0   0.0   0.0   0.6   0.6  |   0.0   0.0   0.0   0.6   0.6  |
KOI8-R                  36850  |  99.7 100.0 100.0 100.0 100.0  |  99.7 100.0 100.0 100.0 100.0  |  99.7 100.0 100.0 100.0 100.0  |  99.7 100.0 100.0 100.0 100.0  |  98.4  98.4  99.8  98.4  98.4  |  99.9  99.9  99.9  99.9  99.9  |
KOI8-U                  36846  |  99.8 100.0 100.0  99.9  99.9  |  99.8 100.0 100.0  99.9  99.9  |  99.8 100.0 100.0  99.9  99.9  |  99.8 100.0 100.0  99.9  99.9  |   0.0  95.9  99.6   0.2   0.2  |   0.0  99.8  99.8   0.2   0.2  |
Shift_JIS               36917  |  99.8  99.8  99.8  99.9  99.9  |  98.4  98.4  98.4  98.5  98.5  |  98.4  98.4  98.4  98.5  98.5  |  98.4  98.4  98.4  98.5  98.5  |  99.7  99.7  99.7  99.8  99.8  |  99.6  99.6  99.6  99.8  99.8  |
UTF-16-BE               36799  |   0.0   0.0   0.0   0.0   0.0  |  96.0  96.0  96.0  96.0  96.0  |  96.0  96.0  96.0  96.0  96.0  |  96.0  96.0  96.0  96.0  96.0  |  69.3  69.3  95.0  69.3  69.3  |   0.0   0.0   0.0   0.0   0.0  |
UTF-16-LE               36736  |   0.0   0.0   0.0   0.0   0.0  |  96.0  96.0  96.0  96.0  96.0  |  96.0  96.0  96.0  96.0  96.0  |  96.0  96.0  96.0  96.0  96.0  |  69.6  69.6  95.2  69.6  69.6  |   0.0   0.0   0.0   0.0   0.0  |
UTF-32-BE               36757  |   0.0   0.0   0.0   0.0   0.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  |   0.0   0.0   0.0   0.0   0.0  |
UTF-32-LE               37011  |   0.0   0.0   0.0   0.0   0.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  |   0.0   0.0   0.0   0.0   0.0  |
UTF-8                   36254  |  97.5  97.5  99.3  99.1  99.1  |  98.4  98.4  98.4 100.0 100.0  |  98.4  98.4  98.4 100.0 100.0  |  98.4  98.4  98.4 100.0 100.0  |  98.0  98.0  98.7  99.6  99.6  |  97.9  97.9  97.9  99.4  99.4  |
windows-1250            34499  |  91.5  91.5  92.6  97.0  97.4  |  91.5  91.5  92.6  97.0  97.4  |  91.5  91.5  92.6  97.0  97.5  |  90.1  90.1  91.1  97.0  97.5  |  60.6  78.3  99.5  81.3  81.3  |   0.0   0.0   0.0   5.5   7.6  |
windows-1251            36852  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  |  97.1  97.1  99.0  97.1  97.1  |  89.7  89.7  89.7  89.7  89.7  |
windows-1252            25874  |  79.2  79.2  82.1  93.0  93.2  |  86.9  86.9  89.9  93.1  93.2  |  87.0  87.0  89.9  93.2  93.3  |  92.7  92.7  95.9  93.2  93.3  |  21.8  90.2  99.5  94.2  94.2  |   0.0  99.1  99.1  75.7  98.9  |
windows-1253            36845  |  99.8  99.8  99.8  99.8  99.8  |  99.8  99.8  99.8  99.8  99.8  |  99.8  99.8  99.8  99.8  99.8  |  99.8  99.8  99.8  99.8  99.8  |  16.1  99.5  99.8  95.8  95.9  |   0.4  99.4  99.4  80.0  95.3  |
windows-1254            36705  |  99.9  99.9  99.9  99.9  99.9  |  99.9  99.9  99.9  99.9  99.9  |  99.9  99.9  99.9  99.9  99.9  |  99.9  99.9  99.9  99.9  99.9  |  37.1  98.5 100.0  98.6  98.6  |   0.0   0.0   0.0   0.1   0.2  |
windows-1255            31252  |  99.9  99.9  99.9  99.9  99.9  |  99.9  99.9  99.9  99.9  99.9  |  99.9  99.9  99.9  99.9  99.9  |  99.9  99.9  99.9  99.9  99.9  |  41.9  77.8  90.3  71.0  77.8  |  99.7  99.7  99.7  99.7  99.8  |
windows-1256            41912  |  99.7  99.7  99.7  99.7  99.7  |  99.7  99.7  99.7  99.7  99.7  |  99.7  99.7  99.7  99.7  99.7  |  99.7  99.7  99.7  99.7  99.7  |  48.9  86.1  98.7  49.0  49.0  |   0.0   0.0   0.0   0.0   0.0  |
windows-1257            30789  |  96.6  96.6  98.3  97.4  97.4  |  96.7  96.7  98.3  97.4  97.4  |  96.7  96.7  98.3  97.4  97.4  |  94.2  94.2  94.9  97.4  97.4  |   0.0   0.0   0.0  10.7  10.7  |   0.0   0.0   0.0   8.6  11.9  |
windows-1258            36885  |  99.9  99.9  99.9 100.0 100.0  |  99.9  99.9  99.9 100.0 100.0  |  99.9  99.9  99.9 100.0 100.0  |  99.9  99.9  99.9 100.0 100.0  |   0.0   0.0   0.0   0.1   0.1  |   0.0   0.0   0.0   0.1   0.1  |
windows-874             31440  |  99.7  99.7  99.7  99.9  99.9  |  99.7  99.7  99.7  99.9  99.9  |  99.7  99.7  99.7  99.9  99.9  |  99.7  99.7  99.7  99.9  99.9  |   0.0   0.0   0.0   0.2   0.2  |   0.0   0.0   0.0  54.5  99.9  |
x-EUC-TW                26788  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  |   0.0   0.0   0.0   0.0   0.0  |  81.1  81.1  81.1  81.1  81.1  |
x-MacRoman               1994  |  86.3  86.3  92.2  88.8  88.8  |  86.6  86.6  92.5  89.0  89.0  |  86.6  86.6  92.5  89.1  89.1  |  86.6  86.6  92.5  89.1  89.1  |   0.0   0.0   0.0   2.5   2.5  |   0.0   0.0   0.0   2.5   2.5  |
x-mac-cyrillic           1773  |  88.2  88.2  88.2  88.2  88.2  |  88.2  88.2  88.2  88.2  88.2  |  88.2  88.2  88.2  88.2  88.2  |  88.2  88.2  88.2  88.2  88.2  |   0.0   0.0   0.0   0.0   0.0  |  85.7  85.7  85.7  85.7  85.7  |
x-windows-949           36719  |  99.6  99.6  99.6  99.6  99.6  |  99.5  99.5  99.5  99.6  99.6  |  99.5  99.5  99.5  99.6  99.6  |  99.5  99.5  99.5  99.6  99.6  |   0.0  99.9  99.9  99.6  99.6  |   0.0  99.8  99.8  99.6  99.6  |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
OVERALL                 1085250  |  81.5  84.9  85.4  85.8  85.9  |  94.6  98.0  98.2  98.7  98.8  |  94.6  98.0  98.2  98.7  98.8  |  94.5  97.9  98.1  98.7  98.8  |  48.2  67.2  71.4  63.0  63.2  |  35.0  49.9  49.9  47.8  50.4  |
  Stat=model only | +ISO=+C1-correction | +CJK=+grammar | All=ML+rules | R%=strict | S%=soft | T3%=top-3 hit | D%=decode-match | A%=alpha-match
  µs/sample                    |                       41.3  |                       37.8  |                       36.7  |                       36.5  |                      102.0  |                       15.0  |

=== Probe length: full ===
                            N  | --- ML ablation --------------------------------------------------- | --- Baselines --------------------------------- |
Charset                        | Stat R%   S%  T3%  D%   A%  | +ISO R%   S%  T3%  D%   A%  | +CJK R%   S%  T3%  D%   A%  | All  R%   S%  T3%  D%   A%  | ICU4J R%   S%  T3%  D%   A%  | juniv R%   S%  T3%  D%   A%  |
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Big5-HKSCS              30334  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  |   0.0  99.9 100.0  33.8  33.8  |   0.0  84.6  84.6  33.7  33.7  |
EUC-JP                  37043  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  |  99.9  99.9  99.9  99.9  99.9  |  99.6  99.6  99.6  99.6  99.6  |
EUC-KR                  36883  |   0.0  99.7  99.7  99.7  99.7  |   0.0  99.7  99.7  99.7  99.7  |   0.0  99.7  99.7  99.7  99.7  |   0.0  99.7  99.7  99.7  99.7  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  |
GB18030                 36862  |  99.9  99.9  99.9  99.9  99.9  |  99.9  99.9  99.9  99.9  99.9  |  99.9  99.9  99.9  99.9  99.9  |  99.9  99.9  99.9  99.9  99.9  |  99.5  99.5  99.8  99.5  99.5  |  99.7  99.7  99.7  99.7  99.7  |
IBM500                  31455  | 100.0 100.0 100.0 100.0 100.0  |  91.4  91.4  91.4  91.4  91.4  |  91.4  91.4  91.4  91.4  91.4  |  91.4  91.4  91.4  91.4  91.4  |  72.2  72.2 100.0  72.2  72.2  |   0.0   0.0   0.0   0.0   0.0  |
IBM850                  30539  |  99.9  99.9  99.9  99.9  99.9  |  99.9  99.9  99.9  99.9  99.9  |  99.9  99.9  99.9  99.9  99.9  |  99.9  99.9  99.9  99.9  99.9  |   0.0   0.0   0.0   0.0   0.0  |   0.0   0.0   0.0   0.0   0.0  |
IBM852                  35403  |  99.9  99.9  99.9  99.9  99.9  |  99.9  99.9  99.9  99.9  99.9  |  99.9  99.9  99.9  99.9  99.9  |  99.9  99.9  99.9  99.9  99.9  |   0.0   0.0   0.0   0.0   0.0  |   0.0   0.0   0.0   0.0   0.0  |
IBM855                  36702  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  |   0.0   0.0   0.0   0.0   0.0  | 100.0 100.0 100.0 100.0 100.0  |
IBM866                  36985  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  |  98.9  98.9  99.9  98.9  98.9  | 100.0 100.0 100.0 100.0 100.0  |
ISO-8859-16             32899  |  99.8  99.8  99.8  99.8  99.8  |  99.8  99.8  99.8  99.8  99.8  |  99.8  99.8  99.8  99.8  99.8  |  99.5  99.5  99.5  99.8  99.8  |   0.0   0.0   0.0  14.0  14.3  |   0.0   0.0   0.0  11.9  12.1  |
ISO-8859-3              35648  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  |   0.0   0.0   0.0   0.0   0.0  |   0.0   0.0   0.0   0.0   0.0  |
KOI8-R                  36850  |  99.9 100.0 100.0 100.0 100.0  |  99.9 100.0 100.0 100.0 100.0  |  99.9 100.0 100.0 100.0 100.0  |  99.9 100.0 100.0 100.0 100.0  |  99.3  99.3  99.9  99.3  99.3  |  99.9  99.9  99.9  99.9  99.9  |
KOI8-U                  36846  |  99.9 100.0 100.0  99.9  99.9  |  99.9 100.0 100.0  99.9  99.9  |  99.9 100.0 100.0  99.9  99.9  |  99.9 100.0 100.0  99.9  99.9  |   0.0  98.2  99.8   0.1   0.1  |   0.0  99.9  99.9   0.1   0.1  |
Shift_JIS               36917  | 100.0 100.0 100.0 100.0 100.0  |  99.5  99.5  99.5  99.5  99.5  |  99.5  99.5  99.5  99.5  99.5  |  99.5  99.5  99.5  99.5  99.5  | 100.0 100.0 100.0 100.0 100.0  |  99.9  99.9  99.9  99.9  99.9  |
UTF-16-BE               36799  |   0.0   0.0   0.0   0.0   0.0  |  95.6  95.6  95.6  95.6  95.6  |  95.6  95.6  95.6  95.6  95.6  |  95.6  95.6  95.6  95.6  95.6  |  68.6  68.6  95.7  68.6  68.6  |   0.0   0.0   0.0   0.0   0.0  |
UTF-16-LE               36736  |   0.0   0.0   0.0   0.0   0.0  |  95.6  95.6  95.6  95.6  95.6  |  95.6  95.6  95.6  95.6  95.6  |  95.6  95.6  95.6  95.6  95.6  |  68.8  68.8  96.5  68.8  68.8  |   0.0   0.0   0.0   0.0   0.0  |
UTF-32-BE               36757  |   0.0   0.0   0.0   0.0   0.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  |   0.0   0.0   0.0   0.0   0.0  |
UTF-32-LE               37011  |   0.0   0.0   0.0   0.0   0.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  |   0.0   0.0   0.0   0.0   0.0  |
UTF-8                   36254  |  99.9  99.9  99.9  99.9  99.9  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  |  99.6  99.6  99.6  99.6  99.6  |
windows-1250            34499  |  99.1  99.1  99.2  99.1  99.1  |  99.1  99.1  99.2  99.1  99.1  |  99.1  99.1  99.2  99.1  99.1  |  99.1  99.1  99.2  99.1  99.1  |  80.3  85.5  99.9  84.5  84.5  |   0.0   0.0   0.0   0.0   0.0  |
windows-1251            36852  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  |  98.9  98.9  99.6  98.9  98.9  |  93.2  93.2  93.2  93.2  93.2  |
windows-1252            25874  |  99.5  99.5  99.5  99.5  99.5  |  99.5  99.5  99.5  99.5  99.5  |  99.5  99.5  99.5  99.5  99.5  |  99.5  99.5  99.5  99.5  99.5  |  46.7  94.4  99.8  94.4  94.4  |   0.0  98.9  98.9  50.7  98.2  |
windows-1253            36845  |  99.9  99.9  99.9  99.9  99.9  |  99.9  99.9  99.9  99.9  99.9  |  99.9  99.9  99.9  99.9  99.9  |  99.9  99.9  99.9  99.9  99.9  |  33.7  99.8  99.9  93.8  93.9  |   1.0  99.7  99.7  61.1  90.4  |
windows-1254            36705  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  |  60.3  99.3 100.0  99.3  99.3  |   0.0   0.0   0.0   0.0   0.0  |
windows-1255            31252  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  |  84.2  96.3  99.1  84.3  96.3  |  99.8  99.9  99.9  99.8  99.9  |
windows-1256            41912  |  99.8  99.8  99.8  99.8  99.8  |  99.9  99.9  99.9  99.9  99.9  |  99.9  99.9  99.9  99.9  99.9  |  99.9  99.9  99.9  99.9  99.9  |  52.0  91.6  99.4  52.0  52.0  |   0.0   0.0   0.0   0.0   0.0  |
windows-1257            30789  |  99.9  99.9  99.9  99.9  99.9  |  99.9  99.9  99.9  99.9  99.9  |  99.9  99.9  99.9  99.9  99.9  |  99.9  99.9  99.9  99.9  99.9  |   0.0   0.0   0.0   0.0   0.0  |   0.0   0.0   0.0   0.0   0.0  |
windows-1258            36885  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  |   0.0   0.0   0.0   0.0   0.0  |   0.0   0.0   0.0   0.0   0.0  |
windows-874             31440  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  |   0.0   0.0   0.0   0.0   0.0  |   0.0   0.0   0.0  11.2  99.9  |
x-EUC-TW                26788  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  | 100.0 100.0 100.0 100.0 100.0  |   0.0   0.0   0.0   0.0   0.0  |  81.1  81.1  81.1  81.1  81.1  |
x-MacRoman               1994  |  99.5  99.5  99.6  99.5  99.5  |  99.5  99.5  99.6  99.5  99.5  |  99.5  99.5  99.6  99.5  99.5  |  99.5  99.5  99.6  99.5  99.5  |   0.0   0.0   0.0   0.0   0.0  |   0.0   0.0   0.0   0.0   0.0  |
x-mac-cyrillic           1773  |  99.4  99.4  99.4  99.4  99.4  |  99.4  99.4  99.4  99.4  99.4  |  99.4  99.4  99.4  99.4  99.4  |  99.4  99.4  99.4  99.4  99.4  |   0.0   0.0   0.0   0.0   0.0  |  95.4  95.4  95.4  95.4  95.4  |
x-windows-949           36719  |  99.8  99.8  99.8  99.8  99.8  |  99.8  99.8  99.8  99.8  99.8  |  99.8  99.8  99.8  99.8  99.8  |  99.8  99.8  99.8  99.8  99.8  |   0.0 100.0 100.0  99.3  99.3  |   0.0  99.9  99.9  99.3  99.3  |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
OVERALL                 1085250  |  82.9  86.3  86.3  86.3  86.3  |  95.9  99.3  99.4  99.3  99.3  |  95.9  99.3  99.4  99.3  99.3  |  95.9  99.3  99.3  99.3  99.3  |  51.8  68.1  71.9  61.2  61.6  |  35.3  50.2  50.2  43.6  48.3  |
  Stat=model only | +ISO=+C1-correction | +CJK=+grammar | All=ML+rules | R%=strict | S%=soft | T3%=top-3 hit | D%=decode-match | A%=alpha-match
  µs/sample                    |                       64.5  |                       60.6  |                       58.4  |                       58.4  |                      227.6  |                       29.8  |

=== Accuracy by probe length (All detector) ===
  Length     Strict%     Soft%     Top3%   Decode%    Alpha%
  ----------------------------------------------------------
  20B           71.9      75.8      78.1      90.6      90.6
  50B           85.3      88.8      90.2      95.9      95.9
  100B          91.7      95.1      95.9      97.9      97.9
  200B          94.5      97.9      98.1      98.7      98.8
  full          95.9      99.3      99.3      99.3      99.3
