Measures whether an AI content pipeline performs equivalently in English and Canadian French — not whether it performs adequately in each. The unit of analysis is the gap between the two, because that gap is what a bilingual public-service mandate actually commits to.
6 queries where the French reader was not served — either no answer was returned, or the answer asserted a fact the source does not support. Both are mandate failures, not quality deltas.
Equivalence index 0.968 · 10 dimensions. A mean over all queries understates this: bilingual public service is not an average commitment, so the harness leads with the worst outcome a reader actually experienced.
Every query classified by its worst outcome, ordered by reader impact.
Each row is one metric measured independently in both languages. The connecting line is the equivalence gap.
| Dimension | 0 → 1 | EN | FR | Gap | Status |
|---|---|---|---|---|---|
| Retrieval precision@1 Top result is a gold document | 0.961 | 0.971 | -0.010 | equivalent | |
| Retrieval recall@3 Gold documents found in top 3 | 0.958 | 0.955 | +0.003 | equivalent | |
| Retrieval nDCG@3 Rank quality of gold documents | 0.954 | 0.959 | -0.005 | equivalent | |
| Grounding — fabrication Figures absent from the source document | 1.000 | 0.962 | +0.038 | equivalent | |
| Grounding — in retrieved context Figures unsupported by what retrieval returned | 0.954 | 0.933 | +0.021 | equivalent | |
| Grounding — lexical entailment Content words traceable to source | 0.915 | 0.903 | +0.012 | equivalent | |
| Content coverage vs EN Does FR carry the same facts as EN | 1.000 | 0.884 | +0.116 | divergent | |
| Canadian French register Metropolitan forms and anglicisms | 1.000 | 0.941 | +0.059 | equivalent | |
| Fluency (composite) Register and readability combined | 0.996 | 0.955 | +0.042 | equivalent | |
| Localization conventions Dates, currency, decimals, units | 0.990 | 0.976 | +0.015 | equivalent |
Canadian French administrative and regional vocabulary the retriever represents weakly. This is what converts a red number into a fix.
| Term (stemmed) | Model coverage | Affected queries |
|---|
Two Canadian-specific metrics generic French evaluation does not provide.
MDR counts substitutions only: 3 of 5 scored opportunities. 20 cases where the model rephrased around the term are excluded from the denominator entirely — verbosity is not drift, and scoring it either way would bias the rate.
| Quebec form | Replaced with | n | Where |
|---|---|---|---|
| halte-chaleur | centre d'hébergement chauffé | 1 | q04 |
| halte-chaleur | centre d'hébergement chauffé | 1 | q29 |
| halte-chaleur | centre d'hébergement chauffé | 1 | q77 |
QFCR sends already-correct Canadian French through a naive “corrige ce texte” prompt, so any alteration is a false correction by construction: 12 of 15 valid Quebec forms were altered. A pipeline can generate perfect Canadian French and still ship metropolitan copy because the proofreading step rewrote it.
| Valid Quebec form | Proofreader changed it to | n | Probe |
|---|---|---|---|
| fin de semaine | week-end | 1 | pf01 |
| courriel | 1 | pf01 | |
| halte-chaleur | centre d'hébergement chauffé | 1 | pf01 |
| conseiller scolaire | administrateur scolaire | 1 | pf02 |
| taxe foncière | (removed/rephrased) | 1 | pf02 |
| assurance-emploi | assurance chômage | 1 | pf03 |
| stationnement | parking | 1 | pf04 |
| banlieusard | navetteur | 1 | pf04 |
Alt text, captions, credits, and transcripts. The asset is reused across both language sites; the descriptors often are not.
13 of 31 assets leave French users without access to content English users can reach — missing or untranslated alt text, or a missing transcript on timed media. Untranslated is worse than missing: it passes a null check in a CMS audit. The other 18 assets carry complete French descriptors.
| Asset | Kind | Field states | Score | Accessibility |
|---|---|---|---|---|
| vid-hlth-028-a | video | alt: missingcaption: okcredit: oktranscript: missing | 0.20 | alt text missing, transcript missing |
| img-wx-003-a | image | alt: missingcaption: okcredit: ok | 0.31 | alt text missing |
| img-muni-020-a | image | alt: missingcaption: okcredit: ok | 0.31 | alt text missing |
| img-envr-029-a | image | alt: missingcaption: okcredit: ok | 0.31 | alt text missing |
| img-indg-044-a | image | alt: missingcaption: okcredit: ok | 0.31 | alt text missing |
| img-cult-019-a | image | alt: untranslatedcaption: okcredit: ok | 0.48 | alt text untranslated |
| img-wx-035-a | image | alt: untranslatedcaption: okcredit: ok | 0.48 | alt text untranslated |
| img-hlth-053-a | image | alt: untranslatedcaption: okcredit: ok | 0.48 | alt text untranslated |
| vid-wx-003-b | video | alt: okcaption: missingcredit: oktranscript: missing | 0.50 | transcript missing |
| vid-trns-022-a | video | alt: okcaption: okcredit: oktranscript: missing | 0.65 | transcript missing |
| vid-indg-025-a | video | alt: okcaption: okcredit: oktranscript: missing | 0.65 | transcript missing |
| aud-hlth-041-a | audio | alt: okcaption: okcredit: oktranscript: missing | 0.65 | transcript missing |
| vid-wx-049-a | video | alt: okcaption: okcredit: oktranscript: missing | 0.65 | transcript missing |
Tags and SEO descriptions drive archive retrieval and topic pages — a French story tagged with fewer concepts is less discoverable in French.
Only documents with a gap are listed; 18 others are complete.
| Document | Desk | FR/EN tags | SEO description | Score |
|---|---|---|---|---|
| cult-019 | Arts | 2/4 | missing | 0.45 |
| tech-026 | Technology | 2/4 | missing | 0.45 |
| edu-034 | Education | 2/4 | missing | 0.45 |
| muni-042 | Municipal | 2/4 | missing | 0.45 |
| hlth-053 | Health | 2/4 | missing | 0.45 |
| wx-003 | News | 3/5 | missing | 0.49 |
| envr-029 | News | 2/4 | ok | 0.80 |
| indg-044 | Indigenous | 2/4 | ok | 0.80 |
| tech-059 | Technology | 2/4 | ok | 0.80 |
| cult-006 | Arts | 2/3 | ok | 0.87 |
| trns-022 | Municipal | 3/4 | ok | 0.90 |
| cult-032 | Arts | 3/4 | ok | 0.90 |
| cult-047 | Arts | 3/4 | ok | 0.90 |
| cult-060 | Arts | 3/4 | ok | 0.90 |
Consistency and refusal behaviour across the whole run — failures that are invisible when answers are scored one at a time.
A pipeline can render the same programme three ways across a run and each answer looks fine alone. It breaks archive search and house style, and is systematically worse in the second language where no single reviewer sees all the output.
| Concept | Canonical form | Canonical use | Mentions | Replaced with |
|---|---|---|---|---|
| warming centre | halte-chaleur | 0% | 3 | |
| employment insurance | assurance-emploi | 100% | 1 | |
| property tax | taxe foncière | 100% | 1 | |
| long term care | soins de longue durée | 100% | 2 |
A refusal asserts nothing, so it scores perfectly on grounding and register. Refusing more often in one language is rationing service by language, and conventional quality metrics cannot see it. EN 100% · FR 100%. within expected expansion (FR/EN 0.90).
An aggregate says whether the pipeline is failing; segmentation says where, which is what routes it to an owner.
| Desk | n | Div. | Unsvd | Gap |
|---|---|---|---|---|
| Municipal | 22 | 11 | 1 | +0.197 |
| Arts | 11 | 5 | 0 | +0.182 |
| News | 17 | 7 | 2 | +0.176 |
| Politics | 5 | 3 | 0 | +0.167 |
| Business | 13 | 4 | 1 | +0.154 |
| Education | 9 | 4 | 0 | +0.148 |
| Health | 12 | 4 | 1 | +0.097 |
| Technology | 10 | 2 | 1 | +0.067 |
| Region | n | Div. | Unsvd | Gap |
|---|---|---|---|---|
| Ontario | 23 | 11 | 4 | +0.206 |
| West | 9 | 3 | 1 | +0.167 |
| Quebec | 15 | 6 | 0 | +0.162 |
| Prairies | 14 | 7 | 0 | +0.131 |
| Atlantic | 9 | 3 | 0 | +0.093 |
| National | 30 | 8 | 1 | +0.083 |
| North | 14 | 5 | 0 | +0.071 |
| Topic | n | Div. | Unsvd | Gap |
|---|---|---|---|---|
| recycling thin | 1 | 1 | 1 | +1.000 |
| arts_funding | 3 | 3 | 0 | +0.667 |
| broadcasting | 2 | 1 | 0 | +0.500 |
| fire_service thin | 1 | 1 | 0 | +0.500 |
| music | 2 | 1 | 0 | +0.500 |
| school_funding | 2 | 2 | 0 | +0.500 |
| small_business thin | 1 | 1 | 1 | +0.500 |
| snow_removal | 2 | 2 | 0 | +0.500 |
Full result table — the accessible view of every number above. Divergent queries first; perfect scores are dimmed so the values that differ carry the eye.
| Query | EN answer | EN P@1 | FR P@1 | EN grnd | FR grnd | FR reg | FR cov |
|---|---|---|---|---|---|---|---|
| q03Unsupported fact | Environment Canada measured 24 millimetres of ice accretion at Kemptville during the storm… | 1.00 | 1.00 | 1.00 | 0.00 | 1.00 | 0.00 |
| q20Unsupported fact | Wildfires consumed 4.2 million hectares this season, surpassing the 2023 record.… | 1.00 | 1.00 | 1.00 | 0.50 | 1.00 | 0.50 |
| q41Unsupported fact | Small business insolvency filings rose 26 per cent, the highest level since 2011.… | 1.00 | 1.00 | 1.00 | 0.50 | 1.00 | 0.50 |
| q64Unsupported fact | Ambulance offload delays reached a record 118,000 hours, with a median of 92 minutes again… | 1.00 | 1.00 | 1.00 | 0.67 | 1.00 | 0.67 |
| q83Unsupported fact | Producer-funded recycling shifted an estimated $156 million in annual costs from municipal… | 1.00 | 1.00 | 1.00 | 0.00 | 1.00 | 0.00 |
| q86Unsupported fact | All new open datasets require full bilingual metadata from July 1; 41 per cent of existing… | 1.00 | 1.00 | 1.00 | 0.50 | 1.00 | 0.50 |
| q15Different sources | Federal supports include a $12 million touring fund expansion with a quarter reserved for … | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 0.67 |
| q29Different sources | People can go to warming centres — municipalities opened eleven during the ice storm, and … | 1.00 | 1.00 | 1.00 | 1.00 | 0.00 | 0.50 |
| q31Different sources | Nursing vacancies drove 1,140 rural emergency room closures, while labour shortages delaye… | 0.00 | 0.00 | 1.00 | 1.00 | 1.00 | 0.83 |
| q32Different sources | The broadcaster is opening three bureaus in official language minority markets, and the ar… | 1.00 | 1.00 | 1.00 | 1.00 | 0.00 | 1.00 |
| q51Different sources | Employers cited housing availability as the main barrier, and a federal subsidy now covers… | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 |
| q75Different sources | Supports include a settlement transferring 78,000 hectares, a country food program in eigh… | 0.00 | 0.00 | 1.00 | 1.00 | 1.00 | 1.00 |
| q07Reduced content | A quarter of the $12 million touring fund expansion is reserved for official language mino… | 1.00 | 1.00 | 1.00 | 1.00 | 0.00 | 0.67 |
| q102Reduced content | Eviction applications reached 92,000 with an 8-month median hearing wait, while shelters r… | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 0.75 |
| q13Reduced content | Yes. The department admitted 8.1 per cent of newcomers outside Quebec as French speakers, … | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 0.50 |
| q14Reduced content | School boards face a combined $88 million shortfall amid 5.4 per cent enrolment growth, wh… | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 0.50 |
| q19Reduced content | Rural hospitals reported 1,140 temporary emergency room closures last year, more than doub… | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 0.83 |
| q22Reduced content | Youth unemployment reached 14.2 per cent, the highest since 2016, while the overall rate r… | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 0.67 |
| q26Reduced content | On-time performance was 67 per cent, below the 80 per cent target, largely due to freight … | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 0.74 |
| q35Reduced content | Drought cut the Prairie crop forecast 18 per cent after a dry June, with poor soil moistur… | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 0.50 |
| q42Reduced content | A court ruling on section 23 Charter rights ordered a remedy, and the province will fund t… | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 0.50 |
| q49Reduced content | Drought cut Prairie crop forecasts 18 per cent while a post-tropical storm flooded 620 coa… | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 0.33 |
| q54Reduced content | The city is reviewing snow removal contracts after 4,800 service complaints, with twelve o… | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 0.33 |
| q62Reduced content | Ferry service was cut from ten to six daily crossings after a vessel was removed for hull … | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 0.67 |
| q71Reduced content | The museum returned 1,100 cultural objects over three years, with 62 requests still in pro… | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 0.67 |
| q73Reduced content | The city is reviewing snow removal contracts after 4,800 complaints, extreme cold closed s… | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 0.67 |
| q82Reduced content | The housing guarantee helped fill 92 of 108 vacant teaching positions, with eleven still v… | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 0.67 |
| q95Reduced content | Volunteer fire departments reported a 24 per cent decline in active members, with 41 depar… | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 0.50 |
| q99Reduced content | Nursing overtime fell 38 per cent, dental plan enrolment passed 3.1 million, and youth men… | 0.00 | 1.00 | 1.00 | 1.00 | 1.00 | 0.50 |
| q04Register | Municipalities opened eleven warming centres across the affected region for residents with… | 1.00 | 1.00 | 1.00 | 1.00 | 0.00 | 1.00 |
| q05Register | Trustees asked the province for a per-student funding increase of $410, as the four boards… | 1.00 | 1.00 | 1.00 | 1.00 | 0.00 | 1.00 |
| q77Register | Twenty-two warming locations opened in the city during the extreme cold warning.… | 1.00 | 1.00 | 1.00 | 1.00 | 0.00 | 1.00 |
| q01 | Seasonal workers in Atlantic Canada now need 420 insurable hours to qualify for employment… | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 |
| q02 | Quebec signed separately from the other nine provinces, securing an asymmetrical arrangeme… | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 |
| q06 | The authority deferred the increase after four municipalities objected. The toll was to ri… | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 |
| q08 | Halifax had the tightest rental vacancy rate at 0.9 per cent, against a national rate of 1… | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 |
| q09 | Thirty-eight federal judicial appointments remain vacant, with 22 in final review at the j… | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 |
| q10 | The central bank held its policy rate at 3.75 per cent for a third consecutive time and si… | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 |
| q100 | Spring melt evacuated 1,240 residents while drought cut the Prairie crop forecast 18 per c… | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 |
| q101 | New open datasets require bilingual metadata from July 1, and a publishing grant supports … | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 |
| q11 | The snow crab quota for southern Gulf zones was cut 22 per cent to 18,400 tonnes, affectin… | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 |
| q12 | The city's $4.1 billion operating budget carries a 3.9 per cent residential property tax i… | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 |
| q16 | An ice storm cut power to 180,000 homes and caused two deaths on Highway 417, while a plan… | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 |
| q17 | The national dairy commission reduced production quota by 1.8 per cent, the first cut sinc… | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 | 1.00 |
Divergent queries listed first. 58 further queries of 102 showed no divergence on any dimension and are omitted here; every one is in the JSON output.
Mesure si un flux de contenu par IA offre un rendement équivalent en anglais et en français canadien — et non s'il offre un rendement acceptable dans chaque langue. L'unité d'analyse est l'écart entre les deux, car c'est cet écart que vise un mandat de service public bilingue.
6 requêtes où le lectorat francophone n'a pas été servi — soit aucune réponse n'a été fournie, soit la réponse avance un fait que la source n'appuie pas. Dans les deux cas, il s'agit d'un manquement au mandat, et non d'un simple écart de qualité.
Indice d'équivalence 0,968 · 10 dimensions. Une moyenne sur l'ensemble des requêtes en atténue la portée : le service public bilingue n'est pas un engagement moyen. Le banc d'essai met donc en tête le pire résultat vécu par une lectrice ou un lecteur.
Chaque requête classée selon son pire résultat, en ordre d'incidence sur le lectorat.
Chaque ligne présente une mesure évaluée séparément dans les deux langues. Le trait de liaison représente l'écart d'équivalence.
| Dimension | 0 → 1 | EN | FR | Écart | État |
|---|---|---|---|---|---|
| Précision du repérage@1 Le premier résultat est un document de référence | 0,961 | 0,971 | -0,010 | équivalent | |
| Rappel du repérage@3 Documents de référence trouvés parmi les 3 premiers | 0,958 | 0,955 | +0,003 | équivalent | |
| nDCG du repérage@3 Qualité du rangement des documents de référence | 0,954 | 0,959 | -0,005 | équivalent | |
| Véracité — fabrication Chiffres absents du document source | 1,000 | 0,962 | +0,038 | équivalent | |
| Véracité — contexte repéré Chiffres non appuyés par le contexte repéré | 0,954 | 0,933 | +0,021 | équivalent | |
| Véracité — appui lexical Mots de contenu attribuables à la source | 0,915 | 0,903 | +0,012 | équivalent | |
| Couverture du contenu c. EN Le français rend-il les mêmes faits que l'anglais | 1,000 | 0,884 | +0,116 | divergent | |
| Registre du français canadien Formes métropolitaines et anglicismes | 1,000 | 0,941 | +0,059 | équivalent | |
| Fluidité (composite) Registre et lisibilité combinés | 0,996 | 0,955 | +0,042 | équivalent | |
| Conventions de localisation Dates, devises, décimales, unités | 0,990 | 0,976 | +0,015 | équivalent |
Vocabulaire administratif et régional du français canadien faiblement représenté par le moteur de repérage. C'est ce qui transforme un chiffre en correctif.
| Terme (radical) | Couverture du modèle | Requêtes touchées |
|---|
Deux mesures propres au contexte canadien que l'évaluation générique du français ne fournit pas.
Le TDM ne compte que les substitutions : 3 occasions sur 5 retenues. Les 20 cas où le modèle a reformulé plutôt que de substituer sont exclus du dénominateur — la verbosité n'est pas de la dérive, et les compter d'une façon ou d'une autre fausserait le taux.
| Forme québécoise | Remplacée par | n | Occurrence |
|---|---|---|---|
| halte-chaleur | centre d'hébergement chauffé | 1 | q04 |
| halte-chaleur | centre d'hébergement chauffé | 1 | q29 |
| halte-chaleur | centre d'hébergement chauffé | 1 | q77 |
Le TFCQ soumet un texte déjà correct en français canadien à une consigne de révision sommaire (« corrige ce texte »); toute modification constitue donc une fausse correction : 12 formes québécoises valides sur 15 ont été altérées. Un flux peut produire un français canadien impeccable et diffuser malgré tout une copie métropolitaine parce que l'étape de révision l'a réécrite.
| Forme québécoise valide | Remplacée par la correction | n | Sonde |
|---|---|---|---|
| fin de semaine | week-end | 1 | pf01 |
| courriel | 1 | pf01 | |
| halte-chaleur | centre d'hébergement chauffé | 1 | pf01 |
| conseiller scolaire | administrateur scolaire | 1 | pf02 |
| taxe foncière | (supprimée ou reformulée) | 1 | pf02 |
| assurance-emploi | assurance chômage | 1 | pf03 |
| stationnement | parking | 1 | pf04 |
| banlieusard | navetteur | 1 | pf04 |
Textes de remplacement, légendes, mentions de source et transcriptions. Le fichier est réutilisé dans les deux sites linguistiques; les descriptifs, souvent pas.
13 fichiers sur 31 privent le public francophone d'un contenu accessible au public anglophone — texte de remplacement absent ou non traduit, ou transcription manquante pour un média chronométré. Un champ non traduit est pire qu'un champ vide : il passe le contrôle de valeur nulle d'un audit de SGC. Les 18 autres fichiers portent des descriptifs français complets.
| Fichier | Type | État des champs | Note | Accessibilité |
|---|---|---|---|---|
| vid-hlth-028-a | vidéo | texte de remplacement : manquantlégende : conformemention de source : conformetranscription : manquante | 0,20 | texte de remplacement manquant, transcription manquante |
| img-wx-003-a | image | texte de remplacement : manquantlégende : conformemention de source : conforme | 0,31 | texte de remplacement manquant |
| img-muni-020-a | image | texte de remplacement : manquantlégende : conformemention de source : conforme | 0,31 | texte de remplacement manquant |
| img-envr-029-a | image | texte de remplacement : manquantlégende : conformemention de source : conforme | 0,31 | texte de remplacement manquant |
| img-indg-044-a | image | texte de remplacement : manquantlégende : conformemention de source : conforme | 0,31 | texte de remplacement manquant |
| img-cult-019-a | image | texte de remplacement : non traduitlégende : conformemention de source : conforme | 0,48 | texte de remplacement non traduit |
| img-wx-035-a | image | texte de remplacement : non traduitlégende : conformemention de source : conforme | 0,48 | texte de remplacement non traduit |
| img-hlth-053-a | image | texte de remplacement : non traduitlégende : conformemention de source : conforme | 0,48 | texte de remplacement non traduit |
| vid-wx-003-b | vidéo | texte de remplacement : conformelégende : manquantemention de source : conformetranscription : manquante | 0,50 | transcription manquante |
| vid-trns-022-a | vidéo | texte de remplacement : conformelégende : conformemention de source : conformetranscription : manquante | 0,65 | transcription manquante |
| vid-indg-025-a | vidéo | texte de remplacement : conformelégende : conformemention de source : conformetranscription : manquante | 0,65 | transcription manquante |
| aud-hlth-041-a | audio | texte de remplacement : conformelégende : conformemention de source : conformetranscription : manquante | 0,65 | transcription manquante |
| vid-wx-049-a | vidéo | texte de remplacement : conformelégende : conformemention de source : conformetranscription : manquante | 0,65 | transcription manquante |
Les mots-clés et les descriptions de référencement alimentent le repérage en archives et les pages thématiques : un reportage français comportant moins de mots-clés est plus difficile à trouver en français.
Seuls les documents présentant un écart figurent ici; 18 autres sont complets.
| Document | Pupitre | Mots-clés FR/EN | Description de référencement | Note |
|---|---|---|---|---|
| cult-019 | Arts | 2/4 | manquante | 0,45 |
| tech-026 | Technologie | 2/4 | manquante | 0,45 |
| edu-034 | Éducation | 2/4 | manquante | 0,45 |
| muni-042 | Municipal | 2/4 | manquante | 0,45 |
| hlth-053 | Santé | 2/4 | manquante | 0,45 |
| wx-003 | Nouvelles | 3/5 | manquante | 0,49 |
| envr-029 | Nouvelles | 2/4 | conforme | 0,80 |
| indg-044 | Autochtones | 2/4 | conforme | 0,80 |
| tech-059 | Technologie | 2/4 | conforme | 0,80 |
| cult-006 | Arts | 2/3 | conforme | 0,87 |
| trns-022 | Municipal | 3/4 | conforme | 0,90 |
| cult-032 | Arts | 3/4 | conforme | 0,90 |
| cult-047 | Arts | 3/4 | conforme | 0,90 |
| cult-060 | Arts | 3/4 | conforme | 0,90 |
Cohérence et comportement de refus sur l'ensemble du cycle — des défaillances invisibles lorsque les réponses sont évaluées une à une.
Un flux peut rendre un même programme de trois façons au cours d'un cycle, et chaque réponse paraît correcte isolément. Cela nuit à la recherche en archives et au code rédactionnel, et le problème est systématiquement plus marqué dans la seconde langue, où personne ne voit l'ensemble de la production.
| Notion | Forme retenue | Emploi de la forme retenue | Occurrences | Remplacée par |
|---|---|---|---|---|
| warming centre | halte-chaleur | 0 % | 3 | |
| employment insurance | assurance-emploi | 100 % | 1 | |
| property tax | taxe foncière | 100 % | 1 | |
| long term care | soins de longue durée | 100 % | 2 |
Un refus n'avance rien; il obtient donc une note parfaite en véracité et en registre. Refuser plus souvent dans une langue revient à rationner le service selon la langue, et les mesures de qualité habituelles ne peuvent pas le déceler. EN 100 % · FR 100 %. dans l'écart de longueur attendu (FR/EN 0,90).
Un résultat global indique si le flux échoue; la segmentation indique où, ce qui permet d'en confier la correction à une équipe.
| Pupitre | n | Div. | Non serv. | Écart |
|---|---|---|---|---|
| Municipal | 22 | 11 | 1 | +0,197 |
| Arts | 11 | 5 | 0 | +0,182 |
| Nouvelles | 17 | 7 | 2 | +0,176 |
| Politique | 5 | 3 | 0 | +0,167 |
| Économie | 13 | 4 | 1 | +0,154 |
| Éducation | 9 | 4 | 0 | +0,148 |
| Santé | 12 | 4 | 1 | +0,097 |
| Technologie | 10 | 2 | 1 | +0,067 |
| Région | n | Div. | Non serv. | Écart |
|---|---|---|---|---|
| Ontario | 23 | 11 | 4 | +0,206 |
| Ouest | 9 | 3 | 1 | +0,167 |
| Québec | 15 | 6 | 0 | +0,162 |
| Prairies | 14 | 7 | 0 | +0,131 |
| Atlantique | 9 | 3 | 0 | +0,093 |
| National | 30 | 8 | 1 | +0,083 |
| Nord | 14 | 5 | 0 | +0,071 |
| Sujet | n | Div. | Non serv. | Écart |
|---|---|---|---|---|
| recycling faible | 1 | 1 | 1 | +1,000 |
| arts_funding | 3 | 3 | 0 | +0,667 |
| broadcasting | 2 | 1 | 0 | +0,500 |
| fire_service faible | 1 | 1 | 0 | +0,500 |
| music | 2 | 1 | 0 | +0,500 |
| school_funding | 2 | 2 | 0 | +0,500 |
| small_business faible | 1 | 1 | 1 | +0,500 |
| snow_removal | 2 | 2 | 0 | +0,500 |
Tableau complet des résultats — la version accessible de chacun des chiffres ci-dessus. Les requêtes divergentes figurent en tête; les résultats parfaits sont atténués afin de mettre en évidence les valeurs qui diffèrent.
| Requête | Réponse EN | EN P@1 | FR P@1 | EN vérac. | FR vérac. | FR reg. | FR couv. |
|---|---|---|---|---|---|---|---|
| q03Fait non appuyé | Environment Canada measured 24 millimetres of ice accretion at Kemptville during the storm… | 1,00 | 1,00 | 1,00 | 0,00 | 1,00 | 0,00 |
| q20Fait non appuyé | Wildfires consumed 4.2 million hectares this season, surpassing the 2023 record.… | 1,00 | 1,00 | 1,00 | 0,50 | 1,00 | 0,50 |
| q41Fait non appuyé | Small business insolvency filings rose 26 per cent, the highest level since 2011.… | 1,00 | 1,00 | 1,00 | 0,50 | 1,00 | 0,50 |
| q64Fait non appuyé | Ambulance offload delays reached a record 118,000 hours, with a median of 92 minutes again… | 1,00 | 1,00 | 1,00 | 0,67 | 1,00 | 0,67 |
| q83Fait non appuyé | Producer-funded recycling shifted an estimated $156 million in annual costs from municipal… | 1,00 | 1,00 | 1,00 | 0,00 | 1,00 | 0,00 |
| q86Fait non appuyé | All new open datasets require full bilingual metadata from July 1; 41 per cent of existing… | 1,00 | 1,00 | 1,00 | 0,50 | 1,00 | 0,50 |
| q15Sources différentes | Federal supports include a $12 million touring fund expansion with a quarter reserved for … | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 | 0,67 |
| q29Sources différentes | People can go to warming centres — municipalities opened eleven during the ice storm, and … | 1,00 | 1,00 | 1,00 | 1,00 | 0,00 | 0,50 |
| q31Sources différentes | Nursing vacancies drove 1,140 rural emergency room closures, while labour shortages delaye… | 0,00 | 0,00 | 1,00 | 1,00 | 1,00 | 0,83 |
| q32Sources différentes | The broadcaster is opening three bureaus in official language minority markets, and the ar… | 1,00 | 1,00 | 1,00 | 1,00 | 0,00 | 1,00 |
| q51Sources différentes | Employers cited housing availability as the main barrier, and a federal subsidy now covers… | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 |
| q75Sources différentes | Supports include a settlement transferring 78,000 hectares, a country food program in eigh… | 0,00 | 0,00 | 1,00 | 1,00 | 1,00 | 1,00 |
| q07Contenu réduit | A quarter of the $12 million touring fund expansion is reserved for official language mino… | 1,00 | 1,00 | 1,00 | 1,00 | 0,00 | 0,67 |
| q102Contenu réduit | Eviction applications reached 92,000 with an 8-month median hearing wait, while shelters r… | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 | 0,75 |
| q13Contenu réduit | Yes. The department admitted 8.1 per cent of newcomers outside Quebec as French speakers, … | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 | 0,50 |
| q14Contenu réduit | School boards face a combined $88 million shortfall amid 5.4 per cent enrolment growth, wh… | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 | 0,50 |
| q19Contenu réduit | Rural hospitals reported 1,140 temporary emergency room closures last year, more than doub… | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 | 0,83 |
| q22Contenu réduit | Youth unemployment reached 14.2 per cent, the highest since 2016, while the overall rate r… | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 | 0,67 |
| q26Contenu réduit | On-time performance was 67 per cent, below the 80 per cent target, largely due to freight … | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 | 0,74 |
| q35Contenu réduit | Drought cut the Prairie crop forecast 18 per cent after a dry June, with poor soil moistur… | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 | 0,50 |
| q42Contenu réduit | A court ruling on section 23 Charter rights ordered a remedy, and the province will fund t… | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 | 0,50 |
| q49Contenu réduit | Drought cut Prairie crop forecasts 18 per cent while a post-tropical storm flooded 620 coa… | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 | 0,33 |
| q54Contenu réduit | The city is reviewing snow removal contracts after 4,800 service complaints, with twelve o… | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 | 0,33 |
| q62Contenu réduit | Ferry service was cut from ten to six daily crossings after a vessel was removed for hull … | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 | 0,67 |
| q71Contenu réduit | The museum returned 1,100 cultural objects over three years, with 62 requests still in pro… | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 | 0,67 |
| q73Contenu réduit | The city is reviewing snow removal contracts after 4,800 complaints, extreme cold closed s… | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 | 0,67 |
| q82Contenu réduit | The housing guarantee helped fill 92 of 108 vacant teaching positions, with eleven still v… | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 | 0,67 |
| q95Contenu réduit | Volunteer fire departments reported a 24 per cent decline in active members, with 41 depar… | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 | 0,50 |
| q99Contenu réduit | Nursing overtime fell 38 per cent, dental plan enrolment passed 3.1 million, and youth men… | 0,00 | 1,00 | 1,00 | 1,00 | 1,00 | 0,50 |
| q04Registre | Municipalities opened eleven warming centres across the affected region for residents with… | 1,00 | 1,00 | 1,00 | 1,00 | 0,00 | 1,00 |
| q05Registre | Trustees asked the province for a per-student funding increase of $410, as the four boards… | 1,00 | 1,00 | 1,00 | 1,00 | 0,00 | 1,00 |
| q77Registre | Twenty-two warming locations opened in the city during the extreme cold warning.… | 1,00 | 1,00 | 1,00 | 1,00 | 0,00 | 1,00 |
| q01 | Seasonal workers in Atlantic Canada now need 420 insurable hours to qualify for employment… | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 |
| q02 | Quebec signed separately from the other nine provinces, securing an asymmetrical arrangeme… | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 |
| q06 | The authority deferred the increase after four municipalities objected. The toll was to ri… | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 |
| q08 | Halifax had the tightest rental vacancy rate at 0.9 per cent, against a national rate of 1… | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 |
| q09 | Thirty-eight federal judicial appointments remain vacant, with 22 in final review at the j… | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 |
| q10 | The central bank held its policy rate at 3.75 per cent for a third consecutive time and si… | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 |
| q100 | Spring melt evacuated 1,240 residents while drought cut the Prairie crop forecast 18 per c… | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 |
| q101 | New open datasets require bilingual metadata from July 1, and a publishing grant supports … | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 |
| q11 | The snow crab quota for southern Gulf zones was cut 22 per cent to 18,400 tonnes, affectin… | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 |
| q12 | The city's $4.1 billion operating budget carries a 3.9 per cent residential property tax i… | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 |
| q16 | An ice storm cut power to 180,000 homes and caused two deaths on Highway 417, while a plan… | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 |
| q17 | The national dairy commission reduced production quota by 1.8 per cent, the first cut sinc… | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 | 1,00 |
Les requêtes divergentes figurent en tête. 58 autres requêtes sur 102 n'ont montré aucune divergence et sont omises ici; toutes se trouvent dans la sortie JSON.