Skip to content

Conversation

@aitap
Copy link
Member

@aitap aitap commented Dec 15, 2025

Switch all tests that depend on untranslated output being produced to use output= or notOutput= so that translation doesn't break them any more. Skip test 1590.14 because it fails due to the bytes having completely different meanings on Windows when the ANSI codepage is not 1252.

This will still fail in interesting ways (e.g. translateChar() warnings from the parser) on systems that cannot represent Latin-1 characters in the native encoding. We still need #7388 and a few more fixes for that.

capture.output() tests are fine in many places, but these ones tested
for messages that have since been translated and must be skipped in
foreign more.
Where capture.output() was previously used to test the absence of
messages, use notOutput= instead so that the test will be skipped.

While the test succeeded anyway due to the captured output containing
neither the original untranslated message (being matched) nor its
translation (that could be printed if a regression happened), skipping
the test is more fair.
When working in foreign mode, count the occurrences of tests for message
content (which are essentially skipped) and report the number if it's
non-zero.
@codecov
Copy link

codecov bot commented Dec 15, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 99.06%. Comparing base (b0c4ac3) to head (01857cb).
⚠️ Report is 15 commits behind head on master.

Additional details and impacted files
@@           Coverage Diff           @@
##           master    #7478   +/-   ##
=======================================
  Coverage   99.06%   99.06%           
=======================================
  Files          86       86           
  Lines       16618    16629   +11     
=======================================
+ Hits        16463    16474   +11     
  Misses        155      155           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@github-actions
Copy link

github-actions bot commented Dec 15, 2025

No obvious timing issues in HEAD=more-foreign-tests
Comparison Plot

Generated via commit 01857cb

Download link for the artifact containing the test results: ↓ atime-results.zip

Task Duration
R setup and installing dependencies 2 minutes and 49 seconds
Installing different package versions 43 seconds
Running and plotting the test cases 2 minutes and 57 seconds

Copy link
Member

@MichaelChirico MichaelChirico left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great!!

Instead, test substitute(x) for %iscall% "print" to decide whether to
print the x before testing the output.
@ben-schwen ben-schwen merged commit 2654599 into master Dec 22, 2025
12 checks passed
@ben-schwen ben-schwen deleted the more-foreign-tests branch December 22, 2025 12:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants