Skip to content

Enable real-time Python test logs by default - #398

Merged
rquidute merged 1 commit into
project-chip:v2.16-developfrom
rquidute:feature/1171-realtime-logs-default
Oct 13, 2026
Merged

rquidute merged 1 commit into
project-chip:v2.16-developfrom
rquidute:feature/1171-realtime-logs-default

Conversation

@rquidute

@rquidute rquidute commented Oct 9, 2026

Copy link
Copy Markdown
Contributor

What

ENABLE_REALTIME_PYTHON_TEST_LOGS defaults to True. Projects can still override it with th_config.enable_realtime_python_test_logs.

Why / evidence

Real-time mode shows logs per step instead of replaying the whole SDK output at the end of each test case. Only worthwhile after #1166: before that fix real-time mode logged half the content, which is why it first looked ~30 s faster. With equal content the gain is 2.5–5 s (3–6%) on a 70–75 s run, around the noise level (stock + gap fix: 74.4 → 70.6 s mean; with the other PRs: 70.6 → 66.0 s).

Notes

  • User-visible behaviour change (logs appear per step). Needs release notes; the User Guide in the main repo still lists False as the default (ENABLE_REALTIME_PYTHON_TEST_LOGS section) and needs a follow-up edit.
  • Merge after the #1166 PR.
  • Low value on its own; happy to drop it if reviewers prefer to keep the current default.

Tests

No test depends on the default (they set it explicitly or mock settings). The unit tests below were not run locally before opening this PR (they need the Docker/Postgres stack); CI will run them. Behaviour was also checked on a real device: TC-ACE-1.3 through the CLI on an Ubuntu test host.

Closes #1171
Part of #1119

Observed ~30s shorter runs on a Raspberry Pi vs. batch replay at the end of
each test case. Projects can still opt out per project via
th_config.enable_realtime_python_test_logs=false, or instance-wide via
ENABLE_REALTIME_PYTHON_TEST_LOGS=False.

Refs project-chip/certification-tool#1119
@coderabbitai

coderabbitai Bot commented Oct 9, 2026 •

Copy link
Copy Markdown

Warning

Review limit reached

You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository.

Next included review available in 59 minutes.

Check out review usage here.

View limit details

Limit details: You’ve used the included review currently available.

Learn how review limits work.

Review configuration:

⚙️ Run configuration
  • Configuration used: Organization UI
  • Review profile: CHILL
  • Plan: Advanced
  • Run ID: 18b18943-84c1-438a-864b-c7e0565ae88f

📥 Commits

Reviewing files that changed from the base of the PR and between ce3ccc8 and c7ca019.


📒 Files selected for processing (1)
  • app/core/config.py


  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@mergify

mergify Bot commented Oct 9, 2026 •

Copy link
Copy Markdown

This pull request does not currently match the merge queue conditions, so it cannot be queued from here. The box comes back if it matches again.

@rquidute rquidute self-assigned this Oct 9, 2026
@rquidute
rquidute requested a review from antonio-amjr October 9, 2026 22:33
@rquidute
rquidute merged commit 5e6ce00 into project-chip:v2.16-develop Oct 13, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants