👀 Is there an existing feature request for this?
🔖 Enhancement description
During OSS replay, if a testcase was recorded with response schema X and the endpoint later returns schema Y where Y only adds new fields, the testcase currently gets marked as a LOW-risk failure.
We want an optional behavior behind a CLI flag:
- pass the testcase
- show a meaningful warning in logs
- do not mark it as a
LOW-risk failure
- do not count it in low-risk failure summaries/reports
Expected behavior
Add a new CLI flag for replay/test.
🎤 Why should this be worked on?
Current flow:
- Record an endpoint response with schema
X
- Change the endpoint so the actual response schema becomes
Y
Y only adds new fields compared to X
- Replay marks the testcase as a low-risk issue/failure
This is not the behavior we want for this feature.
💻 Repository
keploy