Skip to content

[feature]: Add CLI flag to pass additive response schema changes with warning instead of marking them as LOW-risk failures #3971

@AuraReaper

Description

@AuraReaper

👀 Is there an existing feature request for this?

  • I have searched the existing issues

🔖 Enhancement description

During OSS replay, if a testcase was recorded with response schema X and the endpoint later returns schema Y where Y only adds new fields, the testcase currently gets marked as a LOW-risk failure.

We want an optional behavior behind a CLI flag:

  • pass the testcase
  • show a meaningful warning in logs
  • do not mark it as a LOW-risk failure
  • do not count it in low-risk failure summaries/reports

Expected behavior

Add a new CLI flag for replay/test.

🎤 Why should this be worked on?

Current flow:

  1. Record an endpoint response with schema X
  2. Change the endpoint so the actual response schema becomes Y
  3. Y only adds new fields compared to X
  4. Replay marks the testcase as a low-risk issue/failure

This is not the behavior we want for this feature.

💻 Repository

keploy

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions