
RealDiff
RealDiff is a tool that detects runtime behavior changes in pull requests by running the same tests on both branches, comparing method call arguments and return values to uncover behavioral differences that source code review might miss. It supports multiple languages including .NET, Java, Node, Go, Rust, and Python, integrating with existing test suites to observe actual test execution without mutation testing or static analysis.
Ratings & Reviews
Write a reviewBe the first to share a thoughtful review.
Information
Around the Web
I’ve read the readme a few times and still have no idea how this is useful. The motivating example of Sort => SortBy has no description of what’s highlighted and no description of how. Is it running the old test suite with the new changes as a weak form of mutation testing? Something else?
vlovich123 · Imported from Show HN
I love the concept and see the value for refactoring. There is tremendous value in knowing that two implementations are run-time equivalent. I just wanted to share for others that there is a configuration language call Dhall (https://dhall-lang.org/) that has this kind of guarantee as one of its nicest features. See the "Refactor Fearlessly" section. In Dhall, most behavior preserving refactors produce the exact same hash code so you can know - for an absolute fact - that a refactor is behavior neutral. The point of sharing that other language is just to legitimize that "this is a thing" i.e. it has value recognized by others.
johnsuder · Imported from Show HN