Support » Plugin: PHP Compatibility Checker » Accuracy is pretty bad – 30-40% false pos results

Accuracy is pretty bad – 30-40% false pos results

  • Blackhawk Cybersecurity

    (@blackhawkcybersec)


    2 years, 5 months ago

    The accuracy is just plain bad.

    Not sure what other way there is to put it. Tested on over 30 plugins!

    The docs say:

    While this plugin is written to detect as many problems as accurately as possible, 100% reliable detection is very difficult to ensure. It is best practice to run comprehensive tests before you migrate to a new PHP version.

    Not even close to 100%. False positives about 30-40% of the time. That’s not usable. Please put some work into this or take it down.

    Too many errors to list.

    What you said:

    It is best practice to run comprehensive tests before you migrate to a new PHP version.

    Is absolutely true…in which case you don’t need a plugin.

Viewing 2 replies - 1 through 2 (of 2 total)
  • Plugin Author Jason Stallings

    (@octalmage)

    2 years, 5 months ago

    Hi @blackhawkcybersec,

    This plugin uses a popular PHP library for compatibility testing:
    https://github.com/wimg/PHPCompatibility

    This is static code analysis, which will never be 100% accurate. We try to make that as clear as possible. At WP Engine we use it as a starting point. We scan thousands of sites and the sites that pass we consider compatible.

    I apologize if this plugin wasn’t useful for you. If you’d like to help improve the scanning feel free to create issues here. They are very open to all suggestions!

    Thanks for your feedback!

    Blackhawk Cybersecurity

    (@blackhawkcybersec)

    2 years, 5 months ago

    This is static code analysis, which will never be 100% accurate.

    Yes, I know this. I’m a developer. It’s not an effective method.

    At WP Engine we use it as a starting point.

    That doesn’t make it a good method.

Viewing 2 replies - 1 through 2 (of 2 total)
  • The topic ‘Accuracy is pretty bad – 30-40% false pos results’ is closed to new replies.
  • PHP Compatibility Checker
  • Frequently Asked Questions
  • Support Threads
  • Active Topics
  • Unresolved Topics
  • Reviews

Topic Tags

Views