Frequently Asked Questions

  1. What's this site?

    This site tracks the performance of popular JavaScript engines.

  2. What versions are you testing with?

    Each test run checks out a copy of the latest source code for each vendor it's testing. This means we're testing the latest, greatest, unstable, bleeding-edge versions of browsers' JS engines. The scores here may not represent what you see in stable releases.

  3. Who's behind it? Is Mozilla?

    This site is maintained by Mozilla's JavaScript team.

    Special thanks to wx24 for the new layout, and Michael Clackler for the UI improvements such as hover-tip deltas. Awesome!
  4. Why does the v8 benchmark go down, instead of up?

    The v8 benchmark produces a score, not raw time. We inverted the graph so they all look like "lower is better".

  5. Why do some changesets appear multiple times?

    The graphs update on every v8 or tracemonkey check-in, roughly, so if one updates but not the other, the same changeset can be tested twice.

  6. Why isn't Opera/IE/something here?

    Right now, the performance tests are run on a Mac, which means no IE. Also the tests rely on a "shell" JS engine that runs in a command line. It doesn't test browsers. We'll change that, eventually.

  7. What are the axes?

    The Y axis is time to benchmark completion. Lower is better. The X axis represents test runs, chronologically. The left-most run is the oldest, the right-most run is the latest.

  8. What are the graphs?

    The top left-hand graph is Mozilla's Kraken benchmark. The top right-hand graph is Apple's SunSpider benchmark. The bottom graph is Google's V8 benchmark suite.

  9. What do the hover tips mean?

    "Time" is...time. "Source" is where we got the engine from. "Tested" is when we downloaded the engine, compiled, and tested it. "Rev" is the unique point in the engine's revision history we tested. These numbers/strings are for developers to see which changes happened in between points in the graph.

  10. What runs the tests?

    A mac-mini.

  11. What's ARM?

    ARM is the CPU present in many embedded devices, like smartphones. We're interested in this for mobile Firefox.

  12. Is this open source?

    It's not very interesting (or good), but yes: click here