sitespeed.io 16.0, Browsertime 11.0 and the Coach 6.0

sitespeed.io wish you a Merry Christmas!

Santa Claus has something special for you this Christmas: Today we released a new major release of sitespeed.io!

The Coach is back in town! #

We first released the Coach early 2016 and many things has changed on the web since then, it is time to give the Coach some extra love. Here it is: the Coach 6.0.

We tuned the performance advice to include advice about CPU Long Tasks, removed advice about using HTTP Push and added a advice about Cumulative Layout Shift.

We also added Wappalyzer-core to analyse what software that is used to build the page. Together with a new updated version of Third Party Web the Coach gives the big picture of what is used on the page. Go to the Coach result page and check the new Technologies used to build the page section. To give Wappalyzer more information you can collect the HTML of the page using --browsertime.firefox.includeResponseBodies html or --browsertime.chrome.includeResponseBodies html.

Technologies used to build the page

The Coach uses Wappalyzer and Third Party Web to analyse technologies used.

We increased the number of privacy advice. We incorporated third party web to identify third parties, we fixed a bug in how we count cookies and we started to categorize cookies as first vs third party cookies. It’s now easy to check if your site is violating GDPR. We also added a check if fingerprint.js is used to fingerprint the user.

New privacy advice

Not everyone likes the new privacy advice in the Coach that makes it harder for companies/governments to track your users.

We also removed the accessibility category from the Coach. Yep we had to. We couldn’t keep up with the advice and its better to use AXE-core, that helps you more than the Coach when it comes to accessibility. If you are a sitespeed.io user, use --axe.enable to run Axe.

We also made it easier to understand the Coach advice when you use sitespeed.io. Use the show/hide details button to see the description about the advice.

Click to show details

Here you can see the third party domains and why you should not use third party cookies.

Coeach description

With the new Coach you can click on show/hide to see the full description of the advice to understand why!

Showing the description for each advice helps developers like this old gentleman to understand the advice from the Coach.

Old people also like the Coach!

We also been going through all advice to make sure they are still relevant. The Coach is more vital than ever :)

New Browsertime #

A couple of days ago we released a new Browsertime. One relevant fix that you will notice is that we include the full browser window in the video for desktop (as we always done on mobile). It will not affect the metrics, only the video.

Full browser Window

We also updated our EdgeDriver library to download EdgeDriver if it exists (now in Linux) and included Edge in the Docker container. We added Microsoft Edge 89.0.731.0 dev since the corresponding EdgeDriver for 88 is ten times bigger in size and we do want to keep the container as small as possible. Make sure to match the EdgeDriver with your Edge version if you run using NodeJS!

Microsoft Edge 89.0.731.0

Microsoft Edge 89.0.731.0 dev is included in the Docker container for people that care about Microsoft :)

We have some bug fixes too, especially if you test on Android. You can check the changelog to see all changes.

New sitespeed.io #

First off, we have a breaking change if you use the WebPageTest plugin. We moved that to a new repository.

WebPageTest plugin got a new repository #

We moved out the WebPageTest plugin to a new repository. It will still work as before, but you need install the plugin or run the WebPageTest container (docker run --rm -v "$(pwd)":/sitespeed.io sitespeedio/sitespeed.io:16.0.0-webpagetest https://www.sitespeed.io --plugins.add /webpagetest --webpagetest.key KEY):

There’s a couple of reasons:

  1. It’s easier to focus on the core functionality with Browsertime. Some people still think sitespeed.io is built on top of WebPageTest. That is not true. It’s built on top of Browsertime, our own engine (used by Mozilla to test performance regressions). But you can use WebPageTest as complement directly from sitespeed.io as you can with Lighthouse and other tools.
  2. The WebPageTest API library is the 3rd party library that we use that historically has taken the longest time to fix security issues.
  3. A new repository makes it much easier for people at Catchpoint to contribute back to the WebPageTest plugin!
  4. I’m not interested in pushing users to become customers at Catchpoint. WebPageTest is a good tool but I’m not sure Catchpoint is the company to make it better. Maybe they will prove me wrong :)

Other changes #

There’s many many small changes in the new release, checkout the changelog for all changes. You can look at a example run or just try out the latest versions. If you use Docker:

docker run --rm -v "$(pwd):/sitespeed.io" sitespeedio/sitespeed.io:17.1.1 https://www.sitespeed.io/

Or if you use npm, install sitespeed.io globally:

npm install -g sitespeed.io

Make sure you have the browser you want to use for testing installed (Firefox/Chrome/Edge/Safari) and then run:

sitespeed.io https://www.sitespeed.io/ -b chrome

New plugin maintainers welcome #

We are looking for new maintainers of the Lighthouse and WebPageTest plugin. If you are interested, create an issue in the respectively repository.

Support sitespeed.io #

We are still looking for supporters to support our server setup that makes our tests run. You can help us by supporting us at Open Collective!

And more in the latest releases #

We also done a couple of bug fixes. Checkout the Browsertime changelog, the sitespeed.io changelog and the Coach changelog for the full list.

/Peter