Upstream »
Source code »

Software Forge Performance Index in Japan

This webpage collects performance information about various hosted software development services. The reports are updated sometimes, most recently on March 17, 2021 at 08:09 UTC, and were generated with Lighthouse 7.2.0. Patches welcome!

Disclaimer: This website is maintained by postfixnotation.org and is developed by SourceHut.

Expand for details on methodology

We ran Lighthouse 7.2.0 on Ubuntu x86_64, with the following command line:

lighthouse <url> \
    --only-categories=performance,accessibility \
    --profile=desktop \
    --throttling.cpuSlowdownMultiplier=1

The desktop profile is used because it's rare that a developer is coding on a mobile device — and some forges have separate mobile sites, so a separate test suite would be warranted.

We left the throttling settings at the Lighthouse default, because it's less rare that a developer is tethered to their phone or working from a community with less privileged internet access. The simulated latency also helps to reduce the variable impact of real-world latency. Additionally, simulating a low-bandwidth connection helps to draw out the differences between services more clearly. This controls for network conditions; the same tests have been run from various datacenters with various degrees of favorability to each hosting provider with no discernible change in the results.

CPU throttling is disabled to offset the effects of not having a GPU available in our testing environment. If you run these tests locally, it is recommended that you remove this constraint.

The source code (upstream) is available if you wish to run these benchmarks on your own system; it takes about an hour.

0–49 50–89 90–100

All performance results

Bitbucket Codeberg GitHub GitLab Pagure SourceHut
Browsing Git repositories
Summary page 30 82 90 74 85 99
Tree (best case) 30 86 81 77 82 100
Tree (worst case) 28 50 86 38 49 91
Log (best case) 36 80 89 77 74 99
Log (worst case) 36 75 88 83 0 100
Commit 57 72 90 72 75 100
Source file (best case) 24 82 86 77 73 99
Source file (worst case) 20 28 46 0 0 79
Blame (best case) 61 87 86 68 46 98
Blame (worst case) 0 0 n/a 0 0 0
Browsing tickets/issues
Browsing 55 84 91 75 67 99
Search 55 91 86 73 81 98
Details and comments 63 46 75 56 74 87
Code review
Browsing patches 36 92 90 76 85 99
Patch discussion 63 74 73 71 58 87
Patch diff 62 80 84 53 55 87

Browsing Git repositories

Summary page

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
SourceHut 2 requests 32 KiB 99 100 2.8 s 1.2 s 1.2 s 1.2 s 1.2 s 20 ms HTMLJSONstderr
GitHub 37 requests 385 KiB 90 96 2.8 s 2.7 s 2.7 s 2.7 s 2.7 s 30 ms HTMLJSONstderr
Pagure 19 requests 704 KiB 85 67 4.9 s 2.9 s 2.9 s 2.9 s 2.9 s 20 ms HTMLJSONstderr
Codeberg 15 requests 607 KiB 82 78 5.6 s 1.8 s 2.7 s 3.7 s 3.7 s 50 ms HTMLJSONstderr
GitLab 30 requests 799 KiB 74 72 3.0 s 2.6 s 3.5 s 5.7 s 5.7 s 60 ms HTMLJSONstderr
Bitbucket 61 requests 1430 KiB 30 100 9.4 s 7.6 s 8.4 s 11.1 s 11.1 s 250 ms HTMLJSONstderr

Tree (best case)

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
SourceHut 2 requests 30 KiB 100 93 2.3 s 1.3 s 1.3 s 1.3 s 1.3 s 20 ms HTMLJSONstderr
Codeberg 14 requests 602 KiB 86 81 4.7 s 1.8 s 2.6 s 2.6 s 2.6 s 40 ms HTMLJSONstderr
Pagure 18 requests 503 KiB 82 96 4.0 s 2.7 s 2.7 s 2.7 s 2.7 s 20 ms HTMLJSONstderr
GitHub 25 requests 326 KiB 81 98 3.1 s 2.6 s 2.6 s 2.6 s 2.6 s 30 ms HTMLJSONstderr
GitLab 28 requests 746 KiB 77 77 2.2 s 2.0 s 2.0 s 5.3 s 5.4 s 150 ms HTMLJSONstderr
Bitbucket 61 requests 1427 KiB 30 100 8.6 s 7.5 s 8.3 s 11.0 s 11.0 s 270 ms HTMLJSONstderr

Tree (worst case)

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
SourceHut 2 requests 74 KiB 91 93 6.6 s 1.4 s 1.4 s 1.4 s 1.4 s 20 ms HTMLJSONstderr
GitHub * 24 requests 553 KiB 86 98 3.7 s 2.9 s 2.9 s 4.2 s 4.5 s 440 ms HTMLJSONstderr
Codeberg 14 requests 753 KiB 50 81 9.2 s 2.6 s 2.7 s 6.6 s 6.6 s 1,790 ms HTMLJSONstderr
Pagure 18 requests 1229 KiB 49 96 6.9 s 6.3 s 6.3 s 6.3 s 6.3 s 20 ms HTMLJSONstderr
GitLab 49 requests 845 KiB 38 77 3.4 s 1.8 s 4.0 s 13.2 s 13.7 s 670 ms HTMLJSONstderr
Bitbucket * 60 requests 1440 KiB 28 100 9.4 s 7.7 s 8.5 s 11.0 s 11.0 s 290 ms HTMLJSONstderr
Notes

Log (best case)

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
SourceHut 2 requests 33 KiB 99 94 2.9 s 1.2 s 1.2 s 1.2 s 1.2 s 20 ms HTMLJSONstderr
GitHub 27 requests 324 KiB 89 100 3.2 s 2.6 s 2.6 s 2.6 s 2.6 s 30 ms HTMLJSONstderr
Codeberg 42 requests 757 KiB 80 90 5.7 s 2.0 s 2.0 s 3.9 s 3.9 s 70 ms HTMLJSONstderr
GitLab 33 requests 567 KiB 77 77 4.2 s 2.0 s 3.3 s 4.8 s 4.9 s 120 ms HTMLJSONstderr
Pagure 68 requests 702 KiB 74 78 5.5 s 3.3 s 3.3 s 3.3 s 3.3 s 40 ms HTMLJSONstderr
Bitbucket 47 requests 1209 KiB 36 100 8.1 s 7.6 s 7.8 s 7.8 s 9.3 s 250 ms HTMLJSONstderr

Log (worst case)

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
SourceHut 2 requests 39 KiB 100 94 2.2 s 1.1 s 1.1 s 1.1 s 1.1 s 20 ms HTMLJSONstderr
GitHub 29 requests 348 KiB 88 100 3.2 s 2.8 s 2.8 s 2.8 s 2.8 s 30 ms HTMLJSONstderr
GitLab 53 requests 588 KiB 83 77 6.1 s 1.2 s 2.6 s 4.9 s 5.0 s 90 ms HTMLJSONstderr
Codeberg 48 requests 638 KiB 75 90 8.5 s 2.0 s 2.8 s 3.9 s 3.9 s 70 ms HTMLJSONstderr
Bitbucket 50 requests 1205 KiB 36 98 8.3 s 7.6 s 7.8 s 7.8 s 9.5 s 270 ms HTMLJSONstderr
Pagure n/an/a The page provided is not HTML (served as MIME type ). HTML JSON stderr

Commit

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
SourceHut 2 requests 33 KiB 100 83 2.3 s 1.1 s 1.1 s 1.1 s 1.1 s 20 ms HTMLJSONstderr
GitHub 22 requests 324 KiB 90 97 3.1 s 2.7 s 2.7 s 2.7 s 2.7 s 50 ms HTMLJSONstderr
Pagure 23 requests 781 KiB 75 72 5.7 s 3.0 s 3.0 s 5.2 s 5.8 s 90 ms HTMLJSONstderr
Codeberg 22 requests 854 KiB 72 88 6.3 s 2.1 s 3.3 s 3.3 s 3.3 s 30 ms HTMLJSONstderr
GitLab 33 requests 724 KiB 72 81 3.5 s 2.5 s 3.2 s 5.6 s 5.6 s 110 ms HTMLJSONstderr
Bitbucket 40 requests 2411 KiB 57 94 7.5 s 3.0 s 3.0 s 3.0 s 15.0 s 250 ms HTMLJSONstderr

Source file (best case)

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
SourceHut 3 requests 53 KiB 99 94 3.3 s 1.4 s 1.4 s 1.4 s 1.4 s 20 ms HTMLJSONstderr
GitHub 24 requests 377 KiB 86 98 2.8 s 2.6 s 2.6 s 2.6 s 2.6 s 30 ms HTMLJSONstderr
Codeberg 12 requests 621 KiB 82 96 4.9 s 2.0 s 2.0 s 3.8 s 3.8 s 60 ms HTMLJSONstderr
GitLab 23 requests 551 KiB 77 87 3.3 s 2.0 s 3.5 s 5.1 s 5.3 s 120 ms HTMLJSONstderr
Pagure 21 requests 889 KiB 73 94 4.4 s 2.8 s 3.3 s 5.5 s 5.4 s 90 ms HTMLJSONstderr
Bitbucket 67 requests 1910 KiB 24 98 10.5 s 7.5 s 9.6 s 11.0 s 14.1 s 260 ms HTMLJSONstderr

Source file (worst case)

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
SourceHut 3 requests 322 KiB 79 94 9.1 s 2.9 s 2.9 s 2.9 s 2.9 s 20 ms HTMLJSONstderr
GitHub 34 requests 758 KiB 46 ? 5.8 s 4.5 s 4.5 s 7.2 s 7.6 s 160 ms HTMLJSONstderr
Codeberg 12 requests 1104 KiB 28 ? 12.2 s 4.5 s 4.5 s 8.7 s 8.9 s 620 ms HTMLJSONstderr
Bitbucket 71 requests 3009 KiB 20 98 10.4 s 7.5 s 9.6 s 11.1 s 19.8 s 280 ms HTMLJSONstderr
GitLab n/an/a An error occured, see the log for more details. HTML JSON stderr
Pagure n/an/a An error occured, see the log for more details. HTML JSON stderr

Blame (best case)

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
SourceHut 3 requests 60 KiB 98 94 3.7 s 1.2 s 1.2 s 1.2 s 1.2 s 20 ms HTMLJSONstderr
Codeberg 38 requests 772 KiB 87 96 5.8 s 2.2 s 2.2 s 4.3 s 4.3 s 230 ms HTMLJSONstderr
GitHub 33 requests 378 KiB 86 98 3.6 s 2.8 s 2.8 s 3.2 s 3.3 s 60 ms HTMLJSONstderr
GitLab 32 requests 587 KiB 68 84 3.3 s 1.3 s 2.7 s 5.1 s 5.3 s 610 ms HTMLJSONstderr
Bitbucket 33 requests 2491 KiB 61 85 10.0 s 2.9 s 2.9 s 2.9 s 15.3 s 230 ms HTMLJSONstderr
Pagure 20 requests 1202 KiB 46 83 9.1 s 4.5 s 4.5 s 5.7 s 6.6 s 270 ms HTMLJSONstderr

Blame (worst case)

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
Bitbucket n/an/a Lighthouse was unable to reliably load the page you requested. Make sure you are testing the correct URL and that the server is properly responding to all requests. (Status code: 500) HTML JSON stderr
Codeberg n/an/a The page provided is not HTML (served as MIME type ). HTML JSON stderr
GitLab n/an/a Lighthouse was unable to reliably load the page you requested. Make sure you are testing the correct URL and that the server is properly responding to all requests. (Status code: 500) HTML JSON stderr
Pagure n/an/a An error occured, see the log for more details. HTML JSON stderr
SourceHut n/an/a The page provided is not HTML (served as MIME type ). HTML JSON stderr
Notes

Browsing tickets/issues

Browsing

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
SourceHut 2 requests 35 KiB 99 100 2.9 s 1.1 s 1.1 s 1.1 s 1.1 s 20 ms HTMLJSONstderr
GitHub 23 requests 317 KiB 91 98 2.8 s 2.6 s 2.6 s 2.6 s 2.6 s 30 ms HTMLJSONstderr
Codeberg 27 requests 885 KiB 84 86 4.4 s 2.0 s 2.0 s 3.8 s 3.8 s 50 ms HTMLJSONstderr
GitLab 37 requests 737 KiB 75 77 3.1 s 1.2 s 2.6 s 5.7 s 5.7 s 70 ms HTMLJSONstderr
Pagure 17 requests 623 KiB 67 78 7.4 s 3.3 s 3.8 s 3.8 s 3.8 s 40 ms HTMLJSONstderr
Bitbucket 36 requests 2352 KiB 55 92 8.2 s 4.0 s 4.0 s 4.0 s 15.0 s 240 ms HTMLJSONstderr
Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
SourceHut 2 requests 35 KiB 98 100 3.5 s 1.1 s 1.1 s 1.1 s 1.1 s 20 ms HTMLJSONstderr
Codeberg 27 requests 885 KiB 91 86 5.0 s 2.1 s 2.1 s 3.9 s 3.9 s 60 ms HTMLJSONstderr
GitHub 23 requests 318 KiB 86 98 3.5 s 2.8 s 2.8 s 2.8 s 2.8 s 30 ms HTMLJSONstderr
Pagure 18 requests 590 KiB 81 78 5.5 s 3.2 s 3.2 s 3.2 s 3.2 s 20 ms HTMLJSONstderr
GitLab 34 requests 734 KiB 73 70 3.4 s 1.7 s 2.4 s 5.6 s 5.7 s 120 ms HTMLJSONstderr
Bitbucket 35 requests 2350 KiB 55 92 7.9 s 4.0 s 4.0 s 4.0 s 15.0 s 250 ms HTMLJSONstderr

Details and comments

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
SourceHut 2 requests 58 KiB 87 91 9.2 s 1.2 s 1.2 s 1.2 s 1.2 s 20 ms HTMLJSONstderr
GitHub 50 requests 542 KiB 75 98 5.5 s 3.1 s 3.2 s 3.2 s 3.2 s 50 ms HTMLJSONstderr
Pagure 38 requests 3527 KiB 74 87 5.2 s 3.3 s 3.3 s 3.3 s 3.3 s 30 ms HTMLJSONstderr
Bitbucket 35 requests 2363 KiB 63 94 7.4 s 2.9 s 2.9 s 2.9 s 14.1 s 220 ms HTMLJSONstderr
GitLab 61 requests 1116 KiB 56 70 3.3 s 1.3 s 4.0 s 7.3 s 7.6 s 520 ms HTMLJSONstderr
Codeberg 44 requests 1350 KiB 46 84 10.3 s 4.0 s 4.0 s 6.9 s 8.2 s 70 ms HTMLJSONstderr

Code review

Browsing patches

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
SourceHut 2 requests 31 KiB 99 91 3.0 s 1.3 s 1.3 s 1.3 s 1.3 s 20 ms HTMLJSONstderr
Codeberg 27 requests 885 KiB 92 86 5.2 s 1.8 s 1.8 s 3.7 s 3.7 s 60 ms HTMLJSONstderr
GitHub 22 requests 307 KiB 90 98 3.3 s 2.7 s 2.7 s 2.7 s 2.7 s 30 ms HTMLJSONstderr
Pagure 17 requests 538 KiB 85 82 5.7 s 2.8 s 2.8 s 2.8 s 2.8 s 30 ms HTMLJSONstderr
GitLab 30 requests 678 KiB 76 77 3.6 s 1.2 s 2.6 s 5.3 s 5.4 s 60 ms HTMLJSONstderr
Bitbucket 80 requests 1971 KiB 36 100 8.2 s 7.6 s 7.6 s 9.5 s 11.3 s 240 ms HTMLJSONstderr

Patch discussion

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
SourceHut 2 requests 71 KiB 87 ? 9.3 s 1.2 s 1.2 s 1.2 s 1.2 s 20 ms HTMLJSONstderr
Codeberg 21 requests 880 KiB 74 84 6.7 s 2.0 s 2.0 s 4.3 s 4.3 s 60 ms HTMLJSONstderr
GitHub 37 requests 596 KiB 73 ? 6.1 s 3.1 s 3.5 s 3.5 s 3.5 s 40 ms HTMLJSONstderr
GitLab 55 requests 1313 KiB 71 79 4.1 s 2.6 s 4.3 s 7.6 s 8.0 s 250 ms HTMLJSONstderr
Bitbucket 124 requests 2113 KiB 63 ? 8.6 s 2.4 s 2.4 s 2.4 s 10.7 s 190 ms HTMLJSONstderr
Pagure 39 requests 2955 KiB 58 68 9.8 s 4.6 s 4.6 s 4.6 s 4.6 s 30 ms HTMLJSONstderr

Patch diff

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
SourceHut * 2 requests 71 KiB 87 ? 9.2 s 1.2 s 1.2 s 1.2 s 1.2 s 20 ms HTMLJSONstderr
GitHub 23 requests 469 KiB 84 97 4.0 s 2.8 s 3.2 s 3.2 s 3.2 s 40 ms HTMLJSONstderr
Codeberg 20 requests 874 KiB 80 87 6.5 s 2.4 s 2.4 s 4.7 s 5.1 s 60 ms HTMLJSONstderr
Bitbucket * 124 requests 2113 KiB 62 ? 8.5 s 2.9 s 2.9 s 2.9 s 10.0 s 190 ms HTMLJSONstderr
Pagure 39 requests 2955 KiB 55 68 10.3 s 4.6 s 4.6 s 4.6 s 4.6 s 40 ms HTMLJSONstderr
GitLab 54 requests 1350 KiB 53 84 5.7 s 1.2 s 4.5 s 9.2 s 10.1 s 370 ms HTMLJSONstderr
Notes