Upstream »
Source code »

Software Forge Performance Index in Japan

This webpage collects performance information about various hosted software development services. The reports are updated sometimes, most recently on February 2, 2022 at 12:25 UTC, and were generated with Lighthouse 6.3.0. Patches welcome!

Disclaimer: This website is maintained by postfixnotation.org and is developed by SourceHut.

Expand for details on methodology

We ran Lighthouse 6.3.0 on Ubuntu x86_64, with the following command line: 

lighthouse <url> \
    --only-categories=performance,accessibility \
    --profile=desktop \
    --throttling.cpuSlowdownMultiplier=1

The desktop profile is used because it's rare that a developer is coding on a mobile device — and some forges have separate mobile sites, so a separate test suite would be warranted.

We left the throttling settings at the Lighthouse default, because it's less rare that a developer is tethered to their phone or working from a community with less privileged internet access. The simulated latency also helps to reduce the variable impact of real-world latency. Additionally, simulating a low-bandwidth connection helps to draw out the differences between services more clearly. This controls for network conditions; the same tests have been run from various datacenters with various degrees of favorability to each hosting provider with no discernible change in the results.

CPU throttling is disabled to offset the effects of not having a GPU available in our testing environment. If you run these tests locally, it is recommended that you remove this constraint.

The source code (upstream) is available if you wish to run these benchmarks on your own system; it takes about an hour.

0–49 50–89 90–100

All performance results

Bitbucket Codeberg GitHub GitLab Pagure SourceHut
Browsing Git repositories
Summary page 32 86 89 76 88 100
Tree (best case) 32 90 81 76 82 100
Tree (worst case) 27 34 80 70 40 90
Log (best case) 34 72 93 80 85 100
Log (worst case) 35 74 87 75 0 100
Commit 61 73 93 73 80 100
Source file (best case) 0 78 90 72 70 99
Source file (worst case) 0 13 37 61 45 76
Blame (best case) 57 55 92 75 43 97
Blame (worst case) 0 0 n/a 0 0 0
Browsing tickets/issues
Browsing 50 82 91 78 80 99
Search 51 62 91 75 82 98
Details and comments 52 44 79 62 60 96
Code review
Browsing patches 0 82 92 76 83 99
Patch discussion 21 78 83 65 52 86
Patch diff 39 76 87 64 57 86

Browsing Git repositories

Summary page

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
SourceHut 2 requests 31 KiB 100 100 2.1 s 1.2 s 1.2 s 1.2 s 1.2 s 20 ms HTML • JSON • stderr
GitHub 52 requests 907 KiB 89 96 2.5 s 2.5 s 2.5 s 2.5 s 2.5 s 20 ms HTML • JSON • stderr
Pagure 20 requests 751 KiB 88 67 4.4 s 2.8 s 2.8 s 2.8 s 2.8 s 20 ms HTML • JSON • stderr
Codeberg 19 requests 906 KiB 86 82 4.4 s 2.6 s 2.6 s 5.9 s 6.0 s 60 ms HTML • JSON • stderr
GitLab 37 requests 860 KiB 76 77 1.4 s 1.0 s 1.7 s 4.7 s 5.0 s 130 ms HTML • JSON • stderr
Bitbucket 72 requests 2686 KiB 32 100 10.3 s 9.6 s 10.8 s 14.7 s 14.8 s 190 ms HTML • JSON • stderr

Tree (best case)

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
SourceHut 2 requests 30 KiB 100 94 2.2 s 1.2 s 1.2 s 1.2 s 1.2 s 20 ms HTML • JSON • stderr
Codeberg 19 requests 903 KiB 90 85 4.4 s 2.7 s 2.7 s 2.7 s 2.7 s 40 ms HTML • JSON • stderr
Pagure 20 requests 551 KiB 82 96 4.1 s 2.6 s 2.6 s 2.6 s 2.6 s 20 ms HTML • JSON • stderr
GitHub 34 requests 360 KiB 81 98 2.5 s 2.5 s 2.5 s 2.5 s 2.5 s 20 ms HTML • JSON • stderr
GitLab 36 requests 853 KiB 76 81 1.5 s 1.0 s 1.0 s 4.5 s 4.8 s 160 ms HTML • JSON • stderr
Bitbucket 71 requests 2684 KiB 32 100 10.9 s 9.6 s 10.0 s 10.6 s 17.2 s 180 ms HTML • JSON • stderr

Tree (worst case)

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
SourceHut 2 requests 83 KiB 90 ? 7.1 s 1.4 s 1.4 s 1.4 s 1.4 s 20 ms HTML • JSON • stderr
GitHub * 36 requests 591 KiB 80 98 3.6 s 2.7 s 2.7 s 4.7 s 5.1 s 480 ms HTML • JSON • stderr
GitLab 39 requests 871 KiB 70 81 2.5 s 1.0 s 1.8 s 5.5 s 5.5 s 170 ms HTML • JSON • stderr
Pagure 20 requests 1278 KiB 40 96 20.4 s 6.4 s 6.4 s 7.8 s 7.9 s 80 ms HTML • JSON • stderr
Codeberg 19 requests 1055 KiB 34 ? 7.9 s 3.9 s 3.9 s 8.9 s 8.9 s 850 ms HTML • JSON • stderr
Bitbucket * 73 requests 2696 KiB 27 100 10.7 s 9.8 s 11.0 s 11.0 s 15.0 s 290 ms HTML • JSON • stderr
Notes

Log (best case)

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
SourceHut 2 requests 34 KiB 100 ? 2.4 s 1.1 s 1.1 s 1.1 s 1.1 s 20 ms HTML • JSON • stderr
GitHub 34 requests 360 KiB 93 100 2.9 s 2.5 s 2.5 s 2.5 s 2.5 s 30 ms HTML • JSON • stderr
Pagure 70 requests 750 KiB 85 78 4.8 s 3.0 s 3.0 s 3.0 s 3.0 s 20 ms HTML • JSON • stderr
GitLab 40 requests 696 KiB 80 77 1.9 s 1.2 s 1.8 s 4.8 s 5.0 s 130 ms HTML • JSON • stderr
Codeberg 24 requests 1223 KiB 72 82 6.7 s 3.2 s 3.2 s 6.5 s 6.5 s 60 ms HTML • JSON • stderr
Bitbucket 69 requests 1820 KiB 34 100 10.0 s 9.8 s 10.1 s 12.7 s 12.9 s 140 ms HTML • JSON • stderr

Log (worst case)

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
SourceHut 2 requests 40 KiB 100 ? 2.7 s 1.1 s 1.1 s 1.1 s 1.1 s 20 ms HTML • JSON • stderr
GitHub 44 requests 405 KiB 87 100 3.1 s 2.7 s 2.7 s 2.7 s 2.7 s 30 ms HTML • JSON • stderr
GitLab 58 requests 716 KiB 75 79 3.4 s 1.1 s 1.8 s 4.2 s 4.7 s 140 ms HTML • JSON • stderr
Codeberg 19 requests 935 KiB 74 82 7.9 s 2.9 s 2.9 s 6.4 s 6.5 s 70 ms HTML • JSON • stderr
Bitbucket 74 requests 1822 KiB 35 98 9.8 s 9.4 s 9.7 s 11.0 s 11.0 s 150 ms HTML • JSON • stderr
Pagure n/an/a Something went wrong with recording the trace over your page load. Please run Lighthouse again. (NO_FCP) HTML • JSON • stderr

Commit

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
SourceHut 2 requests 33 KiB 100 83 2.2 s 1.1 s 1.1 s 1.1 s 1.1 s 20 ms HTML • JSON • stderr
GitHub 33 requests 370 KiB 93 97 2.6 s 2.6 s 2.6 s 2.6 s 2.6 s 30 ms HTML • JSON • stderr
Pagure 25 requests 829 KiB 80 72 5.5 s 2.9 s 2.9 s 4.9 s 5.7 s 70 ms HTML • JSON • stderr
Codeberg 24 requests 1158 KiB 73 89 5.8 s 3.3 s 3.3 s 3.3 s 7.2 s 120 ms HTML • JSON • stderr
GitLab 38 requests 764 KiB 73 83 4.0 s 1.9 s 1.9 s 4.5 s 4.7 s 90 ms HTML • JSON • stderr
Bitbucket 38 requests 10536 KiB 61 98 24.4 s 2.9 s 2.9 s 2.9 s 55.9 s 290 ms HTML • JSON • stderr

Source file (best case)

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
SourceHut 3 requests 53 KiB 99 94 3.1 s 1.4 s 1.4 s 1.4 s 1.4 s 20 ms HTML • JSON • stderr
GitHub 35 requests 420 KiB 90 98 2.7 s 2.7 s 2.7 s 2.7 s 2.7 s 40 ms HTML • JSON • stderr
Codeberg 18 requests 924 KiB 78 94 6.2 s 2.8 s 2.8 s 6.5 s 6.6 s 170 ms HTML • JSON • stderr
GitLab 31 requests 1342 KiB 72 89 2.0 s 1.0 s 1.7 s 4.5 s 4.8 s 100 ms HTML • JSON • stderr
Pagure 23 requests 937 KiB 70 94 7.0 s 2.9 s 2.9 s 5.5 s 5.5 s 80 ms HTML • JSON • stderr
Bitbucket n/an/a An error occured, see the log for more details. HTML • JSON • stderr

Source file (worst case)

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
SourceHut 3 requests 372 KiB 76 ? 10.4 s 3.0 s 3.0 s 3.0 s 3.0 s 30 ms HTML • JSON • stderr
GitLab 31 requests 1597 KiB 61 ? 3.4 s 1.0 s 1.0 s 6.4 s 6.6 s 320 ms HTML • JSON • stderr
Pagure 21 requests 1205 KiB 45 ? 12.9 s 5.6 s 5.8 s 7.0 s 7.5 s 250 ms HTML • JSON • stderr
GitHub 45 requests 839 KiB 37 ? 5.5 s 4.7 s 4.7 s 7.5 s 8.4 s 680 ms HTML • JSON • stderr
Codeberg 18 requests 1410 KiB 13 ? 11.5 s 5.8 s 5.8 s 14.3 s 14.6 s 3,390 ms HTML • JSON • stderr
Bitbucket n/an/a An error occured, see the log for more details. HTML • JSON • stderr

Blame (best case)

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
SourceHut 3 requests 61 KiB 97 94 4.0 s 1.3 s 1.3 s 1.3 s 1.3 s 20 ms HTML • JSON • stderr
GitHub 43 requests 416 KiB 92 98 2.8 s 2.6 s 2.6 s 4.0 s 4.1 s 80 ms HTML • JSON • stderr
GitLab 26 requests 709 KiB 75 87 3.2 s 1.1 s 1.1 s 4.3 s 4.4 s 260 ms HTML • JSON • stderr
Bitbucket 31 requests 10589 KiB 57 85 19.0 s 2.9 s 2.9 s 2.9 s 55.7 s 260 ms HTML • JSON • stderr
Codeberg 23 requests 1199 KiB 55 94 7.9 s 3.4 s 3.4 s 7.7 s 8.0 s 560 ms HTML • JSON • stderr
Pagure 22 requests 1250 KiB 43 83 19.8 s 4.7 s 4.7 s 7.9 s 7.8 s 320 ms HTML • JSON • stderr

Blame (worst case)

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
GitLab n/an/a Lighthouse was unable to reliably load the page you requested. Make sure you are testing the correct URL and that the server is properly responding to all requests. (Status code: 500) HTML • JSON • stderr
Pagure n/an/a An error occured, see the log for more details. HTML • JSON • stderr
SourceHut n/an/a An error occured, see the log for more details. HTML • JSON • stderr
Bitbucket n/an/a Lighthouse was unable to reliably load the page you requested. Make sure you are testing the correct URL and that the server is properly responding to all requests. (Status code: 500) HTML • JSON • stderr
Codeberg n/an/a An error occured, see the log for more details. HTML • JSON • stderr
Notes

Browsing tickets/issues

Browsing

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
SourceHut 2 requests 34 KiB 99 89 3.0 s 1.1 s 1.1 s 1.1 s 1.1 s 20 ms HTML • JSON • stderr
GitHub 30 requests 350 KiB 91 98 2.5 s 2.5 s 2.5 s 2.5 s 2.5 s 20 ms HTML • JSON • stderr
Codeberg 26 requests 1188 KiB 82 84 5.2 s 3.2 s 3.2 s 3.2 s 3.2 s 50 ms HTML • JSON • stderr
Pagure 19 requests 660 KiB 80 80 6.1 s 3.2 s 3.2 s 3.2 s 3.2 s 30 ms HTML • JSON • stderr
GitLab 43 requests 847 KiB 78 73 1.6 s 1.0 s 1.9 s 5.2 s 5.3 s 180 ms HTML • JSON • stderr
Bitbucket 24 requests 618 KiB 50 85 7.3 s 5.1 s 5.2 s 6.1 s 6.4 s 90 ms HTML • JSON • stderr
Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
SourceHut 2 requests 33 KiB 98 89 3.6 s 1.1 s 1.1 s 1.1 s 1.1 s 20 ms HTML • JSON • stderr
GitHub 30 requests 351 KiB 91 98 2.5 s 2.5 s 2.5 s 2.5 s 2.5 s 20 ms HTML • JSON • stderr
Pagure 20 requests 646 KiB 82 80 5.4 s 3.1 s 3.1 s 3.1 s 3.1 s 20 ms HTML • JSON • stderr
GitLab 43 requests 849 KiB 75 73 2.0 s 1.3 s 1.9 s 5.9 s 6.0 s 150 ms HTML • JSON • stderr
Codeberg 26 requests 1187 KiB 62 84 5.6 s 4.1 s 4.1 s 7.3 s 7.4 s 60 ms HTML • JSON • stderr
Bitbucket 24 requests 618 KiB 51 85 7.5 s 5.2 s 5.3 s 6.3 s 6.5 s 60 ms HTML • JSON • stderr

Details and comments

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
SourceHut 2 requests 46 KiB 96 91 4.4 s 1.2 s 1.2 s 1.2 s 1.2 s 20 ms HTML • JSON • stderr
GitHub 63 requests 622 KiB 79 92 5.1 s 3.1 s 3.1 s 3.1 s 3.1 s 30 ms HTML • JSON • stderr
GitLab 62 requests 1144 KiB 62 73 3.0 s 1.0 s 1.0 s 7.3 s 7.4 s 510 ms HTML • JSON • stderr
Pagure 41 requests 3598 KiB 60 87 10.2 s 3.2 s 3.2 s 3.2 s 3.2 s 30 ms HTML • JSON • stderr
Bitbucket 24 requests 618 KiB 52 85 6.7 s 5.1 s 5.3 s 6.0 s 6.4 s 90 ms HTML • JSON • stderr
Codeberg 42 requests 2144 KiB 44 82 10.3 s 5.2 s 5.2 s 5.2 s 10.5 s 140 ms HTML • JSON • stderr

Code review

Browsing patches

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
SourceHut 2 requests 31 KiB 99 83 3.2 s 1.3 s 1.3 s 1.3 s 1.3 s 20 ms HTML • JSON • stderr
GitHub 29 requests 346 KiB 92 98 2.7 s 2.5 s 2.5 s 2.5 s 2.5 s 20 ms HTML • JSON • stderr
Pagure 19 requests 599 KiB 83 82 5.8 s 3.0 s 3.0 s 3.0 s 3.0 s 30 ms HTML • JSON • stderr
Codeberg 26 requests 1188 KiB 82 84 5.3 s 3.2 s 3.2 s 3.2 s 3.2 s 50 ms HTML • JSON • stderr
GitLab 43 requests 794 KiB 76 73 3.5 s 1.0 s 3.3 s 5.5 s 5.6 s 100 ms HTML • JSON • stderr
Bitbucket n/an/a Lighthouse was unable to reliably load the page you requested. Make sure you are testing the correct URL and that the server is properly responding to all requests. (Status code: 404) HTML • JSON • stderr

Patch discussion

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
SourceHut 2 requests 71 KiB 86 ? 11.0 s 1.1 s 1.1 s 1.1 s 1.1 s 30 ms HTML • JSON • stderr
GitHub 53 requests 615 KiB 83 ? 4.5 s 3.1 s 3.1 s 3.1 s 3.1 s 50 ms HTML • JSON • stderr
Codeberg 28 requests 1425 KiB 78 90 6.6 s 3.2 s 3.2 s 3.2 s 3.2 s 50 ms HTML • JSON • stderr
GitLab 60 requests 1275 KiB 65 80 3.9 s 1.3 s 3.7 s 4.4 s 7.6 s 210 ms HTML • JSON • stderr
Pagure 42 requests 1917 KiB 52 85 9.6 s 4.6 s 4.6 s 4.6 s 4.6 s 20 ms HTML • JSON • stderr
Bitbucket 285 requests 6295 KiB 21 ? 13.7 s 2.9 s 13.9 s 13.9 s 38.5 s 260 ms HTML • JSON • stderr

Patch diff

Page tested Performance Accessibility Speed Index FCP FMP First Idle TTI Max FID Full report
GitHub 41 requests 542 KiB 87 97 3.9 s 2.8 s 2.8 s 2.8 s 2.8 s 30 ms HTML • JSON • stderr
SourceHut * 2 requests 71 KiB 86 ? 11.1 s 1.1 s 1.1 s 1.1 s 1.1 s 20 ms HTML • JSON • stderr
Codeberg 24 requests 1281 KiB 76 88 5.7 s 2.9 s 2.9 s 2.9 s 7.8 s 120 ms HTML • JSON • stderr
GitLab 58 requests 1312 KiB 64 80 5.2 s 1.2 s 3.7 s 8.3 s 8.6 s 220 ms HTML • JSON • stderr
Pagure 42 requests 2312 KiB 57 85 10.4 s 4.6 s 4.6 s 4.6 s 4.6 s 20 ms HTML • JSON • stderr
Bitbucket * 285 requests 6304 KiB 39 ? 13.7 s 3.2 s 14.2 s 14.2 s 38.8 s 260 ms HTML • JSON • stderr
Notes