TOTAL: 142.69199999999995
mediawiki/extensions/WikiEditor 7.649
mediawiki/extensions/CirrusSearch 7.645
mediawiki/extensions/CheckUser 7.156
mediawiki/extensions/Translate 6.735
mediawiki/extensions/Babel 5.763
mediawiki/extensions/CodeEditor 5.474
mediawiki/extensions/ConfirmEdit 5.366
mediawiki/extensions/ContentTranslation 5.072
mediawiki/extensions/Disambiguator 4.565
mediawiki/extensions/Echo 4.258
mediawiki/vendor 3.683
mediawiki/extensions/Wikibase 3.384
mediawiki/extensions/TimedMediaHandler 3.353
mediawiki/extensions/Math 3.236
mediawiki/extensions/PageTriage 2.989
mediawiki/extensions/ProofreadPage 2.579
mediawiki/extensions/CiteThisPage 2.417
mediawiki/extensions/VisualEditor 2.322
mediawiki/extensions/UniversalLanguageSelector 2.238
mediawiki/extensions/WikiLove 2.087
mediawiki/extensions/GrowthExperiments 1.925
mediawiki/extensions/WikimediaMessages 1.807
mediawiki/extensions/Gadgets 1.713
mediawiki/extensions/Interwiki 1.699
mediawiki/extensions/BetaFeatures 1.646
mediawiki/extensions/WikibaseMediaInfo 1.644
mediawiki/extensions/Kartographer 1.633
mediawiki/extensions/AntiSpoof 1.633
mediawiki/skins/MinervaNeue 1.565
mediawiki/extensions/Elastica 1.55
mediawiki/extensions/AbuseFilter 1.52
mediawiki/extensions/FileImporter 1.507
mediawiki/extensions/Thanks 1.502
mediawiki/extensions/MobileFrontend 1.407
mediawiki/extensions/Cite 1.398
mediawiki/extensions/ParserFunctions 1.34
mediawiki/extensions/IPInfo 1.309
mediawiki/skins/Vector 1.275
mediawiki/extensions/Graph 1.223
mediawiki/extensions/InputBox 1.168
mediawiki/extensions/CommunityConfiguration 1.138
mediawiki/extensions/SpamBlacklist 1.127
mediawiki/extensions/JsonConfig 1.123
mediawiki/extensions/WikibaseCirrusSearch 1.116
mediawiki/extensions/GlobalPreferences 1.114
mediawiki/extensions/SiteMatrix 1.113
mediawiki/extensions/GuidedTour 1.106
mediawiki/extensions/ImageMap 1.093
mediawiki/extensions/MobileApp 1.049
mediawiki/extensions/EventBus 1.032
mediawiki/extensions/GeoData 1.009
mediawiki/extensions/EventStreamConfig 0.982
mediawiki/extensions/PdfHandler 0.969
mediawiki/extensions/cldr 0.952
mediawiki/extensions/PageViewInfo 0.944
mediawiki/extensions/MediaModeration 0.918
mediawiki/extensions/SandboxLink 0.911
mediawiki/extensions/GlobalCssJs 0.898
mediawiki/extensions/Scribunto 0.892
mediawiki/extensions/Poem 0.881
mediawiki/extensions/TemplateData 0.865
mediawiki/extensions/PageImages 0.861
mediawiki/extensions/NavigationTiming 0.797
mediawiki/extensions/EventLogging 0.695
mediawiki/extensions/CommunityConfigurationExample 0.672

Wed, Dec 4, 9:10 AM · Quibble, Release-Engineering-Team, Continuous-Integration-Infrastructure

hashar closed T374717: Speed up git clone operation in wmf-quibble job, a subtask of T225730: Reduce runtime of MW shared gate Jenkins jobs to 5 min, as Resolved.

Wed, Dec 4, 9:10 AM · MW-1.43-notes (1.43.0-wmf.22; 2024-09-10), Wikimedia-Performance-recommendation, MW-1.41-notes (1.41.0-wmf.20; 2023-08-01), MW-1.40-notes (1.40.0-wmf.12; 2022-11-28), Release-Engineering-Team (Priority Backlog 📥), MW-1.39-notes (1.39.0-wmf.8; 2022-04-18), MW-1.38-notes (1.38.0-wmf.16; 2022-01-03), MW-1.36-notes (1.36.0-wmf.36; 2021-03-23), MW-1.35-notes (1.35.0-wmf.27; 2020-04-07), Patch-For-Review, Developer Productivity, Code-Health, Epic, MediaWiki-Core-Tests, Continuous-Integration-Config

hashar added a comment to T374830: Various CI jobs running in the integration Cloud VPS project failing due to transient DNS lookup failures, often for our own hosts such as gerrit.wikimedia.org.

This is what I got this morning:

hashar@integration-agent-qemu-1003:~$ sudo mtr -r -c 100 -b 172.20.255.1
Start: 2024-12-04T08:40:01+0000
HOST: integration-agent-qemu-1003 Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- cloudinstances2b-gw.svc.e  0.0%   100    0.4   0.3   0.2   1.0   0.1
  2.|-- vlan1107.cloudgw1002.eqia  0.0%   100    0.5   0.3   0.3   0.6   0.1
  3.|-- irb-1120.cloudsw1-d5-eqia  0.0%   100    3.7   7.7   1.0  50.0   8.7
  4.|-- ns-recursor.openstack.eqi  0.0%   100    0.5  19.9   0.3 839.8 120.6

Wed, Dec 4, 8:59 AM · User-aborrero, Cloud-VPS, cloud-services-team, Continuous-Integration-Infrastructure, Release-Engineering-Team (Seen), User-brennen, ci-test-error (WMF-deployed Build Failure)

Tue, Dec 3

hashar updated subscribers of T381419: Future testing-infra growth on cloud-vps.

Some time ago, @aborrero offered to have the Jenkins instances (integration tenant) to run purely out of tmpfs to bypass most IO and specially Ceph.

Tue, Dec 3, 5:38 PM · collaboration-services, Continuous-Integration-Infrastructure, QTE-TestingOverview, GitLab (CI & Job Runners), Cloud-VPS, cloud-services-team

hashar added hashtags to GitLab (CI & Job Runners): #gitlab-ci, #gitlab-runners.

Tue, Dec 3, 5:34 PM

hashar added a project to T381419: Future testing-infra growth on cloud-vps: Continuous-Integration-Infrastructure.

Tue, Dec 3, 5:27 PM · collaboration-services, Continuous-Integration-Infrastructure, QTE-TestingOverview, GitLab (CI & Job Runners), Cloud-VPS, cloud-services-team

hashar updated the task description for T373711: Add support for Scribunto, JavaScript, CSS, JSON and Vue to CodeMirror 6.

Tue, Dec 3, 4:08 PM · MediaWiki-extensions-CodeMirror, Community-Tech

hashar edited projects for T380668: Add support for Vue language in Gerrit code editor, added: Gerrit (Gerrit 3.11); removed Gerrit.

Looks like @Paladox went to add support for Vue:

Tue, Dec 3, 4:06 PM · Gerrit (Gerrit 3.11)

hashar renamed T380668: Add support for Vue language in Gerrit code editor from Missing vue package in CodeMirror on Gerrit to Add support for Vue language in Gerrit code editor.

Tue, Dec 3, 4:00 PM · Gerrit (Gerrit 3.11)

hashar added a comment to T303828: Delete wmf branches from Gerrit repositories.

scap prep does set the push url for the repositories it is cloning (via _clone_or_update_repo).

Tue, Dec 3, 8:05 AM · Release-Engineering-Team (Priority Backlog 📥)

hashar added a comment to T303828: Delete wmf branches from Gerrit repositories.

The issue is for extensions and skins, the remote push url is the https one. git/curl would thus lookup for the username in a netrc which does not exist and fail. For mediawiki/core it works since we have the push url set:

$ git -C /srv/mediawiki-staging/php-1.44.0-wmf.6  config --show-origin --get remote.origin.pushurl
file:.git/config	ssh://gerrit.wikimedia.org:29418/mediawiki/core

Tue, Dec 3, 7:59 AM · Release-Engineering-Team (Priority Backlog 📥)

hashar added a comment to T303828: Delete wmf branches from Gerrit repositories.

The log is sent by email and shows lot of:

fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address

05:00:01 Cleaning branch: 1.44.0-wmf.3
05:00:01 Clean files owned by www-data
05:00:05 Clean /srv/mediawiki-staging/wmf-config/ExtensionMessages-1.44.0-wmf.3.php
05:00:05 Started prune-git-branches
05:00:05 Deleting mediawiki/core branch
RSA host key for IP address '2620:0:861:2:208:80:154:151' not in list of known hosts.
remote: 
remote: Processing changes: refs: 1 (\)
remote: Processing changes: refs: 1 (\)
remote: Processing changes: refs: 1 (\)
remote: Processing changes: refs: 1, done            
05:00:06 Deleting branch from other projects
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
fatal: could not read Username for 'https://gerrit.wikimedia.org': No such device or address
05:00:40 Finished prune-git-branches (duration: 00m 35s)
05:00:40 Clean /srv/mediawiki-staging/php-1.44.0-wmf.3
05:00:42 Clean /srv/patches/1.44.0-wmf.3
05:00:42 Started sync-masters
05:00:42 sync-masters:   0% (ok: 0; fail: 0; left: 1)                           
05:00:52 sync-masters: 100% (in-flight: 0; ok: 1; fail: 0; left: 0)             
05:00:52 Finished sync-masters (duration: 00m 10s)
05:00:52 Started sync-proxies
05:00:52 sync-proxies:   0% (ok: 0; fail: 0; left: 4)                           
05:01:05 sync-proxies: 100% (in-flight: 0; ok: 4; fail: 0; left: 0)             
05:01:05 Per-host sync duration: average 9.4s, median 9.0s
05:01:05 rsync transfer: average 419,089 bytes/host, total 1,676,356 bytes
05:01:05 Finished sync-proxies (duration: 00m 12s)
05:01:05 Started sync-apaches
05:01:05 sync-apaches:   0% (ok: 0; fail: 0; left: 29)                          
05:01:28 sync-apaches: 100% (in-flight: 0; ok: 29; fail: 0; left: 0)            
05:01:28 Per-host sync duration: average 9.9s, median 8.0s
05:01:28 rsync transfer: average 419,089 bytes/host, total 12,153,581 bytes
05:01:28 Finished sync-apaches (duration: 00m 22s)
05:01:28 Started clean-remote-caches
05:01:28 clean-remote-caches:   0% (ok: 0; fail: 0; left: 33)                   
05:01:29 clean-remote-caches: 100% (in-flight: 0; ok: 33; fail: 0; left: 0)     
05:01:29 Finished clean-remote-caches (duration: 00m 01s)
05:01:29 Pruned MediaWiki: 1.44.0-wmf.3 (duration: 01m 27s)

Tue, Dec 3, 7:36 AM · Release-Engineering-Team (Priority Backlog 📥)

hashar reopened T303828: Delete wmf branches from Gerrit repositories as "Open".

With 1.44.0-wmf.6, the timer ran scap clean --delete-gerrit-branch auto and that pruned the old branch:

mediawiki/core$ git remote prune origin
Pruning origin
URL: https://gerrit.wikimedia.org/r/mediawiki/core.git
 * [pruned] origin/wmf/1.44.0-wmf.3

Tue, Dec 3, 7:35 AM · Release-Engineering-Team (Priority Backlog 📥)

hashar reopened T303828: Delete wmf branches from Gerrit repositories, a subtask of T220606: zuul-merger takes a while to recreate repository branches, as Open.

Tue, Dec 3, 7:34 AM · Zuul, Continuous-Integration-Infrastructure

hashar reopened T303828: Delete wmf branches from Gerrit repositories, a subtask of T374717: Speed up git clone operation in wmf-quibble job, as Open.

Tue, Dec 3, 7:34 AM · Quibble, Release-Engineering-Team, Continuous-Integration-Infrastructure

Mon, Dec 2

hashar closed T380259: Archive Zotero gerrit repo as it's been replaced with gitlab as Resolved.

I have applied the change for CI, finished the archival of repositories in Gerrit and have deleted the mirrors from GitHub.

Mon, Dec 2, 3:21 PM · Projects-Cleanup, Citoid, GitLab (Pipeline Services Migration🐤), Editing-team

hashar closed T380259: Archive Zotero gerrit repo as it's been replaced with gitlab, a subtask of T374558: Migrate Zotero Server repo from gerrit to GitLab, as Resolved.

Mon, Dec 2, 3:16 PM · Citoid, GitLab (Pipeline Services Migration🐤), Editing-team

hashar updated the task description for T380259: Archive Zotero gerrit repo as it's been replaced with gitlab.

Mon, Dec 2, 3:16 PM · Projects-Cleanup, Citoid, GitLab (Pipeline Services Migration🐤), Editing-team

hashar added a comment to T374717: Speed up git clone operation in wmf-quibble job.

After having cherry picked the Puppet patch on the integration project, I gave it a try on integration-agent-docker-1040.integration.eqiad1.wikimedia.cloud:

$ sudo docker run -v /srv/git:/srv/git -v "$(pwd)"/src:/src \
    --rm -it docker-registry.wikimedia.org/releng/quibble-buster-php74:1.11.0 \
    -c /bin/true mediawiki/extensions/WikimediaMessages \
    --git-parallel=1 2>&1|ts -s '%H:%M:%.s'
..
00:00:10.559435 INFO:zuul.Cloner:Creating repo mediawiki/extensions/WikimediaMessages from cache /srv/git/mediawiki/extensions/WikimediaMessages.git
00:00:11.003473 INFO:zuul.Cloner:Updating origin remote in repo mediawiki/extensions/WikimediaMessages to https://gerrit.wikimedia.org/r/mediawiki/extensions/WikimediaMessages
00:00:11.785612 INFO:zuul.Cloner:Falling back to branch master
00:00:11.853725 INFO:zuul.Cloner:Prepared mediawiki/extensions/WikimediaMessages repo with branch master at commit 57a8067e12484e5ba12d109362f3c33a1e5ee0da

Mon, Dec 2, 11:21 AM · Quibble, Release-Engineering-Team, Continuous-Integration-Infrastructure

hashar added a comment to T374717: Speed up git clone operation in wmf-quibble job.

For mediawiki/extensions/WikimediaMessages taking 13.395, that is when resolving the deltas. It is ~ 50MB, I will add it to the list of mirrored repositories.

Mon, Dec 2, 10:38 AM · Quibble, Release-Engineering-Team, Continuous-Integration-Infrastructure

hashar updated the task description for T374717: Speed up git clone operation in wmf-quibble job.

Mon, Dec 2, 9:14 AM · Quibble, Release-Engineering-Team, Continuous-Integration-Infrastructure

hashar merged T380991: Various CI jobs failing with: Could not resolve host: gerrit.wikimedia.org (2024-11-27) into T374830: Various CI jobs running in the integration Cloud VPS project failing due to transient DNS lookup failures, often for our own hosts such as gerrit.wikimedia.org.

Mon, Dec 2, 8:57 AM · User-aborrero, Cloud-VPS, cloud-services-team, Continuous-Integration-Infrastructure, Release-Engineering-Team (Seen), User-brennen, ci-test-error (WMF-deployed Build Failure)

hashar merged task T380991: Various CI jobs failing with: Could not resolve host: gerrit.wikimedia.org (2024-11-27) into T374830: Various CI jobs running in the integration Cloud VPS project failing due to transient DNS lookup failures, often for our own hosts such as gerrit.wikimedia.org.

Mon, Dec 2, 8:55 AM · ci-test-error (WMF-deployed Build Failure), cloud-services-team, Cloud-VPS, Continuous-Integration-Infrastructure, Release-Engineering-Team

Fri, Nov 29

hashar added a comment to T303270: Parallel npm install times out in Quibble.

Repro using P22106 and the Quibble 1.3.0 referred to in this task description:

podman run -it -v .:/src --entrypoint=bash docker-registry.wikimedia.org/releng/quibble-buster:1.3.0 -c 'while true; do python2 /src/P22106; done;'
100
100
100
100
100
100
100
96  # <--- wrong
100
100
100
98  # <--- wrong

Fri, Nov 29, 11:38 AM · Patch-For-Review, Continuous-Integration-Infrastructure, Quibble

hashar added a comment to T303270: Parallel npm install times out in Quibble.

is hopefully on a Python version which includes that fix?

Fri, Nov 29, 11:03 AM · Patch-For-Review, Continuous-Integration-Infrastructure, Quibble

Thu, Nov 28

hashar closed T375664: 1.44.0-wmf.5 deployment blockers as Resolved.

I am claiming the train to have successfully completed!

Thu, Nov 28, 4:14 PM · Release-Engineering-Team (Priority Backlog 📥), Release, Train Deployments

hashar created T381115: MediaWiki\Extension\WikiLambda\ZErrorException: Invalid JSON.

Thu, Nov 28, 3:45 PM · MW-1.44-notes (1.44.0-wmf.8; 2024-12-17), Abstract Wikipedia team (25Q2 (Oct–Dec)), Abstract Wikipedia Fix-It tasks, Wikifunctions, Wikimedia-production-error

Wed, Nov 27

hashar edited P71234 grep -l 'Could not resolve host' /srv/jenkins/builds/*quibble*/*/log|xargs ls --full-time -rt|awk '{ print $6 " " $7 }'.

Wed, Nov 27, 6:52 PM

hashar created P71234 grep -l 'Could not resolve host' /srv/jenkins/builds/*quibble*/*/log|xargs ls --full-time -rt|awk '{ print $6 " " $7 }'.

Wed, Nov 27, 6:52 PM

hashar added a comment to T374830: Various CI jobs running in the integration Cloud VPS project failing due to transient DNS lookup failures, often for our own hosts such as gerrit.wikimedia.org.

From T374830#10198891, I went on contint1002 and ran the oneliner:

grep -l 'Could not resolve host' /srv/jenkins/builds/*quibble*/*/log|xargs ls --full-time -rt|awk '{ print $6 " " $7 }'

Wed, Nov 27, 6:51 PM · User-aborrero, Cloud-VPS, cloud-services-team, Continuous-Integration-Infrastructure, Release-Engineering-Team (Seen), User-brennen, ci-test-error (WMF-deployed Build Failure)

hashar updated the task description for T378423: Shellbox coverage not published since June 2022.

Wed, Nov 27, 6:29 PM · ci-test-error, Test-Coverage, Shellbox

hashar added a comment to T342110: Upgrade to PHPUnit 9.6.

assertEqualXMLStructure() has been marked deprecated. That emits a warning which our config treat as a failure. That is only used in the Checklists extension for which I have filed as T381013

Wed, Nov 27, 5:00 PM · MW-1.42-notes (1.42.0-wmf.21; 2024-03-05), Patch-For-Review, MW-1.41-notes (1.41.0-wmf.25; 2023-09-05), MediaWiki-Core-Tests

hashar added a parent task for T381013: Checklists extension CI fails due to deprecated PHPUnit method assertEqualXMLStructure : T342110: Upgrade to PHPUnit 9.6.

Wed, Nov 27, 4:58 PM · ci-test-error, BlueSpice

hashar added a subtask for T342110: Upgrade to PHPUnit 9.6: T381013: Checklists extension CI fails due to deprecated PHPUnit method assertEqualXMLStructure .

Wed, Nov 27, 4:58 PM · MW-1.42-notes (1.42.0-wmf.21; 2024-03-05), Patch-For-Review, MW-1.41-notes (1.41.0-wmf.25; 2023-09-05), MediaWiki-Core-Tests

hashar created T381013: Checklists extension CI fails due to deprecated PHPUnit method assertEqualXMLStructure .

Wed, Nov 27, 4:57 PM · ci-test-error, BlueSpice

hashar updated subscribers of T380929: Improve wgBetaFeaturesAllowList permission/sign-off process.

The $wgBetaFeaturesAllowList flag was introduced by @Jdforrester-WMF back in 2014 with https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/121892 :

Wed, Nov 27, 4:27 PM · Release-Engineering-Team, WMF-General-or-Unknown

hashar added a comment to T379925: Add support for multi-DB testing to MediaWiki.

For T342763, @Urbanecm proposed a patch to Quibble to have it spin up a second database ( https://gerrit.wikimedia.org/r/c/integration/quibble/+/949986 ).

Wed, Nov 27, 3:58 PM · Quibble, Continuous-Integration-Infrastructure

hashar edited projects for T378423: Shellbox coverage not published since June 2022, added: ci-test-error; removed Continuous-Integration-Infrastructure.

Wed, Nov 27, 2:53 PM · ci-test-error, Test-Coverage, Shellbox

hashar claimed T378423: Shellbox coverage not published since June 2022.

The last coverage was generated on Jun 27 9:53:11 UTC 2022. We eventually switched to php 7.2 /upgraded composer/disabled xdebug. Anyway after some debugging I found that the test server has its own coverage tracking mechanism which thus requires phpcov to be loaded:

\Shellbox\Tests\TestServer::main( '/tmp/sb-test-server-89ce3392e10a8780/test-config.json' );
[Wed Nov 27 14:15:47 2024] PHP 8.1.30 Development Server (http://localhost:8033) started
[Wed Nov 27 14:15:47 2024] [::1]:58272 Accepted 
[Wed Nov 27 14:15:47 2024] [::1]:58272 Closed without sending a request; it was probably just an unused speculative preconnection
[Wed Nov 27 14:15:47 2024] [::1]:58272 Closing
[Wed Nov 27 14:15:47 2024] [::1]:58276 Accepted 
[Wed Nov 27 14:15:47 2024] [::1]:58276 [200]: GET /sbtest.php/healthz 
[Wed Nov 27 14:15:47 2024] [::1]:58276 Closing
[Wed Nov 27 14:15:47 2024] [::1]:58292 Accepted 
[Wed Nov 27 14:15:47 2024] PHP Fatal error:  Uncaught RuntimeException: No code coverage driver available in /src/tests/TestServer.php:74
Stack trace:
#0 /src/tests/TestServer.php(37): Shellbox\Tests\TestServer::selectDriver()
#1 /tmp/sb-test-server-89ce3392e10a8780/sbtest.php(3): Shellbox\Tests\TestServer::main()
#2 {main}
  thrown in /src/tests/TestServer.php on line 74

Wed, Nov 27, 2:45 PM · ci-test-error, Test-Coverage, Shellbox

hashar added a comment to T380977: Wikimedia\RemexHtml\TreeBuilder\TreeBuilderError: Setting foreign attributes is not supported.

I have reached out to Content-Transform-Team so they can triage this task.

Wed, Nov 27, 12:31 PM · Content-Transform-Team-WIP, Patch-For-Review, MW-1.44-notes (1.44.0-wmf.5; 2024-11-25), Cite, Wikimedia-production-error

hashar created T380977: Wikimedia\RemexHtml\TreeBuilder\TreeBuilderError: Setting foreign attributes is not supported.

Wed, Nov 27, 12:27 PM · Content-Transform-Team-WIP, Patch-For-Review, MW-1.44-notes (1.44.0-wmf.5; 2024-11-25), Cite, Wikimedia-production-error

hashar added a comment to T380958: httpb fails upon deployment of 1.44.0-wmf.5.

I have removed this from the list of train subtasks, it only got there cause I have used Create Subtask to create it, but it is NOT a blocker since we can retry the checks.

Wed, Nov 27, 10:49 AM · Deployments, serviceops, Release-Engineering-Team, Wikimedia-production-error

hashar removed a subtask for T375664: 1.44.0-wmf.5 deployment blockers: T380958: httpb fails upon deployment of 1.44.0-wmf.5.

Wed, Nov 27, 10:48 AM · Release-Engineering-Team (Priority Backlog 📥), Release, Train Deployments

hashar removed a parent task for T380958: httpb fails upon deployment of 1.44.0-wmf.5: T375664: 1.44.0-wmf.5 deployment blockers.

Wed, Nov 27, 10:48 AM · Deployments, serviceops, Release-Engineering-Team, Wikimedia-production-error

hashar added a comment to T380958: httpb fails upon deployment of 1.44.0-wmf.5.

How many times has it been reproduced up to now?

Wed, Nov 27, 10:45 AM · Deployments, serviceops, Release-Engineering-Team, Wikimedia-production-error

hashar added a comment to T380958: httpb fails upon deployment of 1.44.0-wmf.5.

Some logs from php-fpm being restarted

Time	type	level	message	program
Nov 27, 2024 @ 09:24:59.702	syslog	NOTICE	Terminating ...	php7.4-fpm
Nov 27, 2024 @ 09:24:59.709	syslog	NOTICE	exiting, bye-bye!	php7.4-fpm
Nov 27, 2024 @ 09:24:59.810	syslog	NOTICE	ready to handle connections	php7.4-fpm
Nov 27, 2024 @ 09:24:59.840	syslog	NOTICE	fpm is running, pid 23867	php7.4-fpm
Nov 27, 2024 @ 09:24:59.843	syslog	NOTICE	systemd monitor interval set to 10000ms	php7.4-fpm

Wed, Nov 27, 9:57 AM · Deployments, serviceops, Release-Engineering-Team, Wikimedia-production-error

hashar closed T364880: Confusing failed httpbb check for totoro.wikimedia.org during scap deployment as Resolved.

I am marking this one resolved since the confusing https://totoro.wikimedia.org. URL has been replaced by https://intentionally-no-such-domain.wikimedia.org which clarify the original ambiguity (I thought totoro was a valid wiki!).

Wed, Nov 27, 9:39 AM · Deployments, serviceops-radar, SRE

hashar triaged T380958: httpb fails upon deployment of 1.44.0-wmf.5 as Medium priority.

Wed, Nov 27, 9:34 AM · Deployments, serviceops, Release-Engineering-Team, Wikimedia-production-error

Tue, Nov 26

hashar claimed T374717: Speed up git clone operation in wmf-quibble job.

Tue, Nov 26, 9:37 PM · Quibble, Release-Engineering-Team, Continuous-Integration-Infrastructure

hashar closed T380841: Convert old release branches to tags as Resolved.

Tue, Nov 26, 9:31 PM · MediaWiki-Releasing (Workflow Improvements), MediaWiki-Release-Tools

hashar closed T380841: Convert old release branches to tags, a subtask of T374717: Speed up git clone operation in wmf-quibble job, as Resolved.

Tue, Nov 26, 9:30 PM · Quibble, Release-Engineering-Team, Continuous-Integration-Infrastructure

hashar added a comment to T380924: Selecting N for "backport the change" doesn't seem to work/exit.

That is in scap/interaction.py

YES_NO_CHOICES = {"Yes": "y", "No": "n"}

Tue, Nov 26, 9:29 PM · Scap

hashar triaged T380924: Selecting N for "backport the change" doesn't seem to work/exit as Low priority.

Tue, Nov 26, 9:29 PM · Scap

hashar added a comment to T380841: Convert old release branches to tags.

To get rid of the legacy branch from a local clone:

git fetch origin --prune

Tue, Nov 26, 9:21 PM · MediaWiki-Releasing (Workflow Improvements), MediaWiki-Release-Tools

hashar added a comment to T380841: Convert old release branches to tags.

Logs:

Tue, Nov 26, 9:12 PM · MediaWiki-Releasing (Workflow Improvements), MediaWiki-Release-Tools

hashar created P71210 log of conversion of REL1_38 branch to tag.

Tue, Nov 26, 9:11 PM

hashar created P71209 log of conversion of REL1_37 branch to tag.

Tue, Nov 26, 9:10 PM

hashar created P71208 log of conversion of REL1_36 branch to tag.

Tue, Nov 26, 9:09 PM

hashar created P71207 log of conversion of REL1_35 branch to tag.

Tue, Nov 26, 9:07 PM

hashar created P71206 log of conversion of REL1_34 branch to tag.

Tue, Nov 26, 9:06 PM

hashar created P71205 log of conversion of REL1_33 branch to tag.

Tue, Nov 26, 9:06 PM

hashar created P71204 log of conversion of REL1_32 branch to tag.

Tue, Nov 26, 9:04 PM

hashar created P71203 log of conversion of REL1_31 branch to tag.

Tue, Nov 26, 9:04 PM

hashar created P71202 log of conversion of REL1_30 branch to tag.

Tue, Nov 26, 9:03 PM

hashar created P71201 log of conversion of REL1_29 branch to tag.

Tue, Nov 26, 9:00 PM

hashar created P71200 log of conversion of REL1_28 branch to tag.

Tue, Nov 26, 8:57 PM

hashar created P71199 log of conversion of REL1_27 branch to tag.

Tue, Nov 26, 8:56 PM

hashar created P71198 log of conversion of REL1_26 branch to tag.

Tue, Nov 26, 8:55 PM

hashar created P71197 log of conversion of REL1_25 branch to tag.

Tue, Nov 26, 8:54 PM

hashar created P71196 log of conversion of REL1_24 branch to tag.

Tue, Nov 26, 8:52 PM

hashar created P71195 log of conversion of REL1_23 branch to tag.

Tue, Nov 26, 8:52 PM

hashar created P71194 log of conversion of REL1_22 branch to tag.

Tue, Nov 26, 8:49 PM

hashar created P71193 log of conversion of REL1_21 branch to tag.

Tue, Nov 26, 8:47 PM

hashar created P71192 log of conversion of REL1_20 branch to tag.

Tue, Nov 26, 8:45 PM

hashar added a comment to T380862: PHP Notice: Trying to access array offset on value of type null.

I have confirmed the log error is gone after deploying the patch to mediawiki/core. The one for Flow ( https://gerrit.wikimedia.org/r/1098108 ) hasn't been backported.

Tue, Nov 26, 8:19 PM · MW-1.44-notes (1.44.0-wmf.6; 2024-12-03), StructuredDiscussions, MediaWiki-Parser, Growth-Team, Content-Transform-Team, Discovery-Search, CirrusSearch, Wikimedia-production-error

hashar added a comment to T375664: 1.44.0-wmf.5 deployment blockers.

I have confirmed yesterday scap clean --delete-gerrit-branch properly delete old wmf branches (solving T303828). I have adjusted the timer that runs it automatically on Tuesday ( 7d301cb368631b2d22451b22c6e21658a35243cf ), and thanks to Reuven that got deployed before it starts. I have confirmed this morning it ran properly.

Tue, Nov 26, 1:29 PM · Release-Engineering-Team (Priority Backlog 📥), Release, Train Deployments

hashar reopened T363587: [Event Platform] Instrument EventBus with prometheus MW Statslib as "Open".

In T363587#10356835, @gerritbot wrote:

Change #1062430 merged by jenkins-bot:

[operations/mediawiki-config@master] config: remove eventbus instrumentation setting

https://gerrit.wikimedia.org/r/1062430

Tue, Nov 26, 1:25 PM · MW-1.43-notes (1.43.0-wmf.22; 2024-09-10), Data-Engineering (Q1 2024 July 1st - September 30th), Dumps 2.0 (Kanban Board), Event-Platform

hashar created T380862: PHP Notice: Trying to access array offset on value of type null.

Tue, Nov 26, 12:43 PM · MW-1.44-notes (1.44.0-wmf.6; 2024-12-03), StructuredDiscussions, MediaWiki-Parser, Growth-Team, Content-Transform-Team, Discovery-Search, CirrusSearch, Wikimedia-production-error

hashar added a comment to T380184: <math>\operatorname{vec}</math> crashes with native MathML.

Thank you @Physikerwelt for the notification on the the train blocker and to have confirmed the resolution! 🏆

Tue, Nov 26, 12:03 PM · MW-1.44-notes (1.44.0-wmf.6; 2024-12-03), Patch-For-Review, Math

hashar removed a parent task for T380844: 2024-11-26 Toolforge DNS incident: T375664: 1.44.0-wmf.5 deployment blockers.

Tue, Nov 26, 10:44 AM · Wikimedia-Incident, Toolforge, cloud-services-team

hashar removed a subtask for T375664: 1.44.0-wmf.5 deployment blockers: T380844: 2024-11-26 Toolforge DNS incident.

Tue, Nov 26, 10:44 AM · Release-Engineering-Team (Priority Backlog 📥), Release, Train Deployments

hashar added a comment to T375664: 1.44.0-wmf.5 deployment blockers.

The Branch cut test patches Jenkins job passed :)

Tue, Nov 26, 10:43 AM · Release-Engineering-Team (Priority Backlog 📥), Release, Train Deployments

hashar updated subscribers of T375664: 1.44.0-wmf.5 deployment blockers.

We have an ongoing issue with toolforge T380844 which breaks the MediaWiki train, notably our automatic jobs that processes the branch.

Tue, Nov 26, 10:28 AM · Release-Engineering-Team (Priority Backlog 📥), Release, Train Deployments

hashar closed T374830: Various CI jobs running in the integration Cloud VPS project failing due to transient DNS lookup failures, often for our own hosts such as gerrit.wikimedia.org as Resolved.

I am reclosingt this task in favor of the other ones that have been filed for WMCS DNS resolution.

Tue, Nov 26, 10:23 AM · User-aborrero, Cloud-VPS, cloud-services-team, Continuous-Integration-Infrastructure, Release-Engineering-Team (Seen), User-brennen, ci-test-error (WMF-deployed Build Failure)

hashar added a parent task for T380844: 2024-11-26 Toolforge DNS incident: T375664: 1.44.0-wmf.5 deployment blockers.

Tue, Nov 26, 10:22 AM · Wikimedia-Incident, Toolforge, cloud-services-team

hashar added a subtask for T375664: 1.44.0-wmf.5 deployment blockers: T380844: 2024-11-26 Toolforge DNS incident.

Tue, Nov 26, 10:22 AM · Release-Engineering-Team (Priority Backlog 📥), Release, Train Deployments

hashar added a comment to T375664: 1.44.0-wmf.5 deployment blockers.

!log Fast forwarded mediawiki/extensions/Math wmf/1.44.0-wmf.5 branch from 0458ea16 to d5076423. That is to apply hotfixes that merged after the branch has been cut # T375664 | T380184

Tue, Nov 26, 10:16 AM · Release-Engineering-Team (Priority Backlog 📥), Release, Train Deployments

hashar added a parent task for T380184: <math>\operatorname{vec}</math> crashes with native MathML: T375664: 1.44.0-wmf.5 deployment blockers.

Tue, Nov 26, 10:08 AM · MW-1.44-notes (1.44.0-wmf.6; 2024-12-03), Patch-For-Review, Math

hashar added a subtask for T375664: 1.44.0-wmf.5 deployment blockers: T380184: <math>\operatorname{vec}</math> crashes with native MathML.

Tue, Nov 26, 10:07 AM · Release-Engineering-Team (Priority Backlog 📥), Release, Train Deployments

hashar added a comment to T375664: 1.44.0-wmf.5 deployment blockers.

I don't know what is up with the listed roadmap. https://wikitech.wikimedia.org/wiki/Deployments/Yearly_calendar/2024 shows it as normal since we have decided we would deploy as usual despite thanksgiving in the USA ( https://wikitech.wikimedia.org/w/index.php?title=Deployments/Yearly_calendar/2024&diff=prev&oldid=2241893 ). wmf.5 got removed from the file on October 30th: https://www.mediawiki.org/w/index.php?title=MediaWiki_1.44/Roadmap&diff=prev&oldid=6820400 , and we forgot to add it back.

Tue, Nov 26, 10:04 AM · Release-Engineering-Team (Priority Backlog 📥), Release, Train Deployments

hashar added a parent task for T380841: Convert old release branches to tags: T374717: Speed up git clone operation in wmf-quibble job.

Tue, Nov 26, 9:55 AM · MediaWiki-Releasing (Workflow Improvements), MediaWiki-Release-Tools

hashar added a subtask for T374717: Speed up git clone operation in wmf-quibble job: T380841: Convert old release branches to tags.

Tue, Nov 26, 9:55 AM · Quibble, Release-Engineering-Team, Continuous-Integration-Infrastructure

hashar created T380841: Convert old release branches to tags.

Tue, Nov 26, 9:54 AM · MediaWiki-Releasing (Workflow Improvements), MediaWiki-Release-Tools

hashar added a comment to T374717: Speed up git clone operation in wmf-quibble job.

From T303828, I have mentioned using branch.py --core --core-bundle wmf_core --bundle wmf_branch --delete <VERSION> which has support for converting branches to tag (via T250095 and c3f8dc8e96b8c91f11444cc53f6b2b7dcc7f702c).

Tue, Nov 26, 9:14 AM · Quibble, Release-Engineering-Team, Continuous-Integration-Infrastructure

hashar changed the status of T374717: Speed up git clone operation in wmf-quibble job from Stalled to Open.

Tue, Nov 26, 8:38 AM · Quibble, Release-Engineering-Team, Continuous-Integration-Infrastructure

hashar (Antoine Musso)
LogisticsAdministrator

Projects (33)
View All

Calendar

Today

Tomorrow

Saturday

User Details

Recent Activity
View All

Tue, Dec 10

Wed, Dec 4

Tue, Dec 3

Mon, Dec 2

Fri, Nov 29

Thu, Nov 28

Wed, Nov 27

Tue, Nov 26

hashar (Antoine Musso)LogisticsAdministrator

Projects (33)View All

Calendar

Today

Tomorrow

Saturday

User Details

Recent ActivityView All

Tue, Dec 10

Wed, Dec 4

Tue, Dec 3

Mon, Dec 2

Fri, Nov 29

Thu, Nov 28

Wed, Nov 27

Tue, Nov 26

hashar (Antoine Musso)
LogisticsAdministrator

Projects (33)
View All

Recent Activity
View All