Searched For: gitsubmodules
---------------------
**Version**: wmf-deployment
**Severity**: normal
```lang=bash
<~/pywikibot>git clone --recursive ssh://multichill … wikimedia.org:29418/pywikibot/core.git
Cloning into 'core'...
Warning: Pe … g/r/p/pywikibot/externals/httplib2.git) registered for path 'externals/ht … t.wikimedia.org/r/p/pywikibot/i18n.git) registered for path 'scripts/i18n … g/r/p/pywikibot/externals/httplib2.git/info/refs?service=git-upload-pack
fatal: HTTP request fa … g/r/p/pywikibot/externals/httplib2.…
ainst the debian `openssh-server` package: `905226.patch`
{F29638280}
instance puppet config very well... it's probably possible to get our git repo wedged in such a way that it' … 583/ would reduce the risk of this.
We have content in git repositories that we want to show … wiki pages:
=== Documentation in git
- [[ https://github.com/wikimedia/ … i | architectural module docs]] in git and publish to wiki
- extension do … ted so the README is maintained in git and this file is transcluded on th … mw.org page.
=== Sample code from git
- [[ https://github.com/wikimedia … can transclude latest content from git using some syntax, probably like [ … ditors need to transclude parts of …
if jenkins were to fail if unable to checkout the required code from submodules. It seems like in every case I can … missing files but under setup-zuul-submodules at around '14:39:05' it's clear th … c6f98a36209bebb8e2d4f4158c943c629'
this and install gems from a Trebuchet managed repo. Putting blobs in git is yuck so I'd like to use git-fat similarly to the way it is use … .29|process for updating Archiva]].
service-runner 2.7.1 npm package contains .git accidently it seems. So, doing `np … will throw error like,
`npm ERR! git cxserver/node_modules/service-runner: Appears to be a git repo or submodule.`
Please republish service-runner 2.7.1 npm.
Step missed when it was created?
ly there's some case-insensitive code that's loading the "wrong" repo?
ntion that you can use branches (or clone initially a specific branch)
tor.com/T5000 (easy to remember) :)
Many gerrit people do not like "git-review", they want to use plain git, and can do so in Gerrit.
Phabric … r review directly using only plain git (and no "arc").
Is it possible to push for review using plain git (and no "arc")?
Split from {T196602}.
We want to move to a `git archive` like solution for tarball … ed to create the tarball is in the git repository itself, which should ma … r to recreate. Bundled stuff is in submodules, and exclusions are in `.gitattrib … es`.
It doesn't look like native `git archive` will meet our needs though because it doesn't include submodules. https://github.com/Kentzo/git-archive-all is a prospective candi … till want to keep a wrapper around …
The mw/core wmf branches have git submodules, we should use specific jobs for them that will process submodules without a specific list of extensi … g around to load the extensions in submodules.
Currently, we point to git-ssh, which is overkill since we on … rthermore our team doesn't work on submodules in place, but in isolation.
We sh … .wikimedia.org/source/draftquality.git`
We've [never released a git tag for kartotherian](https://gith … ian/releases), nor for most of its submodules. This should be done so we have sp … an refer to without needing to use git commits.
@Yurik, do you happen to have a bunch of git tags in your repo that have never been pushed?
hat are "mixed".
So I'd say we indeed lost contributors in Wikimedia Git.
>>! In T103292#1933663, @Qgil wr … ood context to bring these numbers.
you get presented with:
```
Command failed with error #128!
COMMAND
git cat-file -t '42fe1095c7c33253ae49a … el'
STDOUT
(empty)
STDERR
fatal: git cat-file 42fe1095c7c33253ae49a1cd0 … abricator/webroot/index.php:17]
```
The git repositories on tin.eqiad.wmnet un … dle it for us.
On the Zuul merger git repositories, there is a daily cro … the references (less files under `.git/refs/`:
find /srv/deployment -maxdepth 3 -type d -name '.git' -exec git --git-dir='{}' pack-refs --all \;
Could probably add `git repack -A -d` which rebuild object … ts. They can then be removed with `git gc --prune=all`.
ation extension-unittests -> extension-unittests-generic for Wikidata.git makes it not run all tests and fai … cd src/extensions/VisualEditor
- git submodule update --init
-fi
+ m … /mw-apply-settings.sh</command>
```
to https://wikimedia.biterg.io/goto/a0d44c821146e4d72ebcd2467797f8d9 (Git activity for [[ https://gerrit.wik … /05da56fb282508d21469306c6e134dc5 (Git activity for [[ https://gerrit.wik … layed if I explicitly query for it.
ecking out projects for test, zuul-cloner should also check out their submodules. For example, this DonationInterf … tps://gerrit.wikimedia.org/r/180894
The `zuul-merger` git repositories are exposed to the Jenkins slaves via a `git-daemon` process. The two instance … 01` and `contint2001` and each run git 2.1.4 from jessie/main.
git 2.11.0 is available from `jessie-b … ain`. Potentially we could upgrade git which might benefit `git-daemon`. No idea about what has changed in git-daemon though.
Ideally we could use some newer features in git to speed up some operations on the … king at the `--jobs` parameter to `git fetch` (added in 2.8.0) and the `--dissociate` parameter to `git clone` (added in 2.2.0). The former allows us to parallelize our git fetches in submodules, and the latter lets us re-use on- … (just for comparison) is 2.9.2.
`git submodule` has been ported to C wi … etting `submodule.fetchJobs = X`.
…
make-wmf-branch doesn't ensure git has proper user.name and user.emai … failed with:
```
cd VisualEditor
'git' 'checkout' '-q' '-b' 'wmf/1.27.0-wmf.13'
'git' 'commit' '-a' '-q' '-m' 'Creating new wmf/1.27.0-wmf.13 branch'
'git' 'remote' 'rm' 'origin'
'git' 'remote' 'add' 'origin' 'ssh://ge … /mediawiki/extensions/VisualEditor.git'
'git' 'submodule' 'update' '--init' 'li … .org/r/p/VisualEditor/VisualEditor.git) registered for path 'lib/ve'
Clon … 1e04927636ab3255970ad1'
cd lib/ve
'…
ersion**: unspecified
**Severity**: critical
**Whiteboard**: rmqa-2013
when running
```
git clone -b REL1_28 https://gerrit.wi … media.org/r/p/mediawiki/extensions.git extensions --recurse-submodules
```
I am getting a prompt for pas … is prevents the checkout finishing.
Also clone submodules in operations/puppet jobs, otherwi … gerrit.wikimedia.org/r/#/c/238471/2
ing in tests against older branches.
The `-npm` job is declared with git-scm, ` (jenkins) wipe-workspace: false, (git) clean: true`.
This is a regression.
Whenever a new MediaWiki extension git repository is created under media … submodule to mediawiki/extensions.git
I am not sure if that should be … the script in mediawiki/extensions.git
--------------------------
**Vers … specified
**Severity**: enhancement
This project should have its own git repo. The git repo should be setup as follows.
… i.org/wiki/Documentation/Services
The nightly builds appear to include a complete git clone. There have been complaints … ore-(2.0)
**Severity**: enhancement
Git 1.7.9 has an annoying bug in that … s absolute paths when initializing submodules. In the best case, this breaks git within the submodule when the full … worst case, it leads to incorrect git behavior within the submodule.
Th … is issue. Clients are checking the git revision of the submodule and exit … wrong revision.
This was fixed in git 1.7.10, March 2012:
http://thread … ane.org/gmane.comp.version-control.git/192173
-------------------------- … eployment
**Severity**: enhancement…
https://phabricator.wikimedia.org/T130703 added support for submodules:
1) $somebody files a code review … epo name with submodule name/path (git config --get-regexp submodule ?)
2 … the appropriate submodule folder (git submodule foreach $magic ?)
[1]: … ter/puppet_compiler/prepare.py#L117
are-puppet-compiler/blob/master/puppet_compiler/prepare.py#L135-L141
Submodules changes are not pulled, maybe just adding --recurse-submodules=yes could solve the issue?
cd /usr/share/mediawiki20/core/extensions; git pull; git submodule update --init;
worked o … the command. Please check for some git config or corruption in the Person … *: unspecified
**Severity**: normal
mediawiki/core has wmf branches which include submodules. The phpcs job running uses a macro which fetch all submodules, need to be replaced by git-mwcore-nosubmodule
-------------- … *: unspecified
**Severity**: normal
Jenkins (or Zuul, or whatever is handling Git submodules) should update submodules recursively by passing the '--recursive' flag to 'git submodule update'.
-------------- … wmf-deployment
**Severity**: minor
yntaxHighlight_GeSHi/SyntaxHighlight_GeSHi.class.php at line 285]
```
the deploy repo is currently fetched from the deploy host on targets, submodules remain unmodified and will end up … 2. Configure deploy targets to use git `insteadOf` to munge remote URLs. This should cover all submodules recursively without actually havin … ems like the best approach for now.
ear out of date code) still around, so it'd be nice if it got deleted.
Our Jenkins git plugins are aged and need to be up … iki.jenkins-ci.org/display/JENKINS/Git+Client+Plugin | Git Client ]] | 1.4.6+wmf1 | 1.17.1
| … iki.jenkins-ci.org/display/JENKINS/Git+Plugin | Git ]] | 1.5.0 | 2.3.5
git client
-----------
The git client plugin had to be patched (T73533) because it could not reset submodules when using git 1.9 on Trusty ( https://github.com/wikimedia/git-client-plugin/commit/536940e0e9872 … with: https://github.com/jenkinsci/…
erver_Admin_Log&diff=143155&oldid=143153 | LocalisationUpdate failed: git pull of extensions failed ]]
The integration/kss.git was meant to hold http://warpspire … lets phase out the integration/kss.git repo and the puppet related configuration.
**Author:** `rlane32`
**Description:**
git-deploy doesn't have support for recursive submodules. We can either fix this in git-deploy or we can change how beta i … mal
**Whiteboard**: deploysprint-13
LocalisationUpdate failed: git pull of extensions failed
This h … wmf-deployment
**Severity**: normal
"LocalisationUpdate failed: git pull of extensions failed", see SA … wikimedia.org/view/Server_admin_log
er_Admin_Log&oldid=98258
02:01 logmsgbot: LocalisationUpdate failed: git pull of extensions failed
------- … ?title=Server_Admin_Log&oldid=98258
The scm > git > disable_submodule flag we are gi … ob-builder results in the command "git submodule update". This means that … when the workspace is created, no submodules are fetched because "update" only …
So when adding a new project with submodules, or adding (new) submodules to an existing project, they don't … d be that this is a bug in Jenkins-Git-Plugin, or perhaps jenkins-job-bui … wmf-deployment
**Severity**: normal…
On Wikimedia wikis (both the 1.22wmf12 and 1.22wmf13 wikis) the git revision id doesn't show up on spe … *: unspecified
**Severity**: normal
------------------------
**Version**: unspecified
**Severity**: normal
sure why, but it started happening recently, trying to update (some) submodules give a 403.
Some still work, some …
reedy@tin:/a/common/php-1.22wmf4$ git submodule update extensions/Wikiba … /r/p/mediawiki/extensions/Wikibase.git/info/refs
fatal: HTTP request fail …
reedy@tin:/a/common/php-1.22wmf4$ git submodule update extensions/CodeRe … s and modifying extensions/FOOBAR/.git
--------------------------
**Vers … wmf-deployment
**Severity**: major…
mal
**See Also**:
https://bugzilla.wikimedia.org/show_bug.cgi?id=48303
When Zuul creates its references under /var/lib/zuul/git/, it does not update the submodules which ultimately cause Bug 42953.
… *: unspecified
**Severity**: normal
1. git clone https://gerrit.wikimedia.org/r/p/mediawiki/extensions.git
2. cd extensions
3. git submodule update --init
Command 3 … zureSDK'...
> fatal: remote error: Git repository not found
> Clone of 'h … /r/p/mediawiki/extensions/AzureSDK.git' > into submodule path 'AzureSDK' … wmf-deployment
**Severity**: minor
Apparently the mediawiki-core-qunit git definition attempts to fetch submodules. We need to fix it up the same way … pcs job ( bug 44250 ). There is a git macro that explicitly disable subm … *: unspecified
**Severity**: normal
hared files in gluster as a "deployment". We'd like to actually test git-deploy in advance of deploying it … specified
**Severity**: enhancement
**Author:** `sumanah`
**Description:**
Chad needs to make the submodules ready; he estimates this will take … later in March (after the initial Git/Gerrit migration and after Sam cre … *: unspecified
**Severity**: normal
Sorry, there is no git-product, yet so this goes into MediaWiki.
git clone https://gerrit.wikimedia.org/r/p/mediawiki/core.git
results in:
fatal: The remote end … ailed; result=22, HTTP code = 502
git clone https://gerrit.wikimedia.org/r/p/mediawiki/extensions.git
worked but instead of downloading … *: unspecified
**Severity**: normal
hosted in subversion. The beta project requires it to be migrated to git so we can make it a submodule of o … *: unspecified
**Severity**: normal
One thing that the git migration might make more complica … **: unspecified
**Severity**: major
ns` is not available, making it unclonable (with submodule recursion).
odesearch.wmcloud.org/search/?q=to+1%2F10+of+an+arcsecond) finds both.
le 'lib/ve' (https://gerrit.wikimedia.org/r/VisualEditor/VisualEditor.git) registered for path 'lib/ve'
Clon … stions/2144406/how-to-make-shallow-git-submodules | StackOverflow reading ]] led me to:
```
git clone --depth 1 \
--recursive \
--shallow-submodules \
https://gerrit.wikimedia.org/r … /mediawiki/extensions/VisualEditor.git /var/www/html/extensions/VisualEdi … doesn't quite seem to do the trick.
cap/plugins/prep.py", line 39, in update_update_strategy
13:15:25 git.gitcmd("submodule", "foreach", "-- … tcmd
13:15:25 return _runcmd(["git", subcommand] + list(args), **kwar … cap.runcmd.FailedCommand: Command 'git submodule foreach --recursive /usr/bin/git -C /srv/mediawiki-staging/php-mast … p failed: <FailedCommand> Command 'git submodule foreach --recursive /usr/bin/git -C /srv/mediawiki-staging/php-mast … 11:54:09 stderr:
11:54:09 /usr/lib/…
Gerrit can update submodules in a containing project when the s … modules.html | GitLab CI/CD: Using Git submodules with GitLab CI]]
- [[https://doc … s://docs.gitlab.com/ce/ci/runners/#git-submodule-strategy | CI runners: G … riable is used to control if / how Git submodules are included when fetching the cod … per-job in the variables section."
you like to see the diff? [Y/n]:"
Replying "Yes" showed
```
diff --git a/extensions/CentralAuth b/extensi … ``
Which is not very useful.
The git config variable [[https://git-scm.com/docs/git-config#Documentation/git-config.txt-statussubmoduleSummary| … ow the actual content of the diff).
to stay that way, I suggest we migrate it into the main puppet repo.
T332953, kind of a blocker.
wikibase/termbox is included in Wikibase.git repository as a git submodule.
Once wikibase/termbox … termbox code from the new location.
o reproduce** (step by step, including full links if applicable):
* `git clone https://github.com/wmde/new- … ository should be moved to gerrit
eploy, the src directory (which contains the actual Netbox code) is a Git submodule.
Previously, this submod … e with `--recursive` to update the submodules.
The issue is that this script, w … ting the proxies on the script, so git can transparently pull data remote … * I couldn't figure out a way for `git clone` to copy the content of the … the deploy server instead of using git
* make the `src/` directory a regular directory and not a …
leng
20:24:44 No emails were triggered.
20:24:44 Finished: FAILURE
```
ki/Cli/ref/mw_docker_mediawiki_get-code) doesn’t clone / initialize submodules, but without that, some extensions … uld probably clone with `--recurse-submodules` (or run `git submodule --init --recursive` afterwards).
a/%2B/refs/heads/master/README.md#development-instructions I run
```
git clone --recurse-submodules --remote-submodules https://gerrit.wikimedia.org/r/med … ki/wikifunctions/function-schemata.git) registered for path 'function-sch … ``
cd WikiLambda/function-schemata
git checkout main
```
nch is updated. See also: http://stackoverflow.com/questions/1777854/git-submodules-specify-a-branch-tag
Could defini … save us some keystrokes on deploy.
standing of the release process, or a bug in how the release was done?
le changes local and uncommitted, it means that for a full week, the `git status` output in /srv/mediawiki-s … ully (or that have an enhanced PS1 git prompts that includes this informa … probably never learned it.
Given git status has been dirty for two week … to be done, but please ensure the git status is clean in the new branche … ith ease and confidence.
Thanks :)
or pointing out yesterday that we should improve that.)
From https://git.wikimedia.org/blob/mediawiki%2Ftoo … a string). I'd suggest to do that.
ase and asks you to delete everything. It should stop and yell at you.
Jenkins pipeline from `zuul/layout.yaml` file in `integration/config.git`.
- [x] Empty repository, leaving … hive the repo mirror on GitHub.com.
Jenkins pipeline from `zuul/layout.yaml` file in `integration/config.git`.
- [x] Empty repository, leaving … hive the repo mirror on GitHub.com.
ixed ASAP. Presumably caused by @Jdrewniak's updating portals actions.
est to print the following line: `Pywikibot: [https] r-pywikibot-core.git (b96a9bd, g11047, 2019/05/11, 16:42:57, ok)` also for i18n
wiki-staging/php-master/extensions
15:03:01 INFO:mwextupdate:running: git submodule update --init --recursiv … 0 INFO:mwextupdate:Exit code: 1
```
as submodule from meta repo
>
> The extension is currently broken in git, and updating this repo
> leaves o … avoid check out of the last master
e': checked out '7420443fe551e44ae4180c8b14b542d7e8ed9de1'
cd lib/ve
'git' 'checkout' '-q' '-b' 'wmf/1.32.0-wmf.22'
'git' 'push' 'origin' 'wmf/1.32.0-wmf.2 … branch for an extension submodule.
legoktm@tin:/srv/mediawiki-staging/php-1.32.0-wmf.4/extensions/JADE$ git status
HEAD detached at 1a26fc8
Ch … ges not staged for commit:
(use "git add/rm <file>..." to update what will be committed)
(use "git checkout -- <file>..." to discard …
no changes added to commit (use "git add" and/or "git commit -a")
```
Why is this file deleted? cc @mmodell
There is special code in the CI to handle the submodules of the VisualEditor Mediawiki exte … ns or make VisualEditor stop using submodules.
This task was created after: htt … Skin
|--|--
| Refreshed | T154806
Scap3 currently makes a clone from the local git cache for each revision that is deployed to a target node. Git is fairly smart about using hardli … s; however, the way we are cloning submodules to targets is currently making copies of git objects, using an excess amount of … d figure out a smart way to handle submodules so that targets don't keep an excess amount of git objects.
-----------
@Halfak wro … cause is that the scap cache clone …
URLs to the local deploy master?
It looks like this is a regression.
he on tin is timing out when trying to fetch down `editqualtiy` the `.git` objects directory of which is 2.2GB.
The git submodule `scripts/i18n` is necess … TICAL: Closing network session.
```
---------------------
**Version**: wmf-deployment
**Severity**: normal
n `.gitmodules` (i.e. https://gerrit.wikimedia.org/r/p/pywikibot/i18n.git) differently from before.
lEditor deps.txt
00:11:16 + cd src/extensions/VisualEditor
00:11:16 + git submodule update --init
00:11:18 e … shell' marked build as failure
```
Currently, the mediawiki/event-schemas repo is a git submodule in the eventlogging repo … a full restart for a schema change.
update beta portals http://www.wikipedia.beta.wmflabs.org/, so did I (git pull in portals folder, and then s … odule, and I’m thinking maybe a `git submodule update` reverted my stuf … ted deployment of mediawiki config submodules
> **12:05 <@thcipriani> I think th … production. and we’d like to run git pull to test new commits on beta b … ew more folks to check my thinking.
ull
```
Failed to recurse into submodule path 'SpellingDictionary'
```
ng a build.
It checks out the commit of the root repository, but the submodules are stale from whatever commit/bra … r-npm because that job asserts the git checkout is clean.
https://integr … you can see this is caused by the Git plugin having been upgraded and it … re:
```
<scm class="hudson.plugins.git.GitSCM" plugin="git@1.5.0">
..
<disableSubmodules> … ter
```
<scm class="hudson.plugins.git.GitSCM" plugin="git@2.3.5">
..
<extensions>
<hudson.plugins.…
https://github.com/wikimedia/mediawiki/blob/wmf/1.26wmf13/.gitmodules