I'm sure I tried HTTPS and it didn't work, specially since it's much simpler than doing it with ssh.

@Mstyles I've created this project and added you as the project admin. You should be able to access this project on horizon.wikimedia.org and add other users as needed.

@Mstyles I've created this project and added you as the project admin. You should be able to access this project on horizon.wikimedia.org and add other users as needed.

+1

+1

https://gerrit.wikimedia.org/r/Documentation/user-upload.html#http

To be honest, I don't know. I thought about it before making this request (but didn't think a lot). The biggest con of toolforge is the security, specially given that this will be able to create a lot of patches, etc. and I want to isolate the ssh agent as much as possible.

Is it not possible to run this as a Toolforge tool?

Apologies, this fell through the cracks somewhat. I'll reply conclusively
before the end of this week.

@SCherukuwada Did Toolforge work for your needs? Or would you prefer a cloud vps project? Let us know and we'll create the project.

In T301044#7751516, @Doc_James wrote:

With respect to moving this to a Wikimedia service... What would be the steps for that? Reach out to the team itself to discussing the possibility of this becoming a quarterly goal at some point in time?

Hi @Winfinity, the purpose implies that this might only be used by you?

I could also ask if anyone was willing to join this effort as part of their 10% time... https://www.mediawiki.org/wiki/Platform_Engineering_Team/Personal_Development_Share_Back

With respect to moving this to a Wikimedia service... What would be the steps for that? Reach out to the team itself to discussing the possibility of this becoming a quarterly goal at some point in time?

In T301044#7751255, @Sj wrote:

@sbassett a straightforward solution might be to have the OWID data integrated into our data-stores (however we choose to handle tabular data : on WD or on Commons), so that it has the same trust/sanity profile as other data. We are talking about a limited number of datasets, well within the volume of existing updates.

@Sj That was my prior 5 year effort to get OWID working within WP.

This should absolutely be integrated into WM projects. Extremely valuable information, granularly sourced data from a trustworthy secondary source which we must find better ways to synchronize with. (the # of editor-hours currently spent updating COVID data points by hand is unnecessary)

Change 767596 had a related patch set uploaded (by Reedy; author: Reedy):

[operations/mediawiki-config@master] Use namespaced ApiFeatureUsageQueryEngineElastica

https://gerrit.wikimedia.org/r/767596

I'm not certain the WMF Security-Team would take issue with the wmcs piece of this project or even the extension, certainly not within the context of non-Wikimedia-production MediaWiki installations. For Wikimedia production though, this would likely be reviewed and rated as a critical risk, which would require c-level risk acceptance for deployment. Such a risk rating would be due to the primary application living within wmcs and the intention of allowing untrusted and unsanitized OWID data to be displayed on Wikimedia production projects via MediaWiki templates.

The extension mentioned is not really part of this project. It does not run on any of this project's resources nor is there any plan for it to do so. The security and performance review would be of more interest to company on whose infrastructure it gets implemented. If the extension is of broader interest a separate project should be created for that.

Mentioned in SAL (#wikimedia-cloud) [2022-03-02T16:58:00Z] <dcaro> Created the project with default quotas (T302621)

@Aklapper So the first steps is to determine if anyone wants the extension and how much doing this work will cost Wiki Project Med. Our board will than look at if and when we can afford the work.

I'm surprised to see an extension mentioned for the first time. See https://www.mediawiki.org/wiki/Writing_an_extension_for_deployment for extension requirements.

Well we have a version of OWID running. We have adjusting the formatting to mostly display properly (plus work in offline ZIMs). And now we are working on a community consensus. Community consensus will take at least a month.

Done!

dcaro@cloudcontrol1005:~$ sudo wmcs-openstack project create --enable --description "Environment to update and mirror (selected) Wikimedia projects to IPFS (https://ipfs.io)" ipfs
dcaro@cloudcontrol1005:~$ sudo wmcs-openstack role add --project ipfs --user samtar user
dcaro@cloudcontrol1005:~$ sudo wmcs-openstack role add --project ipfs --user firefly user
dcaro@cloudcontrol1005:~$ sudo wmcs-openstack role add --project ipfs --user samtar projectadmin
dcaro@cloudcontrol1005:~$ sudo wmcs-openstack role add --project ipfs --user firefly projectadmin

Approved! Will start working on it shortly, I'll use the default quota, and once you need more storage feel free to create a task requesting the new quota :)

In T301044#7695138, @Doc_James wrote:

So the initial use, as a proof of concept, is to be on MDWiki. Community consensus will need to be developed successfully before it can be rolled on other wikis. Basically the work flow is:

1. Get a version of OWID running
2. Adjust the formatting and get it displaying properly on MDWiki (plus stills displaying offline in ZIMs)
3. Develop community consensus for use on a version of Wikipedia
4. Bring such a request to the WMF tech team to permit this

I have been working on trying to get Our World in Data working on Wikipedia for more than 6 years, fully understand that there is potentially years of work ahead and always a good chance the movement will not be interested... https://en.wikipedia.org/wiki/Template:Global_Heat_Maps_by_Year

+1. I would suggest talking to the folks in the mwoffliner project if you need ZIM files related to the wikis.

Thanks a lot, using it now :-) :-)

In T302621#7746923, @dcaro wrote:

Will the default quota suffice? (80GB for volumes, 20GB for instance OS, 8 instances, 16GB RAM, 12 CPUs)
If not, can you specify what resources you need?