Explore GitLab
Discover projects, groups and snippets. Share your projects with others
-
Collection of data engineering DAGs to be executed by the WMF Airflow instances.
-
Provides classes and functions shared by all components in the Web2Cit translation ecosystem.
-
A simple script to deploy and run spark3 on WMF stat machines
-
Utilities and libraries for working with data pipelines at WMF. E.g. distributing conda envs, building and syncing artifacts, etc.
-
Datapipelines operationalised by the Generated Data Platform team.
-
-
Web2Cit translation server
-
Example project for using gitlab-ci and workflow_utils to test and build job artifacts for running as jobs in the Analytics Data Lake.
-
Data jobs owned by the Global Data and Insights team.
These should use conda-dist from workflow_utils to generate conda env artifacts, which are then deployed to the Analytics Data Lake for scheduling and running by Airflow.
-
Language-agnostic quality model for articles
-
A simple script to deploy and run spark3 on WMF stat machines
-
General mish-mash of tools by (and mostly for) Inductiveload
-
-
API for detecting and surfacting copyedits for Wikipedia articles
-
A simple MediaWiki extension to test out Vue.js and Codex components inside of a MediaWiki environment.
-
Docker images for local MediaWiki development and related tasks.
-
Docker images for local MediaWiki development and related tasks.
-
Stats about Wikimedia train deploys
