WMUK wiki migration/strategy: Difference between revisions

From Wikimedia UK
Jump to navigation Jump to search
(Created page with "Tom has prepared a first analysis regarding the WMUK wiki migration: https://uk.wikimedia.org/wiki/IT_Development/Progress_meetings/18_April_2013/WMUK_Migration_Report I full...")
 
 
(32 intermediate revisions by 2 users not shown)
Line 1: Line 1:
Tom has prepared a first analysis regarding the WMUK wiki migration:
This is a '''technical migration proposal for WMUK wiki'''.
https://uk.wikimedia.org/wiki/IT_Development/Progress_meetings/18_April_2013/WMUK_Migration_Report


I fully suport his conclusions and what follows should be considered as
== Approach ==
information and propositions for the next steps.
 
Like written by Tom, the migration of the data is no a real problem,
here is how it could be done:
* Setup a Mediawiki instance similar to current one
* Setup a Mediawiki instance similar to current one
* Migrate the data from the XML/SQL dump
* Migrate the data from the XML/SQL dump
* Keep data up2date (until the final switch) with a synchronisation script
* Invite users to reconfigure their account
 
== Problem ==
The WMF won't share any information about the users, the biggest problem is how to make this migration feels smooth for our users (in particular regarding their password). Have a look to the [[#Stats|stats]] to know more about our wiki users.
 
== Solution ==
* Recreate all users on the wiki with new random generated passwords
* Email the new passwords to all emailable users and invite them to login to the new instance and change their password.
* Users not emailable should be invited to add their email into the old wiki instance, we would then send them the new account password per email
* The old WMUK instance should be put in readonly (except USER_TALK) and be kept available at least X months (one year?) under a special domain name like ukold.wikimedia.org for example.


Assuming that the WMF won't share any information about the users, the
== Schedule ==
only big problem is how to make this migration feels smooth for our
* D-20: Put on the old wiki a site notice to warn users (@wmuk)
users (in particular regarding the user passwords).
* D-10: Set short TTL (5 minutes) for www.wikimedia.org.uk DNS entry to allow quick propagation after the change.
* D-10: Create an email address where users can write to regarding this migration. Communicate about the migration.
* D-10: Create wiki.wikimedia.org.uk DNS entry (@wmuk)
* D-1: Create the new WMUK Mediawiki instance (@wmuk)
* D-1: Re-create user accounts on the new wiki (@wmuk)
* D-1: Contact users per emails (old wiki) or on the talk page to invite them to reconfigure their account . RuD this script every hours to send emails to people who are newly emailable (@wmuk)
* D: Put old wiki in read-only except NS_USER_TALK (@wmf)
* D: Modify the notice to inform users (@wmf)
* D: Dump the old wiki (@wmf)
* D: Redump new wiki with old wiki data (@wmuk)
* D: Put explaining site notice on the new wiki (@wmuk)
* D: Modify DNS entry www.wikimedia.org.uk to point to the new wiki (@wmuk)
* D+10: Write a last email to users who don't have change their password (@wmuk)
* D+365: Shutdown the old wiki (@wmf)


Before getting into details, a few stats about our users:
== Development work ==
* Write a script to migrate images (with history)
* Write a script to create the users accounts
* Write a script which will send invitation (email or talk page) to login the new wiki to (newly) emailable users.
* Prepare messages for the users
 
== Impact ==
* WMUK should be in readonly during the migration of the data (a few hours)
* Users will loose their private account data
 
== Rollback ==
* Remove the readonly lock on the old wiki and rollback the www.wikimedia.org.uk DNS entry
 
== Stats ==
* 2674 registered users
* 2674 registered users
* 809 have edits
* 809 have edits
* 2175 are global users
* 2175 are global users
* 1772 are emailable (179 with at least 1 edit, 81 with at least 2)
* 1772 are emailable (179 with at least 1 edit, 81 with at least 2)
Here is the simpliest way I can figure out regaring the "password problem":
* Recreate all users on the wiki with new random generated passwords
* Email the new passwords to all emailable users and invite them to
login to the new instance and change their password.
* People not emailable should be invited to add their email into the old
wiki instance, we would then send them the new account password per
email (cronjob or on demand)
* The old WMUK instance should be put in readonly (except USER_TALK) and
be kept available at least X months (one year?) under a special domain
name like wmukold.wikimedia.org.
So the final and global schedule would looks like:
J-3: Create the new WMUK Mediawiki instance
J-2: Migrate the data, create and activate a script to keep data
synchronized
J-1: Put the old wiki in readonly (except user pages) and but a global
notice
J-1: Activate an email address where users can write to regarding this
migration. Communicate about the migration
J-1: Write an email to all emailable users with their new password
J-1: Write a message to the talk page to all non-emailable users
inviting them to follow the procedure to get a new password on the new wiki
J: Switch the DNS, make old wiki available under a custom name
J+10: Write a last email to emailable users who don't have updated
J+30: Write a message on the old wiki on all emailable people who still
don't have updated (message similar to the noemail people).
J+365: Shutdown the old wiki. No way anymore to migrated automatically a
user.
So, everything could be done within a month and would need IOM ~10 days
of work.


== See also ==
== See also ==
* [[IT Development/Progress meetings/18 April 2013/WMUK Migration Report]]
* [[IT Development/Progress meetings/18 April 2013/WMUK Migration Report]]
* [[WMUK wiki migration/tech|Technical details]]
* [[WMUK wiki migration/FAQ|FAQ]]


[[Category:Developement]]
[[Category:IT Development]]

Latest revision as of 12:03, 17 February 2014

This is a technical migration proposal for WMUK wiki.

Approach

  • Setup a Mediawiki instance similar to current one
  • Migrate the data from the XML/SQL dump
  • Invite users to reconfigure their account

Problem

The WMF won't share any information about the users, the biggest problem is how to make this migration feels smooth for our users (in particular regarding their password). Have a look to the stats to know more about our wiki users.

Solution

  • Recreate all users on the wiki with new random generated passwords
  • Email the new passwords to all emailable users and invite them to login to the new instance and change their password.
  • Users not emailable should be invited to add their email into the old wiki instance, we would then send them the new account password per email
  • The old WMUK instance should be put in readonly (except USER_TALK) and be kept available at least X months (one year?) under a special domain name like ukold.wikimedia.org for example.

Schedule

  • D-20: Put on the old wiki a site notice to warn users (@wmuk)
  • D-10: Set short TTL (5 minutes) for www.wikimedia.org.uk DNS entry to allow quick propagation after the change.
  • D-10: Create an email address where users can write to regarding this migration. Communicate about the migration.
  • D-10: Create wiki.wikimedia.org.uk DNS entry (@wmuk)
  • D-1: Create the new WMUK Mediawiki instance (@wmuk)
  • D-1: Re-create user accounts on the new wiki (@wmuk)
  • D-1: Contact users per emails (old wiki) or on the talk page to invite them to reconfigure their account . RuD this script every hours to send emails to people who are newly emailable (@wmuk)
  • D: Put old wiki in read-only except NS_USER_TALK (@wmf)
  • D: Modify the notice to inform users (@wmf)
  • D: Dump the old wiki (@wmf)
  • D: Redump new wiki with old wiki data (@wmuk)
  • D: Put explaining site notice on the new wiki (@wmuk)
  • D: Modify DNS entry www.wikimedia.org.uk to point to the new wiki (@wmuk)
  • D+10: Write a last email to users who don't have change their password (@wmuk)
  • D+365: Shutdown the old wiki (@wmf)

Development work

  • Write a script to migrate images (with history)
  • Write a script to create the users accounts
  • Write a script which will send invitation (email or talk page) to login the new wiki to (newly) emailable users.
  • Prepare messages for the users

Impact

  • WMUK should be in readonly during the migration of the data (a few hours)
  • Users will loose their private account data

Rollback

  • Remove the readonly lock on the old wiki and rollback the www.wikimedia.org.uk DNS entry

Stats

  • 2674 registered users
  • 809 have edits
  • 2175 are global users
  • 1772 are emailable (179 with at least 1 edit, 81 with at least 2)

See also

Retrieved from "https://dev.wikimedia.org.uk/w/index.php?title=WMUK_wiki_migration/strategy&oldid=52042"