WMUK wiki migration/strategy: Difference between revisions

From Wikimedia UK
Jump to navigation Jump to search
No edit summary
 
(31 intermediate revisions by 2 users not shown)
Line 1: Line 1:
This is '''technical migration proposal for WMUK wiki'''. most of this text focus on the user account migration, which is the main challenge.
This is a '''technical migration proposal for WMUK wiki'''.


== Approach ==
== Approach ==
The migration of the wiki could be done like following:
* Setup a Mediawiki instance similar to current one
* Setup a Mediawiki instance similar to current one
* Migrate the data from the XML/SQL dump
* Migrate the data from the XML/SQL dump
* Keep data up2date (until the final switch) with a synchronisation script
* Invite users to reconfigure their account
* Invite users to reconfigure their account


== Problem ==
== Problem ==
Assuming that the WMF won't share any information about the users, the biggest problem is how to make this migration feels smooth for our users (in particular regarding their passwords). Have a look to the [[#stats|stats]] to know more about the wiki users.
The WMF won't share any information about the users, the biggest problem is how to make this migration feels smooth for our users (in particular regarding their password). Have a look to the [[#Stats|stats]] to know more about our wiki users.


== Solution ==
== Solution ==
* Recreate all users on the wiki with new random generated passwords
* Recreate all users on the wiki with new random generated passwords
* Email the new passwords to all emailable users and invite them to login to the new instance and change their password.
* Email the new passwords to all emailable users and invite them to login to the new instance and change their password.
* Users not emailable should be invited to add their email into the old
* Users not emailable should be invited to add their email into the old wiki instance, we would then send them the new account password per email
wiki instance, we would then send them the new account password per email (cronjob or on demand)
* The old WMUK instance should be put in readonly (except USER_TALK) and be kept available at least X months (one year?) under a special domain name like ukold.wikimedia.org for example.
* The old WMUK instance should be put in readonly (except USER_TALK) and be kept available at least X months (one year?) under a special domain name like wmukold.wikimedia.org for example.


== Schedule ==
== Schedule ==
J-3: Create uknew.wikimedia.org DNS entry
* D-20: Put on the old wiki a site notice to warn users (@wmuk)
J-3: Create the new WMUK Mediawiki instance
* D-10: Set short TTL (5 minutes) for www.wikimedia.org.uk DNS entry to allow quick propagation after the change.
J-2: Migrate the data, create and activate a script to keep data synchronized
* D-10: Create an email address where users can write to regarding this migration. Communicate about the migration.
J-1: Put the old wiki in readonly (except user pages) and but a global
* D-10: Create wiki.wikimedia.org.uk DNS entry (@wmuk)
notice
* D-1: Create the new WMUK Mediawiki instance (@wmuk)
J-1: Activate an email address where users can write to regarding this
* D-1: Re-create user accounts on the new wiki (@wmuk)
migration. Communicate about the migration
* D-1: Contact users per emails (old wiki) or on the talk page to invite them to reconfigure their account . RuD this script every hours to send emails to people who are newly emailable (@wmuk)
J-1: Write an email to all emailable users with their new password
* D: Put old wiki in read-only except NS_USER_TALK (@wmf)
J-1: Write a message to the talk page to all non-emailable users
* D: Modify the notice to inform users (@wmf)
inviting them to follow the procedure to get a new password on the new wiki
* D: Dump the old wiki (@wmf)
J: Switch the DNS, make old wiki available under a custom name
* D: Redump new wiki with old wiki data (@wmuk)
J+10: Write a last email to emailable users who don't have updated
* D: Put explaining site notice on the new wiki (@wmuk)
J+30: Write a message on the old wiki on all emailable people who still
* D: Modify DNS entry www.wikimedia.org.uk to point to the new wiki (@wmuk)
don't have updated (message similar to the noemail people).
* D+10: Write a last email to users who don't have change their password (@wmuk)
J+365: Shutdown the old wiki. No way anymore to migrated automatically a
* D+365: Shutdown the old wiki (@wmf)
user.
 
== Development work ==
* Write a script to migrate images (with history)
* Write a script to create the users accounts
* Write a script which will send invitation (email or talk page) to login the new wiki to (newly) emailable users.
* Prepare messages for the users


So, everything could be done within a month and would need IOM ~10 days
== Impact ==
of work.
* WMUK should be in readonly during the migration of the data (a few hours)
* Users will loose their private account data


== Development work ==
== Rollback ==
* Write a script to keep data synchronized between the two wikis
* Remove the readonly lock on the old wiki and rollback the www.wikimedia.org.uk DNS entry
* Write a script which will send invitation to login the new wiki to (newly) emailable users.  


== Stats ==
== Stats ==
Line 52: Line 53:
== See also ==
== See also ==
* [[IT Development/Progress meetings/18 April 2013/WMUK Migration Report]]
* [[IT Development/Progress meetings/18 April 2013/WMUK Migration Report]]
* [[WMUK wiki migration/tech|Technical details]]
* [[WMUK wiki migration/FAQ|FAQ]]


[[Category:Developement]]
[[Category:IT Development]]

Latest revision as of 12:03, 17 February 2014

This is a technical migration proposal for WMUK wiki.

Approach

  • Setup a Mediawiki instance similar to current one
  • Migrate the data from the XML/SQL dump
  • Invite users to reconfigure their account

Problem

The WMF won't share any information about the users, the biggest problem is how to make this migration feels smooth for our users (in particular regarding their password). Have a look to the stats to know more about our wiki users.

Solution

  • Recreate all users on the wiki with new random generated passwords
  • Email the new passwords to all emailable users and invite them to login to the new instance and change their password.
  • Users not emailable should be invited to add their email into the old wiki instance, we would then send them the new account password per email
  • The old WMUK instance should be put in readonly (except USER_TALK) and be kept available at least X months (one year?) under a special domain name like ukold.wikimedia.org for example.

Schedule

  • D-20: Put on the old wiki a site notice to warn users (@wmuk)
  • D-10: Set short TTL (5 minutes) for www.wikimedia.org.uk DNS entry to allow quick propagation after the change.
  • D-10: Create an email address where users can write to regarding this migration. Communicate about the migration.
  • D-10: Create wiki.wikimedia.org.uk DNS entry (@wmuk)
  • D-1: Create the new WMUK Mediawiki instance (@wmuk)
  • D-1: Re-create user accounts on the new wiki (@wmuk)
  • D-1: Contact users per emails (old wiki) or on the talk page to invite them to reconfigure their account . RuD this script every hours to send emails to people who are newly emailable (@wmuk)
  • D: Put old wiki in read-only except NS_USER_TALK (@wmf)
  • D: Modify the notice to inform users (@wmf)
  • D: Dump the old wiki (@wmf)
  • D: Redump new wiki with old wiki data (@wmuk)
  • D: Put explaining site notice on the new wiki (@wmuk)
  • D: Modify DNS entry www.wikimedia.org.uk to point to the new wiki (@wmuk)
  • D+10: Write a last email to users who don't have change their password (@wmuk)
  • D+365: Shutdown the old wiki (@wmf)

Development work

  • Write a script to migrate images (with history)
  • Write a script to create the users accounts
  • Write a script which will send invitation (email or talk page) to login the new wiki to (newly) emailable users.
  • Prepare messages for the users

Impact

  • WMUK should be in readonly during the migration of the data (a few hours)
  • Users will loose their private account data

Rollback

  • Remove the readonly lock on the old wiki and rollback the www.wikimedia.org.uk DNS entry

Stats

  • 2674 registered users
  • 809 have edits
  • 2175 are global users
  • 1772 are emailable (179 with at least 1 edit, 81 with at least 2)

See also

Retrieved from "https://dev.wikimedia.org.uk/w/index.php?title=WMUK_wiki_migration/strategy&oldid=52042"