ECS had a blog server for some years, home to a number of mature blogs.\u00a0 As part of the university-wide systems centralisation, these blogs had to be migrated to existing Southampton WordPress server. Patrick and I were tasked with this.<\/p>\n
Our initial googling return very little information about this, other than people saying how hard it was, so we decided that it was well worth documenting.\u00a0 It wasn\u2019t as hard as all that, though we did things that can\u2019t be considered good computer science.<\/p>\n
This is presented as a set of instructions, and we\u2019re assuming that there are two multisite installations that need to be moved onto a single new server.\u00a0 It relies on the database structure that wordpress 3.4.1 uses, so if you have a different version, your mileage may vary.<\/p>\n
You will need a fresh server, with a fresh install of\u00a0Wordpress (verify that it works). \u00a0Don’t worry too much about plugins and themes, as you will be replacing the whole WordPress tree.<\/p>\n
Decide upon which source server will be primary. \u00a0This is almost certainly the one with the most blogs. \u00a0The heavy lifting in this task will be moving the blogs from the secondary server to the primary one. \u00a0Note that it doesn’t matter how many posts the blogs have, just how many blogs are on the multisite.<\/p>\n
The following terms will be used throughout these instructions:<\/p>\n
Primary<\/strong> [Server\/Database\/Tree]<\/p>\n The server\/database\/file tree of the WordPress install with the most blogs.<\/p>\n Secondary<\/strong> [Server\/Database\/Tree]<\/p>\n The server\/database\/file tree of the WordPress install with the fewest blogs.<\/p>\n Target<\/strong> [Server\/Database]<\/p>\n The server\/database onto which the blogs will be moved.<\/p>\n On the primary server, cd into the WordPress root directory and dump the database:<\/p>\n Then tar up the WordPress tree and scp it across to the target server. \u00a0Note that setting the character set to utf8 is important.<\/p>\n On the target server, create a convenient working directory and untar.<\/p>\n Both the base URL and the base path are stored multiple times in the database. \u00a0These will need to be updated. \u00a0The easiest way to do this is to modify it using vim and regular expressions.<\/p>\n In the example below, we were moving from Move the target WordPress tree to a backup directory and swap in the Primary wordpress tree. \u00a0Then edit wp-config.php:<\/p>\n Create a new database using the settings from wp-config.php. On the command line:<\/p>\n Then cat the mysqldump into the new database (don’t forget the utf8 option):<\/p>\n Restart apache, and check that the blogs are all visible.<\/p>\n Each blog has a numeric ID and a path. The IDs are assigned serially, and must be unique. You will need to assign new IDs to all secondary blogs. To get the information out of the database, do the following for the Secondary database (you may want to print this out to note down the new IDs):<\/p>\n Next, using the target WordPress’ web interface, log in and create a new blog for every blog returned from the query above. It is essential<\/strong> that the same path is used.<\/p>\n Finally, run the above query on the target database to get a list of the new blog IDs. You will need to make a note of the mapping between IDs on the secondary server and IDs on the target server.<\/p>\n The user accounts in the secondary blog need to be moved, and they all have numeric IDs which will need to be incremented. They also have blog permissions associated with them.<\/p>\n First, find the highest ids in the user and usermeta tables in both the target and the secondary databases. The mysql for doing this is:<\/p>\n Make a note of the highest ID and highest umeta_id (from whichever database has the highest). Round these numbers up to the nearest round number.<\/p>\n Then, dump the wp_users and wp_usermeta tables from the secondary database and cat them into a temporary database under your control (don’t forget the utf8 option). Run the following commands in the temporary database (using the numbers rounded up above instead of the examples of 50000 and 600000): Dump the temporary database (note the use of the –no-create-info argument so as to not drop the tables when inserting):<\/p>\n …and then edit it with vim to update the blog permissions. \u00a0For each blog in your ID map, run the following substitution command (in this example, the secondary blog ID of 7 maps to the target blog ID of 88):<\/p>\n This will update all the user permissions in the wp_usermeta table.<\/p>\n Finally, cat this file into the target database. \u00a0This will insert all of the new user records and user metadata into the two tables.<\/p>\n Create a copy of the secondary WordPress tree in a convenient location on the target server. \u00a0You will need to diff and merge the following directories in the secondary and target wordpress trees:<\/p>\n Use Each blog has a directory for uploaded files. \u00a0These need to be copied across. \u00a0Refer to your blog ID map, and copy these directories. \u00a0For example, in our map, the secondary blog ID of 7 maps to the target blog ID of 88. \u00a0This means that the contents of of:<\/p>\n …needs to be copied into a new directory at<\/p>\n Each blog has a number of database tables that hold posts, setting and other bits of data. \u00a0A list of them would look something like this:<\/p>\n Cat a dump of the secondary database (don’t forget the utf8 options) into your temporary database (empty it beforehand if necessary). \u00a0Drop all tables from the database that aren’t blog tables (tables that don’t start with ‘wp_N_’). \u00a0For each blog ID, run the following mysql command (use the rounded user ID from above):<\/p>\n Dump the database and edit with vim. \u00a0For each ID in your map, run the following (replace the digits according to your blog ID map):<\/p>\n If you wish to use the front page of the secondary multisite as the frontpage of the target multisite, then you should set this up by hand. \u00a0Open both in your web browser and copy across the settings.<\/p>\n You will want to maintain any old URLs. \u00a0In your apache configuration you will need:<\/p>\n Job Done!<\/p>\n We noticed that some (but not all) theme settings had not moved across and had to be set manually. \u00a0It may be a good idea to inspect every blog for issues after the migration, particularly those from the secondary server.<\/p>\n <\/p>\n <\/p>\n <\/p>\n","protected":false},"excerpt":{"rendered":" ECS had a blog server for some years, home to a number of mature blogs.\u00a0 As part of the university-wide systems centralisation, these blogs had to be migrated to existing Southampton WordPress server. Patrick and I were tasked with this. Our initial googling return very little information about this, other than people saying how hard […]<\/p>\n","protected":false},"author":24,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"ngg_post_thumbnail":0,"footnotes":""},"categories":[52475],"tags":[],"class_list":["post-943","post","type-post","status-publish","format-standard","hentry","category-wordpress-2"],"_links":{"self":[{"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/posts\/943","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/users\/24"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/comments?post=943"}],"version-history":[{"count":9,"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/posts\/943\/revisions"}],"predecessor-version":[{"id":952,"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/posts\/943\/revisions\/952"}],"wp:attachment":[{"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/media?parent=943"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/categories?post=943"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.soton.ac.uk\/webteam\/wp-json\/wp\/v2\/tags?post=943"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}Package Up the Primary Database and Tree<\/h3>\n
mysqldump --default-character-set=utf8 --lock-tables=false -c -uUSER -pPASS DBNAME > mysqlbackup.[date].mysqldump<\/code><\/p>\nManipulate the Primary Database Dump<\/h3>\n
http:\/\/blogs.ecs.soton.ac.uk<\/code> to http:\/\/blog.soton.ac.uk<\/code>. WordPress was located at \/home\/blogs\/blogs.ecs.soton.ac.uk\/htdocs\/<\/code> on the primary server and \/usr\/share\/wordpress\/<\/code> on the target server.<\/p>\n :%s\/\\\/home\\\/blogs\\\/blogs\\.ecs\\.soton\\.ac\\.uk\\\/htdocs\/\\\/usr\\\/share\\\/wordpress\/g
\n:%s\/http:\\\/\\\/blogs\\.ecs\\.soton\\.ac\\.uk\/http:\\\/\\\/blog.soton.ac.uk\/g
\n:%s\/blogs\\.ecs\\.soton\\.ac\\.uk\/blog.soton.ac.uk\/g<\/code><\/p>\nGet the Primary Blogs Up<\/h3>\n
\n
echo 'CREATE DATABASE dbname;' | mysql
\necho \"GRANT ALL PRIVILEGES ON dbname.* TO 'dbuser'@'localhost' IDENTIFIED BY 'password';\" | mysql
\necho \"FLUSH PRIVILEGES;\" | mysql<\/code><\/p>\ncat \u00a0mysqlbackup.[date].mysqldump | mysql\u00a0--default-character-set=utf8\u00a0-uDBUSER -pPASSWORD DBNAME<\/code><\/p>\nCreate Blog ID Map and Placeholders for Secondary Blogs<\/h3>\n
echo 'select blog_id, path from wp_blogs' | mysql -u USER -pPASSWORD DBNAME<\/code><\/p>\nMerge in Secondary Users<\/h3>\n
SELECT MAX(ID) FROM wp_users;
\nSELECT MAX(umeta_id) FROM wp_usermeta;<\/code><\/p>\n
\n<\/code><\/p>\nUPDATE wp_users SET ID=ID+50000;
\nUPDATE wp_usermeta SET user_id=user_id+50000;
\nUPDATE wp_usermeta SET umeta_id=umeta_id+600000;<\/code><\/p>\n mysqldump --default-character-set=utf8 --no-create-info -u USER -pPASSWORD temp_db wp_usermeta wp_users > user_migration.mysqldump<\/code><\/p>\n :%s\/wp_7_\/wp_88_\/g<\/code><\/p>\nMerge Plugins and Themes<\/h3>\n
\n
\/[wordpress_root]\/wp-content\/plugins<\/code><\/li>\n\/[wordpress_root]\/wp-content\/mu-plugins<\/code><\/li>\n\/[wordpress_root]\/wp-content\/themes<\/code><\/li>\n<\/ul>\ndiff -rq<\/code> on the directories of the target install and the copy of the secondary install, and copy across anything that’s missing in the target install. If there are differences, you’ll have to figure out what to keep. \u00a0Note that plugins and mu-plugins may need to be configured through the target web interface. \u00a0Any themes copied in from the secondary tree will also need to be enabled through the web interface ( My Sites -> Network Admin -> Dashboard -> Themes ).<\/p>\nCopy Blog Media Files<\/h3>\n
\/[secondary_root]\/wp-content\/blogs.dir\/7\/<\/code><\/p>\n\/[target_root]\/wp-content\/blogs.dir\/88\/<\/code><\/p>\nImport Secondary Blog Database Tables<\/h3>\n
\n
UPDATE wp_7_posts SET post_author = post_author + 50000;<\/code><\/p>\n:%s\/wp_7_\/wp_84_\/g<\/code><\/p>\n<\/code>Save the file and exit vim, then cat the file (which must only contain blog tables — verifying this may be a good idea) into the target database.<\/p>\nVerify the Front Page<\/h3>\n
Configure Apache Redirects<\/h3>\n
RewriteEngine On
\nRewriteCond %{HTTP_HOST} ^(oldblogurl.domain.com) [NC]
\nRewriteRule ^(.*)$ http:\/\/newblogurl.domain.com$1 [R=301,L]<\/code><\/p>\n<\/code>Then update your DNS entries.<\/p>\nA Final Word<\/h3>\n