There seem to be a lot of questions from the online community surrounding the process that developers go through to patch PC games, so I want to shed some light and remove some of the mystery by posting a walkthrough of each phase of the process. All in all, it can take anywhere from a minimum of 2 months to several months, depending on the variables involved in a particular game update.
Phase 1: Listen to the community.
As soon as the game is released, we scour the forums and play online with the fans to listen to feedback and keep an eye out for issues that degrade the experience for gamers. We build a list of every issue reported, which goes immediately into our test lab for reproduction. Estimated time: minimum of 2 weeks to build a comprehensive list. In actuality, this is an ongoing process that starts as soon as the game is released and goes on forever. J It’s given a minimum of 2 weeks here because the first two weeks of a game’s release typically do not yield enough information about the game to be considered comprehensive.
Phase 2: Reproduce the issues and engineer a solution. The test team tries to reproduce the issues in a test environment, and enters bugs into our bug-tracking database to assign to engineers, artists, or designers. It’s imperative that we reproduce the issues in the test lab. Video games are highly complex pieces of software – every change made to the software impacts something else in the game, often in a way that introduces more bugs. For this reason, it’s very dangerous to “fix” bugs that cannot be reproduced in the test lab because team members don’t know with 100% certainty what the cause of the issue is. The repro success rate for a PC game is much lower than its console counterparts, due to the myriad of variations in the hardware components, device drivers, OS configurations, and other software which may be present on the user machines. All of these additional unknown factors complicate the PC QA process. Once the issue is reproduced and the bug is assigned, the team researches the cause of the issue, engineers a solution, compiles it back into the game, and tests their fix. Estimated time: minimum of 2 weeks to make the rounds through QA, spend time researching the causes, and implement solutions. This phase is typically the longest part of the process and will generally take more than 2 weeks, depending on the number of issues reported and the complexity of those issues. Once a game is released, every change made to it is a high risk. We never want to make a problem worse, so adequate time is needed here to implement the best possible solution.
Phase 3: Test the updated game before submission to Activision for approvals. Once the team is satisfied that the list of issues has been resolved, the updated game goes through a rigorous internal testing procedure to ensure that all issues have been addressed without introducing any new issues. The team must ensure the changes / additions do not create any new compatibility problems with the supported hardware devices from previous versions. This process is iterative and is mixed in with Phase 2. If, during this phase, new issues are discovered or the original issue is not fixed appropriately, the team has to spend more time researching and implementing a solution, and Phase 3 starts over again. As stated above, every change made to the software has a potential impact somewhere else in the game, so we cannot just test the one issue – we have to test the entire game. Estimated time: minimum of 2 weeks to thoroughly test the entire game, iterate on fixing issues, and internally approve the updated game for release. Again, this phase typically takes longer than 2 weeks, but this is a best-case scenario.
Phase 4: Activision’s QA & Code Release Group reviews patch. As soon as our QA team has approved the game update internally, it is then submitted to our publisher, Activision, for their own testing and approval. At this point, it is completely out of our hands as developers. If the game update is approved by Activision, the process is almost done. If the game update is rejected, an abbreviated version of the entire process starts again from Phase 2. Estimated time: minimum of 1 week to get an approval report from Activision, typically less time to get a rejection report.
Phase 5: Create Installer, Release! Once the game update is approved by both internal QA and Activision QA, a patch Installer and release notes are created, tested, and prepared for worldwide distribution. Installer package is embargoed and distributed to mirror & community sites, to allow for concurrent and fair release from each participating party. This is typically a very short process, but it can add time depending on outside factors. Estimated time: minimum of 3-5 days. That is the PC patching process in a nutshell. Of course, the intricacies of the process are far more detailed than this, but this description provides a general overview. The minimum estimates of time listed above are best-case scenarios, and on average, it takes longer than 2 months. In rare emergency cases, this time can be trimmed down, but this is very rare, and depends on what is being addressed.
You may have also seen posts in the forums regarding “hot fixes” (more specifically, in the console forums only). There is presently no infrastructure for us to release Call of Duty: World at War “hot fixes” to the PC community, as is possible with the consoles. There is no overarching service for the PC version like PSN or Xbox LIVE to make this possible. Thus, any hotfixes you see a console receiving must wait to be included in the full PC patch.
So there you have it – hopefully this removes some of the mystery of the process and educates the community as to why game patches take as much time as they do. Enjoy the game and keep communicating your feedback to us!
