NeoOffice 2.2.1 Release Tasks

Create NeoOffice-2_2_1_Early_Access_branch branch from the HEAD branch for NeoOffice 2.2.1 Early Access so that we can continue to do bug fixes and release Patches while we are working on this release.

Note: After creating the branch, I invoked the following command in my NeoOffice 2.2.1 Early Access workspace to ensure that I don't accidently pull NeoOffice 2.2.1 changes into my build: cvs update -r NeoOffice-2_2_1_Early_Access_branch

Perform a clean checkout of the HEAD branch and set build to build with a new version and NeoOffice and RetroOffice trademarked product names.

This includes the following steps:

• Perform a clean checkout of the HEAD branch
• Copy custom.neo.mk file to custom.mk so that the clean checkout will build with the trademarked product names

• In makefile, change the following macros to the respective values:

  PRODUCT_VERSION=2.2.1
  PRODUCT_DIR_VERSION=2.2.1
  X11_PRODUCT_VERSION=2.2.1
  X11_PRODUCT_DIR_VERSION=2.2.1
  PRODUCT_PATCH_VERSION=Patch 0
  PRODUCT_DIR_PATCH_VERSION=Patch-0
  X11_PRODUCT_PATCH_VERSION=Patch 0
  X11_PRODUCT_DIR_PATCH_VERSION=Patch-0
  NEO_TAG:=-rHEAD
  X11_NEO_TAG:=-rHEAD
  

• In this release, there will not be a patch that upgrades a NeoOffice 2.2.1 Early Access installation so reduce the size of future patches by removing all libraries other than libvcl*.dylib from the build.patch_package_shared target in the makefile. Note that this library should only be applied to NeoOffice builds and not to RetroOffice builds.
• Commit makefile changes and invoke make build.oo_checkout to checkout the OpenOffice.org code

Verify that ooo-build does not have a newer tag than the OOO_BUILD_2_2_1 tag.

Verify that odf-converter does not have a newer tag than the word1.1-M1 tag.

Perform a clean checkout and build of the HEAD branch on Mac OS X 10.4 Intel with gcc 4.0.1.

Note: don't forget to copy custom.neo.mk file to custom.mk so that the clean checkout will build with the trademarked product name

Perform a clean checkout and build of the HEAD branch on Mac OS X 10.4 PowerPC with gcc 3.3.

Note: don't forget to copy custom.neo.mk file to custom.mk so that the clean checkout will build with the trademarked product name

Verify that none of the NeoOffice Intel build's executables or libraries link to any X11 libraries.

Note: to do this task, install your latest NeoOffice build and, in a terminal, execute the following commands:

sh
cd /Applications/NeoOffice.app/Contents/MacOS
for i in `find . -type f`; do echo $i ; otool -L $i 2>&1 | grep X11; done

If none of the binaries link to any X11 libraries, the above commands will only print a list of files. However, if you see any lines that look similar to the following, the file listed just before this type of line is linked to an X11 library and this must be correct before the NeoOffice binaries can be released.

/usr/X11R6/lib/libX11.6.dylib (compatibility version 6.2.0, current version 6.2.0)

Verify that none of the NeoOffice PowerPC build's executables or libraries link to any X11 libraries.

Note: Use the same steps as used for the matching Intel task.

Modify and test bin/installutils script to treat NeoOffice 2.2.1 Early Access as a match.

In this release, language pack resource files are incompatible so we want to preserve them in they exist.

Note: I tested this code by building the installer, language packs, and patch installer and then doing the following steps:

• Install the patch installer and verify that it does not upgrade my NeoOffice 2.2.1 Early Access installation.
• Install a NeoOffice 2.2.1 Early Access language pack, change my machine's preferred language to match the installed language pack, run NeoOffice 2.2.1 Early Access, and verify that the menus are not in English.
• With the same preferred language set in the previous step, install NeoOffice 2.2.1, and verify that the menus are still not in English.
• Install the NeoOffice 2.2.1 British English language pack, change my machine's preferred language to British Englis, run NeoOffice 2.2.1, and verify that the menus are not in English and verify that bug 2533 no longer occurs.

Commit and test updated icon files in etc/package.

• cd etc/package
• Execute the following shell script:

  #!/bin/csh
  #
  # execute within etc/package directory
  
  setenv PKGDIR `pwd`
  
  pushd ~
  curl -C - -O http://www.pimley.net/projects/downloads/NeoOfficeAquaElements.dmg
  popd
  
  setenv VOL `hdiutil mount ~/NeoOfficeAquaElements.dmg | perl -ne 'if ( /(\/Volumes.*)$/ ) { print $1; }'`
  if ( "$VOL" != "" ) then
          mkdir "NeoOffice Aqua Elements 2.1.1.070804"
          pushd "$VOL"
          cp -rf * "$PKGDIR/NeoOffice Aqua Elements 2.1.1.070804"
          popd
          pushd "NeoOffice Aqua Elements 2.1.1.070804"
          find . -type f -name \.\* -print0 | xargs -0 -n 1 rm -f
          popd
  
          if ( -e NeoOfficeAquaElements.zip ) then
                  rm NeoOfficeAquaElements.zip
          endif
          zip -r NeoOfficeAquaElements.zip "NeoOffice Aqua Elements 2.1.1.070804"
          hdiutil unmount "$VOL"
          rm -rf "NeoOffice Aqua Elements 2.1.1.070804"
  
  pushd ~
  curl -C - -O http://www.pimley.net/projects/downloads/RetroOfficeElements.dmg
  popd
  
  setenv VOL `hdiutil mount ~/RetroOfficeElements.dmg | perl -ne 'if ( /(\/Volumes.*)$/ ) { print $1; }'`
  if ( "$VOL" != "" ) then
          mkdir "RetroOffice Elements 2.1.1.070804"
          pushd "$VOL"
          cp -rf * "$PKGDIR/RetroOffice Elements 2.1.1.070804"
          popd
          pushd "RetroOffice Elements 2.1.1.070804"
          find . -type f -name \.\* -print0 | xargs -0 -n 1 rm -f
          popd
  
          if ( -e RetroOfficeElements.zip ) then
                  rm RetroOfficeElements.zip
          endif
          zip -r RetroOfficeElements.zip "RetroOffice Elements 2.1.1.070804"
          hdiutil unmount "$VOL"
          rm -rf "RetroOffice Elements 2.1.1.070804"
  endif
  

• Rebuild NeoOffice and RetroOffice installers with new icon zip files and verify proper build.
• Reinstall both builds and check that updated icons are available.

Get latest version of DicOOo.sxw and FontOOo.sxw files, replace all references to the Control key with the Command key, and commit files in etc/share/dict/ooo.

Note: to do this task, do the following steps:

• Download the latest DicOOo.sxw file from here
• Create a new directory and in that directory, unzip the downloaded file using the zip command.
• Change all of the Windows carriage returns in the unzipped files to Unix newlines and ensure that the files end with a Unix newline by executing the following command:

sh
for i in `find /path/to/first/directory -name content.xml -o -name "Translation*.xml"`; do
( cat $i ; echo ) | tr '\r' '\n' > $i.tmp
mv -f $i.tmp $i
done

• Replace all known references to the Control key with the Command key and replace OpenOffice.org with NeoOffice in the first directory by executing the following command:

sh
for i in `find /path/to/first/directory -name content.xml -o -name "Translation*.xml"`; do
cat $i | \
sed 's#\[CTRL\]#[Command]#g' | \
sed 's#\[Ctrl\]#[Command]#g' | \
sed 's#\[ctrl\]#[Command]#g' | \
sed 's#\[Strg\]#[Command]#g' | \
sed 's# CTRL #[Command]#g' | \
sed 's#\(Ctrl\)#[Command]#g' | \
sed 's#«Ctrl»#[Command]#g' | \
sed 's#OpenOffice\.org#NeoOffice#g' | \
sed 's#OpenOffice#NeoOffice#g' | \
sed 's#/NeoOfffice/#/OpenOffice.org/#g' > $i.tmp
mv -f $i.tmp $i
done

• Replace the etc/share/dict/ooo/DicOOo.sxw file by executing the following commands:

sh
cd /path/to/first/directory
zip -r /path/to/etc/share/dict/ooo/DicOOo.sxw .

• Copy your etc/share/dict/ooo/DicOOo.sxw into your latest NeoOffice installation and run the wizard to verify that the modified file actually works and that the text has been properly changed before commiting the modified file.
• Download the latest FontOOo.sxw file from here and repeat the above steps by replacing "DicOOo" with "FontOOo".

Merge any NeoOffice 2.2.1 Early Access bug fixes committed to the NeoOffice-2_2_1_Early_Access_branch branch.

Tag the code in the HEAD branch with the NeoOffice-2_2_1 and RetroOffice-2_2_1 tags.

Note: Because the installer build checks out source code from the anoncvs.neooffice.org server, the following steps must be done to complete this task properly:

• Do a cvs update -Ad to ensure that you have the latest code in your workspace, verify that none of the files are marked as updated, patched, modified, or have conflicts, and verify that the latest code actually builds through the installer.
• In the makefile, set the NEO_TAG macro to NEO_TAG:=-rNeoOffice-2_2_1 and X11_NEO_TAG macro to X11_NEO_TAG:=-rRetroOffice-2_2_1 and commit the makefile.
• Tag all files in your workspace by invoking cvs tag NeoOffice-2_2_1 ; cvs tag RetroOffice-2_2_1.
• On the cvs.neooffice.org server, run the script to synchronize the anoncvs.neooffice.org server.
• Verify that the installer still builds by deleting the build.source_zip* files and invoking make NOLANGPACKS=true.
• If there are any build errors, fix and commit them, retag the changed files by invoking cvs tag -F NeoOffice-2_2_1 ; cvs tag -F RetroOffice-2_2_1, and repeating the previous two steps.

Create releasable NeoOffice 2.2.1 and RetroOffice 2.2.1 builds for Intel.

Note: the following steps are overkill, but they ensure that all recent changes to the NeoOffice custom code has been built:

• Do a cvs update -d -rNeoOffice-2_2_1 and verify that none of the files are marked as updated, patched, modified, or have conflicts. If any such errors appear, the previous task (tagging of the workspace) has not been done properly and it needs to done properly before you can proceed with this task.
• Do a cvs update -Ad so that you can do bug fixing and release patches after you create your releasable build
• Delete all build.neo_*, build.odf-converter*, and build.source_zip* files. This will force the installer to rebuild the odf-converter code and all of the NeoOffice custom code without causing any of the OpenOffice.org or ooo-build code to be rebuilt.
• Invoke make to create the releasable installer and language packs.

Create releasable NeoOffice 2.2.1 and RetroOffice 2.2.1 builds for PowerPC.

Note: Use the same steps as used for the matching Intel task.

Create backup copy of releasable Intel binaries and upload them to staging server.

The following steps are the steps that I used to create my backup copy:

• Create an empty NeoOffice-2.2.1 directory outside of the workspace
• Copy all 58 install/*.dmg files from your releasable build into the empty NeoOffice-2.2.1 directory and chmod 444 *.dmg in that directory

sftp all 58 files up to staging server and chmod 444 *.dmg all of the files on the staging server.

diff the md5 *Intel.dmg | sort' output of the files on the server and in local NeoOffice-2.2.1 directory.

Repeat the above steps using RetroOffice-2.2.1 instead of NeoOffice-2.2.1 and install_X11/*.dmg instead of install/*.dmg.

Put the NeoOffice-2.2.1 and RetroOffice-2.2.1 folders in a new empty directory and create a CD master NeoRetroOffice-2.2.1.cdr file of the new directory using the following command:

hdiutil create -srcfolder /path/to/new/directory \
-format UDTO -ov -o /path/to/output/NeoRetroOffice-2.2.1.cdr

Create backup copy of releasable PowerPC binaries and upload them to staging server.

Note: Use the same steps as used for the matching Intel task (except diff using md5 *PowerPC.dmg | sort'.

Verify that the releasable installers and one or more language packs install and run on Intel for the following Mac OS X versions:

• 10.4.10
• 10.5.0 developer seed 9A499

Verify that the releasable installers and one or more language packs install and run on PowerPC for the following Mac OS X versions:

• 10.3.9
• 10.4.10
• 10.5.0 developer seed 9A499

Create 2.2.1 Early Access tag for the www.neooffice.org website to avoid modifying production web pages while we modify the web pages in the test website. Steps:

• Construct a local checkout of the website: cvs co www_htdocs
• cd into the checkout directory and tag the checkout by invoking the following command: cvs tag NeoOffice-2_2_1_Early_Access
• Login to the www.neooffice.org server, cd to the its webroot directory, and set the tag by invoking the following command: cvs update -d -rNeoOffice-2_2_1_Early_Access ; chmod -Rf ug+rw .htaccess *

Update all version names, file URLs, and patch version in all of the earlyaccess*.php files in the www-test.neooffice.org web pages.

Note: I used the following steps to do this:

• Update the version name and file URLs by executing the following commands in the neojava directory of the web pages:

sh
for i in `find . -name "earlyaccess*.php" -o -name "header.html"`; do
sed 's#NeoOffice 2\.2\.1 Early Access#NeoOffice 2.2.1#g' $i | \
sed 's#_Early_Access##g' > $i.tmp
mv $i.tmp $i
done

• Reset the patch version to "Patch 0" by executing the following commands in the neojava directory of the web pages.

sh
for i in `find . -name "earlyaccesspatch.php" -o -name "header.html"`; do
sed 's#Patch 2#Patch 0#g' $i | \
sed 's#Patch-2#Patch-0#g' > $i.tmp
mv $i.tmp $i
done

• Manually edit all of the earlyaccesspatch.php pages, uncomment the last table row (the one that says "No patches have been released") and comment out the other two table rows (the PowerPC and Intel patch links).
• Manually edit the neojava/globals.php page, set $earlyaccessproduct to NeoOffice 2.2.1, set $earlyaccessproductfamily[0] to NeoOffice 2.2.1 Early Access, and set $earlyaccesspatch to Patch 0.
• Manually edit the news banner text in all of the header.html pages.
• After you verify the that changes look correct, invoke the following command to commit your changes: cvs commit ; chmod -Rf ug+rw .htaccess *

Update the 116 file sizes in all of the earlyaccessdownload.php and earlyaccesslangpackdownload.php files in the www-test.neooffice.org web pages.

Note: I used the following steps to do this:

• Login to the www-test.neooffice.org server, cd to the its webroot directory, and invoke the following command: cvs update -Ad ; chmod -Rf ug+rw .htaccess *
• Get a file containing the new release's file names and the matching file sizes from the NeoOffice 2.2.1 Early Access release by executing the following command:

ls -l /directory/NeoOffice-2.2.1_Early_Access/binaries/NeoOffice-2.2.1_Early_Access-*.dmg | \
awk '{print $9 " " $5}' | \
sed 's#^.*NeoOffice-2.2.1_Early_Access#NeoOffice-2.2.1#' | \
sort > /path/to/a/new/file

• Get a file containing the new release's file names and the matching file sizes by executing the following commands:

ls -l /directory/NeoOffice-2.2.1/binaries/NeoOffice-2.2.1-*.dmg | \
awk '{print $9 " " $5}' | \
sort > /path/to/a/new/file

• Create a chained list of sed commands by executing the following command:

join /file/from/first/step /file/from/second/step | \
sed 's#^.*dmg ##' | \
sed 's# #\##' | \
sed 's#^#sed "s\##' | \
sed 's#$#\#g" | \\#' > /path/to/a/new/file

• Manually edit the file created in the last step and insert the following lines before the first sed command:

for i in `find . -name "earlyaccessdownload.php" -o -name "earlyaccesslangpackdownload.php"`; do
cat $i | \

• Manually edit the same file and insert the following lines after the last sed command:

cat > $i.tmp
mv $i.tmp $i
done

• cd to the neojava directory and execute the following command to update all of the file sizes:

sh /path/to/file/edited/in/last/step

• After you verify the that changes look correct, invoke the following command to commit your changes: cvs commit ; chmod -Rf ug+rw .htaccess *

Close all bugs with a status of "Resolved" by setting the following field values:

• Set "Status" field to "Closed"
• Set "Resolution" field to "Fixed"
• Set "Target Version" field to "2.2.1"
• Set "Closed in Version" field to "2.2.1"

Make room for the new NeoOffice binaries by removing the NeoOffice Aqua Beta 3 binaries from the www.planamesa.org and eap.neooffice.org mirror sites.

Note: the following steps were used to complete this task:

• Login to the www.neooffice.org server, cd to the its webroot directory, and invoke the following command: cvs update -Ad ; chmod -Rf ug+rw .htaccess *.
• Comment out the www.planamesa.net and www.planamesa.org servers from the neojava/mirrors.php file in the www.neooffice.org website's neojava/mirrors.php file and invoke the following command to commit your changes: cvs commit ; chmod -Rf ug+rw .htaccess *.
• Delete all NeoOffice-2.1-*.dmg files from both of the www.planamesa.net and www.planamesa.org servers.

Create 2.2.1 Early Access branch for the www.neooffice.org website to avoid modifying production web pages while we modify the web pages in the test website. Steps:

• Construct a local checkout of the website: cvs co www_htdocs
• cd into the checkout directory and tag the checkout by invoking the following command: cvs tag -b NeoOffice-2_2_1_Early_Access_branch
• Login to the www.neooffice.org server, cd to the its webroot directory, and set the tag by invoking the following command: cvs update -d -rNeoOffice-2_2_1_Early_Access_branch ; chmod -Rf ug+rw .htaccess *

Update all version names, file URLs, and patch version in all of the non Early Access *.php files in the www-test.neooffice.org web pages.

Note: I used the following steps to do this:

• Copy all of the earlyaccessfeatures.php pages to the features.php pages by executing the following commands in the neojava directory of the web pages:

sh
for i in `find . -name "features.php"`; do
cp `dirname $i`/earlyaccess`basename $i` $i
done

• Manually edit all of the features.php pages and delete the following 2 PHP code blocks:

<?php
    include('../earlyaccesslogincheck.php');
?>

    if ($earlyaccessdownloadenabled && $_SESSION[DONATIONSUSERSESSIONKEY]) {
        printLogoutLink();
    }

• Update the version name and file URLs by executing the following commands in the neojava directory of the web pages:

sh
for i in `find . -name "*.php" -o -name "header.html" | grep -v earlyaccess`; do
sed 's#NeoOffice 2\.1#NeoOffice 2.2.1#g' $i | \
sed 's#NeoOffice-2\.1#NeoOffice-2.2.1#g' | \
sed 's#NeoOffice-2_1#NeoOffice-2_2_1#g' | \
sed 's# 2\.1 # 2.2.1 #g' | \
sed 's#\*2\.1\*#*2.2.1*#g' > $i.tmp
mv $i.tmp $i
done

• Reset the patch version to "Patch 0" by executing the following commands in the neojava directory of the web pages.

sh
for i in `find . -name "patch.php" -o -name "header.html"`; do
sed 's#Patch 7#Patch 0#g' $i | \
sed 's#Patch-7#Patch-0#g' > $i.tmp
mv $i.tmp $i
done

• Manually edit all of the patch.php pages, uncomment the last table row (the one that says "No patches have been released") and comment out the other two table rows (the PowerPC and Intel patch links).
• Manually edit the neojava/globals.php page and set the following variables to the following values:

$earlyaccessdownloadenabled = false;
$earlyaccessproduct = '';
$earlyaccessproductfamily[0] = '';
$earlyaccesspatch = 'Patch 0';
$earlyaccesspatchpage = 'earlyaccesspatch.php';
$currentproduct = 'NeoOffice 2.2.1';
$currentproductfamily[0] = '';
$currentpatch = 'Patch 0';
$currentpatchpage = 'patch.php';
$currentpatchhidemirrors = true;

• Manually edit the news banner text in all of the header.html pages and comment out all Early Access Program table rows and uncomment and update the non-Early Access Program table rows.
• Manually edit all of the index.php pages, change the version in the "27 March 2007" line in the "News" section back to "NeoOffice 2.1", copy the edited "27 March 2007" line to a new line above it, change the date and version numbers in the new line, delete the sentence with the download link in the "27 March 2007" line, and delete the "1 July 2006" line.
• After you verify the that changes look correct, invoke the following command to commit your changes: cvs commit ; chmod -Rf ug+rw .htaccess *

Update the 114 language packs' file sizes in all of the earlyaccessdownload.php files in the download.neooffice.org web pages.

Note: I used the following steps to do this:

• Get a file containing the new release's file names and the matching file sizes from the NeoOffice 2.1 Early Access release by executing the following command:

ls -l /directory/NeoOffice-2.1_Early_Access/binaries/*Language_Pack*.dmg | \
awk '{print $9 " " $5}' | \
sed 's#^.*NeoOffice-2.1_Early_Access#NeoOffice-2.1#' | \
sort > /path/to/a/new/file

• Get a file containing the new release's file names and the matching file sizes by executing the following commands:

ls -l /directory/NeoOffice-2.1/binaries/*Language_Pack*.dmg | \
awk '{print $9 " " $5}' | \
sort > /path/to/a/new/file

• Create a chained list of sed commands by executing the following command:

join /file/from/first/step /file/from/second/step | \
sed 's#^.*dmg ##' | \
sed 's# #\##' | \
sed 's#^#sed "s\##' | \
sed 's#$#\#g" | \\#' > /path/to/a/new/file

• Manually edit the file created in the last step and insert the following lines before the first sed command:

for i in `find . -name "earlyaccessdownload.php" -o -name "header.html"`; do
cat $i | \

• Manually edit the same file and insert the following lines after the last sed command:

cat > $i.tmp
mv $i.tmp $i
done

• cd to the neojava directory and execute the following command to update all of the file sizes:

sh /path/to/file/edited/in/last/step

Create a neojava/press_releases directory and cvs add it to the download.neooffice.org. Obtain each localized version of the NeoOffice 2.1 press release in HTML format and save them in this directory using the following naming format so that the webserver's language detection will serve the closest matching file, and cvs add them:

• English - Save as two files: NeoOffice_2.1.html.en and NeoOffice_2.1.html.html
• Other languages - Save using the format NeoOffice_2.1.html.<two-digit-language-code> replacing <two-digit-language-code> with the standard language code (e.g. de for German, fr for French, etc.

Before the actual release time, create a new category in the donations database that has a start date and time that is a few hours before the planned release time to ensure that donors who donate after we make the NeoOffice 2.2.1 binaries downloadable get their donation credited to the next Early Access Program using the following steps:

• Login to the www.neooffice.org server, cd to the /neojava/donationsadmin directory, and execute the following command to add a new category:

  sh
  ./manage_categories.php -a
  

• Enter the following data when the above command asks for it to create a new category for the next Early Access Program membership. The category's name, amounts, and end date will be changed when the next Early Access Program dates are set but the start date should not change:

  category_name: Next Planned NeoOffice Early Access Program Membership
  mc_gross_USD: 25
  mc_gross_EUR: 25
  mc_gross_GBP: 25
  mc_gross_CAD: 25
  mc_gross_AUD: 25
  mc_gross_JPY: 2500 
  start_date: 08/26/07
  end_date: 01/01/09
  enabled: 1
  

• Run the command again and enter the following data when the above command asks for it to create a new category for the next Early Access Program subscription. The category's name, amounts, and end date will be changed when the next Early Access Program dates are set but the start date should not change:

  category_name: Next Planned NeoOffice 2.x Early Access Program Subscription
  mc_gross_USD: 50
  mc_gross_EUR: 50
  mc_gross_GBP: 50
  mc_gross_CAD: 50
  mc_gross_AUD: 50
  mc_gross_JPY: 5000
  start_date: 08/26/07
  end_date: 01/01/09
  enabled: 1
  

Synchronize the donation's database to PayPal's database to ensure that none of the donors' transactions are missing and to pick up any e-mail address changes made by donors during the Early Access period using the following steps:

• Login to PayPal, click on the History tab, click on Download My History link, select Custom Date Range, enter the day before the start of the Early Access period as the "From" date and the current date as the "To" date, and "Comma Delimited - All Activity" as the "File Types to Download".
• It will take some time for PayPal to prepare the file. Once the file is ready, download it and use sftp to copy it to the www.neooffice.org server. Note: be sure to delete your local copy.
• Once the history file is on the www.neooffice.org server, login to the server, cd to the /neojava/donationsadmin directory, and execute the following command to import the history file:

  sh
  ./import_paypal_transaction_history.php /path/to/history/file 2>/path/to/error/file
  

• Inspect the entries in the error file created in the previous command and verify that none of the rejected lines from the file are donor transactions.