Streamline Backups and Restores during Critical EBS Upgrades

The process of upgrading an E-Business Suite (EBS) system is one requiring dozens or hundreds of steps. Think of it like climbing a wall. Each handhold or foothold is analogous to one of the steps in the upgrade.

Written by: Mike Swing -- The process of upgrading an E-Business Suite (EBS) system is one requiring dozens or hundreds of steps. Think of it like climbing a wall. Each handhold or foothold is analogous to one of the steps in the upgrade. What happens if you miss a handhold or foothold? If you are close to the ground, then the fall isn't dangerous, and you can get restarted easily. But what happens if you're 25 or 35 feet off the ground? A fall from that height can result in serious injury, unless you are strapped to a climbing rope to catch your fall. And that is role that EBS backups play in any lengthy process with many discrete steps, such as an Oracle EBS upgrade. Performing a EBS backup of the systems you're upgrading every half-dozen or dozen steps allows you to restore to the most recent backup and resume work while having only lost a relatively small amount of work. But think of the costs of taking a full backup of the systems you're upgrading. Let's assume that the Oracle EBS database is 1 TB in size, the dbTier is 4 GB, and the appsTier is another 4 GB. All told each backup takes up over a TB of backup media and takes 2 hours to perform, start to finish. So, for an upgrade process of 100 steps, and performing a backup every dozen steps, means performing 8-9 backups, at 2 hours apiece, totaling 16-18 hours alone! Not only do the backups represent a significant portion of the total number of steps to perform, but those steps also consume a significant portion of the total elapsed time of the entire upgrade process. So, in the event of a mistake or mishap, it will take about 2 hours to restore to the previous backup, and then the intervening steps have to be replayed, which might take another couple of painstaking hours. Because of this high cost of failure, believe it that each step will be double-checked and triple-checked, perhaps by a second or third person, before it is committed or the ENTER key is pressed. No wonder upgrading Oracle EBS is so exhausting and expensive!

The fastest operation is the one you never perform

What if you never had to perform all those backups, but you could still recover your entire Oracle EBS systems stack to any point-in-time as if you had? This is what it is like to use data virtualization technology from Delphix. You start by linking a set of asourcea Oracle EBS components into Delphix, and these sources are stored in compressed format within the Delphix appliance. Following that, these sources can produce virtual copies taking up very little storage in a matter of minutes. A Delphix administrator can provision virtual copies of the entire Oracle EBS systems stack into a single Delphix JetStream container for use by an individual or a team. The components of the container, which include the Oracle EBS database, the Oracle EBS dbTier, and the Oracle EBS appsTier, become the environment upon which the upgrade team is working. Delphix captures all of the changes made to the Oracle EBS database, the Oracle EBS dbTier, and the Oracle EBS appsTier, which is called a timeflow. Additionally, Delphix JetStream containers allow users to create bookmarks, or named points-in-time, within the timeflow to speed up the location of a significant point-in-time, and easily restore to it. So each developer or team can have their own private copy of the entire Oracle EBS systems stack. As the developer is stepping through each step of the upgrade, they can create a bookmark, which takes only seconds, after every couple steps. If they make a mistake or a mishap occurs, then they can rewind the entire JetStream container, consisting of the entire Oracle EBS systems stack, back to the desired bookmark in minutes, and then resume from there. Let's step through this, using the following example Oracle EBS system stack already linked and ready to use within a Delphix appliance.

An example Oracle Oracle EBS system stack in Delphix

So here we see a full E-Business Suites R12.1 system stack linked into Delphix. In the screenshot below, you can see three dSource objects in the left-hand navigation bar, under the Sources database group or folder. These three dSource objects are named:

  1. Oracle EBS R12.1 appsTier
  2. Oracle EBS R12.1 dbTechStack
  3. Oracle EBSDB

The first two items are vFiles, containing the file system sub-directories representing the E-Business Suites R12.1 applications tier and database tier, respectively. The last item is a virtual database or VDB, containing the Oracle database for the E-Business Suites R12.1 system. Each are indicated as dSources by the circular black dSource icon with the letters "dS" within (indicated below by the red arrows); Oracle EBS / Delphix

Registering Oracle EBS dSources as JetStream templates

The three dSources have been encapsulated within the Delphix JetStream user-interface within a templates, as shown by the JetStream icons showing a tiny hand holding out a tiny cylinder representing a datasource (indicated below by the red arrows) just to the right of the dSource icons;

Oracle EBS / Delphix

Within the JetStream user-interface itself, we see that all three dSources are encapsulated within one JetStream template, with the three dSources comprising the three datasources for the template;

Oracle EBS / Delphix

Encapsulating Oracle EBS VDBs as JetStream containers

Once dSources are encapsulated as a JetStream template, then we can encapsulate VDBs and vFiles created from those dSources as JetStream containers. Here, we see the database group or folder called Targets circled in the left-hand navigation bar, and the blue icons for VDBs and vFiles with the letter "V" within are indicated by red arrow, while the darker icons for JetStream Containers are indicated by the green arrow;

Oracle EBS / Delphix

Working with JetStream containers for Oracle Oracle EBS

With an entire Oracle EBS system stack under the control of Delphix JetStream, we can begin the lengthy process of upgrading Oracle EBS. Before we begin, we should create a JetStream bookmark called Upgrade Step 0 to indicate the starting point of the upgrade;

Oracle EBS / Delphix

Then, after performing the first five steps of the upgrade in the Oracle EBS system stack, come back to the JetStream user-interface and create a JetStream bookmark namedUpgrade Step 5, as shown below;

Oracle EBS / Delphix

After every couple steps of the upgrade, or prior to any lengthy step, come back to the Delphix JetStream user-interface and create a bookmark named appropriate for the step in the upgrade process, as shown below;

Oracle EBS / Delphix

Performing a rewind in a JetStream container for Oracle Oracle EBS

So we're cruising along, performing productive steps in the Oracle EBS upgrade process, and not worrying about making backups. WHOOPS! At upgrade step 59, we made a serious mistake! If we had been making backups every 12 steps or so, then the most recent backup may have been Upgrade Step 48, which was 11 steps ago. Besides the multiple hours it may take to restore the backup in the database, the dbTier, and the appsTier, we are going to have to perform 11 steps over again. In contrast, using Delphix JetStream, we have better choices. From the Delphix JetStream user-interface, we can restore to any point-in-time on the timeflow, whether it is one of the bookmarks we previously created at a known step in the upgrade process, or to any point-in-time location on the timeflow line, which may or may be located in the middle of one the upgrade steps, and thus not a viable point from which to restart. So, because we want to restart the upgrade from a known and viable step in the process, we're going to restore the entire Oracle EBS systems stack consistently back to the JetStream bookmark Upgrade Step 55;|

Oracle EBS / Delphix

So, first let's click on the JetStream bookmark named Upgrade Step 55 and then click on the icon for the Restore operation to start the rewind;

Oracle EBS / Delphix

After being prompted Are You Sure and then confirming Yes I Am, then the Restore process starts to create a brand new timeflow for all three datasources in the container;


Please notice that the old timeflow is still visible and accessible to the left in the JetStream user-interface, even with the new timeflow being restored to the right. Finally, the restore operation completes, and now all three parts of the Oracle EBS systems stack (i.e. appsTier, dbTier, and database) have been restored to Upgrade Step 55 in about 15 minutes elapsed time, a fraction of the 2 hours it would have taken to restore from backups.   Now we can resume the Oracle EBS upgrade process with barely any time lost!

Summary of benefits

So a few things to bear in mind from this example when using Delphix Jetstream;

  1. Once a JetStream container has been provisioned by the Delphix administrators (usually a role occupied by database administrators or DBAs), all the operations shown above are performed by JetStream data users, who are usually the developers performing the upgrade themselves
    • No need to coordinate backups or restores between teams == less time wasted
  2. Using Delphix removed the need to perform backups, because all changes across the timeflow of all three components of the Oracle EBS systems stack (i.e. appsTier, dbTechStack, and database) are recorded automatically within Delphix
    • No backups == less storage consumed == less time wasted
  3. Using Delphix removed the need to restore from backups, because the timeflow can be restored to any previous point-in-time in a fraction of the time it takes to perform a restore from backup
    • No restores == less time wasted

It is difficult to imagine not performing Oracle EBS upgrades using the methods weave used for decades, but the that time is here. Data virtualization, like server virtualization, is fast becoming the new norm, and it is changing everything for the better. Come check Delphix out at Collaborate! I will be there signing books and talking about EBS. Can's make it? That is okay, check out this recent webinar I did with Delphix, Avoiding The Pitfalls Of An Oracle E-Business Suite Upgrade Project

Mike Swing

Written By: Mike Swing OCP DBA, Oracle Ace and Author of 13 Oracle EBS Upgrade Books

Twitter: @mike_swing