STS-93: We don’t need any more of those

It was about a quarter past midnight on July 23, 1999 when the Ralph Roe, the Shuttle Launch Director, told Eileen’s crew that they were go for launch and wished them good luck. The launch, which had been scrubbed late in the countdown on two previous attempts, was going to be about 7 minutes late due to some transient communications system problems at the Merritt Island Launch Annex (MILA) tracking station.

 

In Houston, I was sitting on the back row of mission control acting as the Mission Operations Director. Sitting next to me was Chuck Knarr, former flight director and executive in the United Space Alliance. In the hot seat at the Flight Director position was John Shannon with LeRoy Cain sitting beside him to watch the weather and keep track of the checklists. Capcom was Scott “Scooter” Altman.

 

The old joke was: “which F-14 pilot do you want as your wingman? Cobra, Maverick, or Scooter?” The correct answer was Scooter – Cobra and Maverick were just Hollywood movie creations for ‘Top Gun’; in that movie all the real flying was done by Scooter.

 

Down in the trench was Flight Dynamics Officer (FDO) Lisa Shore with Carson Sparks sitting next to her as TRAJ officer. On the Electrical General Instrumentation and Lighting (EGIL) console was Tim North – about to get the ride of his life – and on the back row was Booster Officer Jon Reding, one of the coolest heads to sit at that position. A well seasoned crew to watch over the launch phase for Eileen Collins, the first woman to command a Space Shuttle mission, her pilot Jeff Ashby, and the rest of the unusually small crew of Columbia.

 

STS-93 carried the heaviest payload the shuttle ever launched; the Chandra X-ray observatory (formerly known as the Advanced X-ray Astronomy Facility or AXAF) and it IUS booster. The Boeing build solid rocket upper stage called the Inertial Upper Stage was extremely reliable, but a heavy load. It had an interesting history; originally called the Interim Upper Stage (same acronym), its more powerful replacement was cancelled for budgetary reasons and the IUS lived on.

 

Everything appeared quiet, but problem lurked just beneath the surface.
Post flight we calculated that the LOX load was less than planned; due to slight temperature variations, tank volume, placement of the ‘full’ level sensors and other factors, Columbia was going to launch this night with 897 lbs less LOX in her tank than was intended. Given everything else working normally, there should have been a performance reserve still in excess of 3,000 lbs. But everything else did not work as precisely as planned.

 

Columbia, the oldest shuttle, had flown 25 missions by this time and the tiles and thermal blankets showed it; scars and stains over almost all of them. And hidden, deep down inside, were the flaws and insults that any real world flying machine always carries: some minor, some major, some that never had a consequence, and some that ultimately contributed to her loss.

 

One flaw lived in a stretch of 22 gauge kapton insulated wiring, nearly half way down the payload bay, where a single strand of AC current carrying wire had rubbed and chaffed against a screw head which had a minor burr where the tech had over tightened it long ago, and which other techs had probably stepped on during turnaround refurbishment. In the Right SRB, a hydraulic pressure sensor was not completely connected to its wiring and even though it was showing accurate pressure now, the connection could shake loose under vibration just enough to open the circuit and give a false low pressure reading. In the center main engine the two chamber pressure measurements A&B were reading exactly the same with the engines off, but the B channel had a bias that would only show up when the engine reached full throttle; it would read 12 psi high. This was outside the allowable error but still small compared to the 6,000 psi operating pressure. On the right engine, a deactivated LOX post in the main injector had a gold coated pin that wasn’t quite as tightly seated as it should have been, whether it was installed slightly off or worked loose over a number of firings, in the end it didn’t matter. Columbia had a lot of really minor flaws that didn’t affect today’s story, but some of which would show up later with other consequences. Viewgraph PowerPoint spaceships are always flawless; real spaceships are made and maintained by fallible human beings and are less perfect.

 

Somebody posted the NASA TV video of the launch on YouTube – you can watch it at:

So the countdown started up at T-9 minutes as it always did, seemingly uneventful on the surface, but we all knew what was about to happen and the adrenalin built up as we waited. Ashby started the APUs right on time, pumping high pressure hydraulic fluid to all the valves in the main engines among other things. At T-31 seconds the onboard computers took over, calculating the exact launch parameters, allowing the IMU gimbals to turn freely, opening vent doors so that pressures could equalize during the climb to space. At T-10 seconds the ground computers sent the last command onboard – the electronic equivalent of ‘go for main engine start’. The onboard computers reacted immediately by firing off the ‘sparklers’ called ROFIs (never can remember what that stands for) to burn off the excess hydrogen down by the main engines. At T-6.6 seconds the onboard computer commanded the first main engine to start, and staggered the second start by 140 milliseconds, and then the third by the same delay. The SSME controllers commanded the spark igniters on, and started the complex choreography of valve openings to bring the three main engines safely to roaring life.

 

By about T-3 seconds, all engines were up and operating at 100% of rated power level. Exactly when it happened is not clear, but on the right engine, the gold plated pin from LOX post 32 in row 13 came shooting out. Just like a bullet it went through the narrow part of the converging nozzle and flew out into the nozzle extension.
Now two scary things could have happened. First, the LOX post, which was pinned for a reason, could have failed allowing LOX to pour into the engine cavity where the hot hydrogen was introduced. Remember from an earlier post that this could have caused an explosion, or melting of other LOX posts, or other really bad things to happen. Failure of the LOX post was considered a CRIT 1 failure – loss of vehicle and crew ‘promptly’. Fortunately – luckily – the LOX post held together for the next eight and one half minutes. How close we were to disaster has never been determined.

 

Second, the nozzle extension could have failed. Early on in ground testing, one of them did fail – spectacularly – generating a huge explosion and fire. Those nozzle extensions were one of the weak points of the entire complex engine system. Made of 1080 long narrow stainless steel tubes braze welded together, the nozzle extension was cooled by liquid hydrogen flowing down its length. So cold on the outside that a layer of frost condensed out of the moist Florida air in seconds over the outside of the nozzle extension, the temperature inside was hot enough to melt any metal. These tubes were a bear to maintain and the entire extension had to be replaced periodically. The tubes were prone to split which required complex weld repairs until there were just too many repairs and a new nozzle extension had to be installed. The next upgrade to the SSMEs was to build a more robust channel wall nozzle extension. The shuttle program ended before that was done. Someone had calculated that if 5 adjacent cooling tubes split or were otherwise ruptured, there would not be enough local area cooling and a burn through would occur, causing a cascading failure of the nozzle and . . . a CRIT 1 failure.

 

The bullet shaped LOX post pin hit the side of the right engine nozzle extension about two thirds of the way to the end with great force. Just by sheer luck, three nozzle tubes were breached. Three adjacent nozzle tubes lost cooling and started leaking hydrogen into the hot stream of gas coming out of the engine. Three tubes, not five. The adjacent cooling tubes kept the nozzle from failing during the eight and a half minutes the engines operated.

 

At the time, the LOX post pin and nozzle tube leak went undetected. Look closely in the video and see a blue streak on the side of the nozzle. Nobody in Mission Control noticed it until afterwards during the photo review. The nozzle was leaking 3.5 lbs of hydrogen every second.

STS-93.MissionStatusBriefing.Slide (2)

Several things happened as a result. One might think that this would lead to running out of hydrogen, which, as an earlier post noted, would have been very bad. But the engine reacts in to the loss of hydrogen in this area in a very interesting manner. This leak was downstream of the hydrogen flow meter so to all observers – human and digital – it appeared that the right amount of hydrogen was going into the engine. The real loss of hydrogen flow to the turbines driving the pumps on the right engine was lower mixture ratio – the mixture ratio now closer to stoichiometric – and the turbine temperatures increased by about 100 degrees. Normally there is about a 200 degree margin between the normal turbine temperatures and the redline value that will automatically shut an engine down. The nozzle leak immediately used up half the operating margin to the redline.

 

Since the chamber pressure dropped slightly due to the loss of fuel for the fire in the main combustion chamber, the SSME controller commanded more oxygen be sent to the MCC. That may sound strange but it is the way the SSME computer controls the chamber pressure. Again, the mixture ratio is off and not only is the fire hotter in the MCC, but more oxygen is being consumed. Due to both of these processes, post flight calculations showed that the LOX tank should have been short about 3,000 lbs – translating to about 200 fps short at MECO. That large velocity shortfall did not happen because we were lucky: what happened to the Center SSME corrected that. Hold that thought.

 

Meanwhile, about a minute after launch, the booster officer and his team recognized the fact that the right engine turbine temperatures and speeds were higher than normal. They correctly identified that this might be due to a nozzle leak, but there was another potential anomaly that also had the same signature. If the oxidizer pump started to lose ‘efficiency’ (blades rubbing, pump clogging, etc.) it would look the same. As the SSME controller commanded mixture ratio changes to keep up with the loss of efficiency on the pump, the turbines would reach their temp limit and the engine would have to throttle down to prevent a shutdown: this was called ‘thrust limiting’. Until the SSME went into thrust limiting, the Booster team could not tell the difference between an oxidizer turbine/pump efficiency loss and a nozzle leak. The instrumentation just wasn’t precise enough to know what was going on. Jon and his team correctly identified that the engine was running off nominally (‘off tags’) but could not quantify it. Later on, when the FDO asked him, the Booster officer had to report that none of the engines were ‘suspect’. All these terms were precisely defined in the flight rules and had specific actions for the flight controllers and crew to take to maximize safety. But this leak was too small for any of that.

 

The reason the booster officer took over a full minute to identify problems on the right engine was because of distractions: the AC 1 short – which was real, and had real consequences – and a big red light that went off on his console saying the Right SRB hydraulic system pressure had dropped to catastrophic levels – which was not real. Each of the solid rocket boosters put out over twice the thrust as the three SSMEs put together. The steering mechanism was critical and each SRB had two separate hydraulic systems for redundancy. If both hydraulic systems on one SRB failed there would be no steering on that side; probable loss of control, and another one of those ‘prompt’ CRIT 1 failures – loss of vehicle and crew. So having that red light go off right in front of his nose took a few seconds to sort out. It clearly was a transducer failure, not a real hydraulic system failure since all the other parameters were OK. But it surely got the heart rate higher. Good thing it wasn’t displayed to the crew; they never knew about it.

 

Failed SRB TVC could, in the worst case, result in the shuttle flying directly back to the Launch Control Center. Given worst case reaction time by the Range Safety officer (7 seconds), large chunks of SRB – probably with the propellant still ignited – could land on the LCC. I used to think about that when I sat in the front row of the LCC, up near the glass. Those big louvers in front of the windows? They were for shade; not only no protection from flying debris but likely to become lethal missiles themselves.

 

As Columbia lifted off the KSC public affairs officer, Lisa Malone made her little speech about how this flight advanced X-ray astronomy and women’s authority in the world. In the MCC, we didn’t listen to the PAO commentary so we were shocked to hear Eileen report “Fuel Cell PH”.

 

I’ve written about fuel cell PH failure mode before: https://blogs.nasa.gov/waynehalesblog/2009/01/07/post_1231342021582/

 

To make a long story short, it means that one of the fuel cells might be failing “It’s the Kaboom Case, Flight”.  On board Columbia, the Master Alarm klaxon had gone off and there were two messages on the failure summary page: H2O pump, FC 1 PH. As it turns out, these were symptoms, not the cause of the problem. The Fuel Cell was not breaking down, ready to explode, and the water pump (used for cooling) was not shut down. Instead it was one of the alternating current buses- AC 1 Phase A – which had shorted. About 5 seconds after liftoff, for about half a second, it sputtered along with a short of up to 72 amps. That is a lot of current!

93 short

The automatic protection cut in and shut down the affected part of the circuit. The Fuel Cell instrumentation that monitored for the escape of potassium hydroxide ( a strong base, high PH) used this bus, and this unpowered instrumentation gave an erroneous alarm. The water pump slowed and then resumed after the circuit breaker popped and normal power was returned on all the other AC1 equipment. An avionics bay fan (providing air cooling) had slowed but not enough to trip an alarm. What remained was loss of power to the SSME controllers.

 

The A computer on the Center SSME lost power, never to be recovered. The B computer (DCU B) immediately took control and the engine ran on normally. Well, almost – back to that in a moment. The Right Engine lost its B computer, but the A computer stayed in control and the engine, with its hydrogen leak, hung in there.

 

Loss of DCU A on the center engine caused a couple of interesting consequences. First of all, the MCC lost almost all the telemetry on the center engine; valve positions, turbine speed, some temperatures, almost everything was gone with the lost of DCU A. The folks that programmed the SSME computers put everything on the A side and very little – just Main Combustion Chamber pressure and hexadecimal word indicating any problems in the engine – on the B side. We were on ‘backup data’. The B computer also lost all the sensors that were being read by the A computer. Most importantly, the A chamber pressure transducer went away. The B computer no longer averaged the A and B transducers to get its chamber pressure for the basis of engine control but only had the B transducer – and it was reading 12 psi high! This may not seem like a lot, but it caused the center DCU B computer to command a throttle down on the center engine. All of a sudden, less LOX (and hydrogen) was being consumed. Almost invisibly, the Center engine was making up for the large shortfall of LOX that had been created by the nozzle leak on the right engine.

 

How lucky we were. Instead of being 200 or more fps short at MECO, possibly leading to an abort landing or requiring two tons of OMS propellant to make up, we wound up being only 15 fps short, well within the capability of the OMS budget.

 

Less than a minute off the pad and multiple failures. What were you thinking Sim Sup? Surely that is not a realistic case. Except it was real.

 

During a shuttle ascent, the crew normally has very little to do other than monitor the automated systems. As the velocity builds up, the MCC – the FDO – keeps the crew informed of what ‘abort mode’ they might have to use if one or more main engines were to turn off prematurely. As long as nothing happens, the crew happily gets to sit quietly until they are in orbit.

 

For STS-93, the big action for the crew was to take the AC bus sensors to off. Since the inverters – the devices that change the direct current electricity into alternating current – had a failure mode that could possibly make them over volt and fry their associated equipment, the automated circuit protection was enabled to swiftly react to any voltage issues. For the record, that never occurred in 135 shuttle flights. After losing two SSME computers, another AC bus dropping offline would cause one of the two affected main engines to shut down, probably requiring an abort. There was a slight chance the automated voltage control equipment could erroneously trip off an AC bus. Given the situation, the flight rules directed the crew to disable the automated shutdown. So Scooter told Ashby to take the AC Bus Sensors to off. That was the only action that the crew had to take the entire ascent.

 

They were blissfully unaware of the erroneous R SRB HYD pressure transducer. They did not get the word that the FDO was seeing the affects of . . . .something . . . .which turned out to be the combined effects of the right and center engine anomalies: a ‘6 fps thrust update in the ARD’ – not huge, not entirely atypical, but something going on. Not enough to change any calls: ‘no suspect engines’ ‘no under speed predicted’ ‘nominal shutdown plan’ were phrases – all carefully scripted by flight rules – that were passed between the flight controllers.

 

And of course, the flight controllers were unaware of all of what transpired inside Columbia.  That may be a good thing.

 

As it turns out, there was a LOX shortfall of 405 lbs. The LOX low level sensors detected depletion of the LOX, commanded main engine shutdown approximately 0.15 seconds earlier than guidance would have wanted, and the final shuttle velocity was about 15 feet per second short of what was desired; out of more than 25,500 feet per second. There was enough margin in the Orbital Maneuvering System load to make up about 300 lbs, and the flight proceeded normally.

 

Except Mr. Shannon, when informed of the situation shortly after main engine cut off said loud and clear on the Flight loop: “Yikes. We don’t need another one of those.”

 

If you look at the video of NASA TV just after those words, you can see me on the telephone, talking to the program manager down in Florida, about what this all meant.

 

It was just a couple of minutes later that one of the projectors hanging from the ceiling in Mission Control – the projectors that put up the displays on the front screens – overheated and started smoking. Quick action by the Ground Control officer to shut it off probably prevented a fire in the MCC, which would have lead to an evacuation.

 

That’s really over the top, isn’t it Sim Sup?

 

How much more exciting can you get. Give me a nominal, boring launch any day.

From friends at NASASpaceFlight.com watch the annotated video:

https://www.youtube.com/watch?v=O9WjCyWq-iA

 

Now for the lesson: Be prepared. Spacecraft are complex and can fail in complex ways. Never, ever let your guard down. Practice for disaster all the time.

 

And remember:  Murphy does not play by the rules.

About waynehale

Wayne Hale is retired from NASA after 32 years. In his career he was the Space Shuttle Program Manager or Deputy for 5 years, a Space Shuttle Flight Director for 40 missions, and has retired from consulting and is currently a full time grandpa. He might be available for speaking engagements for the right incentives (coffee and donuts work!)
This entry was posted in Uncategorized and tagged , . Bookmark the permalink.

53 Responses to STS-93: We don’t need any more of those

  1. John says:

    Audio is also on youtube: https://www.youtube.com/watch?v=f2c_hEY19n4 It ends just after the “Yikes” comment.

  2. B. Ivy Stiles says:

    Wayne, I was captivated by the narrative, and just a little exhausted by the end. Thank you for pulling back the veil on this launch. At some point, you should turn these ruminations in to a book. All the expertise you bring to these posts should be mandatory reading for Senate and House committees on space, Perhaps a dose of reality will silence the skeptics who viewed the Shuttle as the be all and end all in American spaceflight. We must do better, our nation deserves better, and our astronauts deserve nothing less than our very best. And as to Murphy not obeying rules, sounds like O’Toole’s Law should govern space flight (and sims): simply stated, “Murphy was an optimist.”

    • waynehale says:

      I think you missed the point. Not that the shuttle was the ‘be all and end all’ but that all real space flight vehicles have ‘issues’. Could we do better, yes, I wish we had built a second generation shuttle. Don’t think that any of the new vehicles will be flawless.

      • B. Ivy Stiles says:

        Actually that was the point I was attempting to make. The shuttle was not perfect; though the public viewed it as a guarantee with each flight, you and the rest at NASA kept trying to remind us that no spacecraft is perfect, the unexpected is always looking over your shoulder, and each successful launch is no guarantee for flawless performance the next time. Yesterday that was proven again, and the entire time I kept thinking about this post. Could something as ‘simple’ as happened on STS 93 have occurred for the Antares launch. Do they have the avionics data available to determine the cause, or will it become a long detective story. Shuttle was an amazing system, and I’m proud of its successes, but is was also an experimental craft. Through tireless work, it launched and returned 133 times. But that tireless effort, that care to examine in detail everything, even with this amount of expertise, bad things happened.

  3. Beth says:

    Whew! Even decades after the event, it reads like the roller coaster ride from Hell. It really can all break loose.

  4. “…firing off the ‘sparklers’ called ROFIs (never can remember what that stands for)…”

    ROFI = Radially Outward Firing Initiators

    In case anyone was wondering. 😉 (I was).

    • Paul Schermerhorn says:

      The ROFI’s are responsible for that high pitch turbine like sound that occurred just before they started sparking.

      • waynehale says:

        Are you sure? The APUs are running and very shortly thereafter the main engine turbopumps spin up. I guess I didn’t know the ROFIs made a high pitched turbine sounding noise. Maybe so.

      • GLS says:

        a) “ROFI” is Delta IV nomenclature. In the shuttle they were called “long throw igniters”. There were also “short throw igniters” that were also tested in the MPTA firings in preparation for MLP installation, but they *lost out* to the long throw ones.

        b) that hissing sound is the air being pushed out of the sound suppression system pipes, as the water.

        c) thank you Wayne for this awesome blog

      • Brian Lewis says:

        If I hear what you’re referring to (at about T-14sec), I always assumed it was related to the sound suppression water system, since it seemed to coincide with the water showing up in the trench. Perhaps big water pumps coming up to speed?

        For old times’ sake I let Wayne’s YouTube link play from the beginning and listened to prelaunch activities while I was working. Recording CNN launch coverage on our VCR and listening to NASA select rebroadcast by WA3NAN on 14.295MHz was such a fun obsession in my late 80s/early 90s childhood. I was in college for this one, but I remember watching STS-93’s re-entry plasma trail over Baton Rouge. I hope there is something as awe-inspiring for my children as these feats were for me.

      • M. Mraz says:

        I think you’re hearing the water beginning to flow into the flame bucket from multiple nozzles, that was approximately 15 seconds before T-0 I think. The ROFIs sounded exactly the way they looked, like really big 4th-of-July sparklers. The APUs operate in a pulsed mode, their sound is unmistakable and does have a little accelerating/decelerating turbine whine.

      • Mika Takala says:

        I always thought that the high-pitched whine around T-15 was the SRB APU’s spinning up. SRB:s had APU’s of their own, and they had limited consumables, so they were started just in time to be ready&checked for launch.

      • Paul Schermerhorn says:

        No Wayne, I wasnt sure, so a while ago I asked a current NASA Eng.(around for STS) and told me ROFI(incorrectly I believe) was teh cause of the T-15-14 s “turbine’ish” sound
        So we have:
        A) the ROFI’s(not ignited until T-10s)
        B) SRB HPU’s have their APU’s spinup at T-1:28-100% speed equals 72,000rpm IIRC
        C) SSME spinup(thought that would happen after ROFI ignition at T-10s)
        D) the H2O pushing air out of the SSWS-SSME duct deluge-(is activated at T-15s)
        E) Orbiter APU’s (very distinct “chuff” but also distinct “mechanical” sound

        I have heard all these answers before. Whatever the sound is, it certainly doesnt start all at once, which could concievably be explained by multiple “turbines” or air being evacuated at slightly differing locations in the SSME duct deluge at slightly differing times.

      • Grant Miller says:

        On page 303 of astronaut Mike Mullane’s excellent book, “Riding Rockets”, he attributes the high pitched sound (“animal-like shriek”) heard at the LCC just ahead of the SRBs as coming from the Main Engines. But he does got give any detail regarding what part of the SSMEs. I always just assumed it was the fuel pumps or probably the nozzle exhaust itself. I got to watch the night launch of STS-130 from the Press Site, also 3 miles from the pad, and do not even remember hearing any high pitched shriek. I was probably overwhelmed by the visual spectacle before me while to trying to also take photos and anticipating the pressure wave of sound that 7 million pounds of thrust creates. Awesome experience! Somewhat addictive I think, similar to the way that total solar eclipse watchers seem to get “addicted” to that natural spectacle. Can’t wait for August 21, 2017. If you haven’t already watched it, I highly recommend “Ascent:Commemorating Shuttle” by Matt Melis and Kevin Burke. Spectacular footage of STS launches in high def, super slo-mo with explanations of what you’re see and why. Just look for the title on Youtube.

      • Paul Schermerhorn says:

        The “screech” you reference can be heard on some of the FRF(Flight Readiness Firings) on you tube. Namely heard at engine start and engine shutdown.
        STS-26 Flight Readiness Firing (8-10-88) of Discovery at 0:30 of the video https://www.youtube.com/watch?v=opeEtE_OZNk

        STS-121 Launch and Landing, Discovery

        At 0;48 the sound is short then again at 0:49 the distinct “turbine spinup sound” is much longer.

        STS-122 Launch and Landing, Atlantis

        Excellent APU chuff/”accelerating/decelerating turbine whine” from teh very start of video. 2 distinct high pitch “turbine spinup” shounds at 0:20 with a 2nd occuring again at 0:21’ish.

        STS-107, Columbia

        Great APU “chuffing” right from the beginning of the video. The “turbine spinup” type sound occurs distinctly at 0:22 and again at 0:23 seconds with the “report” of the ROFI being heard at 0:26 second in the video.
        It seems that audio pickup of the pad sounds improved as the SSP progressed.
        The Ascent video you reference certainly is a treat.
        It also appears that SLS-1(EM-1) has slipped to the right to NET Dec 31, 2017. It sure will be nice to hear those RS-25’s fire again.

      • Grant Miller says:

        Thanks for the links. Regarding Dec. 31, 2017, that’s the big advantage eclipses have over launches. We KNOW when the eclipses will take place. Launches…not so much.

      • thomas moody says:

        Thanks Paul for the detailed research into this otherwise subtending topic. I’m writing an article that’s nostalgic in nature but still detailed concerning Shuttle launches and appreciate your work here. The only question I’ve got is, have you or anyone come to a final conclusion as to where this “whine” sound actually came from? Your videos below clearly show that it starts just prior to Sound Suppression Water System initiation, a system with no pumps, but still way too early, imo, for it to be from the SSME’s or the SRB APU’s. If you have any further insight, I’d love to hear it and thanks again for the passionate argument!

  5. Markus says:

    Radial Outward Firing Initiators.

  6. dngerboy35 says:

    Wayne,

    Thanks for the amazing insight into this particularly famous launch – it’s quite amazing to see just how volatile the Shuttle was.

    The general public never really knew how un-routine this “routine” access to space vehicle was – had we known it was as volatile and treacherous as it was, perhaps there would have been much more interest in the program than there was, sadly.

    Question for you though – had there been a need to abort, would it have been a ATO situation or would we have been looking at a RTLS?

    One final question – was an RTLS abort ever a ‘real’ option? Or was it one of those “keep busy while you’re dying” situations?

    Thanks for these posts Wayne – it’s a pleasure and honor to be able to read them!

    • waynehale says:

      RTLS was a certified intact abort mode. Although there were risks, I am confident that it would have worked – at least in the mature phase of shuttle operations after some of the bugs were worked out.

      Depending on what failure you want to postulate coming, and when it might occur, almost any of the abort modes could have been invoked.

    • Markus says:

      As Wayne reminds of the factor of program maturity, very early on there was the suggestion that the first or one of the first Shuttle flights should be a forced RTLS test flight. John Young reportedly rejected the idea to the effect of “You don’t have to practice bleeding.” Considering he’s the one in the left seat, I can see where he’s coming from.

      • waynehale says:

        Capt. Young’s most memorable quotation about the proposed STS-1 “sub orbital test flight (SOFT)” was that for “RTLS to be successful would require repeated miracles interspersed by acts of God”. Of course we didn’t understand all about RTLS in the early days and in fact the unexpected vehicle trajectory lofting on STS-1 meant that a successful RTLS would be unlikely.

        Many improvements were made over the years, of course.

      • I worked on the Backup Flight System through about STS-2, and I remember that OPS-6 scared the bejeezus out of everybody. ATO and AOA seemed plausible (IIRC, TAL wasn’t an option on the test flights), but doing hammerheads with an orbiter and external tank seemed like a really bad idea.

  7. Yusef A. Johnson says:

    The looks on Henry Cordova and the DOLILU team by the coffee station was priceless! They were all standing around wondering if it was something they did.

    • waynehale says:

      The Day of Launch I-load Uplink team certainly tried to predict the ascent performance, based on all systems operating normally. If they ever missed the mark by that much we probably would have fired them all. But this one wasn’t their fault

  8. Ted Christian says:

    Are you saying that throttling down the center engine prevented a 200 fps underspeed at MECO that would otherwise have been caused by loss of hydrogen and a richer mixture on the right engine? Seems like throttling down the center engine would have just extended the SSME burn time and slightly increased the underspeed. I should read through all your details again and see if I can figure out what I’m not seeing but I’m just going to ask.
    Ted

    • waynehale says:

      The entire post is too long and I admit to quickly summarizing the affects of the C SSME on total performance. Enough for one day, don’t you think?

      • Nope. This is your best post. Turn it into a book if need be. I have the exact same question.

        I can see two effects of throttling down the center engine:
        1) It postpones some of the burn to later, so that gravity losses should be a little bit higher, thus more underspeed.
        2) It causes the center engine to burn a little less of the fuel load, and the right engine to burn a little more.

        My guess is that the right engine, burning closer to stochiometric and thus hotter, actually had a slightly higher exhaust velocity. Way less margin though, as you point out. So this second effect, I’m guessing, would have reduced underspeed.

        Is my guess right?

      • waynehale says:

        I’m waiting for all my old colleagues to weigh in and explain it in more detail than I remember

  9. Ed Minchau says:

    Whaddya mean, Murphy doesn’t play by the rules? Murphy IS the rule! In fact I wouldn’t be surprised if the Grand Unified Theory of Physics turns out to be a restatement of Murphy’s law.

  10. Dave Dooling says:

    After press conference during the post-Challenger investigation, Sue Butler (ex-Missiles & Rockets magazine in the 1960s; USBI PAO in the ’70s and early ’80s, then back with papers), said to J.R. Thompson (ex-SSME project manager), “Aren’t you glad it wasn’t one of your main engines that caused the accident?” He replied, “Don’t fool yourself, Susie. They’ll bite you in the ass the first chance they get.”

  11. Kirk says:

    Is that a typo in the paragraph toward the end starting, “As it turns out …:? Shouldn’t “300 lbs” be “300 fps”? (Great story, BTW.)

  12. Grant Miller says:

    I guess after MECO descriptive words like “Yikes!” were acceptable terminology. lol Very interesting story about a very complex launch system, aka a controlled explosion. Thanks.

  13. Charlie Ross says:

    Fascinating post, thank you. What surprised me, after watching both videos, is the PAO’s multiple statements that no issues were being tracked. That was clearly incorrect. In addition to the loss of the two engine controllers (audible to everyone when the CapCom relayed it to the crew), the “loop” recording clearly reveals that there were concerns being monitored, even the possibility of a leak. Did the PAO monitor the flight loop? And if so, did they have the training to understand what was being said? The statements seem to go beyond simply “accentuating the positive”…

  14. Sarah says:

    Man. Watching that video made my heart race, and it’s been 3+ years since I sat on console.

  15. roman853 says:

    Fascinating piece

  16. virial says:

    Thank you Wayne. It is the kind of writing I appreciate, in depth, to the point and technical, while at the same time human. Twenty years ago I was in highschool, I remember that we got our first slow internet connection in our school in ’96, for Macedonian standards, that was a success at the time.
    Before, I managed to get some planetary images from NASA, even one Boeing old issue of advanced propulsion concepts and a Shuttle orbiter cutout. I remember I envied all who worked at the STS operations and got to see all that up close. If someone told me back then that in 20 years I would be able to read personal stories of the flight director online, and even converse with him, I would told that person to keep on dreaming.
    Now I am an astronomer, and having used Chandra data a few times, I am glad that STS-93 climbed up sucesfully. Your work, all of you at NASA, has been an inspiration.

  17. spacebrat1 says:

    just read thru the comments and saw your first comment response, written here a bit ago now: ‘Don’t think that any of the new vehicles will be flawless.’… physics is unforgiving.

    Excellent story, thank you.

  18. JP Burke says:

    Apologies if this is obvious, but why wasn’t the short detected before liftoff? Was the wire insulation not worn through until the flight had begun?

    Thanks for sharing such a fascinating story!

  19. teachersyn says:

    I’m merely a space enthusiast, alive during Apollo 11 but not actively watching flights before Apollo 15. Combined with joining NASASpaceflight.com (a private site for those not aware) and learning of you, it’s been wonderful to get this “inside baseball” view of your part of the space program. Someone on NSF posted the flight director loops of Apollo 13 a bit ago; it’s enjoyable to hear the background of decision making and how REALLY hard rockets are–yet your teams and those of old are incredible. Thanks for sharing. Write a book and I’m buying it!

  20. thomas moody says:

    Hello Wayne, just wanted to thank you for a tremendously detailed account of this launch. I’m writing a nostalgic magazine piece on the Shuttle and wanted to use much of what you detail here. All credit goes to you, obviously…I’m fictionalizing an STS mission that actually does get to on-orbit but faces many obstacles similar to what you document here and hoped you’d be OK with me mining some of your technical expertise. Since this was a public forum, I thought that I could just take it and run but out of respect and admiration for you, I wanted to contact you and ask permission. Thanks.

  21. Steve Terry says:

    Hi Wayne, I found your commentary from an STS-93 search on this nineteenth anniversary of the launch. I was one of the AXAF Flight Directors at Cambridge on console for each launch attempt. I heard Eileen’s call among the cheering in the Chandra OCC for the launch, but I never knew the details since we thankfully were busy getting Chandra/IUS prepped for deploy. Thanks for interesting commentary and I’m very glad Columbia made it to orbit without anything other problems. Chandra’s had a great mission every since and keeps on ticking – it’s going to try for 25 years! I’ve retired from MSFC but still work part-time monitoring Chandra ops.

Leave a comment