Enlarge / Numerous pieces of ice fell off the second stage of the Falcon 9 rocket during its climb into orbit from Vandenberg Space Force Base, California.SpaceX

A SpaceX Falcon 9 rocket suffered an upper stage engine failure and deployed a batch of Starlink internet satellites into a perilously low orbit after launch from California Thursday night, the first blemish on the workhorse launcher’s record in more than 300 missions since 2016.
Elon Musk, SpaceX’s founder and CEO, posted on X that the rocket’s upper stage engine failed when it attempted to reignite nearly an hour after the Falcon 9 lifted off from Vandenberg Space Force Base, California, at 7:35 pm PDT (02:35 UTC).
Frosty evidence
After departing Vandenberg to begin SpaceX’s Starlink 9-3 mission, the rocket’s reusable first stage booster propelled the Starlink satellites into the upper atmosphere, then returned to Earth for an on-target landing on a recovery ship parked in the Pacific Ocean. A single Merlin Vacuum engine on the rocket’s second stage fired for about six minutes to reach a preliminary orbit.
A few minutes after liftoff of SpaceX’s Starlink 9-3 mission, veteran observers of SpaceX launches noticed an unusual build-up of ice around the top of the Merlin Vacuum engine, which consumes a propellant mixture of super-chilled kerosene and cryogenic liquid oxygen. The liquid oxygen is stored at a temperature of several hundred degrees below zero.
Numerous chunks of ice fell away from the rocket as the upper stage engine powered into orbit, but the Merlin Vacuum, or M-Vac, engine appeared to complete its first burn as planned. A leak in the oxidizer system or a problem with insulation could lead to ice accumulation, although the exact cause, and its possible link to the engine malfunction later in flight, will be the focus of SpaceX’s investigation into the failure.
A second burn with the upper stage engine was supposed to raise the perigee, or low point, of the rocket’s orbit well above the atmosphere before releasing 20 Starlink satellites to continue climbing to their operational altitude with their own propulsion.
“Upper stage restart to raise perigee resulted in an engine RUD for reasons currently unknown,” Musk wrote in an update two hours after the launch. RUD, or a Rapid Unscheduled Disassembly, is a term of art in rocketry that usually signifies a catastrophic or explosive failure.
“Team is reviewing data tonight to understand root cause,” Musk continued. “Starlink satellites were deployed, but the perigee may be too low for them to raise orbit. Will know more in a few hours.”
Telemetry from the Falcon 9 rocket indicated it released the Starlink satellites into an orbit with a perigee just 86 miles (138 kilometers) above Earth, roughly 100 miles (150 kilometers) lower than expected, according to Jonathan McDowell, an astrophysicist and trusted tracker of spaceflight activity. Detailed orbital data from the US Space Force were not immediately available.

Ripple effects
While ground controllers scramble to salvage the 20 Starlink satellites from, SpaceX engineers began probing what went wrong with the second stage’s M-Vac engine. For SpaceX and its customers, the investigation into the rocket malfunction is likely the more pressing matter.
SpaceX could absorb the loss of 20 Starlink satellites relatively easily. The company’s satellite assembly line can produce 20 Starlink spacecraft in a few days. But the Falcon 9 rocket’s dependability and high flight rate have made it a workhorse for NASA, the US military, and the wider space industry. An investigation will probably delay several upcoming SpaceX flights.

The first in-flight failure for SpaceX’s Falcon rocket family since June 2015, a streak of 344 consecutive successful launches until tonight.
A lot of unusual ice was observed on the Falcon 9’s upper stage during its first burn tonight, some of it falling into the engine plume. https://t.co/1vc3P9EZjj pic.twitter.com/fHO73MYLms
— Stephen Clark (@StephenClark1) July 12, 2024
Depending on the cause of the problem and what SpaceX must do to fix it, it’s possible the company can recover from the upper stage failure and resume launching Starlink satellites soon. Most of SpaceX’s launches aren’t for external customers, but deploy satellites for the company’s own Starlink network. This gives SpaceX a unique flexibility to quickly return to flight with the Falcon 9 without needing to satisfy customer concerns.
Ars has asked the Federal Aviation Administration, which licenses all commercial space launches in the United States, if it will require SpaceX to complete a mishap investigation before resuming Falcon 9 flights.
Two crew missions are supposed to launch on SpaceX’s human-rated Falcon 9 rocket in the next six weeks, but those launch dates are now in doubt.
The all-private Polaris Dawn mission, commanded by billionaire Jared Isaacman, is scheduled to launch on a Falcon 9 rocket July 31 from NASA’s Kennedy Space Center in Florida. Isaacman and three commercial astronaut crewmates will spend five days in orbit on a mission that will include the first commercial spacewalk outside their Crew Dragon capsule, using new pressure suits designed and built by SpaceX.
NASA’s next crew mission with SpaceX is slated to launch from Florida aboard a Falcon 9 rocket around August 19. This team of four astronauts will replace a crew of four who have been on the International Space Station since March.
Some customers, especially NASA’s commercial crew program, will likely want to see the results of an in-depth inquiry, and require SpaceX string together a series of successful Falcon 9 flights with Starlink satellites before clearing their own missions for launch. SpaceX has already launched 70 flights with its Falcon family of rockets since January 1, an average cadence of one launch every 2.7 days, more than the combined number of orbital launches by all other nations this year.
With this rapid-fire launch cadence, SpaceX could quickly demonstrate the fitness of any fixes engineers recommend to resolve the problem that caused Thursday night’s failure. But investigations into rocket failures often take weeks or months. It was too soon early Friday to know the true impact of the upper stage malfunction on SpaceX’s launch schedule.
Enlarge / File of a Falcon 9 rocket launch from Vandenberg Space Force Base.
SpaceX reported its ground team established contact with five of the 20 Starlink satellites soon after they separated from the Falcon 9’s failed upper stage. Officials hope to quickly activate their ion thrusters to overcome the effects of atmospheric drag. At their current altitude, without orbit-raising, the satellites will be naturally dragged back into the atmosphere to burn up in a matter of hours or days.

“The satellite thrusters need to raise orbit faster than atmospheric drag pulls them down or they burn up,” Musk said, adding that the efforts to save the satellites “will probably not work, but it’s worth a shot.”
By the numbers
Going into Thursday’s mission, the current version of SpaceX’s Falcon 9 rocket, known as the Falcon 9 Block 5, was indisputably the most reliable launch vehicle in history. Since debuting in May 2018, the Falcon 9 Block 5, which NASA has certified for astronaut flights, never had a mission failure in all of its 297 launches before the ill-fated Starlink 9-3 mission.
Assuming the Starlink satellites can’t be saved, and if Thursday night’s launch is scored a complete mission failure, the Falcon 9 Block 5 still has a 99.7 percent success rate. This is still an enviable number for any launch company.
Since 2010, SpaceX has launched 354 flights of the Falcon 9 rocket, including retired versions of the vehicle. The more powerful Falcon Heavy, which uses three Falcon 9 rocket boosters connected together, has flown 10 times.
There were several failures in the early years of the Falcon 9 rocket. A first stage engine failure on the fourth Falcon 9 launch in 2012 prevented the rocket from deploying a secondary payload into the correct orbit, but SpaceX was still able to complete the primary mission of delivering cargo to the International Space Station.
The Falcon 9’s only total in-flight launch failure occurred on its 19th flight on June 28, 2015, when the upper stage’s liquid oxygen tank burst a couple of minutes after launch from Cape Canaveral Space Force Station, Florida. The rocket disintegrated in the upper atmosphere, dooming a Dragon cargo capsule en route to the space station.
SpaceX resumed Falcon 9 launches six months later in December 2015. On that flight, SpaceX landed the Falcon 9’s first stage booster back at Cape Canaveral for the first time, a historic achievement and a harbinger of the company’s later success in refusing rockets.
Enlarge / Two reusable side boosters from a Falcon Heavy rocket land at Cape Canaveral Space Force Station on June 25.
Nine SpaceX missions flawlessly launched before a Falcon 9 rocket exploded on the launch pad during a prelaunch test on September 3, 2016. This wasn’t an in-flight failure, but the fireball destroyed the Israeli Amos-6 communications satellite mounted on top of the Falcon 9. Engineers traced the cause to a helium tank failure in the upper stage.
Since then, it’s been smooth sailing for SpaceX’s Falcon family of rockets, which counted 335 consecutive successful launches since the on-pad explosion in 2016, or 344 flights since an in-flight failure. Both numbers are all-time industry records.
The first Falcon Heavy rocket launched in 2018, and SpaceX launched its first astronaut mission under contract with NASA in May 2020. SpaceX ramped up the flight rate from 18 launches in 2017 to 96 Falcon rocket flights in 2023. SpaceX aims to launch Falcon rockets 144 times this year, but even a brief halt in launches could jeopardize that goal.
Through it all, SpaceX mastered the recovery and reuse of Falcon 9 boosters and payload fairings while maintaining a perfect launch success record. The upper stage of the Falcon 9, though, remains expendable, and every launch flies with a brand new second stage engine. This is the element that failed Thursday night.