A federal appeals court has rejected Tom Brady's attempt to get a new hearing on his "Deflategate" suspension.

Brady was asking for the full 2nd U.S. Circuit Court of Appeals to hear the case. In April, a three-judge panel said that NFL commissioner Roger Goodell was within his powers when he suspended the star quarterback four games for his role in a scheme to doctor the footballs used in a Jan. 18, 2015, playoff game.

The decision Wednesday affirms the wide-ranging powers given to the commissioner by the NFL's collective bargaining agreement and was a setback for organized labor groups arguing for due process in employee discipline.

Brady's remaining hope is to appeal to the U.S. Supreme Court.

The Patriots open the season Sept. 11 at Arizona. If Brady is suspended, backup quarterback Jimmy Garoppolo would take his place.

What began as an accusation of cheating in the 2015 AFC championship game has grown into a multimillion-dollar legal battle over three NFL seasons, involving not just an MVP quarterback but also some of the elite lawyers and scientists in the country.

And as it developed, it evolved from a silly little dispute about the air pressure in footballs into a referendum on the powers of a sport's commissioner and the right of all unionized employees to due process in a disciplinary hearing.

Joining the case along the way were longtime league adversary Jeffrey Kessler and former U.S. Solicitor General Ted Olson, who was involved in the Bush v. Gore lawsuit that settled the 2000 presidential election and the case that overturned California's ban on same-sex marriages. Piping in with friend of the court briefs were the AFL-CIO and scholars from some of the top legal and scientific institutions in the country.

At stake for the Patriots was not only the availability of their quarterback for a quarter of the season, but their legacy as an NFL dynasty. Already convicted once of cheating by Goodell — in an illegal videotaping scheme in 2007 that predictably came to be known as "SpyGate" — the Patriots saw the suspension as an attack on their legitimacy of the four Super Bowl championships earned under Brady and coach Bill Belichick.

The suspicions boiled over on Jan. 18, 2015, when the league tested — somewhat unscientifically, it would belatedly learn — the footballs provided by the home team for the AFC title game against the Indianapolis Colts and found them to be underinflated.

After three months, league investigator Ted Wells found that the Patriots intentionally used underinflated footballs in the game and that Brady was "at least generally aware" of the scheme. The NFL suspended the four-time Super Bowl champion quarterback four games and docked the team $1 million and two draft picks.

Brady appealed — first within the league, and Goodell affirmed the decision. Brady appealed to federal court, and U.S. District Judge Richard Berman overturned the suspension. The league appealed to the 2nd Circuit, and the three-judge panel reinstated the original penalty.

That left Brady hoping for a new hearing in front of the complete circuit — called "en banc" — or an even more unlikely hearing at the Supreme Court.

"That's always an option to litigants," Olson said after joining the case. "It is not something we have resolved ourselves to doing."

New England fans rallied behind their quarterback, putting "Free Brady" on T-shirts, reciting the Ideal Gas Law from memory and giving a hero's welcome not only to the quarterback when he took the field for the 2015 regular season opener but also to Kessler and U.S. District Judge Richard Berman — whose ruling for Brady would later be overturned on appeal.

But in other NFL cities, fans were just as convinced that the Patriots and Belichick were up to no good. Added to the videotaping penalty — along with Belichick's tendency to stretch the rules to their limits, or occasionally beyond — it was seen as confirmation that the team can't win without cheating.

The court's decision is unlikely to change minds on either side.