A campaign to root out financial fraud secured a victory on Wednesday, as authorities took aim at the Royal Bank of Scotland for its role in an interest rate manipulation scheme that has emboldened prosecutors and consumed the banking industry.

U.S. and British authorities struck a combined $612 million settlement with the bank, the latest case to emerge from the global investigation into rate-rigging. The U.S. Justice Department dealt another blow to the bank, forcing its Japanese unit to plead guilty to criminal wrongdoing.

The penalty for the subsidiary, a hub of rate manipulation, underscores a recent shift in the way federal authorities punish financial wrongdoing. The RBS case echoed an earlier action taken against a UBS subsidiary, which similarly pleaded guilty to felony wire fraud as part of a larger settlement. These cases represent the first units of a big bank to agree to criminal charges in more than a decade.

"I want financial institutions to know that this department will absolutely hold them to account," Lanny Breuer, head of the Justice Department's criminal division, said Wednesday.

Some of the world's largest financial institutions remain caught in the cross hairs of the rate manipulation case, an investigation that could drag on for years. Authorities suspect that more than a dozen banks falsified reports to influence benchmarks like the London Interbank Offered Rate, or LIBOR, which underpins the costs for trillions of dollars in financial products like mortgages and credit cards.

A person involved in the investigation indicated that the first banks to settle were among the worst actors in the rate case. But they also received a "discount" for their eager cooperation, according to people with knowledge of the matter.

That approach raises the prospect that remaining banks could face high-priced settlements.

Deutsche Bank, which set aside an undisclosed amount to cover potential penalties and suspended five employees tied to the case, is expected to settle with authorities in late 2013, several people briefed on the matter said. But the timetable could shift. The bank is not in formal settlement talks and is not prepared to resolve the case, the people said.

U.S. banks could be next

While foreign banks have borne the brunt of the scrutiny, a U.S. institution could be among the next to settle. Citigroup and JPMorgan Chase are under investigation by the Commodity Futures Trading Commission, the U.S. regulator leading the case, though actions are not imminent.

The RBS action concluded a first phase of rate-rigging investigations for authorities, who are now planning to take a brief hiatus from filing cases. The next case is not expected until spring at the earliest, two of the people briefed on the matter said.

Some bank executives, fearful that fallout from the case will stain their firms, are pushing for a broad deal encompassing multiple institutions. But authorities are balking at a "global settlement," people involved in the case say, arguing that investigations are proceeding at different stages and involve widely varying fact patterns.

As regulators continue to pursue actions, prosecutors are planning charges against traders involved in the scheme. The first charges came last year when the Justice Department filed actions against two former UBS traders.

"Our investigation is far from finished," Breuer said.

The rate-rigging case has centered on how much banks charge each other for loans. Such figures form the basis of LIBOR and other rates. But banks corrupted the process. Government complaints filed over the last year outlined a scheme in which banks reported false rates to lift their trading profits.

Authorities announced the first LIBOR case in June, extracting a $450 million settlement with the British bank Barclays. In December, UBS agreed to a record $1.5 billion settlement with authorities. The Justice Department also secured the guilty plea from one of the bank's subsidiaries.

RBS had little leverage

Royal Bank of Scotland, based in Edinburgh, had aimed to avert the guilty plea for its Japanese subsidiary, people involved in the case said. But the Justice Department's criminal division declined to back down, and the bank had little leverage to push back. It decided not to formally appeal its case to Attorney General Eric Holder, another person said.

With fines coming from multiple authorities, the $612 million case amounted to the second-largest penalty levied in the multiyear investigation into rate manipulation. "The settlement with RBS is much more than a slap on the wrist," argued Bart Chilton, a member of the trading commission who is critical of soft fines on big banks.

The settlement represents the latest setback for Royal Bank of Scotland, which has struggled to shake the legacy of the 2008 financial crisis. The British firm, which is majority-owned by the government after a bailout, already has put aside $2.7 billion to compensate customers who were inappropriately sold loan insurance in recent years.