The three women found alive after being held captive for a decade were only allowed to go outside twice during the 10 year period, were repeatedly raped and forced to celebrate the anniversary of their abductions with the man accused of kidnapping them, investigators say.

The women were allowed outside in disguises, just to a garage a few steps away.

Ariel Castro, the 52-year-old former school bus driver accused of kidnapping and raping the women made his first public appearance in court Thursday after emerging as the lone suspect.

Castro was arraigned on charges of rape and kidnapping after three women missing for about a decade and one of their young daughters were found alive at his home earlier in the week. The Cleveland suspect looked down at the ground for almost the entire court proceeding, biting his collar and signing documents with his handcuffed hands. He didn't speak. Bond was set at $8 million.

While many questions remain about how Castro maintained such tight control over the women for so many years before one of them made a daring escape Monday, the horrors they suffered are beginning to come to light.

Police say the women were apparently bound by ropes and chains at times and were kept in different rooms. They suffered prolonged sexual and psychological abuse and had miscarriages, according to a city official briefed on the case.

Castro has been charged with four counts of kidnapping — covering the captives and the daughter born to one of them — and three counts of rape, against all three women.

In a torturous ritual, the three women were served cake and dinner in a celebration of their "abduction days," as their "new birthdays" according to a cousin of a victim who spoke to The New York Times. The women were also forced to watch heartbreaking TV coverage of the vigils held in their honor by the families of the missing.

The women and Castro have given lengthy statements to police that have helped build their case, said Deputy Police Chief Ed Tomba.

None of the women, though, gave them any indication that Castro's two older brothers, who've been in custody since Monday, were involved, Tomba said. Prosecutors brought no charges against the brothers, citing a lack of evidence.

"Ariel kept everyone at a distance," Tomba said.

One thing that remains a mystery, he said, is how the women were kept in the house so long.

"As far as the circumstances inside the home and the control he may have had over those girls ... I think that's going to take us a long time to figure that out," he said.

The women, now in their 20s and 30s, vanished separately between 2002 and 2004. At the time, they were 14, 16 and 20 years old.

At a news conference, authorities would not discuss the circumstances of their kidnapping and captivity.

City Councilman Brian Cummins earlier said: "We know that the victims have confirmed miscarriages, but how many and in what conditions, we don't know."

"It sounds pretty gruesome," he added.

They never saw a chance to escape over the last 10 years until this week, when Amanda Berry broke through a door and ran to freedom, alerting police who rescued the other two women while Castro was away from the house.

In newly released police audio tapes, a 911 dispatcher notifies officers on Monday that she's just spoken to a woman who "says her name is Amanda Berry and that she had been kidnapped 10 years ago."

An officer on the recorded call says, "This might be for real."

After police arrive at the house, women can be heard crying in the background. Then an officer tells the dispatcher: "We found 'em. We found 'em."

Tomba said of Berry, "Something must have clicked and she saw an opportunity and she took that opportunity."

He said the women could remember being outside only twice during their entire time in captivity. "We were told they left the house and went into the garage in disguise," he said.

Also in the house was Berry's 6-year-old daughter, named Jocelyn. A paternity test on Castro was being done to establish whether he fathered the child.

“Yeah, she’s my daughter,” said Berry, 27, to Police according to The New York Daily News. “Born on Christmas.”

Berry was abducted on April 21, 2003 and got pregnant in her fourth year in captivity, police said.

On Wednesday Federal agents searched a vacant house near where the women had been held. Officials would only say their search was an attempt to get evidence in the case against Castro, but they refused to say what they found or what led them there.

Few people in Cleveland, outside the families of the women, thought there was any chance they were still alive.

Berry, 27, and Gina DeJesus, who is in her early 20s, were welcomed home Wednesday by jubilant crowds of loved ones and neighbors with balloons and banners. Family members hustled them inside, past hundreds of reporters and onlookers.

Neither woman spoke.

"This is the best Mother's Day I could ever have," said Nancy Ruiz, Gina's mother. She said she hugged her daughter and didn't want to let go.

Ruiz said she spent time with all three women after they were rescued. "There's no word to describe the beauty of just seeing them," she said.

DeJesus' father pumped his fist after arriving home with his daughter, and urged people across the country to watch over the children in their neighborhoods — including other people's kids.

"Too many kids these days come up missing, and we always ask this question: How come I didn't see what happened to that kid? Why? Because we chose not to," he said.

The third captive, Michelle Knight, 32, was reported in good condition at Metro Health Medical Center, which a day earlier had reported that all three victims had been released. There was no immediate explanation from the hospital.

Knight, according to a police report obtained by local NBC television affiliate WKYC-TV in Cleveland, told police she saved Berry's baby at birth by providing CPR when Jocelyn was born not breathing.

The Associated Press does not usually identify people who may be victims of sexual assault, but the names of the women were widely circulated by their families, friends and law enforcement authorities for years during their disappearance.

Castro was accused of twice breaking the nose of his children's mother, knocking out a tooth, dislocating each shoulder and threatening to kill her and her daughters, according to a 2005 domestic-violence filing in Cuyahoga County Domestic Relations Court.

The filing for a protective order by Grimilda Figueroa also said that Castro frequently abducted her daughters and kept them from her. Figueroa died in April 2012 after a battle with cancer.

Figueroa's father, Ismail Figueroa, said Wednesday that Castro would regularly lock his daughter inside a second-floor apartment in the house where they lived when they were first together.

Later, when they moved a few blocks to the house Castro purchased — the house from which, years later, the women would escape — he kept a close eye on her and refused to let people come inside to visit her or even let her pick up their children from school, said Angel Villanueva, who is married to Grimilda Figueroa's sister.

Grimilda was "not allowed to go nowhere," said Villanueva. No matter where she wanted to go, "it had to be with him."

Based on reporting by the Associated Press.