The Department of Public Safety arrested a Fort Worth man Sunday after he was allegedly caught breaking into the Texas State Capitol building.

According to DPS, just before 3:30 a.m. a trooper observed a man climbing up the scaffolding on the south side of the Capitol. Investigators said the California man, identified as Tanner Christian Graeber, 22, climbed up scaffolding outside the Capitol and broke a window to get into the building.

DPS said that once Graeber was inside he went to the third floor where he took a portrait of a former governor and a fire extinguisher and threw both from the balcony to the floor of the rotunda.

The frame was valued at approximately $10,000 by the state preservation board.

DPS and Capitol Security arrested Graber without incident.

Graeber was booked into the Travis County Jail where he faces felony charges of burglary of a building and criminal mischief.