The incident took place on Thursday evening in the 8000 block of Montague Court in Glen Burnie.
There, Matthew Klein fired a shot in his home that went through his residence and into his the home of a neighbor – where it finally stopped in a wall.
Six people were present in the house at the time, including three children. No one was injured.
Klein initially tried to tell his neighbors he had accidentally fired an air rifle, but police later found a loaded gun in the home.
Authorities also found two high-powered rifles, 2 air rifles, an assault pistol and fourteen handguns, along with thousands of rounds of ammo.
At this point, there is no indication that Klein obtained the weapons illegally, but the investigation is ongoing.
Klein has been charged with reckless endangerment.