The foundation of the stone fort were laid in 1635 by order of the spanish goverment. The construction was directed by the Jesuit Father Melchor de Vera. This fort was known as " The fort of Sat. Joseph" In 1662 the fort were abandoned by the spanish garrisons which sailed for Manila to help depend that City from the thread of the powerful Chinese pirate Kuesing. The Forts were totally destroyed in 1663.
The reconstruction of the new Fort on the same spot begun in 1718 and was finished on April 8th 1719, under the direction of another Jesuit Priest. The newly rebuilt fort which is the existing one was placed under the protection of La Nuestra Senora Del Pillar of Zaragoza, Spain.
As to how and when the present image was carved and happend to be where it is actually seem. there is no attesting to that effect except the testimonies of witnesses.
On a certian occasion an Image of the Blessed Virgin Mary was born in a religious procession to the forts The main entrance was located on that side of the fort where the present stone carved image can still be seem. While the services were in progress, the alarm was given that Moro forces were about to make an assult. The Frightened congregation rushed and crowded inside the fort. SSuddenly the entrance was closed and sealed with lime and stone, in confustion, the image was left in her carroza, as they check the area after the sudden re route of the moros the image could no longer be found but as they look up from the miraculously closed entrance they behold the image of Our Lady of the Pillar.
Now the Fort is called: FORT PILLAR.