In the 14th century, bishop Maciej from Gołańcza started to build a brick castle in the place of the destroyed castle. The bishops wanted to have their residence near Włocławek. The site was chosen as the headland of an escarpment cutting into the Vistula valley. This is because the steeply sloping high hill provided natural defensive conditions. In the period preceding the Great War with the Teutonic Knights, Queen Jadwiga and Władysław Jagiełło stayed at Raciążek castle to negotiate with the Teutonic Knights for the return of the Bobrza and Dobrzyń lands. The castle, expanded over the years, has not survived to the present day. Today we can see its magnificent ruins.