You have to bump into the three crystals in the hallway leading to the sword boost for it to activate.