Karaim do not put on tefillin. But it seems that Tzedukim did (tefillin were found in Qumran, and I buy Dr. Schiffman’s argument that the Qumran sect was Tzedukim).
That goes to the point that the Tzedukim did not outright reject the concept of a Torah Sh’bal peh the way that the later Karaites did.