You can confirm this with your Rav:
On Tisha B’av, one who has a headache may swallow tylanol without water.
This is mutar l’chatchila.
However, taking tylanol on an empty stomach might be an issue.