Wait, you’re only talking about Sefardim? Why didn’t you say so?
Anyhow, FYI, there are Sefardi poskim who disagree with Chacham Ovadiah as well, and as you point out, his psak is based on his understanding of the Shiltei Giborim, which poskim bigger than Chacham Ovadiah disagreed with.