When you say “speaker” do you mean something like a powered computer speaker? Or just a speaker cone?
If the latter then no, don’t try to do it that way. Speakers are low impedance and you’ll fry a chip. You can build a simple speaker driver with an LM386. Take a look at section 9 in the datasheet for some possible circuits.
https://www.ti.com/lit/ds/symlink/lm386.pdf?HQS=TI-null-null-sf-df-ds-null-wwe