No it doesn't.
The portion of the poem which was adopted as our national anthem doesn't mention slaves at all.
You'll note that the poem is called Defense of Fort M'Henry, while the anthem is named The Star Spangled Banner.
Saying they are the same is the rough equivalent of saying Ice Ice Baby and Under Pressure are the same song, which would be stupid.
Finally, you're talking about a 203 year old poem. Goodwin hardly dropped a bomb.