Here's the thing, every POTUS takes time away from the White House, and for the most part the amount Obama, Bush Jr, Clinton, etc took off is all relatively consistent. And then there's Trump, taking most weekends 'off'*.
So yeah, the activities might be the same, but the quantity does matter, imo.
* - Even when a POTUS is on 'vacation' they are still 'working'... at least usually.