This was exactly my family vacations as a kid — and an adult, for that matter. After repeated attempts to save up to go to Disney World, we finally managed it when I was 18. It is not cheap to take five kids anywhere.
I did go on a school trip out of the country, once. It was miserable. Never felt any desire to ~travel~ since — not that I could afford it if I wanted to!