Cap with retaining strap