Check out durable bottle holders from Brompton.
The elastic strap on the saddle pouch can prevent the water bottle from “jumping out” while still allowing for quick access and storage.
Small personal belongings and tool kits can still be stored under the bottle.