As a beginner runner, I have clear, vivid, haunting memories of an early run with a fanny pack. It. Was. Awful. Surefire way to avoid the dreaded bouncing and chafing, but still carry your essentials? A waist pack like this one. No bounce, comfortable fit, and ample storage.
PakRat Running Belt ($30, originally $40)