Traveling nonclassical states of light are important resources for quantum metrology, secure communication, and quantum networks. Motivated by this, we derive master equations for an arbitrary quantum system (e.g. a quantum harmonic oscillator or a multi-level atom) interacting with a wave packet of light prepared in an N-photon Fock state. We then generalize this to N-photon states with arbitrary spectral distribution functions and wavepackets in two polarization (or spatial) modes.