We have observed narrowband transmission or rejection in the frequency spectra of THz pulses transmitted through air-spaced parallel plate photonic waveguides. These waveguides have one of the metal plates covered by a silicon plate with a metallic photonic band gap (PBG) surface precisely fabricated by lithographic techniques. We use two different PBG surface types: an array of metallic cylindrical pillars, and an array of metallic cylindrical holes. With the inversion of the PBG structures from cylinders to holes, the output spectra changes from narrow bandpass to narrow band-reject filtering. These photonic waveguides show extremely sharp spectral responses in regions as large as 1 THz, with stop bands or transmission bands having contrasts of as much as 90 dB.