Powerful radio jets are thought to play a key role in the formation and growth of supermassive black holes (SMBHs). They are also thought to have a significant effect on galaxy evolution. However, currently there is a dearth of radio sources at $z \geq 7$. I will present the discovery of the most distant radio-loud quasar known-to-date at $z=7.0$, as well as the multi-wavelength follow-up studies of this unique object from X-ray to radio. I will discuss the nature of this highly variable source via multi-epoch multi-frequency radio observations, and the implications of its existence at such a high redshift. I will also present milliarcsecond resolution ($\sim$10s of pc scale) imaging of this source with the Very Long Baseline Array (VLBA).