Reclaimed asphalt pavement (RAP) and recycled asphalt shingles (RAS) are incorporated into some asphalt mixtures produced today. The use of recycled asphalt materials (RAM) in asphalt mixtures encompasses engineering challenges pertaining to uncertainty in the proportion of the recycled binder that is in contact with and blends with the virgin binder in the asphalt mixture, termed recycled binder contribution (RBC) here. Recent research shows that agglomerations of RAM particles are the main cause of partial RBC. These agglomerations prevent recycled binder from interacting with the virgin binder. However, current practices generally assume complete RBC and a detailed understanding of the role of asphalt mixture constituents on RBC does not at present exist. The use of softer binders, extenders, and recycling agents has been proposed in high-RAM-content mixtures to restore recycled binder stiffness and embrittlement. However, the effects of asphalt binder variables as well as RAM type, source, and content on RBC is at present poorly understood. This paper aims to investigate the effects of asphalt mixture constituents on the RBC in asphalt mixtures using energy-dispersive x-ray spectroscopy (EDS) tracer-based microscopy analysis. It is found that the virgin binder, RAM type, and source significantly influence RBC in asphalt mixtures. However, RAP age level and content as well as additives are found to have only marginal impacts on RBC.