The propagator of a dynamically screened Coulomb interaction W in a sandwichlike structure consisting of two graphene layers separated by a slab of Al2O3 (or vacuum) is derived from single-layer graphene response functions and by using a local dielectric function for the bulk Al2O3. The response function of graphene is obtained using two approaches within the random phase approximation (RPA): an ab initio method that includes all electronic bands in graphene and a computationally less demanding method based on the massless Dirac fermion (MDF) approximation for the low-energy excitations of electrons in the π bands. The propagator W is used to derive an expression for the effective dielectric function of our sandwich structure, which is relevant for the reflection electron energy loss spectroscopy of its surface. Focusing on the range of frequencies from THz to mid-infrared, special attention is paid to finding an accurate optical limit in the ab initio method, where the response function is expressed in terms of a frequency-dependent conductivity of graphene. It was shown that the optical limit suffices for describing hybridization between the Dirac plasmons in graphene layers and the Fuchs-Kliewer phonons in both surfaces of the Al2O3 slab, and that the spectra obtained from both the ab initio method and the MDF approximation in the optical limit agree perfectly well for wave numbers up to about 0.1 nm−1. Going beyond the optical limit, the agreement between the full ab initio method and the MDF approximation was found to extend to wave numbers up to about 0.3 nm−1 for doped graphene layers with the Fermi energy of 0.2 eV.