A search for the Higgs boson decaying into a photon and a pair of electrons or muons with an invariant mass GeV is presented. The analysis is performed using 139 fb of proton-proton collision data, produced by the LHC at a centre-of-mass energy of 13 TeV and collected by the ATLAS experiment. Evidence for the process is found with a significance of over the background-only hypothesis, compared to an expected significance of . The best-fit value of the signal strength parameter, defined as the ratio of the observed signal yield to the one expected in the Standard Model, is . The Higgs boson production cross-section times the branching ratio for GeV is determined to be 8.7~^{+2.8}_{-2.7}~\text{fb}.