Searches are conducted for new spin-0 or spin-1 bosons using events where a Higgs boson with mass GeV decays to four leptons ( , ). This decay is presumed to occur via an intermediate state which contains two on-shell, promptly decaying bosons: , where the new boson has a mass between 1 and 60 GeV. The search uses collision data collected with the ATLAS detector at the LHC with an integrated luminosity of 139 fb at a centre-of-mass energy TeV. The data are found to be consistent with Standard Model expectations. Limits are set on fiducial cross sections and on the branching ratio of the Higgs~boson to decay to . Limits are also set on mixing parameters relevant in extensions of the Standard Model containing a dark sector where is interpreted to be a dark boson.