Searches are performed for non-resonant and resonant di-Higgs boson production in the final state. The data set used corresponds to an integrated luminosity of 139 fb of proton-proton collisions at a center-of-mass energy of 13 TeV recorded by the ATLAS detector at the CERN Large Hadron Collider. No excess with respect to background expectations is found and upper limits on the di-Higgs boson production cross sections are set. A 95% confidence level upper limit of 130 fb is set on the non-resonant production, where the expected limit is 180 fb. The observed (expected) limit corresponds to 4.1 (5.5) times the cross section predicted by the Standard Model. The observed (expected) limit on the Higgs boson trilinear coupling modifier is extracted to be [-1.5, 6.7] ([-2.4, 7.7]) at 95% confidence level. The constraints on are obtained over an expected hypothesis excluding production. For the resonant production of a new hypothetical scalar particle (), limits on the cross section are presented for the narrow-width approximation as a function of in the range GeV GeV. The observed (expected) limits on the cross section range from 610 fb to 47 fb (360-43 fb) over the considered mass range.