BPS invariants from $p$-adic integrals