Disagreeing about the score
The FIP rules explain how the score is called but say nothing about four players who disagree on it. In a friendly game, the fair fix is to go back to the last score all four of you agree on.
What the rules say
The rules set out the calls, love, 15, 30, 40 and game, and that the server's score is called first. They are written for matches with an umpire and do not cover a dispute between the players.
Go back to what you agree on
Talk through the points you remember and settle on the last score all four of you accept, then play on from there. This is a habit of friendly play, not an FIP rule.
Stop it happening
Have the server call the score out loud before every serve. Agree before the match which deuce format you are playing: advantage, star point or golden point.
Questions
What do you do if you disagree about the score in padel?
The FIP rules do not cover it. In friendly play, go back to the last score all four players agree on and play on from there.