Your cap or a ball from your pocket lands on their side
If anything you are wearing or carrying touches the other pair's court while the ball is in play, your pair loses the point. If it only falls on your own side, play goes on unless it puts an opponent off.
Over the net
The rules say a pair loses the point if a player, their racket or anything they wear or carry touches the net, the posts, the cable or any part of the other pair's court while the ball is in play. A cap, a sweatband or a spare ball that flies over and lands in their half counts.
On your own side
Something dropping on your own floor is not a fault on its own. If it puts an opponent off as they play their shot, that is involuntary interference: the point is replayed, and a second one by the same pair loses the point.
If their shot hits it
A shot from the other pair that hits an object lying on your floor, such as a spare ball, is a good return, so the rally goes on. Clear spare balls and loose kit before each point.
Pytania
What if my hat falls off during a point in padel?
On your side, play on unless it puts an opponent off, which means a replay. If it lands on their side of the net, your pair loses the point.