With only 4,000 images that gap is very likely a data problem before it's a regularization problem. Try aggressive augmentation first (flips, crops, color jitter) — it's usually cheaper than collecting more data and often closes most of that gap.
Sophea K.
Algorithms mentor · answered 22h ago