The Feldenkreis family, which owns 20 percent of the diluted shares of Perry Ellis International, is said to be considering a possible change of ownership