Allen is suing American Apparel for putting his image from the 1977 movie "Annie Hall," where he appeared as a Hasidic Jew, on billboards without his consent.
The film maker calls American Apparel, whose eccentric founder strips to his underwear in the office and has reportedly masturbated in front of a journalist, "sleazy."
Allen seeks 10 million dollars compensation -- the amount he says he'd charge if he had agreed to an endorsement -- in the trial scheduled to start May 18.
The California company, whose tight-fitting lingerie and casual wear enjoy a cult following, says Allen's colorful personal life leaves him without much of an image to defend.
American Apparel lawyers contend that the "sex scandal" of Allen's marriage to adopted daughter Soon-Yi Previn, after a bitter divorce from actress Mia Farrow, will be fair game.
Lawyers say in court documents they intend to show "the highly publicized sex scandal and custody battle" impacted on Allen's career and the value of his image.