So, no questions are off limits coming from a prospective employer?
I think not. The PE has a right to get up and walk out and find another job. If the guy is just asking outrageous questions that are offensive or rude or something else, then I am sure his behavior will also run through his company. Which in turn will probably make his business suffer at some point.