Even in an absurd world, there is a circle of probability.
Certainly, hyperrealism has become a trend at many improv companies. Sometimes players are afraid to enter into a more dreamy or absurd realm. This is probably because it makes them feel lost.
Many absurd scenes turn out to become overly absurd really quickly. It then seems like every single event needs to make us rethink how this world operates. That makes things very hard for your partners on scene and generally makes the audience tune out after a while too.
Remember that even in absurd worlds, there are laws which events abide to. It also reminds to a little warmup game where the players are asked to quickly form a family photo of aliens. If they all end up making completely different aliens, remind them that even in a different world that ours, members of the same family will most probably look more or less alike (i.e. will be of the same species).