Dining at Disney World is actually very very casual.
Most table service restaurants actually permit you to wear whatever it is you were wearing to the parks.
Really, the only thing you need to get into a Disney restaurant are shirt and shoes.
However, it is a little more strict when it comes to signature dining.