Why is the drag area usually limited to the "title bar"?

Take a simple dialog window:

The user will expect that the titlebar can be used to drag the window through the screen. But why is it limited to just this bar?

Why is it uncommon that windows can be moved by clicking anywhere in the window that isn't an input element and just drag from there?