You must have left out part of the problem? If the question is "given a square, identify the set of points for which this function will return the largest number", that immediately reduces to the problem of "what is the largest triangle that can be inscribed inside a square?" (because there is no possible advantage to including more than three points in your set).
It looks like the problem is actually a derivative of the function you described - if your function is f(A) [where A is any set of points in the unit square], then what we want is a function g(n), for integer n >= 3, which gives us the maximum value taken by f when f is restricted to sets that contain exactly n points?