# Active learning for inferring a convex optimization formulation

I was wondering if anybody knows of any relevant references on the general topic of active learning for gradually inferring/updating a convex opt. formulation.

As a specific example, I am thinking of a system where a learner can query an oracle the validity of the current best solution to incrementally learn constraints or coefficients of an LP cost function.

### Update

I am interested in problems and methods where we don't have access to the full definition of the problem (e.g. in LP the constraints that define the polytope, or the cost coefficients are unknown). Yet we may be able to iteratively solve the problem by iteratively asking a sequence of questions to an oracle until the last query confirms we have reached an optimal solution (an optimal vertex in LP)

• Andrew is right in that this is a very general question. For example, one view of the multiplicative weight update method for SDPs is as an "active" learning problem where you query an oracle to change the distribution over constraints that you're working with. Would that count ? – Suresh Venkat Apr 16 '12 at 18:24
• This doesn't seem as much active learning as query learning. Querying the oracle with the validity of solutions makes me think of Statistical Queries (or even Correlational Statistical Queries). Lots of work has been done in this area. – Lev Reyzin Apr 16 '12 at 19:07
• Thanks @SureshVenkat, yes I guess that would count as well. I guess I am interested in methods where we don't have access to the full definition of the problem (e.g. the constraints that define the polytope, or the cost coefficients of an LP problem are unknown). Yet we may be able to iteratively solve the LP problem by asking a sequence of questions to an oracle until the last query confirms we reached an optimal vertex. – Amelio Vazquez-Reina Apr 16 '12 at 19:33
• – Jeffε Apr 16 '12 at 21:09
• The version where you don't know the cost might be interesting. The version where you don't have the constraints is one where methods like the ellipsoid come into play. – Suresh Venkat Apr 17 '12 at 2:00