The.Algorithm.Design.Manual.Springer-Verlag.1998

The.Algorithm.Design.Manual.Springer-Verlag.1998 The.Algorithm.Design.Manual.Springer-Verlag.1998

18.04.2013 Views

War Story: Hard Against the Clock like. Next: Approximation Algorithms Up: Intractable Problems and Approximations Previous: The Art of Proving Algorithms Mon Jun 2 23:33:50 EDT 1997 file:///E|/BOOK/BOOK3/NODE118.HTM (4 of 4) [19/1/2003 1:29:56]

Approximation Algorithms Next: Approximating Vertex Cover Up: Intractable Problems and Approximations Previous: War Story: Hard Against Approximation Algorithms For the practical person, demonstrating that a problem is NP-complete is never the end of the line. Presumably, there was a reason why you wanted to solve it in the first place. That reason for wanting the solve it will not have gone away on being told that there is no polynomial-time algorithm. You still seek a program that solves the problem of interest. All you know is that you won't find one that quickly solves the problem to optimality in the worst case. You still have the following options: ● Algorithms fast in the average case - Examples of such algorithms include backtracking algorithms with substantial pruning. ● Heuristics - Heuristic methods like simulated annealing or greedy approaches can be used to find a solution with no requirement that it be the best one. ● Approximation algorithms - The theory of NP-completeness does not stipulate that it is hard to get close to the answer, only that it is hard to get the optimal answer. With clever, problem-specific heuristics, we can often get provably close to the optimal answer. Approximation algorithms return solutions with a guarantee attached, namely that the optimal solution can never be much better than this given solution. Thus you can never go too far wrong in using an approximation algorithm. No matter what your input instance is and how lucky you are, you are doomed to do all right. Further, approximation algorithms realizing provably good bounds often are conceptually simple, very fast, and easy to program. One thing that is usually not clear, however, is how well the solution from an approximation algorithm compares to what you might get from a heuristic that gives you no guarantees. The answer could be worse or it could be better. Leaving your money in a savings account in a bank guarantees you 3% interest without risk. Still, you likely will do much better putting your money in stocks than in the bank, even though performance is not guaranteed. One way to get the best of approximation algorithms and heuristics is to run both of them on the problem instance and pick the solution giving the better answer. This way, you get a solution that comes with a guarantee and a second chance to do even better. When it comes to heuristics for hard problems, sometimes you can have it both ways. file:///E|/BOOK/BOOK3/NODE119.HTM (1 of 2) [19/1/2003 1:29:57]

Approximation <strong>Algorithm</strong>s<br />

Next: Approximating Vertex Cover Up: Intractable Problems and Approximations Previous: War Story:<br />

Hard Against<br />

Approximation <strong>Algorithm</strong>s<br />

For the practical person, demonstrating that a problem is NP-complete is never the end of the line.<br />

Presumably, there was a reason why you wanted to solve it in the first place. That reason for wanting the<br />

solve it will not have gone away on being told that there is no polynomial-time algorithm. You still seek<br />

a program that solves the problem of interest. All you know is that you won't find one that quickly solves<br />

the problem to optimality in the worst case. You still have the following options:<br />

● <strong>Algorithm</strong>s fast in the average case - Examples of such algorithms include backtracking<br />

algorithms with substantial pruning.<br />

● Heuristics - Heuristic methods like simulated annealing or greedy approaches can be used to find<br />

a solution with no requirement that it be the best one.<br />

● Approximation algorithms - <strong>The</strong> theory of NP-completeness does not stipulate that it is hard to get<br />

close to the answer, only that it is hard to get the optimal answer. With clever, problem-specific<br />

heuristics, we can often get provably close to the optimal answer.<br />

Approximation algorithms return solutions with a guarantee attached, namely that the optimal solution<br />

can never be much better than this given solution. Thus you can never go too far wrong in using an<br />

approximation algorithm. No matter what your input instance is and how lucky you are, you are doomed<br />

to do all right. Further, approximation algorithms realizing provably good bounds often are conceptually<br />

simple, very fast, and easy to program.<br />

One thing that is usually not clear, however, is how well the solution from an approximation algorithm<br />

compares to what you might get from a heuristic that gives you no guarantees. <strong>The</strong> answer could be<br />

worse or it could be better. Leaving your money in a savings account in a bank guarantees you 3%<br />

interest without risk. Still, you likely will do much better putting your money in stocks than in the bank,<br />

even though performance is not guaranteed.<br />

One way to get the best of approximation algorithms and heuristics is to run both of them on the problem<br />

instance and pick the solution giving the better answer. This way, you get a solution that comes with a<br />

guarantee and a second chance to do even better. When it comes to heuristics for hard problems,<br />

sometimes you can have it both ways.<br />

file:///E|/BOOK/BOOK3/NODE119.HTM (1 of 2) [19/1/2003 1:29:57]

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!