PyEPO: a PyTorch-based end-to-end predict-then-optimize library for linear and integer programming (original) (raw)

References

  1. Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., Devin, M., et al.: Tensorflow: Large-Scale Machine Learning on Heterogeneous Distributed Systems. arXiv preprint arXiv:1603.04467 (2016)
  2. Agrawal, A., Amos, B., Barratt, S., Boyd, S., Diamond, S., Kolter, J.Z.: Differentiable convex optimization layers. In: Wallach, H., Larochelle, H., Beygelzimer, A., d’Alché-Buc, F., Fox, E., Garnett, R. (eds.) Advances in Neural Information Processing Systems, vol. 32. Curran Associates Inc., Glasgow (2019)
    Google Scholar
  3. Agrawal, A., Barratt, S., Boyd, S., Busseti, E., Moursi, W.M.: Differentiating Through a Cone Program. arXiv preprint arXiv:1904.09043 (2019)
  4. Amos, B., Kolter, J.Z.: Optnet: differentiable optimization as a layer in neural networks. In: International Conference on Machine Learning, PMLR, pp. 136–145 (2017)
  5. Bengio, Y.: Using a financial training criterion rather than a prediction criterion. Int. J. Neural Syst. 8(04), 433–443 (1997)
    Article Google Scholar
  6. Berthet, Q., Blondel, M., Teboul, O., Cuturi, M., Vert, J.P., Bach, F.: Learning with differentiable perturbed optimizers. arXiv preprint arXiv:2002.08676 (2020)
  7. Blondel, M., Martins, A.F., Niculae, V.: Learning with Fenchel-Young losses. J. Mach. Learn. Res. 21(35), 1–69 (2020)
    MathSciNet Google Scholar
  8. Chen, T., Li, M., Li, Y., Lin, M., Wang, N., Wang, M., Xiao, T., Xu, B., Zhang, C., Zhang, Z.: Mxnet: a flexible and efficient machine learning library for heterogeneous distributed systems. arXiv preprint arXiv:1512.01274 (2015)
  9. Cplex, I.I.: V12.1: user’s manual for complex. Int. Bus. Mach. Corp. 46(53), 157 (2009)
  10. Dalle, G., Baty, L., Bouvier, L., Parmentier, A.: Learning with combinatorial optimization layers: a probabilistic approach. arXiv preprint arXiv:2207.13513 (2022)
  11. Dantzig, G., Fulkerson, R., Johnson, S.: Solution of a large-scale traveling-salesman problem. J. Oper. Res. Soc. Am. 2(4), 393–410 (1954)
    MathSciNet Google Scholar
  12. Djolonga, J., Krause, A.: Differentiable learning of submodular models. In: Guyon, I., Luxburg, U.V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., Garnett, R. (eds.) Advances in Neural Information Processing Systems, vol. 30. Curran Associates Inc., Glasgow (2017)
    Google Scholar
  13. Domke, J.: Generic methods for optimization-based modeling. In: Artificial Intelligence and Statistics, PMLR, pp 318–326 (2012)
  14. Donti, P., Amos, B., Kolter, J.Z.: Task-based end-to-end model learning in stochastic optimization. In: Guyon, I., Luxburg, U.V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., Garnett, R. (eds.) Advances in Neural Information Processing Systems, vol. 30. Curran Associates Inc., Glasgow (2017)
    Google Scholar
  15. Elmachtoub, A., Liang, J.C.N., McNellis, R.: Decision trees for decision-making under the predict-then-optimize framework. In: International Conference on Machine Learning, PMLR, vol. 119, pp. 2858–2867 (2020)
  16. Elmachtoub, A.N., Grigas, P.: Smart predict, then optimize. Manag. Sci. 68(1), 9–26 (2021)
    Article Google Scholar
  17. Ferber, A., Wilder, B., Dilkina, B., Tambe, M.: Mipaal: mixed integer program as a layer. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 1504–1511 (2020)
  18. Feurer, M., Klein, A., Eggensperger, K., Springenberg, J., Blum, M., Hutter, F.: Efficient and robust automated machine learning. Adv. Neural. Inf. Process. Syst. 28, 2962–2970 (2015)
    Google Scholar
  19. Ford, B., Nguyen, T., Tambe, M., Sintov, N., Delle Fave, F.: Beware the soothsayer: From attack prediction accuracy to predictive reliability in security games. In: International Conference on Decision and Game Theory for Security, pp. 35–56. Springer, Berlin (2015)
  20. Gavish, B., Graves, S.C.: The travelling salesman problem and related problems. Operations Research Center Working Paper; OR 078-78 (1978)
  21. Ge, D., Huangfu, Q., Wang, Z., Wu, J., Ye, Y.: Cardinal Optimizer (COPT) user guide. https://guide.coap.online/copt/en-doc (2022)
  22. Gould, S., Fernando, B., Cherian, A., Anderson, P., Cruz, R.S., Guo, E.: On differentiating parameterized argmin and argmax problems with application to bi-level optimization. arXiv preprint arXiv:1607.05447 (2016)
  23. Gurobi Optimization, LLC. Gurobi Optimizer Reference Manual. https://www.gurobi.com (2021)
  24. Hagberg, A., Swart, P., Chult, D.: Exploring network structure, dynamics, and function using networkX. Tech. rep., Los Alamos National Lab. (LANL), Los Alamos, NM (United States) (2008)
  25. Hart, W.E., Laird, C.D., Watson, J.P., Woodruff, D.L., Hackebeil, G.A., Nicholson, B.L., Siirola, J.D., et al.: Pyomo-Optimization Modeling in Python, vol. 67. Springer, Berlin (2017)
    Book Google Scholar
  26. Kao, Yh., Roy, B., Yan, X.: Directed regression. In: Bengio, Y., Schuurmans, D., Lafferty, J., Williams, C., Culotta, A. (eds.) Advances in Neural Information Processing Systems, vol. 22. Curran Associates Inc., Glasgow (2009)
    Google Scholar
  27. Liu, T.Y., et al.: Learning to rank for information retrieval. Found. Trends Inf. Retr. 3(3), 225–331 (2009)
    Article Google Scholar
  28. Mandi, J., Guns, T.: Interior point solving for lp-based prediction+optimisation. In: Larochelle, H., Ranzato, M., Hadsell, R., Balcan, M.F., Lin, H. (eds.) Advances in Neural Information Processing Systems, vol. 33, pp. 7272–7282. Curran Associates Inc., Glasgow (2020)
    Google Scholar
  29. Mandi, J., Stuckey, P.J., Guns, T., et al.: Smart predict-and-optimize for hard combinatorial optimization problems. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 1603–1610 (2020). https://doi.org/10.1609/aaai.v34i02.5521
  30. Mandi, J., Bucarey, V., Tchomba, M.M.K., Guns, T.: Decision-focused learning: through the lens of learning to rank. In: International Conference on Machine Learning, PMLR, pp. 14935–14947 (2022)
  31. Mandi, J., Kotary, J., Berden, S., Mulamba, M., Bucarey, V., Guns, T., Fioretto, F.: Decision-focused learning: Foundations, state of the art, benchmark and future opportunities. arXiv preprint arXiv:2307.13565 (2023)
  32. Martello, S., Toth, P.: Knapsack Problems: Algorithms and Computer Implementations. Wiley, New York (1990)
    Google Scholar
  33. Mattingley, J., Boyd, S.: Cvxgen: a code generator for embedded convex optimization. Optim. Eng. 13(1), 1–27 (2012)
    Article MathSciNet Google Scholar
  34. Miller, C.E., Tucker, A.W., Zemlin, R.A.: Integer programming formulation of traveling salesman problems. J. ACM 7(4), 326–329 (1960)
    Article MathSciNet Google Scholar
  35. Mulamba, M., Mandi, J., Diligenti, M., Lombardi, M., Bucarey, V., Guns, T.: Contrastive losses and solution caching for predict-and-optimize. arXiv preprint arXiv:2011.05354 (2020)
  36. Ortega-Arranz, H., Llanos, D.R., Gonzalez-Escribano, A.: The shortest-path problem: analysis and comparison of methods. Synth. Lect. Theor. Comput. Sci. 1(1), 1–87 (2014)
    Article Google Scholar
  37. Paszke, A., Gross, S., Chintala, S., Chanan, G., Yang, E., DeVito, Z., Lin, Z., Desmaison, A., Antiga, L., Lerer, A.: Automatic differentiation in pytorch. In: NIPS 2017 Autodiff Workshop (2017)
  38. Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., Desmaison, A., Kopf, A., Yang, E., DeVito, Z., Raison, M., Tejani, A., Chilamkurthy, S., Steiner, B., Fang, L., Bai, J., Chintala, S.: Pytorch: an imperative style, high-performance deep learning library. In: Wallach, H., Larochelle, H., Beygelzimer, A., d’Alché-Buc, F., Fox, E., Garnett, R. (eds.) Advances in Neural Information Processing Systems, vol. 32, pp. 8024–8035. Curran Associates Inc., Glasgow (2019)
    Google Scholar
  39. Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., Vanderplas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., Duchesnay, E.: Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825–2830 (2011)
    MathSciNet Google Scholar
  40. Pogančić, M.V., Paulus, A., Musil, V., Martius, G., Rolinek, M.: Differentiation of blackbox combinatorial solvers. In: International Conference on Learning Representations (2019)
  41. Sadana, U., Chenreddy, A., Delage, E., Forel, A., Frejinger, E., Vidal, T.: A survey of contextual optimization methods for decision making under uncertainty. arXiv preprint arXiv:2306.10374 (2023)
  42. Wilder, B., Dilkina, B., Tambe, M.: Melding the data-decisions pipeline: decision-focused learning for combinatorial optimization. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp. 1658–1665 (2019)

Download references