A learned index for continuous range queries over streaming data (original) (raw)

References

  1. Zhou, L., Tu, W., Li, Q., Guan, D.: A heterogeneous streaming vehicle data access model for diverse iot sensor monitoring network management. IEEE Internet Things J. 11(16), 26929–26943 (2024)
    Article Google Scholar
  2. Lim, J., Bok, K., Yoo, J.: An efficient continuous range query processing scheme in mobile p2p networks. J. Supercomput. 76, 1–15 (2020)
    Article Google Scholar
  3. Li, H., Zheng, Z., Liu, K.: Online monitoring of high-dimensional data streams with deep q-network. IEEE Trans. Autom. Sci. Eng. 22, 12606–12620 (2025)
    Article Google Scholar
  4. Thakkar, H., Laptev, N., Mousavi, H., Mozafari, B., Russo, V., Zaniolo, C.: SMM: A data stream management system for knowledge discovery. In: Proceedings of the 27th International Conference on Data Engineering, ICDE 2011, April 11-16, 2011, Hannover, Germany, pp. 757–768 (2011)
  5. Girod, L., Mei, Y., Newton, R., Rost, S., Thiagarajan, A., Balakrishnan, H., Madden, S.: Xstream: a signal-oriented data stream management system. In: Proceedings of the 24th International Conference on Data Engineering, ICDE 2008, April 7-12, 2008, Cancún, Mexico, pp. 1180–1189 (2008)
  6. Carney, D., Çetintemel, U., Cherniack, M., Convey, C., Lee, S., Seidman, G., Stonebraker, M., Tatbul, N., Zdonik, S.B.: Monitoring streams - A new class of data management applications. In: Proceedings of 28th International Conference on Very Large Data Bases, VLDB 2002, Hong Kong, August 20-23, 2002, pp. 215–226 (2002)
  7. Wang, H., Zimmermann, R.: Processing of continuous location-based range queries on moving objects in road networks. IEEE Trans. Knowl. Data Eng. 23(7), 1065–1078 (2011)
    Article Google Scholar
  8. Chen, S., Zhou, G., An, X.: An efficient indexing structure for multi-dimensional range query. Frontiers Comput. Sci. 15(4), 154612 (2021)
    Article Google Scholar
  9. Sar, A., Choudhury, T., Choudhury, T., Sati, S., Joshi, P., Aich, S., Pant, B., Dewangan, B.K.: A comparative study and analysis of different optimized indexing algorithms in database management systems. In: 2024 OPJU International Technology Conference (OTCON) on Smart Computing for Innovation and Advancement in Industry 4.0, pp. 1–7 (2024)
  10. Chen, S., Zhou, G., An, X.: An efficient indexing structure for multi-dimensional range query. Frontiers Comput. Sci. 15(4), 154612 (2021)
    Article Google Scholar
  11. Prabhakar, S., Xia, Y., Kalashnikov, D.V., Aref, W.G., Hambrusch, S.E.: Query indexing and velocity constrained indexing: Scalable techniques for continuous queries on moving objects. IEEE Trans. Comput. 51, 1124–1140 (2002)
    Article MathSciNet Google Scholar
  12. Jung, H., Kim, Y.S., Chung, Y.D.: Qr-tree: An efficient and scalable method for evaluation of continuous range queries. Inf. Sci. 274, 156–176 (2014)
    Article MathSciNet Google Scholar
  13. Bhm, C., Ooi, B.C., Plant, C., Yan, Y.: Efficiently processing continuous k-nn queries on data streams. In: Proceedings of the 23rd International Conference on Data Engineering (ICDE 2007), pp. 123–130 (2007)
  14. Jung, H., Kim, Y.-S., Chung, Y.D.: Spqi: An efficient index for continuous range queries in mobile environments. J. Inf. Sci. Eng. 29, 557–578 (2013)
    Google Scholar
  15. Peng, W., Chen, L., Ouyang, X., Xiong, W.: A time-identified r-tree: A workload-controllable dynamic spatio-temporal index scheme for streaming processing. ISPRS International Journal of Geo-Information 13(2), 49 (2024)
    Article Google Scholar
  16. Kraska, T., Beutel, A., Chi, E.H., Dean, J., Polyzotis, N.: The case for learned index structures. In: Proceedings of the 2018 International Conference on Management of Data, SIGMOD Conference 2018, Houston, TX, USA, June 10-15, 2018, pp. 489–504 (2018)
  17. Bayer, R.: Symmetric binary b-trees: Data structure and maintenance algorithms. Acta Informatica 1, 290–306 (1972)
    Article MathSciNet Google Scholar
  18. Ding, J., Minhas, U.F., Yu, J., Wang, C., Do, J., Li, Y., Zhang, H., Chandramouli, B., Gehrke, J., Kossmann, D., Lomet, D.B., Kraska, T.: ALEX: an updatable adaptive learned index. In: Proceedings of the 2020 International Conference on Management of Data, SIGMOD Conference 2020, Online Conference [Portland, OR, USA], June 14-19, 2020, pp. 969–984 (2020)
  19. Tang, C., Wang, Y., Dong, Z., Hu, G., Wang, Z., Wang, M., Chen, H.: Xindex: A scalable learned index for multicore data storage. In: PPoPP ’20: 25th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, pp. 308–320 (2020)
  20. Li, P., Lu, H., Zheng, Q., Yang, L., Pan, G.: Lisa: A learned index structure for spatial data. In: SIGMOD/PODS ’20: International Conference on Management of Data, pp. 2119–2133 (2020)
  21. Wang, H., Fu, X., Xu, J., Lu, H.: Learned index for spatial queries. In: 20th IEEE International Conference on Mobile Data Management, MDM 2019, Hong Kong, SAR, China, June 10-13, 2019, pp. 569–574 (2019)
  22. Ziv, J., Lempel, A.: A universal algorithm for data compression. IEEE Trans. Inf. Theory 23, 337–343 (1977)
    Article MathSciNet Google Scholar
  23. Vaidya, K., Kraska, T., Chatterjee, S., Knorr, E.R., Mitzenmacher, M., Idreos, S.: SNARF: A learning-enhanced range filter. Proc. VLDB Endow. 15(8), 1632–1644 (2022)
    Article Google Scholar
  24. Park, J., Hong, B., Ban, C.: An efficient query index on RFID streaming data. J. Inf. Sci. Eng. 25(3), 921–935 (2009)
    Google Scholar
  25. Chung, Y.D.: An indexing scheme for energy-efficient processing of content-based retrieval queries on a wireless data stream. Information Sciences 177(2), 525–542 (2007)
    Article Google Scholar
  26. Chaudhry, N., Yousaf, M.M.: Exploiting hashing for concurrent query processing and indexing of current location of moving objects. Concurrency and Computation: Practice and Experience (2024). https://doi.org/10.1002/cpe.8013
    Article Google Scholar
  27. Choi, D., Yoon, H., Lee, H., Chung, Y.D.: Waffle: In-memory grid index for moving objects with reinforcement learning-based configuration tuning system. Proc. VLDB Endow. 15(11), 2375–2388 (2022)
    Article Google Scholar
  28. Hadjieleftheriou, M., Manolopoulos, Y., Theodoridis, Y., Tsotras, V.J.: R-trees: A dynamic index structure for spatial searching. In: Encyclopedia of GIS, pp. 1805–1817 (2017)
  29. Gu, T., Feng, K., Cong, G., Long, C., Wang, Z., Wang, S.: The rlr-tree: A reinforcement learning based r-tree for spatial data. Proc. ACM Manag. Data 1(1), 63–16326 (2023)
    Article Google Scholar
  30. Wang, L., Ye, Q., Hu, H., Meng, X.: Pripl-tree: Accurate range query for arbitrary distribution under local differential privacy. Proc. VLDB Endow. 17(11), 3031–3044 (2024)
    Article Google Scholar
  31. Finkel, R.A., Bentley, J.L.: Quad trees: A data structure for retrieval on composite keys. Acta Informatica 4, 1–9 (1974)
    Article Google Scholar
  32. Khames, W., Hadjali, A., Lagha, M.: Parallel continuous skyline query over high-dimensional data stream windows. Distributed Parallel Databases 42, 469–524 (2024)
    Article Google Scholar
  33. Zhu, R., Li, C., Meng, X., Zong, C., Qiu, T.: Continuous group nearest neighbor query over sliding window. In: Advanced Data Mining and Applications. Lecture Notes in Computer Science, vol. 14180, pp. 225–236 (2023)
  34. Salgado, C., Cheema, M.A., Ali, M.E.: Continuous monitoring of range spatial keyword query over moving objects. World Wide Web 21, 687–712 (2018)
    Article Google Scholar
  35. Liu, H., Yan, J., Wang, J., Chen, B., Chen, M., Huang, X.: HGST: A hilbert-geosot spatio-temporal meshing and coding method for efficient spatio-temporal range query on massive trajectory data. ISPRS International Journal of Geo-Information 12(3), 113 (2023)
    Article Google Scholar
  36. Bareche, I., Xia, Y.: A distributed hybrid indexing for continuous KNN query processing over moving objects. ISPRS International Journal of Geo-Information 11, 264 (2022)
    Article Google Scholar
  37. Deng, Z., Wu, X., Wang, L., Chen, X., Ranjan, R., Zomaya, A., Chen, D.: Parallel processing of dynamic continuous queries over streaming data flows. IEEE Trans. Parallel Distrib. Syst. 26, 834–846 (2015)
    Article Google Scholar
  38. Li, P., Hua, Y., Jia, J., Zuo, P.: Finedex: A fine-grained learned index scheme for scalable and concurrent memory systems. Proc. VLDB Endow. 15(2), 321–334 (2021)
    Article Google Scholar
  39. Zhang, H., Andersen, D.G., Pavlo, A., Kaminsky, M., Ma, L., Shen, R.: Reducing the storage overhead of main-memory OLTP databases with hybrid indexes. In: Proceedings of the 2016 International Conference on Management of Data, SIGMOD Conference 2016, San Francisco, CA, USA, June 26 - July 01, 2016, pp. 1567–1581 (2016)
  40. Galakatos, A., Markovitch, M., Binnig, C., Fonseca, R., Kraska, T.: Fiting-tree: A data-aware index structure. In: Proceedings of the 2019 International Conference on Management of Data, SIGMOD Conference 2019, Amsterdam, The Netherlands, June 30 - July 5, 2019, pp. 1189–1206 (2019)
  41. Ferragina, P., Vinciguerra, G.: The pgm-index: a fully-dynamic compressed learned index with provable worst-case bounds. Proc. VLDB Endow. 13(8), 1162–1175 (2020)
    Article Google Scholar
  42. Wu, J., Zhang, Y., Chen, S., Chen, Y., Wang, J., Xing, C.: Updatable learned index with precise positions. Proc. VLDB Endow. 14(8), 1276–1288 (2021)
    Article Google Scholar
  43. Yu, T., Liu, G., Liu, A., Li, Z., Zhao, L.: Lifoss: A learned index scheme for streaming scenarios. World Wide Web 26, 501–518 (2022)
    Article Google Scholar
  44. Yang, G., Liang, L., Hadian, A., Heinis, T.: FLIRT: A fast learned index for rolling time frames. In: Proceedings 26th International Conference on Extending Database Technology, EDBT 2023, Ioannina, Greece, March 28-31, 2023, pp. 234–246 (2023)
  45. Wang, H., Fu, X., Xu, J., Lu, H.: Learned index for spatial queries. In: 20th IEEE International Conference on Mobile Data Management (MDM), pp. 569–574 (2019)
  46. Zhang, S., Ray, S., Lu, R., Zheng, Y.: Spatial interpolation-based learned index for range and knn queries. CoRR abs/2102.06789 (2021) https://arxiv.org/abs/2102.06789
  47. Davitkova, A., Milchevski, E., Michel, S.: The ml-index: A multidimensional, learned index for point, range, and nearest-neighbor queries. In: Proceedings of the 23rd International Conference on Extending Database Technology, EDBT 2020, Copenhagen, Denmark, March 30 - April 02, 2020, pp. 407–410 (2020)
  48. Nathan, V., Ding, J., Alizadeh, M., Kraska, T.: Learning multi-dimensional indexes. In: Proceedings of the 2020 International Conference on Management of Data, SIGMOD Conference 2020, Online Conference [Portland, OR, USA], June 14-19, 2020, pp. 985–1000 (2020)
  49. Ding, J., Nathan, V., Alizadeh, M., Kraska, T.: Tsunami: A learned multi-dimensional index for correlated data and skewed workloads. Proc. VLDB Endow. 14(2), 74–86 (2020)
    Article Google Scholar
  50. Vardakas, G., Likas, A.: Global k-means++: an effective relaxation of the global k-means clustering algorithm. Appl. Intell. 54(19), 8876–8888 (2024)
    Article Google Scholar
  51. Deng, Z., Wang, Y., Liu, T., Dustdar, S., Ranjan, R., Zomaya, A.Y., Liu, Y., Wang, L.: Spatial-keyword skyline publish/subscribe query processing over distributed sliding window streaming data. IEEE Trans. Computers 71(10), 2659–2674 (2022)
    Article Google Scholar
  52. Ramani, V., Chen, J., Yates, R.D.: Age-memory trade-off in read-copy-update. In: IEEE INFOCOM 2024 - IEEE Conference on Computer Communications Workshops, Vancouver, BC, Canada, May 20, 2024, pp. 1–6 (2024)
  53. Kalashnikov, D.V., Prabhakar, S., Hambrusch, S.E.: Main memory evaluation of monitoring queries over moving objects. Distributed and Parallel Databases 15, 117–135 (2004)
    Article Google Scholar

Download references