Dynamical Deep Generative Latent Modeling of 3D Skeletal Motion (original) (raw)
References
Ackerson, G., & Fu, K. (1970). On state estimation in switching environments. IEEE Transactions on Automatic Control,15(1), 10–17. Article Google Scholar
Bahadori, M. T., Yu, Q. R., & Liu, Y. (2014). Fast multivariate spatio-temporal analysis via low rank tensor learning. In Advances in neural information processing systems (pp. 3491–3499).
Barbič, J., Safonova, A., Pan, J. Y., Faloutsos, C., Hodgins, J. K., & Pollard, N. S. (2004). Segmenting motion capture data into distinct behaviors. In Proceedings of graphics interface (pp. 185–194). Citeseer.
Becker, P., Pandya, H., Gebhardt, G., Zhao, C., Taylor, C. J., & Neumann, G. (2019). Recurrent Kalman networks: Factorized inference in high-dimensional deep feature spaces. In International conference on machine learning (pp. 544–552).
Becker-Ehmck, P., Peters, J., & Van Der Smagt, P. (2019). Switching linear dynamics for variational Bayes filtering. In International conference on machine learning (pp. 553–562).
Bergou, A. J., Swartz, S. M., Vejdani, H., Riskin, D. K., Reimnitz, L., Taubin, G., & Breuer, K. S. (2015). Falling with style: Bats perform complex aerial rotations by adjusting wing inertia. PLoS Biology,13(11), e1002297. Article Google Scholar
Birch, M. C., Quinn, R. D., Hahm, G., Phillips, S. M., Drennan, B., Fife, A., Verma, H., & Beer, R. D. (2000). Design of a cricket microrobot. In Proceedings 2000 ICRA. Millennium conference. IEEE international conference on robotics and automation. Symposia proceedings (Cat. No. 00CH37065, vol. 2, pp. 1109–1114). IEEE.
Blender Online Community. (2020). Blender—A 3D modelling and rendering package. Blender Foundation, Blender Institute, Amsterdam. http://www.blender.org
Cai, Y., Tong, H., Fan, W., Ji, P., & He, Q. (2015) Facets: Fast comprehensive mining of coevolving high-order time series. In ACM SIGKDD international conference on knowledge discovery and data mining (pp. 79–88).
Chang, C. B., & Athans, M. (1978). State estimation for discrete systems with switching parameters. IEEE Transactions on Aerospace and Electronic Systems,3, 418–425. ArticleMathSciNet Google Scholar
Chang, Y. Y., Sun, F. Y., Wu, Y. H., & Lin, S. D. (2018). A memory-network based solution for multivariate time-series forecasting. arXiv preprint arXiv:1809.02105
Chen, L., Amiri, S. E., & Prakash, B. A. (2018). Automatic segmentation of data sequences. In Proceedings of the AAAI conference on artificial intelligence.
Farnoosh, A., Azari, B., & Ostadabbas, S. (2020). Deep switching auto-regressive factorization: Application to time series forecasting. arXiv preprint arXiv:2009.05135
Farnoosh, A., Rezaei, B., Sennesh, E. Z., Khan, Z., Dy, J., Satpute, A., Hutchinson, J. B., van de Meent, J. W., & Ostadabbas, S. (2020). Deep Markov spatio-temporal factorization. arXiv preprint arXiv:2003.09779
Fox, E., Sudderth, E. B., Jordan, M. I., & Willsky, A. S. (2009). Nonparametric Bayesian learning of switching linear dynamical systems. In Advances in neural information processing systems (pp. 457–464).
Fraccaro, M., Kamronn, S., Paquet, U., & Winther, O. (2017). A disentangled recognition and nonlinear dynamics model for unsupervised learning. In Advances in neural information processing systems (pp. 3601–3610).
Fragkiadaki, K., Levine, S., Felsen, P., & Malik, J. (2015). Recurrent network models for human dynamics. In Proceedings of the IEEE international conference on computer vision (pp. 4346–4354).
Ghahramani, Z., & Hinton, G. E. (1996). Switching state-space models. Tech. rep., Citeseer.
Gong, C., Travers, M. J., Astley, H. C., Li, L., Mendelson, J. R., Goldman, D. I., & Choset, H. (2016). Kinematic gait synthesis for snake robots. The International Journal of Robotics Research,35(1–3), 100–113. Article Google Scholar
Gong, D., Medioni, G., & Zhao, X. (2013). Structured time series analysis for human action segmentation and recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence,36(7), 1414–1427. Article Google Scholar
Hamilton, J. D. (1990). Analysis of time series subject to changes in regime. Journal of Econometrics,45(1–2), 39–70. ArticleMathSciNet Google Scholar
Hoff, J., Ramezani, A., Chung, S. J., & Hutchinson, S. (2016). Synergistic design of a bio-inspired micro aerial vehicle with articulated wings. In Robotics: science and systems.
Hoffman, M. D., Blei, D. M., Wang, C., & Paisley, J. (2013). Stochastic variational inference. The Journal of Machine Learning Research,14(1), 1303–1347. MathSciNetMATH Google Scholar
Jolliffe, I. T. (1986). Principal components in regression analysis. In Principal component analysis (pp. 129–155). Springer.
Karl, M., Soelch, M., Bayer, J., & van der Smagt, P. (2017). Deep variational Bayes filters: Unsupervised learning of state space models from raw data. Stat,1050, 3. Google Scholar
Kingma, D. P., & Ba, J. (2014). Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980
Kingma, D. P., & Welling, M. (2014). Auto-encoding variational Bayes. Stat,1050, 1. MATH Google Scholar
Krishnan, R. G., Shalit, U., & Sontag, D. (2017). Structured inference networks for nonlinear state space models. In 31st AAAI conference on artificial intelligence.
Krüger, B., Vögele, A., Willig, T., Yao, A., Klein, R., & Weber, A. (2016). Efficient unsupervised temporal segmentation of motion data. IEEE Transactions on Multimedia,19(4), 797–812. Article Google Scholar
Lai, G., Chang, W. C., Yang, Y., & Liu, H. (2018). Modeling long-and short-term temporal patterns with deep neural networks. In ACM SIGIR conference on research and development in information retrieval (pp. 95–104).
Li, S., Jin, X., Xuan, Y., Zhou, X., Chen, W., Wang, Y. X., & Yan, X. (2019). Enhancing the locality and breaking the memory bottleneck of transformer on time series forecasting. In Advances in neural information processing systems.
Linderman, S., Johnson, M., Miller, A., Adams, R., Blei, D., & Paninski, L. (2017). Bayesian learning and inference in recurrent switching linear dynamical systems. In Artificial intelligence and statistics (pp. 914–922).
Meshry, M., Hussein, M. E., & Torki, M. (2016). Linear-time online action detection from 3d skeletal data using bags of gesturelets. In 2016 IEEE winter conference on applications of computer vision (WACV) (pp. 1–9). IEEE.
Min, J., & Chai, J. (2012). Motion graphs++ a compact generative model for semantic motion analysis and synthesis. ACM Transactions on Graphics (TOG),31(6), 1–12. Article Google Scholar
Murphy, K. P. (1998). Switching Kalman filters. Citeseer.
Nakamura, T., Nagai, T., Mochihashi, D., Kobayashi, I., Asoh, H., & Kaneko, M. (2017). Segmenting continuous motions with hidden semi-Markov models and gaussian processes. Frontiers in Neurorobotics,11, 67. Article Google Scholar
Nassar, J., Linderman, S., Bugallo, M., & Park, I. (2019). Tree-structured recurrent switching linear dynamical systems for multi-scale modeling. In International conference on learning representations (ICLR).
Papoutsakis, K., Panagiotakis, C., & Argyros, A. A. (2017). Temporal action co-segmentation in 3d motion capture data and videos. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 6827–6836).
Paszke, A., Gross, S., Chintala, S., Chanan, G., Yang, E., DeVito, Z., Lin, Z., Desmaison, A., Antiga, L., & Lerer, A. (2017). Automatic differentiation in pytorch. In NIPS 2017 workshop.
Patrona, F., Chatzitofis, A., Zarpalas, D., & Daras, P. (2018). Motion analysis: Action detection, recognition and evaluation based on motion capture data. Pattern Recognition,76, 612–622. Article Google Scholar
Ranganath, R., Wang, C., David, B., & Xing, E. (2013). An adaptive learning rate for stochastic variational inference. In International conference on machine learning (pp. 298–306).
Rangapuram, S. S., Seeger, M. W., Gasthaus, J., Stella, L., Wang, Y., & Januschowski, T. (2018). Deep state space models for time series forecasting. In Advances in neural information processing systems (pp. 7785–7794).
Riskin, D. K., Willis, D. J., Iriarte-Díaz, J., Hedrick, T. L., Kostandov, M., Chen, J., Laidlaw, D. H., Breuer, K. S., & Swartz, S. M. (2008). Quantifying the complexity of bat wing kinematics. Journal of Theoretical Biology,254(3), 604–615. Article Google Scholar
Salinas, D., Flunkert, V., Gasthaus, J., & Januschowski, T. (2020). Deepar: Probabilistic forecasting with autoregressive recurrent networks. International Journal of Forecasting,36(3), 1181–1191. Article Google Scholar
Santello, M., Flanders, M., & Soechting, J. F. (1998). Postural hand synergies for tool use. Journal of Neuroscience,18(23), 10105–10115. Article Google Scholar
Sen, R., Yu, H. F., & Dhillon, I. S. (2019). Think globally, act locally: A deep neural network approach to high-dimensional time series forecasting. In Advances in neural information processing systems (pp. 4837–4846).
Sun, J. Z., Parthasarathy, D., & Varshney, K. R. (2014). Collaborative Kalman filtering for dynamic matrix factorization. IEEE Transactions on Signal Processing,62(14), 3499–3509. ArticleMathSciNet Google Scholar
Sun, L., & Chen, X. (2019). Bayesian temporal factorization for multidimensional time series prediction. arXiv preprint arXiv:1910.06366
Takeuchi, K., Kashima, H., & Ueda, N. (2017). Autoregressive tensor factorization for spatio-temporal predictions. In 2017 IEEE international conference on data mining (ICDM) (pp. 1105–1110). IEEE.
Wang, J. M., Fleet, D. J., & Hertzmann, A. (2007). Gaussian process dynamical models for human motion. IEEE Transactions on Pattern Analysis and Machine Intelligence,30(2), 283–298. Article Google Scholar
Wang, Z., Chai, J., & Xia, S. (2019). Combining recurrent neural networks and adversarial training for human motion synthesis and control. IEEE Transactions on Visualization and Computer Graphics,27(1), 14–28. Article Google Scholar
Watter, M., Springenberg, J., Boedecker, J., & Riedmiller, M. (2015). Embed to control: A locally linear latent dynamics model for control from raw images. In Advances in neural information processing systems (pp. 2746–2754).
Wu, Z., Liu, W., & Xing, W. (2017). A novel method for human motion capture data segmentation. In 2017 IEEE 15th intl. conf. on dependable, autonomic and secure computing, 15th intl. conf. on pervasive intelligence and computing, 3rd intl. conf. on big data intelligence and computing and cyber science and technology congress (DASC/PiCom/DataCom/CyberSciTech) (pp. 780–787). IEEE.
Xia, G., Sun, H., Feng, L., Zhang, G., & Liu, Y. (2017). Human motion segmentation via robust kernel sparse subspace clustering. IEEE Transactions on Image Processing,27(1), 135–150. ArticleMathSciNet Google Scholar
Xia, G., Chen, B., Sun, H., & Liu, Q. (2020). Nonconvex low-rank kernel sparse subspace learning for keyframe extraction and motion segmentation. IEEE Transactions on Neural Networks and Learning Systems,32(4), 1612–1626. ArticleMathSciNet Google Scholar
Yu, H. F., Rao, N., & Dhillon, I. S. (2016). Temporal regularized matrix factorization for high-dimensional time series prediction. In Advances in neural information processing systems (pp. 847–855).
Zhou, F., De la Torre, F., & Hodgins, J. K. (2012). Hierarchical aligned cluster analysis for temporal clustering of human motion. IEEE Transactions on Pattern Analysis and Machine Intelligence,35(3), 582–596. Article Google Scholar
Zhou, T., Fu, H., Gong, C., Shen, J., Shao, L., & Porikli, F. (2020). Multi-mutual consistency induced transfer subspace learning for human motion segmentation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (pp 10277–10286).