Research Focus
  • Machine Learning

Research in this area focuses on large-scale data analytics, deep learning modeling, and large-scale model training, which are critical to data-driven intelligence.

  • Optimization

Research in this area focuses on techniques that help optimize complex systems and solve decision-making issues in the real world. For example, these techniques have produced remarkable results in user traffic-based recommendation and the allocation of inventories and resources.

  • Intelligent Time Series

Research in this area focuses on general algorithms for intelligent time series analysis, by leveraging AI technologies to solve the complex real-world problems related to time series data such as forecasting, time series anomaly detection, etc.

  • Artificial Intelligence for IT Operations (AIOps)

Research in this area focuses on intelligent and effective algorithms for large-scale IT operations, including fault detection, root cause analysis, predictive maintenance, autoscaling, resource optimization, etc.

  • Explainable Artificial Intelligence

Research in this area is two fold, where the first is developing intrinsically interpretable models that is understandable to users, and the second is providing explanations for given white-box and black-box models through uncovering their desicion process. We aim to derive trustworthy artificial intelligence technique in high-risk situations and encourage interactions between machines and experts.


Products and Applications
  • MindOpt Optimization Solver

    The MindOpt optimization solver is designed to solve problems in operations and delivers general solver capabilities. MindOpt can find answers to issues such as linear programming, mixed integer programming, and non-linear programming. It also supports black-box optimization and online optimization. Solutions for mathematical modeling and application of solvers are also provided for different industries. The linear programming solver of MindOpt is available to the public and is ranked first in the Linear Programming Benchmark by Hans D. Mittelmann, a renowned scholar whose benchmarks for optimization software are widely accepted.

    Learn more
  • "Daling" System for Computing Resource Optimization

    The Daling system is an intelligent solution oriented towards computing infrastructure. Daling can be integrated into computing resource management systems to provide optimal computing resource usage plans by leveraging machine learning and optimization techniques. In this way, it delivers higher stability and utilization of computing resources.

    The Daling system includes the following modules:

    1)Intelligent O&M, such as predictive maintenance, and anomaly detection and alerting.

    2)Application profiling, such as usage prediction and interference detection

    3)Scheduling, such as optimal resource orchestration, online scheduling, batch scheduling, rescheduling, load balancing, and auto scaling

    4)Resource planning, such as resource capacity planning, and infrastructure planning and simulation During 2017's Double 11, storage scheduling reduced the peak resource usage by 30% and reduced the overall resource usage by 25%. In addition, cluster scheduling raised the overall utilization of CPUs from 70% to 90%.

  • "Longling" System for User Traffic-based Optimization in the Retail Industry

    The Longling system analyzes user behavior to construct features. Paired with an online decision-making module that utilizes user traffic streams, Longling implements recommendations that are optimized and tailored to individual users. As such, smart decision-making based on user traffic can be achieved. Longling is applied to several retail-related services, such as Tmall (shopping), Youku (video streaming), Hema (retail), and Xianyu (secondhand-goods marketplace). During Double 11, Longling plays an integral role in providing personalized recommendations, with over 600 million calls per day.


Academic Achievements
Publications and Presentations
  • Qingsong Wen, Linxiao Yang, Tian Zhou, Liang Sun, "Robust Time Series Analysis and Applications: An Industrial Perspective," in the 28th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD 2022), Washington DC, Aug. 2022 (Tutorial)
  • Qingsong Wen, Linxiao Yang, Tian Zhou, Liang Sun, “Robust Time Series Analysis: from Theory to Applications in the AI Era,” in the 31st International Joint Conference on Artificial Intelligence (IJCAI 2022), Vienna, Austria, Jul. 2022 (Tutorial)
  • Yanwei Fu, Xinwei Sun, Yao Yuan, Wotao Yin, "Sparsity Learning in Neural Networks and Robust Statistical Analysis", in the IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR 2022), New Orleans, LA, Jun. 2022 (Tutorial)
  • Tian Zhou, Ziqing Ma, Qingsong Wen, Xue Wang, Liang Sun, Rong Jin, "FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecasting," in the 39th International Conference on Machine Learning (ICML 2022), Baltimore, Maryland, July 17-23, 2022.
  • Weiqi Chen, Wenwei Wang, Bingqing Peng, Qingsong Wen, Tian Zhou, Liang Sun, "Learning to Rotate: Quaternion Transformer for Complicated Periodical Time Series Forecasting", in the 28th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD 2022), Washington DC, Aug. 2022
  • Yihong Zhou, Zhaohao Ding, Qingsong Wen, Yi Wang, "Robust Load Forecasting towards Adversarial Attacks via Bayesian Learning," IEEE Transactions on Power Systems (TPS), 2022.
  • Longyuan Li, Junchi Yan, Qingsong Wen, Yaohui Jin, and Xiaokang Yang, "Learning Robust Deep State Space for Unsupervised Anomaly Detection in Contaminated Time-Series," IEEE Transactions on Knowledge and Data Engineering (TKDE), 2022.
  • Huajie Qian, Qingsong Wen, Liang Sun, Jing Gu, Qiulin Niu, Zhimin Tang, "RobustScaler: QoS-Aware Autoscaling for Complex Workloads," in Proc. IEEE 38th International Conference on Data Engineering (ICDE 2022), Kuala Lumpur, Malaysia, May 2022.
  • Wei Wang, Liangzhu Ge, Jingqiao Zhang, Cheng Yang. "Improving Contrastive Learning of Sentence Embeddings with Case-Augmented Positives and Retrieved Negatives," in Proc. 45th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2022), Madrid, Spain, July, 2022.
  • Jihai Zhang, Fangquan Lin, Cheng Yang, Wei Wang. "Deep Multi-Representational Item Network for CTR Prediction," in Proc. 45th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2022), Madrid, Spain, July, 2022.
  • Jihai Zhang, Fangquan Lin, Cheng Yang, Wei Jiang. "A new sequential prediction framework with spatial-temporal embedding," in Proc. 45th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2022), Madrid, Spain, July, 2022.
  • Yan Li, Rui Xia, Chunchen Liu, Liang Sun, "A Hybrid Causal Structure Learning Algorithm for Mixed-type Data," In Proc. of the 36th AAAI Conference on Artificial Intelligence (AAAI 2022), 2022.
  • Shuang Li, Qiuwei Li, Local and Global Convergence of General Burer-Monteiro Tensor Optimizations, In Proc. of the 36th AAAI Conference on Artificial Intelligence (AAAI 2022), 2022.
  • Yifei Xu*, Jingqiao Zhang*, Ru He*, Liangzhu Ge*, Chao Yang, Cheng Yang, Ying Nian Wu, SAS: Self-Augmentation Strategy for Language Model Pre-Training, In Proc. of the 36th AAAI Conference on Artificial Intelligence (AAAI 2022), 2022.
  • Samy Wu Fung, Howard Heaton, Qiuwei Li, Daniel McKenzie, Stanley Osher, Wotao Yin, JFB: Jacobian-free backpropagation for implicit networks, In Proc. of the 36th AAAI Conference on Artificial Intelligence (AAAI 2022), 2022.
  • Chaoli Zhang^, Zhiqiang Zhou^, Yingying Zhang^, Linxiao Yang^, Kai He^, Qingsong Wen^, Liang Sun^ (^Equally Contributed), "NetRCA: An Effective Network Fault Cause Localization Algorithm," in Proc. IEEE 47th International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2022), Singapore, May 2022.
  • Jihai Zhang*, Fangquan Lin*, Wei Jiang*, Ziqiang Cui*, Cheng Yang*, Gaoge Liu, Neighbor-Augmented Transformer-based Embedding for Retrieval, in Proc. IEEE 47th International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2022), Singapore, May 2022.
  • Yingying Zhang, Zhengxiong Guan, Huajie Qian, Leili Xu, Hengbo Liu, Qingsong Wen, Liang Sun, Junwei Jiang, Lunting Fan and Min Ke, "CloudRCA: A Root Cause Analysis Framework for Cloud Computing Platforms," in Proc. 30th ACM International Conference on Information and Knowledge Management (CIKM 2021), 2021.
  • Kan Wu, Edward Huang, Mengchang Wang, Meimei Zheng. "Job scheduling of diffusion furnaces in semiconductor fabrication facilities", European Journal of Operational Research, 2021,
  • Tianyi Chen, Yuejiao Sun, Wotao Yin. "Solving stochastic compositional optimization is nearly as easy as solving stochastic optimization", IEEE Transactions on Signal Processing, 69, 4937-4948, 2021.
  • Hanqin Cai, Jialin Liu, and Wotao Yin. "Learned Robust PCA: A Scalable Deep Unfolding Approach for High-Dimensional Outlier Detection", In Advances in Neural Information Processing Systems (NeurIPS 2021).
  • Tianyi Chen, Yuejiao Sun, Wotao Yin. "Communication-Adaptive Stochastic Gradient Methods for Distributed Learning", IEEE Transactions on Signal Processing, 69, 4637-4651, 2021.
  • Xiaohan Chen, Jialin Liu, Zhangyang Wang, and Wotao Yin. "Hyperparameter Tuning is All You Need for LISTA", In Advances in Neural Information Processing Systems (NeurIPS 2021).
  • Xinwei Zhang, Mingyi Hong, Sairaj Dhople, Wotao Yin, Yang Liu. "FedPD: A Federated Learning Framework With Adaptivity to Non-IID Data", IEEE Transactions on Signal Processing, 69, 6055-6070, 2021.
  • Tianyi Chen, Yuejiao Sun, and Wotao Yin. "Closing the Gap: Tighter Analysis of Alternating Stochastic Gradient Methods for Bilevel Problems", In Advances in Neural Information Processing Systems (NeurIPS 2021).
  • Fan Yang, Kai He, Linxiao Yang, Hongxia Du, Jingbang Yang, Bo Yang, Liang Sun. "Learning Interpretable Decision Rule Sets: A Submodular Optimization Approach",  In Advances in Neural Information Processing Systems (NeurIPS 2021).
  • Xinmeng Huang, Kun Yuan, Xianghui Mao, and Wotao Yin. "An Improved Analysis and Rate for Variance Reduction under Without-replacement Sampling Orders",  In Advances in Neural Information Processing Systems (NeurIPS 2021).
  • Bicheng Ying, Kun Yuan, Yiming Chen, Pan Pan, and Wotao Yin. "Exponential Graph is Provably Efficient in Decentralized Deep Training", In Advances in Neural Information Processing Systems (NeurIPS 2021).
  • Kun Yuan, Yiming Chen, Xinmeng Huang, Yingya Zhang, Pan Pan, Yinghui Xu, and Wotao Yin. "DecentLaM: Decentralized Momentum SGD for Large-Batch Deep Training", in Proc. of International Conference on Computer Vision (ICCV 2021).
  • Junhao Hua; Ling Yan; Huan Xu; Cheng Yang. "Markdowns in E-Commerce Fresh Retail: A Counterfactual Prediction and Multi-Period Optimization Approach," in Proc. of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2021). 
  • Yiming Chen, Kun Yuan, Yingya Zhang, Pan Pan, Yinghui Xu, and Wotao Yin. "Accelerating Gossip SGD with Periodic Global Averaging," in Proc. of The 38th International Conference on Machine Learning (ICML 2021).
  • Hanqin Cai, Yuchen Lou, Daniel McKenzie, and Wotao Yin.“A Zeroth-Order Block Coordinate Descent Algorithm for Huge-Scale Black-Box Optimization.”In Proc. of The 38th International Conference on Machine Learning (ICML 2021).
  • Haoxian Chen, Ziyi Huang, Henry Lam, Huajie Qian, and Haofeng Zhang. "Learning prediction intervals for regression: Generalization and calibration." In International Conference on Artificial Intelligence and Statistics, pp. 820-828. (AISTATS 2021)
  • Qingsong Wen, Kai He, Liang Sun, Yingying Zhang, Min Ke, and Huan Xu, "RobustPeriod: Time-Frequency Mining for Robust Multiple Periodicities Detection," in Proc. ACM SIGMOD International Conference on Management of Data (SIGMOD 2021), Xi'an, China, Jun. 2021.
  • Qingsong Wen, Liang Sun, Fan Yang, Xiaomin Song, Junkun Gao, Xue Wang, and Huan Xu, "Time Series Data Augmentation for Deep Learning: A Survey," in Proc. 30th International Joint Conference on Artificial Intelligence (IJCAI 2021), Montreal, Canada, Aug. 2021.
  • Qingyang Xu, Qingsong Wen, Liang Sun, A Two-Stage Framework for Seasonal Time Series Forecasting, in Proc. of IEEE 46th International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2021), Toronto, Canada, June 2021
  • Linxiao Yang, Qingsong Wen, Bo Yang, Liang Sun, A Robust and Efficient Multi-Scale Seasonal-Trend Decomposition, in Proc. of IEEE 46th International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2021), Toronto, Canada, June 2021.
  • Qingsong Wen, Zhengzhi Ma, and Liang Sun, "On Robust Variance Filtering and Change Of Variance Detection," accepted for Oral Presentation, in Proc. of IEEE 45th International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2020), Barcelona, Spain, May 2020. Oral paper.
  • Qingsong Wen, Zhe Zhang, Yan Li and Liang Sun, "Fast RobustSTL: Efficient and Robust Seasonal-Trend Decomposition for Time Series with Complex Patterns," in Proc. of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD 2020), San Diego, CA, Aug. 2020
  • Yifei Zhao, Yu-Hang Zhou, Mingdong Ou, Huan Xu, Nan Li: Maximizing Cumulative User Engagement in Sequential Recommendation: An Online Optimization Perspective. KDD 2020: 2784-2792
  • Guillermo Gallego, Anran Li, Van-Anh Truong, and Xinshang Wang. 2020. “Approximation Algorithms for Product Framing and Pricing.” Operations Research 68 (1): 134-60.
  •  David Simchi-Levi, Rui Sun, and Xinshang Wang. 2019. “Online Matching with Bayesian Rewards.” SSRN Electronic Journal.
  • Rong Jin, David Simchi-Levi, Li Wang, Xinshang Wang, and Sen Yang. 2019. “Shrinking the Upper Confidence Bound: A Dynamic Product Selection Problem for Urban Warehouses.” SSRN Electronic Journal.
  • Zhao Kui, Junhao Hua, Ling Yan, Qi Zhang, Huan Xu, and Cheng Yang. "A Unified Framework for Marketing Budget Allocation." In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 1820-1830. 2019.
  • Yi Peng, Miao Xie, Jiahao Liu, Xuying Meng, Nan Li, Cheng Yang, Tao Yao. A Practical Semi-Parametric Contextual Bandit. International Joint Conference on Artificial Intelligence 2019 (IJCAI)
  • Mingdong Ou, Nan Li, Cheng Yang, Shenghuo Zhu, and Rong Jin. Semi-parametric sampling for stochasitc bandits with many arms. In Proc. of AAAI Conference on Artificial Intelligence 2019 (AAAI)
  • Yu-Hang Zhou, Chen Liang, Nan Li, Cheng Yang, Shenghuo Zhu, Rong Jin. Robust Online Matching with User Arrival Distribution Drift. In Proc. of AAAI Conference on Artificial Intelligence 2019 (AAAI)
  • Qingsong Wen, Jingkun Gao, Xiaomin Song, Liang Sun, Jian Tan. "RobustTrend: A Huber Loss with a Combined First and Second Order Difference Regularization for Time Series Trend Filtering," in Proc. of the 28th International Joint Conference on Artificial Intelligence (IJCAI 2019), pp. 3856-3862, Macao, China, Aug. 2019. Oral paper.
  • Qingsong Wen, Jingkun Gao, Xiaomin Song, Liang Sun, Huan Xu, Shenghuo Zhu. "RobustSTL: A Robust Seasonal-Trend Decomposition Algorithm for Long Time Series," in Proc. of the 33rd AAAI Conference on Artificial Intelligence (AAAI 2019), 2019, pp. 5409-5416, Honolulu, Hawaii, Jan. 2019. Oral paper.
  • Hao Yu and Sen Yang and Shenghuo Zhu, ‘‘Parallel Restarted SGD with Faster Convergence and Less Communication: Demystifying Why Model Averaging Works for Deep Learning," AAAI Conference on Artificial Intelligence (AAAI 2019)
  • Hao Yu and Rong Jin and Sen Yang, ‘‘On the Linear Speedup Analysis of Communication Efficient Momentum SGD for Distributed Non-Convex Optimization," International Conference on Machine Learning (ICML 2019)
  • Hao Yu and Rong Jin ‘‘On the Computation and Communication Complexity of Parallel SGD with Dynamic Batch Sizes for Stochastic Non-Convex Optimization," International Conference on Machine Learning (ICML 2019)
  • Cong Leng, Hao Li, Shenghuo Zhu, Rong Jin. Extremely Low Bit Neural Network: Squeeze the Last Bit Out with ADMM. In: Proceedings of the 32rd AAAI Conference on Artificial Intelligence (AAAI, 18), New Orleans, LA, 2018.
  • Ao Zhang, Nan Li, Jian Pu, Jun Wang, Junchi Yan, Hongyuan Zha. tau-FPL: Tolerance-Constrained Learning in Linear Time. In: Proceedings of the 32rd AAAI Conference on Artificial Intelligence (AAAI, 18), New Orleans, LA, 2018.
  • Qi Qian, Jisheng Tang, Hao Li, Shenghuo Zhu and Rong Jin. Large-scale Distance Metric Learning with Uncertainty. In: Proceedings of the 31th IEEE Conference on Computer Vision and Pattern Recognition (CVPR, 18), Salt Lake City, UT, 2018.
  • Mingdong Ou, Nan Li, Shenghuo Zhu, Rong Jin. Multinomial Logit Bandit with Linear Utility Functions. In: Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI, 18), 2018.
  • Yang Yu, Wei-Yang Qu, Nan Li, and Zimin Guo. Open category classification by adversarial sample generation. In: Proceedings of the 26th International Joint Conference on Artificial Intelligence (IJCAI, 17), Melbourne, Australia, 2017.
Expand
Competition
  • 2022: ICASSP Grand Challenges, Root Cause Analysis for Wireless Network Fault Localization, First Place
  • 2022: GECCO Evolutionary Computation Competition, Risk-based Energy Scheduling, First Place
  • 2022: KDD Cup, Spatial Dynamic Wind Power Forecasting Challenge, Top 1%
  • 2021: NeurIPS Machine Learning for Combinatorial Optimization (ML4CO) Competition, Configuration Task, Runner-up
  • 2021: NeurIPS Machine Learning for Combinatorial Optimization (ML4CO) Competition, Primal Task, Third Place
  • 2021: State Grid AI Innovation Competition In Power Dispatch And Control, Intelligent Arrangement of Grid Operation, First Place
  • 2021: State Grid AI Innovation Competition In Power Dispatch And Control, New Energy Power Generation Forecasting, Runner-up
  • 2021: General Language Understanding Evaluation (GLUE) Benchmark, First Place
  • 2021: KDD Cup, Multi-dataset Time Series Anomaly Detection, Top 1%
  • 2021: International AIOps Challenge, Runner-up
  • 2020: Linear Programming Benchmark, First Place
  • 2018: PASCAL VOC Target Detection Competition, First Place

Scan QR code
关注Ali TechnologyWechat Account