TensorLOB: Structure-Preserving Tensor Learning for Limit Order Book Forecasting
Yuxuan Gu, Danilo Mandic
arXiv:2611.02866v1The problem this paper tackles is very familiar in market microstructure: given a stream of limit order book updates, can we predict the next short-term mid-price move well enough to matter for market making, execution, or high-frequency risk control? That sounds narrow, but it is a core problem. If you can anticipate whether the mid-price is more likely to go up, down, or stay put over the next few horizons, you can improve quoting decisions, reduce adverse selection, and manage inventory and execution timing more intelligently. The challenge is that limit order book data are noisy, highly non-stationary, and class-imbalanced. Most of the time, the next move is not a clean, large directional jump. It is subtle structure buried in a sequence of order submissions, cancellations, and executions. And the data itself has a natural geometry: there is time, there are two sides of the book, there are ordered price levels on each side, and there are attributes such as price and volume. In other words, the LOB is not just a flat feature vector. It is a multiway object. That point is the central motivation of the paper. The authors argue that many strong existing models still flatten the book into a matrix or vector before processing it. DeepLOB-style convolutional and recurrent models, attention-based variants, and bilinear methods like TABL all do well, but they generally collapse economically meaningful dimensions into one feature axis. Once you flatten the book, the model has to rediscover from data what it means for two observations to share the same side, the same price level, or the same time position. The inductive bias is weaker than it could be. TensorLOB is the authors’ answer to that issue. The model is designed to stay in the tensor domain from start to finish. The input is the most recent 100 LOB events, arranged as a four-dimensional tensor with time, side, level, and attribute modes. In their setup, the side mode has ask and bid, the level mode covers 10 price levels, and the attribute mode includes price and volume. Rather than flattening this into a single long vector, TensorLOB preserves that structure throughout feature extraction and classification. The intuition is simple but important: if the book is naturally multiway, then the network should learn in a way that respects those modes. That lets the model encode relationships more directly. For example, two entries at the same event share the same temporal factor, and if they are also at the same price level, they share the level factor as well. So the model ties parameters according to the book’s structure instead of assigning an independent weight to every flattened coordinate pair. The architecture has three main parts. First is a mode-aware normalization step, inspired by bilinear normalization. The authors normalize the input from two complementary views: a temporal view that normalizes each book entry across the time axis, and a cross-sectional view that normalizes the state within each event across the non-temporal modes. Those two normalized tensors are then combined with learned non-negative weights. This is meant to handle scale variation both over time and across the book snapshot. Second is the feature extraction stack. TensorLOB uses two multi-head tensor projection layers. Each layer performs mode-wise tensor contractions, which is the tensor analogue of applying a structured linear map. The key idea is that all heads share the same transformation along the temporal mode, but each head learns distinct projections along side, level, and attribute. So instead of one monolithic projection, you get multiple heads capturing complementary interaction patterns in parallel. The paper also points out that this tensor contraction is equivalent to a Kronecker-factorized linear transformation after vectorization. That equivalence matters because it shows TensorLOB is not just an arbitrary tensor trick; it is a structured, parameter-efficient way of representing a large linear map. But the computation is done directly on the tensor, preserving the modes explicitly. The two feature extraction layers progressively compress the temporal dimension while expanding the learned attribute dimension. In the reported configuration, the first layer maps the input from 100 by 2 by 10 by 2 to 35 by 2 by 10 by 6, and the second maps that to 20 by 2 by 10 by 12. So the model is not trying to preserve every raw time step equally. It compresses temporal history into a learned representation while keeping the side and level structure intact. After each projection, the representation is normalized along the attribute mode, passed through GELU, and regularized with dropout. So the network is still a neural model in the usual sense; the novelty is in how the linear algebra is structured. Third is the classifier. Instead of flattening the final tensor and feeding it to a dense layer, TensorLOB maps the tensor directly to class logits. Each class gets its own coefficient tensor, and that tensor is parameterized with a low-rank CP decomposition. CP decomposition represents a tensor as a sum of rank-one outer products, which is a standard way to keep the classifier compact while still respecting the multiway structure. So the final prediction layer also stays tensor-native. In terms of experimentation, the paper evaluates on the FI-2010 benchmark, which is a widely used dataset for LOB movement prediction. The task is to forecast mid-price movement over multiple horizons. The authors compare TensorLOB against state-of-the-art baselines, including vectorized convolutional/recurrent models and bilinear approaches. The paper emphasizes four evaluated horizons, and the model is tested across them consistently. The key results are straightforward: TensorLOB achieves the highest accuracy, recall, and F1 score across all four horizons. The paper specifically highlights mean accuracy, weighted recall, and weighted F1 as the metrics where it leads. That consistency is important. In LOB forecasting, it is easy to get one metric to move a little while others degrade, especially under class imbalance. Here the claim is not just that TensorLOB wins on one horizon or one metric, but that it shows broad gains across the benchmark settings. What does that actually tell us? First, it suggests that preserving the native structure of the order book is a useful inductive bias. The model is not merely larger or more complex; it is better aligned with the data geometry. Second, because the gains show up across accuracy, recall, and F1, the improvement is not just an artifact of predicting the majority class more often. Weighted F1 and recall are especially relevant in an imbalanced setting, so improvement there indicates more balanced classification quality. The paper is careful to frame this as a proof of concept rather than a final answer to LOB forecasting. That is an important limitation. The benchmark is FI-2010, which is standard, but it is still one benchmark. We should be cautious about generalizing the result to other assets, other venues, or more modern market regimes without further testing. LOB data are notoriously sensitive to sampling choices, labeling schemes, and horizon definitions, so out-of-sample robustness across instruments and time periods is the real test. Another limitation is that structure-preserving tensor models can be elegant, but they also introduce design choices about how to contract modes, how many heads to use, and how to choose low-rank sizes. Those choices can affect performance and interpretability. Also, while the Kronecker and CP parameterizations reduce the parameter burden relative to an unrestricted dense tensor, the model still needs careful tuning, and the practical latency of tensor operations matters if one were to consider deployment in a live high-frequency environment. Still, the broader contribution is conceptually strong. The paper makes a clear case that financial market data often have latent multiway structure, and that flattening can throw away useful inductive bias before learning even begins. TensorLOB shows that if you preserve the time, side, level, and attribute modes explicitly, you can build a model that is both structured and parameter-efficient, and that this can translate into better predictive performance on a standard benchmark. So the takeaway is not that tensors magically solve LOB forecasting. The takeaway is that representation matters, and in a domain like market microstructure, respecting the native geometry of the data can be a real advantage. TensorLOB is a strong demonstration of that idea, and it opens the door to more high-dimensional, structure-aware modeling of financial time series and order book dynamics.
Other candidates that day
Previous AI trading papers