18 karma · joined January 4, 2019
One reviewer wrote (word for word) "you will get in bad trouble if you publish this"
[a] Time Warps, String Edits, and Macromolecules The Theory and Practice of Sequence Comparison David Sankoff and Joseph Kruskal, with introduction by John Nerbonne
[a] Matrix Profile XXX: MADRID: A Hyper-Anytime Algorithm to Find Time Series Anomalies of all Lengths. Yue Lu, Thirumalai Vinjamoor Akhil Srinivas, Takaaki Nakamura, Makoto Imamura, and Eamonn Keogh. ICDM 2023.
A paper published today finds an anomaly in an "InternalBleeding" dataset, after setting eighteen parameters [a].
Could we find the anomaly with a completely parameter-free algorithm? As the figure below shows, the answer is YES, if you use MADRID [b].
One line of code >>MADRID(UCRAnomalyInternalBleeding)
So Yes, simple is better.
[a] Learning Rate, Dropout Rate, Dim Feedforward, Batch Size, Encoder Layers, Decoder Layers, Activation Func, Time Warping, Time Masking, Gaussian Noise, Linear Embedding, Phase Type, Self Conditioning, Layer Norm, Pos. Enc. Type, FFN Layers, Window Size.
[b] https://www.dropbox.com/scl/fi/hd9gt0xs8v8mrsx3upwd3/ICDM23_...
There is also a video here [b]
[a] https://www.dropbox.com/scl/fi/cwduv5idkwx9ci328nfpy/Problem...
“…itself…and hence the very meaning of life itselfish bastard, I'll kick him… selfish…” Here there is a motif “itself” and there is a motif “selfish”. Note that one occurrence of each motif appears overlapping in “itselfish”. --- Now for the first case: “….soihsehihrhewCOMICOMICireoqiwwherhqwe…”
Here we have a motif “COMIC”, but they share a letter, the central ‘C’. We can allow motifs to share more letters, but they cannot share ALL letters, that would be a trivial match.
The matrix profile has a simple parameter (the exclusion zone) that lets you control how much overlap you want to allow.