1
$\begingroup$

I am looking for an efficient method to visualize measured time series data with about 100.000 data points per year, such that eye-catching data points may interactively be tagged as suspicious, e.g. using the mouse button. The problem I have in other software environments is that the process of updating the data point status (suspicous / OK) takes much too long time, at least, if several time series are displayed at once (which is necessary). Is there any way in Mathematica to handle these large amounts of data in an efficient way?

$\endgroup$

closed as too broad by m_goldberg, Bill Watts, MarcoB, Pinti, Alex Trounev Feb 9 at 14:50

Please edit the question to limit it to a specific problem with enough detail to identify an adequate answer. Avoid asking multiple distinct questions at once. See the How to Ask page for help clarifying this question. If this question can be reworded to fit the rules in the help center, please edit the question.

  • 2
    $\begingroup$ If you want to have it fast and in Mathematica, then don't make it interactive. Instead, make a plot, guess what the charactistics of the outliers are, develop appropriate filter criteria, and filter them out (e.g., by using Pick) in conjunction with these filters. This might sound very abstract but in view of the lack of an appropriate example dataset, that's all I can do for you at the moment. $\endgroup$ – Henrik Schumacher Feb 6 at 14:34
  • 1
    $\begingroup$ Have you seen this or this and related/linked posts there? $\endgroup$ – gwr Feb 6 at 14:35
  • 1
    $\begingroup$ I'm pretty sure you could reduce the number of points you need to plot trivially, but would have to see what the data actually looks like in order to suggest something. $\endgroup$ – C. E. Feb 6 at 17:11
  • $\begingroup$ I will load up my data in a minute - the problem is that the data need to be checked as such and in combination with other quantities, since it is not that trivial to detect the causes for erroneous measurements without this. The three columns with water content should at least be displayed at the same time and also the meteorological variables. $\endgroup$ – SvendeS Feb 7 at 10:42
  • $\begingroup$ The problem is that several time series are necessary to decide wheather a data point needs to be delete or not. I have put and example dataset on hidrive.strato.com/lnk/EdEOHzUi . At least the 3 water content time series and the meteorological variables are necessary to be displayed at once. $\endgroup$ – SvendeS Feb 7 at 11:19