Questions on systematic data handling and analysis, including data correction, manipulation, or selection of user-data or built-in data available with Mathematica.

learn more… | top users | synonyms

2
votes
2answers
92 views

How to created visualization dashboard for summary data?

I would like to create the following dashboard: The numbers indicate my desired dimensions for the cells. I would like the cells to contain a regional plot, a trend line, and bar charts. I have ...
1
vote
1answer
103 views

Find intersections points with axes

Let's create some points corresponding to a simple closed curve ...
4
votes
0answers
74 views

File Formats for Scientific Data

I have a simulation written in another language which currently just dumps all its data (doubles, lists of doubles, lists of lists of doubles) in lines in ASCII, and then I read it into Mathematica by ...
3
votes
1answer
145 views

How to normalize histogram height to unity?

When doing Histogram[data], I get the total nummber of counts in each bin. Doing Histogram[data,Automatic,"Probability"] ...
1
vote
2answers
144 views

Handling big data in Mathematica 10 [closed]

I have a huge amount of data saved in a .txt file (153 MB, ~7300000 rows). What I want in the end is a list like ...
1
vote
2answers
110 views

depicting specific element of a table (knowing its position) in different color

there is some 20 Time 20 tables, in each step we choose one element randomly. how can show this random selected element with different color?
4
votes
2answers
104 views

Parsing tab delimited file

Problem Description I have my data arranged in a tab delimited file and I'm trying to parse/access certain parts of it. As an example, I'd like to extract the number of points and the sampling ...
0
votes
1answer
147 views

How to fit multiple Gaussian peaks to data [duplicate]

How would I fit this data with Gaussian Peaks? I have tried various codes but none have even worked. Note: If I do Log[data], the peaks are more visible (I have tried the method from here but it got ...
1
vote
1answer
116 views

Fitting multiple peaks

I am using the code found here to fit multiple peaks of a large dataset which I don't know anything about. This was the only code I could find on the internet to do such a thing. So this is my attempt ...
0
votes
0answers
21 views

Remove background from multipeak data [duplicate]

Let's say I have a a very large list of data in the format {{n,f[n]}} so something like {{1,600},{2,700},{3,1100}...} and if this data is plotted, then it will look like a sum of Gaussian functions+a ...
5
votes
3answers
238 views

Removing background from peak function

Let's say I have a a very large list of data in the format {{n,f[n]}} so something like {{1,600},{2,700},{3,1100}...} and if this data is plotted, then it will look like a sum of Gaussian functions+a ...
2
votes
2answers
90 views

Plotting cones from data read from a file

I would like to plot cones centered at specific points in a lattice and with different orientations and colors that depend on them. For this, I have the data in an external file with 11 columns: 1) ...
3
votes
0answers
91 views

Data smoothing in three dimensions

I have data with statistical fluctuations of the form $f(x_i,y_i)$ over a discrete grid. I now need the values of $f(x,y)$ also at points other than the grid points. That can be achieved by ...
2
votes
1answer
109 views

Collecting Data in table

I wrote a program (with help of the stackexchange) that is supposed to run in a loop. Each time the program runs, it exports a small data. Is it possible to generate a table where each run adds the ...
2
votes
1answer
93 views

simple contour plot with variable thickness

I have a data set on the form of 3 spatial coordinates x,y,z and an amplitude. Here is a small crop of the data, : ...
3
votes
3answers
173 views

Making large calculation results persistent

Very often, I need to do same calculations under different parameters for comparing the results. Every calculation may generate a large data set; for example, the calculation result of ...
0
votes
1answer
75 views

How to import columns of data (.mat file)

I have a two 100x2 .mat file and I would like to get the elements stored as pairwise entries i.e. something like data = [{a1,b1},{a2,b2}..{a100,b100}]. Can someone help me do this efficiently?
3
votes
1answer
191 views

Animating N points

So I'm trying to create an animation of N interacting particles in two dimensions confined in a box. Generating the data is fine and it's being stored in a text file with two columns for each ...
3
votes
3answers
217 views

flipping y axis

I know that some topics were created for this subject but any solution works for me. I would like to reverse the y axis. By this I mean that I would like to have the highest values at the bottom and ...
12
votes
2answers
548 views

Construct a master curve from data

I will try to be as informative as possible. Clear["Global`*"] I have the following data ...
7
votes
5answers
534 views

How to extract points from a closed curve

OK, let's create a simple closed curve C0 = ContourPlot[x^2/4 + y^2/9 == 1, {x, -5, 5}, {y, -5, 5}]; and let's plot the corresponding points ...
2
votes
2answers
276 views

Put markers in the maximum values in a Plot

I have made my graph of a list of data with the following code: ListLinePlot[data, PlotMarkers -> {Automatic, 10}] So this way I can see some markers in the ...
4
votes
1answer
176 views

Drawing a RegionPlot but for data instead of a function

I am trying to draw something similar to RegionPlot, but instead of functions I only have data matrices. For example, I have the following 3 pieces of data ...
3
votes
1answer
173 views

Use Kalman filter to predict

Here is a set of altitude data I collected with an Arduino sensor BMP-180 on a board CanSat data = {13.15, 13.4, 13.15, 13.31, 13.4, 13.31, 13.15,.....} how can ...
3
votes
1answer
228 views

Import a table from a text file or string

XYScan produces results in the following form (as *.txt): ...
0
votes
1answer
34 views

Help with data manipulation

I'm fairly new to Mathematica and I'm trying to manipulate some data but its not going very well. I want to import a text file into Mathematica(its a list of chapter headings and page numbers of a ...
14
votes
2answers
321 views

upper envelope of data

Here is a ListPlot[] of some data. Clearly, there is a fairly smooth upper envelope - the question is whether there is an nice way of extracting it...
2
votes
3answers
191 views

data manipulation in log-log scale

Say that I have the following: y[t_] := 2 + (2/10)*(1 - Exp[-t/11]) timedat = N[Table[{t, y[t]}, {t, 0, 10, 1/1000}]]; How is it possible to construct an ...
2
votes
2answers
55 views

Implementing BinCounts for alphabetical structures

Is it possible to implement BinCounts for alphabets such that those alphabets which fall into the group {a,b,c,d} can be counted ...
7
votes
3answers
199 views

Fitting data with interdependence

I have an issue, of which I'm not sure it can be solved, with or without Mathematica. I feel as if it should be possible, but I'm quite clueless as to how. Some introduction is required. I'm working ...
3
votes
2answers
184 views

Automatically detect higher slope in numerical data (within a certain range)

Suppose the dataset data is part of some simulations whose results should follow a certain model. Here is data and its ...
6
votes
1answer
179 views

How to avoid creating negative values when using Interpolation?

I'm having some problems with Interpolation. I'm trying to interpolating some measurements data into mathematica. But using Interpolation will create some negative data, which is actually not possible ...
6
votes
0answers
113 views

Can Predict/Classify be parallelized?

Being able to parallelize Predict /Classify would be useful on multiple fronts: Performance/Scale Streaming Pedagogical ...
3
votes
0answers
78 views

How to export to NetCDF format

Consider I have a scalar field on a grid f(x,y), where x and y can take values ...
2
votes
2answers
62 views

Converting data set from one form to another

I wish to convert Data to Data2. Both sets are provided below. Note that the second set has an arbitrary parameter "t". How can this be done. ...
0
votes
1answer
42 views

Determine what a sound snippet contains?

The function SystemDialogInput["RecordSound"] brings up an interface that lets you record a sound object. Let's say we first record a one second long snippet of ...
0
votes
1answer
34 views

How can I plot a function of imported data that ends up nested in lists four deep? [closed]

I imported a file of data from a model that I am running for my research. It produces the following output in Mathematica: ...
18
votes
0answers
341 views

How does Dataset compare to DataFrame in pandas?

Pandas is a Python package providing fast, flexible, and expressive data structures designed to make working with “relational” or “labeled” data. Just like ...
2
votes
1answer
108 views

Still more problems with Fitting, please help

I'm in a little over my head here and I'm fully aware of it, so I'm hoping for some help. I've been assigned to a project where I am given data: http://www.pastebin.ca/3061136 (Example Data) I ...
2
votes
1answer
59 views

BinaryWrite negative numbers [closed]

testList = {1, 2, 3, 4}; file = "test1"; BinaryWrite[file, testList]; BinaryReadList[file] Close[file]; Gives {1, 2, 3, 4} ...
4
votes
6answers
698 views

How to smooth the noise

This is a sample data ...
-1
votes
1answer
191 views

NonlinearModelFit errors and precision

For this problem, I use a data set, which I've made available here. ...
1
vote
1answer
106 views

Importing a spreadsheet with infinity values from Excel

I have imported a spreadsheet from Excel that I want to use as an adjacency matrix. I want to use this matrix as the argument in WeightedAdjacencyGraph, so I have ...
1
vote
2answers
202 views

Plotting data from multiple text files

I'm new to mathematica and stack exchange, so any help would be appreciated. I want to plot a bunch of data from text files that contain a lot of extraneous data. I have a hundred files with different ...
6
votes
2answers
264 views

Removing a non linear noise trend from data

I have a dataset that looks as follows Now, this is from an actual measurement (of the reflection coefficient of a microchip with four LC resonators connected in a periodic fashion) so there is ...
1
vote
1answer
72 views

Writing to a serial device failing mysteriously

I have a device which communicates with the computer through serial. The device waits until it receives the character 'a', and then begins to stream data. I have been able to connect to the device and ...
19
votes
4answers
1k views

How: 2D scatterplots with quantitative density-dependent coloring

Consider the following scatterplot of a 50K-point dataset: ...
1
vote
1answer
165 views

Matching entries then finding positions of two lists

I'm trying to analyse data with Mathematica. I have a big array with various columns representing timestamps and then lots of data. I have some code that will produce a list of timestamps when the ...
3
votes
3answers
84 views

Orderless storage of tabulated function values

I would like to elaborate on my previous question Function of arguments given in non-fixed order and a relevant related one Best practice of passing a large number of parameters to functions I find ...
17
votes
2answers
586 views

Can A Plot Be Overlayed With A Map?

Some brief, only slightly important background. I am doing a research project using the data from NASA's GRACE mission. I wrote a short Perl script to take two data files and find the change in ...